-- Logs begin at Sat 2022-05-14 15:00:54 UTC, end at Sat 2022-05-14 16:11:29 UTC. -- May 14 15:37:36.625781 dv-cinder-839793-11-iscsi systemd[1]: Starting Devstack devstack@n-api.service... May 14 15:37:36.634634 dv-cinder-839793-11-iscsi devstack@n-api.service[114369]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini May 14 15:37:36.636546 dv-cinder-839793-11-iscsi devstack@n-api.service[114369]: *** Starting uWSGI 2.0.18-debian (64bit) on [Sat May 14 15:37:36 2022] *** May 14 15:37:36.636546 dv-cinder-839793-11-iscsi devstack@n-api.service[114369]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 May 14 15:37:36.636546 dv-cinder-839793-11-iscsi devstack@n-api.service[114369]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 May 14 15:37:36.636546 dv-cinder-839793-11-iscsi devstack@n-api.service[114369]: nodename: dv-cinder-839793-11-iscsi May 14 15:37:36.636546 dv-cinder-839793-11-iscsi devstack@n-api.service[114369]: machine: x86_64 May 14 15:37:36.636546 dv-cinder-839793-11-iscsi devstack@n-api.service[114369]: clock source: unix May 14 15:37:36.636546 dv-cinder-839793-11-iscsi devstack@n-api.service[114369]: pcre jit disabled May 14 15:37:36.636546 dv-cinder-839793-11-iscsi devstack@n-api.service[114369]: detected number of CPU cores: 4 May 14 15:37:36.636546 dv-cinder-839793-11-iscsi devstack@n-api.service[114369]: current working directory: / May 14 15:37:36.636546 dv-cinder-839793-11-iscsi devstack@n-api.service[114369]: detected binary path: /usr/bin/uwsgi-core May 14 15:37:36.637218 dv-cinder-839793-11-iscsi devstack@n-api.service[114369]: your processes number limit is 47680 May 14 15:37:36.637218 dv-cinder-839793-11-iscsi devstack@n-api.service[114369]: your memory page size is 4096 bytes May 14 15:37:36.637218 dv-cinder-839793-11-iscsi devstack@n-api.service[114369]: detected max file descriptor number: 2048 May 14 15:37:36.637218 dv-cinder-839793-11-iscsi devstack@n-api.service[114369]: lock engine: pthread robust mutexes May 14 15:37:36.637218 dv-cinder-839793-11-iscsi devstack@n-api.service[114369]: thunder lock: enabled May 14 15:37:36.637218 dv-cinder-839793-11-iscsi devstack@n-api.service[114369]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 May 14 15:37:36.637218 dv-cinder-839793-11-iscsi devstack@n-api.service[114369]: Python version: 3.8.10 (default, Mar 15 2022, 12:22:08) [GCC 9.4.0] May 14 15:37:36.681396 dv-cinder-839793-11-iscsi devstack@n-api.service[114369]: Python main interpreter initialized at 0x5612919149c0 May 14 15:37:36.681396 dv-cinder-839793-11-iscsi devstack@n-api.service[114369]: python threads support enabled May 14 15:37:36.681396 dv-cinder-839793-11-iscsi devstack@n-api.service[114369]: your server socket listen backlog is limited to 100 connections May 14 15:37:36.681396 dv-cinder-839793-11-iscsi devstack@n-api.service[114369]: your mercy for graceful operations on workers is 90 seconds May 14 15:37:36.681736 dv-cinder-839793-11-iscsi devstack@n-api.service[114369]: mapped 403077 bytes (393 KB) for 2 cores May 14 15:37:36.681812 dv-cinder-839793-11-iscsi devstack@n-api.service[114369]: *** Operational MODE: preforking *** May 14 15:37:36.682049 dv-cinder-839793-11-iscsi devstack@n-api.service[114369]: *** uWSGI is running in multiple interpreter mode *** May 14 15:37:36.682049 dv-cinder-839793-11-iscsi devstack@n-api.service[114369]: spawned uWSGI master process (pid: 114369) May 14 15:37:36.682231 dv-cinder-839793-11-iscsi systemd[1]: Started Devstack devstack@n-api.service. May 14 15:37:36.683335 dv-cinder-839793-11-iscsi devstack@n-api.service[114369]: spawned uWSGI worker 1 (pid: 114370, cores: 1) May 14 15:37:36.686333 dv-cinder-839793-11-iscsi devstack@n-api.service[114369]: spawned uWSGI worker 2 (pid: 114371, cores: 1) May 14 15:37:36.686333 dv-cinder-839793-11-iscsi devstack@n-api.service[114369]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... May 14 15:37:37.878246 dv-cinder-839793-11-iscsi devstack@n-api.service[114371]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. May 14 15:37:37.883802 dv-cinder-839793-11-iscsi devstack@n-api.service[114370]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. May 14 15:37:38.607303 dv-cinder-839793-11-iscsi devstack@n-api.service[114371]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 14 15:37:38.607303 dv-cinder-839793-11-iscsi devstack@n-api.service[114371]: from cryptography.utils import int_from_bytes May 14 15:37:38.607644 dv-cinder-839793-11-iscsi devstack@n-api.service[114371]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 14 15:37:38.607644 dv-cinder-839793-11-iscsi devstack@n-api.service[114371]: from cryptography.utils import int_from_bytes May 14 15:37:38.611599 dv-cinder-839793-11-iscsi devstack@n-api.service[114370]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 14 15:37:38.611599 dv-cinder-839793-11-iscsi devstack@n-api.service[114370]: from cryptography.utils import int_from_bytes May 14 15:37:38.612051 dv-cinder-839793-11-iscsi devstack@n-api.service[114370]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 14 15:37:38.612051 dv-cinder-839793-11-iscsi devstack@n-api.service[114370]: from cryptography.utils import int_from_bytes May 14 15:37:41.225122 dv-cinder-839793-11-iscsi devstack@n-api.service[114371]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=114371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} May 14 15:37:41.225648 dv-cinder-839793-11-iscsi devstack@n-api.service[114370]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=114370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} May 14 15:37:41.225999 dv-cinder-839793-11-iscsi devstack@n-api.service[114371]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=114371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} May 14 15:37:41.226092 dv-cinder-839793-11-iscsi devstack@n-api.service[114370]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=114370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} May 14 15:37:41.226173 dv-cinder-839793-11-iscsi devstack@n-api.service[114371]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=114371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} May 14 15:37:41.226285 dv-cinder-839793-11-iscsi devstack@n-api.service[114370]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=114370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} May 14 15:37:41.226406 dv-cinder-839793-11-iscsi devstack@n-api.service[114371]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=114371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} May 14 15:37:41.226493 dv-cinder-839793-11-iscsi devstack@n-api.service[114370]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=114370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} May 14 15:37:41.226576 dv-cinder-839793-11-iscsi devstack@n-api.service[114371]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=114371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} May 14 15:37:41.226661 dv-cinder-839793-11-iscsi devstack@n-api.service[114370]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=114370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} May 14 15:37:41.226810 dv-cinder-839793-11-iscsi devstack@n-api.service[114371]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=114371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 15:37:41.227039 dv-cinder-839793-11-iscsi devstack@n-api.service[114370]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=114370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 15:37:41.227146 dv-cinder-839793-11-iscsi devstack@n-api.service[114371]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=114371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 15:37:41.227331 dv-cinder-839793-11-iscsi devstack@n-api.service[114370]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=114370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 15:37:41.227442 dv-cinder-839793-11-iscsi devstack@n-api.service[114371]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=114371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 15:37:41.227655 dv-cinder-839793-11-iscsi devstack@n-api.service[114370]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=114370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 15:37:41.227766 dv-cinder-839793-11-iscsi devstack@n-api.service[114371]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=114371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 15:37:41.227978 dv-cinder-839793-11-iscsi devstack@n-api.service[114370]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=114370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 15:37:41.228073 dv-cinder-839793-11-iscsi devstack@n-api.service[114371]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=114371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 15:37:41.228313 dv-cinder-839793-11-iscsi devstack@n-api.service[114370]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=114370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 15:37:41.228406 dv-cinder-839793-11-iscsi devstack@n-api.service[114371]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=114371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 15:37:41.228630 dv-cinder-839793-11-iscsi devstack@n-api.service[114370]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=114370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 15:37:41.228723 dv-cinder-839793-11-iscsi devstack@n-api.service[114371]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=114371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 15:37:41.228955 dv-cinder-839793-11-iscsi devstack@n-api.service[114370]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=114370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 15:37:41.229066 dv-cinder-839793-11-iscsi devstack@n-api.service[114371]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=114371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 15:37:41.229283 dv-cinder-839793-11-iscsi devstack@n-api.service[114370]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=114370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 15:37:41.229389 dv-cinder-839793-11-iscsi devstack@n-api.service[114371]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=114371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 15:37:41.229543 dv-cinder-839793-11-iscsi devstack@n-api.service[114371]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=114371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 15:37:41.229710 dv-cinder-839793-11-iscsi devstack@n-api.service[114370]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=114370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 15:37:41.229850 dv-cinder-839793-11-iscsi devstack@n-api.service[114371]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=114371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 15:37:41.229988 dv-cinder-839793-11-iscsi devstack@n-api.service[114370]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=114370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 15:37:41.230169 dv-cinder-839793-11-iscsi devstack@n-api.service[114371]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-839793-11-iscsi {{(pid=114371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 15:37:41.230585 dv-cinder-839793-11-iscsi devstack@n-api.service[114370]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=114370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 15:37:41.230776 dv-cinder-839793-11-iscsi devstack@n-api.service[114371]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=114371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 15:37:41.230888 dv-cinder-839793-11-iscsi devstack@n-api.service[114370]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-839793-11-iscsi {{(pid=114370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 15:37:41.231088 dv-cinder-839793-11-iscsi devstack@n-api.service[114371]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=114371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 15:37:41.231187 dv-cinder-839793-11-iscsi devstack@n-api.service[114370]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=114370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 15:37:41.231402 dv-cinder-839793-11-iscsi devstack@n-api.service[114370]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=114370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 15:37:41.231505 dv-cinder-839793-11-iscsi devstack@n-api.service[114371]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=114371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 15:37:41.231718 dv-cinder-839793-11-iscsi devstack@n-api.service[114370]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=114370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 15:37:41.231811 dv-cinder-839793-11-iscsi devstack@n-api.service[114371]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=114371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 15:37:41.232022 dv-cinder-839793-11-iscsi devstack@n-api.service[114371]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=114371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 15:37:41.232107 dv-cinder-839793-11-iscsi devstack@n-api.service[114370]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=114370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 15:37:41.232338 dv-cinder-839793-11-iscsi devstack@n-api.service[114370]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=114370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 15:37:41.232436 dv-cinder-839793-11-iscsi devstack@n-api.service[114371]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=114371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 15:37:41.232643 dv-cinder-839793-11-iscsi devstack@n-api.service[114371]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=114371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 15:37:41.232734 dv-cinder-839793-11-iscsi devstack@n-api.service[114370]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=114370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 15:37:41.232958 dv-cinder-839793-11-iscsi devstack@n-api.service[114370]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=114370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 15:37:41.233135 dv-cinder-839793-11-iscsi devstack@n-api.service[114371]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=114371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 15:37:41.233460 dv-cinder-839793-11-iscsi devstack@n-api.service[114370]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=114370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 15:37:41.233569 dv-cinder-839793-11-iscsi devstack@n-api.service[114371]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=114371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 15:37:41.233777 dv-cinder-839793-11-iscsi devstack@n-api.service[114370]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=114370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 15:37:41.233863 dv-cinder-839793-11-iscsi devstack@n-api.service[114371]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=114371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 15:37:41.234088 dv-cinder-839793-11-iscsi devstack@n-api.service[114370]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=114370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 15:37:41.234186 dv-cinder-839793-11-iscsi devstack@n-api.service[114371]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=114371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 15:37:41.234423 dv-cinder-839793-11-iscsi devstack@n-api.service[114370]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=114370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 15:37:41.234523 dv-cinder-839793-11-iscsi devstack@n-api.service[114371]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=114371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 15:37:41.234766 dv-cinder-839793-11-iscsi devstack@n-api.service[114370]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=114370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 15:37:41.234942 dv-cinder-839793-11-iscsi devstack@n-api.service[114371]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=114371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 15:37:41.235092 dv-cinder-839793-11-iscsi devstack@n-api.service[114370]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=114370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 15:37:41.235191 dv-cinder-839793-11-iscsi devstack@n-api.service[114371]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=114371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 15:37:41.235403 dv-cinder-839793-11-iscsi devstack@n-api.service[114370]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=114370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 15:37:41.235515 dv-cinder-839793-11-iscsi devstack@n-api.service[114371]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=114371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 15:37:41.235720 dv-cinder-839793-11-iscsi devstack@n-api.service[114371]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=114371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 15:37:41.235812 dv-cinder-839793-11-iscsi devstack@n-api.service[114370]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=114370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 15:37:41.236029 dv-cinder-839793-11-iscsi devstack@n-api.service[114370]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=114370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 15:37:41.236127 dv-cinder-839793-11-iscsi devstack@n-api.service[114371]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=114371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 15:37:41.236337 dv-cinder-839793-11-iscsi devstack@n-api.service[114371]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=114371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 15:37:41.236475 dv-cinder-839793-11-iscsi devstack@n-api.service[114370]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=114370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 15:37:41.236653 dv-cinder-839793-11-iscsi devstack@n-api.service[114370]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=114370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 15:37:41.236858 dv-cinder-839793-11-iscsi devstack@n-api.service[114371]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-839793-11-iscsi {{(pid=114371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 15:37:41.237080 dv-cinder-839793-11-iscsi devstack@n-api.service[114371]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=114371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 15:37:41.237186 dv-cinder-839793-11-iscsi devstack@n-api.service[114370]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-839793-11-iscsi {{(pid=114370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 15:37:41.237396 dv-cinder-839793-11-iscsi devstack@n-api.service[114371]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=114371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 15:37:41.237530 dv-cinder-839793-11-iscsi devstack@n-api.service[114370]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=114370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 15:37:41.237700 dv-cinder-839793-11-iscsi devstack@n-api.service[114370]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=114370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 15:37:41.237799 dv-cinder-839793-11-iscsi devstack@n-api.service[114371]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=114371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 15:37:41.238016 dv-cinder-839793-11-iscsi devstack@n-api.service[114370]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=114370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 15:37:41.238110 dv-cinder-839793-11-iscsi devstack@n-api.service[114371]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=114371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 15:37:41.238428 dv-cinder-839793-11-iscsi devstack@n-api.service[114371]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=114371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 15:37:41.238537 dv-cinder-839793-11-iscsi devstack@n-api.service[114370]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=114370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 15:37:41.238739 dv-cinder-839793-11-iscsi devstack@n-api.service[114371]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=114371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 15:37:41.238832 dv-cinder-839793-11-iscsi devstack@n-api.service[114370]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=114370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 15:37:41.239060 dv-cinder-839793-11-iscsi devstack@n-api.service[114370]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=114370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 15:37:41.239199 dv-cinder-839793-11-iscsi devstack@n-api.service[114371]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=114371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 15:37:41.239380 dv-cinder-839793-11-iscsi devstack@n-api.service[114371]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=114371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 15:37:41.239466 dv-cinder-839793-11-iscsi devstack@n-api.service[114370]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=114370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 15:37:41.239686 dv-cinder-839793-11-iscsi devstack@n-api.service[114371]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=114371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 15:37:41.239779 dv-cinder-839793-11-iscsi devstack@n-api.service[114370]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=114370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 15:37:41.240000 dv-cinder-839793-11-iscsi devstack@n-api.service[114370]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=114370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 15:37:41.240095 dv-cinder-839793-11-iscsi devstack@n-api.service[114371]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=114371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 15:37:41.240315 dv-cinder-839793-11-iscsi devstack@n-api.service[114371]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=114371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 15:37:41.240404 dv-cinder-839793-11-iscsi devstack@n-api.service[114370]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=114370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 15:37:41.240633 dv-cinder-839793-11-iscsi devstack@n-api.service[114371]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=114371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 15:37:41.240724 dv-cinder-839793-11-iscsi devstack@n-api.service[114370]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=114370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 15:37:41.240954 dv-cinder-839793-11-iscsi devstack@n-api.service[114371]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=114371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 15:37:41.241058 dv-cinder-839793-11-iscsi devstack@n-api.service[114370]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=114370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 15:37:41.241253 dv-cinder-839793-11-iscsi devstack@n-api.service[114371]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=114371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 15:37:41.241345 dv-cinder-839793-11-iscsi devstack@n-api.service[114370]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=114370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 15:37:41.241559 dv-cinder-839793-11-iscsi devstack@n-api.service[114371]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=114371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 15:37:41.241653 dv-cinder-839793-11-iscsi devstack@n-api.service[114370]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=114370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 15:37:41.241866 dv-cinder-839793-11-iscsi devstack@n-api.service[114370]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=114370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 15:37:41.241959 dv-cinder-839793-11-iscsi devstack@n-api.service[114371]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=114371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 15:37:41.242177 dv-cinder-839793-11-iscsi devstack@n-api.service[114370]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=114370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 15:37:41.242268 dv-cinder-839793-11-iscsi devstack@n-api.service[114371]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=114371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 15:37:41.242505 dv-cinder-839793-11-iscsi devstack@n-api.service[114371]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=114371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 15:37:41.242605 dv-cinder-839793-11-iscsi devstack@n-api.service[114370]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=114370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 15:37:41.242808 dv-cinder-839793-11-iscsi devstack@n-api.service[114371]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=114371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 15:37:41.242894 dv-cinder-839793-11-iscsi devstack@n-api.service[114370]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=114370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 15:37:41.243058 dv-cinder-839793-11-iscsi devstack@n-api.service[114371]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=114371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 15:37:41.243149 dv-cinder-839793-11-iscsi devstack@n-api.service[114370]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=114370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 15:37:41.243352 dv-cinder-839793-11-iscsi devstack@n-api.service[114370]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=114370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 15:37:41.243444 dv-cinder-839793-11-iscsi devstack@n-api.service[114371]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=114371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 15:37:41.243662 dv-cinder-839793-11-iscsi devstack@n-api.service[114370]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=114370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 15:37:41.243748 dv-cinder-839793-11-iscsi devstack@n-api.service[114371]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=114371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 15:37:41.243977 dv-cinder-839793-11-iscsi devstack@n-api.service[114371]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=114371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 15:37:41.244061 dv-cinder-839793-11-iscsi devstack@n-api.service[114370]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=114370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 15:37:41.244297 dv-cinder-839793-11-iscsi devstack@n-api.service[114370]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=114370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 15:37:41.244393 dv-cinder-839793-11-iscsi devstack@n-api.service[114371]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=114371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 15:37:41.244547 dv-cinder-839793-11-iscsi devstack@n-api.service[114371]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=114371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 15:37:41.244638 dv-cinder-839793-11-iscsi devstack@n-api.service[114370]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=114370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 15:37:41.244803 dv-cinder-839793-11-iscsi devstack@n-api.service[114371]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=114371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 15:37:41.244943 dv-cinder-839793-11-iscsi devstack@n-api.service[114370]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=114370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 15:37:41.245107 dv-cinder-839793-11-iscsi devstack@n-api.service[114370]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=114370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 15:37:41.245201 dv-cinder-839793-11-iscsi devstack@n-api.service[114371]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=114371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 15:37:41.245425 dv-cinder-839793-11-iscsi devstack@n-api.service[114371]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=114371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 15:37:41.245554 dv-cinder-839793-11-iscsi devstack@n-api.service[114370]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=114370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 15:37:41.245732 dv-cinder-839793-11-iscsi devstack@n-api.service[114371]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=114371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 15:37:41.245831 dv-cinder-839793-11-iscsi devstack@n-api.service[114370]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=114370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 15:37:41.246038 dv-cinder-839793-11-iscsi devstack@n-api.service[114371]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=114371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 15:37:41.246135 dv-cinder-839793-11-iscsi devstack@n-api.service[114370]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=114370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 15:37:41.246364 dv-cinder-839793-11-iscsi devstack@n-api.service[114370]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=114370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 15:37:41.246487 dv-cinder-839793-11-iscsi devstack@n-api.service[114371]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=114371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 15:37:41.246672 dv-cinder-839793-11-iscsi devstack@n-api.service[114371]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=114371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 15:37:41.246771 dv-cinder-839793-11-iscsi devstack@n-api.service[114370]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=114370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 15:37:41.246976 dv-cinder-839793-11-iscsi devstack@n-api.service[114371]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=114371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 15:37:41.247061 dv-cinder-839793-11-iscsi devstack@n-api.service[114370]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=114370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 15:37:41.247280 dv-cinder-839793-11-iscsi devstack@n-api.service[114371]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=114371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 15:37:41.247364 dv-cinder-839793-11-iscsi devstack@n-api.service[114370]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=114370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 15:37:41.247584 dv-cinder-839793-11-iscsi devstack@n-api.service[114370]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=114370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 15:37:41.247675 dv-cinder-839793-11-iscsi devstack@n-api.service[114371]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=114371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 15:37:41.247886 dv-cinder-839793-11-iscsi devstack@n-api.service[114371]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=114371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 15:37:41.247976 dv-cinder-839793-11-iscsi devstack@n-api.service[114370]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=114370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 15:37:41.248191 dv-cinder-839793-11-iscsi devstack@n-api.service[114370]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=114370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 15:37:41.248282 dv-cinder-839793-11-iscsi devstack@n-api.service[114371]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=114371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 15:37:41.248499 dv-cinder-839793-11-iscsi devstack@n-api.service[114371]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=114371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 15:37:41.248585 dv-cinder-839793-11-iscsi devstack@n-api.service[114370]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=114370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 15:37:41.248813 dv-cinder-839793-11-iscsi devstack@n-api.service[114370]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=114370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 15:37:41.248896 dv-cinder-839793-11-iscsi devstack@n-api.service[114371]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=114371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 15:37:41.249114 dv-cinder-839793-11-iscsi devstack@n-api.service[114371]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=114371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 15:37:41.249197 dv-cinder-839793-11-iscsi devstack@n-api.service[114370]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=114370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 15:37:41.249429 dv-cinder-839793-11-iscsi devstack@n-api.service[114370]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=114370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 15:37:41.249513 dv-cinder-839793-11-iscsi devstack@n-api.service[114371]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=114371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 15:37:41.249750 dv-cinder-839793-11-iscsi devstack@n-api.service[114370]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=114370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 15:37:41.249840 dv-cinder-839793-11-iscsi devstack@n-api.service[114371]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.61 {{(pid=114371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 15:37:41.250061 dv-cinder-839793-11-iscsi devstack@n-api.service[114371]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.61 {{(pid=114371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 15:37:41.250151 dv-cinder-839793-11-iscsi devstack@n-api.service[114370]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.61 {{(pid=114370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 15:37:41.250391 dv-cinder-839793-11-iscsi devstack@n-api.service[114371]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=114371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 15:37:41.250480 dv-cinder-839793-11-iscsi devstack@n-api.service[114370]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.61 {{(pid=114370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 15:37:41.250703 dv-cinder-839793-11-iscsi devstack@n-api.service[114370]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=114370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 15:37:41.250796 dv-cinder-839793-11-iscsi devstack@n-api.service[114371]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=114371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 15:37:41.251039 dv-cinder-839793-11-iscsi devstack@n-api.service[114371]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=114371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 15:37:41.251157 dv-cinder-839793-11-iscsi devstack@n-api.service[114370]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=114370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 15:37:41.251348 dv-cinder-839793-11-iscsi devstack@n-api.service[114371]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=114371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 15:37:41.251452 dv-cinder-839793-11-iscsi devstack@n-api.service[114370]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=114370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 15:37:41.251655 dv-cinder-839793-11-iscsi devstack@n-api.service[114370]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=114370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 15:37:41.251743 dv-cinder-839793-11-iscsi devstack@n-api.service[114371]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=114371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 15:37:41.251973 dv-cinder-839793-11-iscsi devstack@n-api.service[114371]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=114371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 15:37:41.252080 dv-cinder-839793-11-iscsi devstack@n-api.service[114370]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=114370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 15:37:41.252280 dv-cinder-839793-11-iscsi devstack@n-api.service[114371]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=114371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 15:37:41.252904 dv-cinder-839793-11-iscsi devstack@n-api.service[114370]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=114370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 15:37:41.253165 dv-cinder-839793-11-iscsi devstack@n-api.service[114371]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=114371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 15:37:41.253259 dv-cinder-839793-11-iscsi devstack@n-api.service[114370]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=114370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 15:37:41.253489 dv-cinder-839793-11-iscsi devstack@n-api.service[114370]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=114370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 15:37:41.253645 dv-cinder-839793-11-iscsi devstack@n-api.service[114371]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=114371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 15:37:41.253795 dv-cinder-839793-11-iscsi devstack@n-api.service[114370]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=114370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 15:37:41.253967 dv-cinder-839793-11-iscsi devstack@n-api.service[114371]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=114371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 15:37:41.254119 dv-cinder-839793-11-iscsi devstack@n-api.service[114370]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=114370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 15:37:41.254292 dv-cinder-839793-11-iscsi devstack@n-api.service[114371]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=114371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 15:37:41.254469 dv-cinder-839793-11-iscsi devstack@n-api.service[114370]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=114370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 15:37:41.254625 dv-cinder-839793-11-iscsi devstack@n-api.service[114371]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=114371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 15:37:41.254777 dv-cinder-839793-11-iscsi devstack@n-api.service[114370]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=114370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 15:37:41.254871 dv-cinder-839793-11-iscsi devstack@n-api.service[114371]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=114371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 15:37:41.255032 dv-cinder-839793-11-iscsi devstack@n-api.service[114370]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=114370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 15:37:41.255174 dv-cinder-839793-11-iscsi devstack@n-api.service[114371]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=114371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 15:37:41.255338 dv-cinder-839793-11-iscsi devstack@n-api.service[114370]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=114370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 15:37:41.255465 dv-cinder-839793-11-iscsi devstack@n-api.service[114371]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=114371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 15:37:41.255648 dv-cinder-839793-11-iscsi devstack@n-api.service[114370]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=114370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 15:37:41.255784 dv-cinder-839793-11-iscsi devstack@n-api.service[114371]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=114371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 15:37:41.255966 dv-cinder-839793-11-iscsi devstack@n-api.service[114370]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=114370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 15:37:41.256089 dv-cinder-839793-11-iscsi devstack@n-api.service[114371]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=114371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 15:37:41.256275 dv-cinder-839793-11-iscsi devstack@n-api.service[114370]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=114370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 15:37:41.256394 dv-cinder-839793-11-iscsi devstack@n-api.service[114371]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=114371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 15:37:41.256584 dv-cinder-839793-11-iscsi devstack@n-api.service[114370]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=114370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 15:37:41.256720 dv-cinder-839793-11-iscsi devstack@n-api.service[114371]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=114371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 15:37:41.256891 dv-cinder-839793-11-iscsi devstack@n-api.service[114370]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=114370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 15:37:41.256989 dv-cinder-839793-11-iscsi devstack@n-api.service[114371]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=114371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 15:37:41.257194 dv-cinder-839793-11-iscsi devstack@n-api.service[114370]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=114370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 15:37:41.257285 dv-cinder-839793-11-iscsi devstack@n-api.service[114371]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=114371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 15:37:41.257501 dv-cinder-839793-11-iscsi devstack@n-api.service[114370]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=114370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 15:37:41.257585 dv-cinder-839793-11-iscsi devstack@n-api.service[114371]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=114371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 15:37:41.257807 dv-cinder-839793-11-iscsi devstack@n-api.service[114370]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=114370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 15:37:41.257897 dv-cinder-839793-11-iscsi devstack@n-api.service[114371]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=114371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 15:37:41.258114 dv-cinder-839793-11-iscsi devstack@n-api.service[114370]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=114370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 15:37:41.258200 dv-cinder-839793-11-iscsi devstack@n-api.service[114371]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=114371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 15:37:41.258445 dv-cinder-839793-11-iscsi devstack@n-api.service[114370]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=114370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 15:37:41.258542 dv-cinder-839793-11-iscsi devstack@n-api.service[114371]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=114371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 15:37:41.258748 dv-cinder-839793-11-iscsi devstack@n-api.service[114371]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=114371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 15:37:41.258840 dv-cinder-839793-11-iscsi devstack@n-api.service[114370]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=114370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 15:37:41.259053 dv-cinder-839793-11-iscsi devstack@n-api.service[114370]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=114370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 15:37:41.259144 dv-cinder-839793-11-iscsi devstack@n-api.service[114371]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=114371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 15:37:41.259355 dv-cinder-839793-11-iscsi devstack@n-api.service[114371]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=114371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 15:37:41.259446 dv-cinder-839793-11-iscsi devstack@n-api.service[114370]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=114370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 15:37:41.259660 dv-cinder-839793-11-iscsi devstack@n-api.service[114371]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=114371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 15:37:41.259747 dv-cinder-839793-11-iscsi devstack@n-api.service[114370]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=114370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 15:37:41.259964 dv-cinder-839793-11-iscsi devstack@n-api.service[114370]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=114370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 15:37:41.260055 dv-cinder-839793-11-iscsi devstack@n-api.service[114371]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=114371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 15:37:41.260279 dv-cinder-839793-11-iscsi devstack@n-api.service[114371]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=114371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 15:37:41.260363 dv-cinder-839793-11-iscsi devstack@n-api.service[114370]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=114370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 15:37:41.260583 dv-cinder-839793-11-iscsi devstack@n-api.service[114371]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=114371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 15:37:41.260676 dv-cinder-839793-11-iscsi devstack@n-api.service[114370]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=114370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 15:37:41.260887 dv-cinder-839793-11-iscsi devstack@n-api.service[114371]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=114371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 15:37:41.260978 dv-cinder-839793-11-iscsi devstack@n-api.service[114370]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=114370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 15:37:41.261190 dv-cinder-839793-11-iscsi devstack@n-api.service[114370]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=114370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 15:37:41.261280 dv-cinder-839793-11-iscsi devstack@n-api.service[114371]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=114371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 15:37:41.261490 dv-cinder-839793-11-iscsi devstack@n-api.service[114371]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=114371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 15:37:41.261575 dv-cinder-839793-11-iscsi devstack@n-api.service[114370]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=114370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 15:37:41.261794 dv-cinder-839793-11-iscsi devstack@n-api.service[114370]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=114370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 15:37:41.261957 dv-cinder-839793-11-iscsi devstack@n-api.service[114371]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=114371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 15:37:41.262097 dv-cinder-839793-11-iscsi devstack@n-api.service[114371]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=114371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 15:37:41.262192 dv-cinder-839793-11-iscsi devstack@n-api.service[114370]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=114370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 15:37:41.262423 dv-cinder-839793-11-iscsi devstack@n-api.service[114371]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=114371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 15:37:41.262511 dv-cinder-839793-11-iscsi devstack@n-api.service[114370]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=114370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 15:37:41.262730 dv-cinder-839793-11-iscsi devstack@n-api.service[114370]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=114370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 15:37:41.262815 dv-cinder-839793-11-iscsi devstack@n-api.service[114371]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=114371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 15:37:41.263030 dv-cinder-839793-11-iscsi devstack@n-api.service[114371]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=114371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 15:37:41.263125 dv-cinder-839793-11-iscsi devstack@n-api.service[114370]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=114370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 15:37:41.263334 dv-cinder-839793-11-iscsi devstack@n-api.service[114371]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=114371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 15:37:41.263419 dv-cinder-839793-11-iscsi devstack@n-api.service[114370]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=114370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 15:37:41.263638 dv-cinder-839793-11-iscsi devstack@n-api.service[114370]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=114370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 15:37:41.263728 dv-cinder-839793-11-iscsi devstack@n-api.service[114371]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=114371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 15:37:41.263942 dv-cinder-839793-11-iscsi devstack@n-api.service[114371]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=114371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 15:37:41.264033 dv-cinder-839793-11-iscsi devstack@n-api.service[114370]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=114370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 15:37:41.264246 dv-cinder-839793-11-iscsi devstack@n-api.service[114371]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=114371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 15:37:41.264344 dv-cinder-839793-11-iscsi devstack@n-api.service[114370]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=114370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 15:37:41.264550 dv-cinder-839793-11-iscsi devstack@n-api.service[114370]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=114370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 15:37:41.264634 dv-cinder-839793-11-iscsi devstack@n-api.service[114371]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=114371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 15:37:41.264846 dv-cinder-839793-11-iscsi devstack@n-api.service[114371]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=114371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 15:37:41.264938 dv-cinder-839793-11-iscsi devstack@n-api.service[114370]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=114370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 15:37:41.265149 dv-cinder-839793-11-iscsi devstack@n-api.service[114371]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=114371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 15:37:41.265247 dv-cinder-839793-11-iscsi devstack@n-api.service[114370]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=114370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 15:37:41.265451 dv-cinder-839793-11-iscsi devstack@n-api.service[114370]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=114370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 15:37:41.265541 dv-cinder-839793-11-iscsi devstack@n-api.service[114371]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=114371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 15:37:41.265769 dv-cinder-839793-11-iscsi devstack@n-api.service[114371]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=114371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 15:37:41.265864 dv-cinder-839793-11-iscsi devstack@n-api.service[114370]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=114370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 15:37:41.266063 dv-cinder-839793-11-iscsi devstack@n-api.service[114370]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=114370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 15:37:41.266157 dv-cinder-839793-11-iscsi devstack@n-api.service[114371]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=114371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 15:37:41.266387 dv-cinder-839793-11-iscsi devstack@n-api.service[114371]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=114371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 15:37:41.266474 dv-cinder-839793-11-iscsi devstack@n-api.service[114370]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=114370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 15:37:41.266691 dv-cinder-839793-11-iscsi devstack@n-api.service[114370]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=114370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 15:37:41.266825 dv-cinder-839793-11-iscsi devstack@n-api.service[114371]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=114371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 15:37:41.266991 dv-cinder-839793-11-iscsi devstack@n-api.service[114371]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=114371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 15:37:41.267087 dv-cinder-839793-11-iscsi devstack@n-api.service[114370]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=114370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 15:37:41.267293 dv-cinder-839793-11-iscsi devstack@n-api.service[114370]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=114370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 15:37:41.267377 dv-cinder-839793-11-iscsi devstack@n-api.service[114371]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=114371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 15:37:41.267592 dv-cinder-839793-11-iscsi devstack@n-api.service[114371]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=114371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 15:37:41.267683 dv-cinder-839793-11-iscsi devstack@n-api.service[114370]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=114370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 15:37:41.267894 dv-cinder-839793-11-iscsi devstack@n-api.service[114370]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=114370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 15:37:41.267984 dv-cinder-839793-11-iscsi devstack@n-api.service[114371]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=114371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 15:37:41.268768 dv-cinder-839793-11-iscsi devstack@n-api.service[114370]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=114370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 15:37:41.268905 dv-cinder-839793-11-iscsi devstack@n-api.service[114371]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=114371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 15:37:41.269072 dv-cinder-839793-11-iscsi devstack@n-api.service[114370]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=114370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 15:37:41.269239 dv-cinder-839793-11-iscsi devstack@n-api.service[114371]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=114371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 15:37:41.269392 dv-cinder-839793-11-iscsi devstack@n-api.service[114370]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=114370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 15:37:41.269562 dv-cinder-839793-11-iscsi devstack@n-api.service[114371]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=114371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 15:37:41.269714 dv-cinder-839793-11-iscsi devstack@n-api.service[114370]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=114370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 15:37:41.269873 dv-cinder-839793-11-iscsi devstack@n-api.service[114371]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=114371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 15:37:41.270025 dv-cinder-839793-11-iscsi devstack@n-api.service[114370]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=114370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 15:37:41.270183 dv-cinder-839793-11-iscsi devstack@n-api.service[114371]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=114371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 15:37:41.270351 dv-cinder-839793-11-iscsi devstack@n-api.service[114370]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=114370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 15:37:41.270518 dv-cinder-839793-11-iscsi devstack@n-api.service[114371]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=114371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 15:37:41.270664 dv-cinder-839793-11-iscsi devstack@n-api.service[114370]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=114370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 15:37:41.270838 dv-cinder-839793-11-iscsi devstack@n-api.service[114371]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=114371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 15:37:41.270984 dv-cinder-839793-11-iscsi devstack@n-api.service[114370]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=114370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 15:37:41.271172 dv-cinder-839793-11-iscsi devstack@n-api.service[114371]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=114371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.271325 dv-cinder-839793-11-iscsi devstack@n-api.service[114370]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=114370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.271505 dv-cinder-839793-11-iscsi devstack@n-api.service[114371]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=114371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.271641 dv-cinder-839793-11-iscsi devstack@n-api.service[114370]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=114370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.271845 dv-cinder-839793-11-iscsi devstack@n-api.service[114371]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=114371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.271988 dv-cinder-839793-11-iscsi devstack@n-api.service[114370]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=114370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.272158 dv-cinder-839793-11-iscsi devstack@n-api.service[114371]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=114371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.272306 dv-cinder-839793-11-iscsi devstack@n-api.service[114370]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=114370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.272489 dv-cinder-839793-11-iscsi devstack@n-api.service[114371]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=114371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.272640 dv-cinder-839793-11-iscsi devstack@n-api.service[114370]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=114370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.272819 dv-cinder-839793-11-iscsi devstack@n-api.service[114371]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=114371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.272976 dv-cinder-839793-11-iscsi devstack@n-api.service[114370]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=114370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.273137 dv-cinder-839793-11-iscsi devstack@n-api.service[114371]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=114371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.273297 dv-cinder-839793-11-iscsi devstack@n-api.service[114370]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=114370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.273449 dv-cinder-839793-11-iscsi devstack@n-api.service[114371]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=114371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.273611 dv-cinder-839793-11-iscsi devstack@n-api.service[114370]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=114370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.273762 dv-cinder-839793-11-iscsi devstack@n-api.service[114371]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=114371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.273926 dv-cinder-839793-11-iscsi devstack@n-api.service[114370]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=114370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.274087 dv-cinder-839793-11-iscsi devstack@n-api.service[114371]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=114371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.274257 dv-cinder-839793-11-iscsi devstack@n-api.service[114370]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=114370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.274423 dv-cinder-839793-11-iscsi devstack@n-api.service[114371]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=114371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.274597 dv-cinder-839793-11-iscsi devstack@n-api.service[114370]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=114370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.274735 dv-cinder-839793-11-iscsi devstack@n-api.service[114371]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=114371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.274913 dv-cinder-839793-11-iscsi devstack@n-api.service[114370]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=114370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.275047 dv-cinder-839793-11-iscsi devstack@n-api.service[114371]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=114371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.275227 dv-cinder-839793-11-iscsi devstack@n-api.service[114370]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=114370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.275363 dv-cinder-839793-11-iscsi devstack@n-api.service[114371]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=114371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.275555 dv-cinder-839793-11-iscsi devstack@n-api.service[114370]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=114370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.275671 dv-cinder-839793-11-iscsi devstack@n-api.service[114371]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=114371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.275875 dv-cinder-839793-11-iscsi devstack@n-api.service[114370]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=114370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.275999 dv-cinder-839793-11-iscsi devstack@n-api.service[114371]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=114371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.276205 dv-cinder-839793-11-iscsi devstack@n-api.service[114370]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=114370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.276306 dv-cinder-839793-11-iscsi devstack@n-api.service[114371]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=114371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.276527 dv-cinder-839793-11-iscsi devstack@n-api.service[114370]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=114370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.276612 dv-cinder-839793-11-iscsi devstack@n-api.service[114371]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=114371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.276847 dv-cinder-839793-11-iscsi devstack@n-api.service[114370]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=114370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.276946 dv-cinder-839793-11-iscsi devstack@n-api.service[114371]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=114371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.277168 dv-cinder-839793-11-iscsi devstack@n-api.service[114370]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=114370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.277253 dv-cinder-839793-11-iscsi devstack@n-api.service[114371]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=114371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.277482 dv-cinder-839793-11-iscsi devstack@n-api.service[114370]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=114370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.277568 dv-cinder-839793-11-iscsi devstack@n-api.service[114371]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=114371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.277800 dv-cinder-839793-11-iscsi devstack@n-api.service[114370]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=114370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.277896 dv-cinder-839793-11-iscsi devstack@n-api.service[114371]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=114371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.278130 dv-cinder-839793-11-iscsi devstack@n-api.service[114370]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=114370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.278230 dv-cinder-839793-11-iscsi devstack@n-api.service[114371]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=114371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.278477 dv-cinder-839793-11-iscsi devstack@n-api.service[114370]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=114370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.278564 dv-cinder-839793-11-iscsi devstack@n-api.service[114371]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=114371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.278793 dv-cinder-839793-11-iscsi devstack@n-api.service[114370]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=114370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.278880 dv-cinder-839793-11-iscsi devstack@n-api.service[114371]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=114371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.279135 dv-cinder-839793-11-iscsi devstack@n-api.service[114370]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=114370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.279220 dv-cinder-839793-11-iscsi devstack@n-api.service[114371]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=114371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.279481 dv-cinder-839793-11-iscsi devstack@n-api.service[114370]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=114370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.279579 dv-cinder-839793-11-iscsi devstack@n-api.service[114371]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=114371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.279799 dv-cinder-839793-11-iscsi devstack@n-api.service[114370]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=114370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.279885 dv-cinder-839793-11-iscsi devstack@n-api.service[114371]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=114371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.280121 dv-cinder-839793-11-iscsi devstack@n-api.service[114371]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=114371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.280217 dv-cinder-839793-11-iscsi devstack@n-api.service[114370]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=114370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.280436 dv-cinder-839793-11-iscsi devstack@n-api.service[114371]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=114371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.280528 dv-cinder-839793-11-iscsi devstack@n-api.service[114370]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=114370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.280750 dv-cinder-839793-11-iscsi devstack@n-api.service[114370]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=114370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.280836 dv-cinder-839793-11-iscsi devstack@n-api.service[114371]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=114371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.281058 dv-cinder-839793-11-iscsi devstack@n-api.service[114371]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=114371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.281152 dv-cinder-839793-11-iscsi devstack@n-api.service[114370]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=114370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.281370 dv-cinder-839793-11-iscsi devstack@n-api.service[114370]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=114370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.281461 dv-cinder-839793-11-iscsi devstack@n-api.service[114371]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=114371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.281697 dv-cinder-839793-11-iscsi devstack@n-api.service[114370]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=114370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.281787 dv-cinder-839793-11-iscsi devstack@n-api.service[114371]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=114371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.282006 dv-cinder-839793-11-iscsi devstack@n-api.service[114371]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=114371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.282090 dv-cinder-839793-11-iscsi devstack@n-api.service[114370]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=114370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.282352 dv-cinder-839793-11-iscsi devstack@n-api.service[114371]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=114371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.282453 dv-cinder-839793-11-iscsi devstack@n-api.service[114370]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=114370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.282663 dv-cinder-839793-11-iscsi devstack@n-api.service[114371]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=114371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.282754 dv-cinder-839793-11-iscsi devstack@n-api.service[114370]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=114370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.282976 dv-cinder-839793-11-iscsi devstack@n-api.service[114370]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=114370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.283061 dv-cinder-839793-11-iscsi devstack@n-api.service[114371]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=114371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.283285 dv-cinder-839793-11-iscsi devstack@n-api.service[114371]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=114371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.283377 dv-cinder-839793-11-iscsi devstack@n-api.service[114370]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=114370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.283596 dv-cinder-839793-11-iscsi devstack@n-api.service[114370]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=114370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.283687 dv-cinder-839793-11-iscsi devstack@n-api.service[114371]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=114371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.283932 dv-cinder-839793-11-iscsi devstack@n-api.service[114371]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=114371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.284128 dv-cinder-839793-11-iscsi devstack@n-api.service[114370]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=114370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.284338 dv-cinder-839793-11-iscsi devstack@n-api.service[114371]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=114371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.284435 dv-cinder-839793-11-iscsi devstack@n-api.service[114370]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=114370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.284570 dv-cinder-839793-11-iscsi devstack@n-api.service[114371]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=114371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.284779 dv-cinder-839793-11-iscsi devstack@n-api.service[114370]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=114370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.284875 dv-cinder-839793-11-iscsi devstack@n-api.service[114371]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=114371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.285101 dv-cinder-839793-11-iscsi devstack@n-api.service[114370]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=114370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.285262 dv-cinder-839793-11-iscsi devstack@n-api.service[114371]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=114371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.285424 dv-cinder-839793-11-iscsi devstack@n-api.service[114370]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=114370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.285510 dv-cinder-839793-11-iscsi devstack@n-api.service[114371]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=114371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.285746 dv-cinder-839793-11-iscsi devstack@n-api.service[114370]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=114370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.285830 dv-cinder-839793-11-iscsi devstack@n-api.service[114371]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=114371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.286072 dv-cinder-839793-11-iscsi devstack@n-api.service[114370]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=114370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.286164 dv-cinder-839793-11-iscsi devstack@n-api.service[114371]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=114371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.286416 dv-cinder-839793-11-iscsi devstack@n-api.service[114370]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=114370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.286502 dv-cinder-839793-11-iscsi devstack@n-api.service[114371]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=114371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.286725 dv-cinder-839793-11-iscsi devstack@n-api.service[114371]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=114371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.286810 dv-cinder-839793-11-iscsi devstack@n-api.service[114370]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=114370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.287031 dv-cinder-839793-11-iscsi devstack@n-api.service[114371]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=114371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.287134 dv-cinder-839793-11-iscsi devstack@n-api.service[114370]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=114370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.287336 dv-cinder-839793-11-iscsi devstack@n-api.service[114371]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=114371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.287421 dv-cinder-839793-11-iscsi devstack@n-api.service[114370]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=114370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.287643 dv-cinder-839793-11-iscsi devstack@n-api.service[114370]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=114370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.287726 dv-cinder-839793-11-iscsi devstack@n-api.service[114371]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=114371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.287946 dv-cinder-839793-11-iscsi devstack@n-api.service[114371]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=114371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.288041 dv-cinder-839793-11-iscsi devstack@n-api.service[114370]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=114370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.288258 dv-cinder-839793-11-iscsi devstack@n-api.service[114370]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=114370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.288341 dv-cinder-839793-11-iscsi devstack@n-api.service[114371]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=114371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.288567 dv-cinder-839793-11-iscsi devstack@n-api.service[114370]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=114370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.288651 dv-cinder-839793-11-iscsi devstack@n-api.service[114371]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=114371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.288872 dv-cinder-839793-11-iscsi devstack@n-api.service[114371]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=114371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.288957 dv-cinder-839793-11-iscsi devstack@n-api.service[114370]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=114370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.289203 dv-cinder-839793-11-iscsi devstack@n-api.service[114371]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=114371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.289293 dv-cinder-839793-11-iscsi devstack@n-api.service[114370]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=114370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.289510 dv-cinder-839793-11-iscsi devstack@n-api.service[114370]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=114370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.289593 dv-cinder-839793-11-iscsi devstack@n-api.service[114371]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=114371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.289818 dv-cinder-839793-11-iscsi devstack@n-api.service[114371]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=114371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.289911 dv-cinder-839793-11-iscsi devstack@n-api.service[114370]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=114370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.290127 dv-cinder-839793-11-iscsi devstack@n-api.service[114371]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=114371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.290219 dv-cinder-839793-11-iscsi devstack@n-api.service[114370]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=114370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.290464 dv-cinder-839793-11-iscsi devstack@n-api.service[114371]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=114371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.290553 dv-cinder-839793-11-iscsi devstack@n-api.service[114370]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=114370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.290772 dv-cinder-839793-11-iscsi devstack@n-api.service[114371]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=114371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.290866 dv-cinder-839793-11-iscsi devstack@n-api.service[114370]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=114370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.291084 dv-cinder-839793-11-iscsi devstack@n-api.service[114371]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=114371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.291168 dv-cinder-839793-11-iscsi devstack@n-api.service[114370]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=114370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.291390 dv-cinder-839793-11-iscsi devstack@n-api.service[114370]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=114370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.291479 dv-cinder-839793-11-iscsi devstack@n-api.service[114371]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=114371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.291692 dv-cinder-839793-11-iscsi devstack@n-api.service[114371]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=114371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.291777 dv-cinder-839793-11-iscsi devstack@n-api.service[114370]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=114370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.292006 dv-cinder-839793-11-iscsi devstack@n-api.service[114370]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=114370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.292096 dv-cinder-839793-11-iscsi devstack@n-api.service[114371]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=114371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.292314 dv-cinder-839793-11-iscsi devstack@n-api.service[114371]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=114371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.292411 dv-cinder-839793-11-iscsi devstack@n-api.service[114370]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=114370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.292622 dv-cinder-839793-11-iscsi devstack@n-api.service[114371]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=114371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.292706 dv-cinder-839793-11-iscsi devstack@n-api.service[114370]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=114370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.292937 dv-cinder-839793-11-iscsi devstack@n-api.service[114370]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=114370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.293020 dv-cinder-839793-11-iscsi devstack@n-api.service[114371]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=114371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.293242 dv-cinder-839793-11-iscsi devstack@n-api.service[114371]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=114371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.293333 dv-cinder-839793-11-iscsi devstack@n-api.service[114370]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=114370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.293548 dv-cinder-839793-11-iscsi devstack@n-api.service[114371]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=114371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.293632 dv-cinder-839793-11-iscsi devstack@n-api.service[114370]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=114370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.293856 dv-cinder-839793-11-iscsi devstack@n-api.service[114370]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=114370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.293939 dv-cinder-839793-11-iscsi devstack@n-api.service[114371]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=114371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.294164 dv-cinder-839793-11-iscsi devstack@n-api.service[114370]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=114370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.294258 dv-cinder-839793-11-iscsi devstack@n-api.service[114371]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=114371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.294500 dv-cinder-839793-11-iscsi devstack@n-api.service[114371]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=114371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.294585 dv-cinder-839793-11-iscsi devstack@n-api.service[114370]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=114370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.294811 dv-cinder-839793-11-iscsi devstack@n-api.service[114371]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=114371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.294895 dv-cinder-839793-11-iscsi devstack@n-api.service[114370]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=114370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.295123 dv-cinder-839793-11-iscsi devstack@n-api.service[114370]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=114370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.295214 dv-cinder-839793-11-iscsi devstack@n-api.service[114371]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=114371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.295446 dv-cinder-839793-11-iscsi devstack@n-api.service[114370]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=114370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.295572 dv-cinder-839793-11-iscsi devstack@n-api.service[114371]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=114371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.295756 dv-cinder-839793-11-iscsi devstack@n-api.service[114371]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=114371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.295840 dv-cinder-839793-11-iscsi devstack@n-api.service[114370]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=114370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.296067 dv-cinder-839793-11-iscsi devstack@n-api.service[114371]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=114371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.296158 dv-cinder-839793-11-iscsi devstack@n-api.service[114370]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=114370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.296381 dv-cinder-839793-11-iscsi devstack@n-api.service[114370]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=114370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.296465 dv-cinder-839793-11-iscsi devstack@n-api.service[114371]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=114371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.296696 dv-cinder-839793-11-iscsi devstack@n-api.service[114370]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=114370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.296781 dv-cinder-839793-11-iscsi devstack@n-api.service[114371]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=114371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.297006 dv-cinder-839793-11-iscsi devstack@n-api.service[114371]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=114371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.297134 dv-cinder-839793-11-iscsi devstack@n-api.service[114370]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=114370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.297330 dv-cinder-839793-11-iscsi devstack@n-api.service[114371]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=114371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.297414 dv-cinder-839793-11-iscsi devstack@n-api.service[114370]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=114370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.297647 dv-cinder-839793-11-iscsi devstack@n-api.service[114370]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=114370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.297730 dv-cinder-839793-11-iscsi devstack@n-api.service[114371]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=114371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.297961 dv-cinder-839793-11-iscsi devstack@n-api.service[114371]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=114371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.298046 dv-cinder-839793-11-iscsi devstack@n-api.service[114370]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=114370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.298266 dv-cinder-839793-11-iscsi devstack@n-api.service[114371]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=114371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.298380 dv-cinder-839793-11-iscsi devstack@n-api.service[114370]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=114370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.298602 dv-cinder-839793-11-iscsi devstack@n-api.service[114371]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=114371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.298688 dv-cinder-839793-11-iscsi devstack@n-api.service[114370]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=114370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.298909 dv-cinder-839793-11-iscsi devstack@n-api.service[114370]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=114370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.299002 dv-cinder-839793-11-iscsi devstack@n-api.service[114371]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=114371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.299213 dv-cinder-839793-11-iscsi devstack@n-api.service[114371]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=114371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.299333 dv-cinder-839793-11-iscsi devstack@n-api.service[114370]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=114370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.299558 dv-cinder-839793-11-iscsi devstack@n-api.service[114371]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=114371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.299696 dv-cinder-839793-11-iscsi devstack@n-api.service[114370]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=114370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.299922 dv-cinder-839793-11-iscsi devstack@n-api.service[114370]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=114370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.300007 dv-cinder-839793-11-iscsi devstack@n-api.service[114371]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=114371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.300142 dv-cinder-839793-11-iscsi devstack@n-api.service[114370]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=114370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.300226 dv-cinder-839793-11-iscsi devstack@n-api.service[114371]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=114371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.300442 dv-cinder-839793-11-iscsi devstack@n-api.service[114371]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=114371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.300540 dv-cinder-839793-11-iscsi devstack@n-api.service[114370]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=114370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.300747 dv-cinder-839793-11-iscsi devstack@n-api.service[114370]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=114370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.300838 dv-cinder-839793-11-iscsi devstack@n-api.service[114371]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=114371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.301049 dv-cinder-839793-11-iscsi devstack@n-api.service[114371]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=114371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.301139 dv-cinder-839793-11-iscsi devstack@n-api.service[114370]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=114370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.301353 dv-cinder-839793-11-iscsi devstack@n-api.service[114370]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=114370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.301446 dv-cinder-839793-11-iscsi devstack@n-api.service[114371]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=114371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.301661 dv-cinder-839793-11-iscsi devstack@n-api.service[114370]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=114370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.301747 dv-cinder-839793-11-iscsi devstack@n-api.service[114371]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=114371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.301967 dv-cinder-839793-11-iscsi devstack@n-api.service[114371]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=114371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.302050 dv-cinder-839793-11-iscsi devstack@n-api.service[114370]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=114370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.302272 dv-cinder-839793-11-iscsi devstack@n-api.service[114371]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=114371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.302396 dv-cinder-839793-11-iscsi devstack@n-api.service[114370]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=114370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.302603 dv-cinder-839793-11-iscsi devstack@n-api.service[114371]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=114371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.302689 dv-cinder-839793-11-iscsi devstack@n-api.service[114370]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=114370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.302906 dv-cinder-839793-11-iscsi devstack@n-api.service[114371]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=114371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.303001 dv-cinder-839793-11-iscsi devstack@n-api.service[114370]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=114370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.303212 dv-cinder-839793-11-iscsi devstack@n-api.service[114370]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=114370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.303297 dv-cinder-839793-11-iscsi devstack@n-api.service[114371]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=114371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.303518 dv-cinder-839793-11-iscsi devstack@n-api.service[114370]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=114370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.303603 dv-cinder-839793-11-iscsi devstack@n-api.service[114371]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=114371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.303864 dv-cinder-839793-11-iscsi devstack@n-api.service[114370]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=114370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.303949 dv-cinder-839793-11-iscsi devstack@n-api.service[114371]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=114371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.304175 dv-cinder-839793-11-iscsi devstack@n-api.service[114370]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=114370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.304260 dv-cinder-839793-11-iscsi devstack@n-api.service[114371]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=114371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.304496 dv-cinder-839793-11-iscsi devstack@n-api.service[114371]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=114371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.304580 dv-cinder-839793-11-iscsi devstack@n-api.service[114370]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=114370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.304818 dv-cinder-839793-11-iscsi devstack@n-api.service[114371]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=114371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.304910 dv-cinder-839793-11-iscsi devstack@n-api.service[114370]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=114370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.305129 dv-cinder-839793-11-iscsi devstack@n-api.service[114371]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=114371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.305222 dv-cinder-839793-11-iscsi devstack@n-api.service[114370]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=114370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.305451 dv-cinder-839793-11-iscsi devstack@n-api.service[114371]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=114371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.305542 dv-cinder-839793-11-iscsi devstack@n-api.service[114370]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=114370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.305765 dv-cinder-839793-11-iscsi devstack@n-api.service[114370]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=114370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.305854 dv-cinder-839793-11-iscsi devstack@n-api.service[114371]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=114371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.306074 dv-cinder-839793-11-iscsi devstack@n-api.service[114371]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=114371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.306194 dv-cinder-839793-11-iscsi devstack@n-api.service[114370]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=114370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.306410 dv-cinder-839793-11-iscsi devstack@n-api.service[114371]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=114371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.306499 dv-cinder-839793-11-iscsi devstack@n-api.service[114370]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=114370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.306724 dv-cinder-839793-11-iscsi devstack@n-api.service[114371]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=114371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.306818 dv-cinder-839793-11-iscsi devstack@n-api.service[114370]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=114370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.307036 dv-cinder-839793-11-iscsi devstack@n-api.service[114370]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=114370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.307128 dv-cinder-839793-11-iscsi devstack@n-api.service[114371]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=114371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.307344 dv-cinder-839793-11-iscsi devstack@n-api.service[114371]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=114371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.307434 dv-cinder-839793-11-iscsi devstack@n-api.service[114370]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=114370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.307664 dv-cinder-839793-11-iscsi devstack@n-api.service[114370]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=114370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.307754 dv-cinder-839793-11-iscsi devstack@n-api.service[114371]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=114371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.307973 dv-cinder-839793-11-iscsi devstack@n-api.service[114371]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=114371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.308057 dv-cinder-839793-11-iscsi devstack@n-api.service[114370]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=114370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.308292 dv-cinder-839793-11-iscsi devstack@n-api.service[114370]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=114370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.308382 dv-cinder-839793-11-iscsi devstack@n-api.service[114371]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=114371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.308599 dv-cinder-839793-11-iscsi devstack@n-api.service[114371]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=114371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.308691 dv-cinder-839793-11-iscsi devstack@n-api.service[114370]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=114370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.308919 dv-cinder-839793-11-iscsi devstack@n-api.service[114371]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=114371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.309003 dv-cinder-839793-11-iscsi devstack@n-api.service[114370]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=114370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.309223 dv-cinder-839793-11-iscsi devstack@n-api.service[114371]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=114371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.309307 dv-cinder-839793-11-iscsi devstack@n-api.service[114370]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=114370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.309539 dv-cinder-839793-11-iscsi devstack@n-api.service[114371]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=114371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.309631 dv-cinder-839793-11-iscsi devstack@n-api.service[114370]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=114370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.309845 dv-cinder-839793-11-iscsi devstack@n-api.service[114370]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=114370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.309930 dv-cinder-839793-11-iscsi devstack@n-api.service[114371]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=114371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.310163 dv-cinder-839793-11-iscsi devstack@n-api.service[114370]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=114370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.310247 dv-cinder-839793-11-iscsi devstack@n-api.service[114371]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=114371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.310520 dv-cinder-839793-11-iscsi devstack@n-api.service[114371]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=114371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.310621 dv-cinder-839793-11-iscsi devstack@n-api.service[114370]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=114370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.310845 dv-cinder-839793-11-iscsi devstack@n-api.service[114371]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=114371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.310937 dv-cinder-839793-11-iscsi devstack@n-api.service[114370]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=114370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.311156 dv-cinder-839793-11-iscsi devstack@n-api.service[114371]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=114371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.311243 dv-cinder-839793-11-iscsi devstack@n-api.service[114370]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=114370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.311471 dv-cinder-839793-11-iscsi devstack@n-api.service[114371]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=114371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.311564 dv-cinder-839793-11-iscsi devstack@n-api.service[114370]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=114370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.311781 dv-cinder-839793-11-iscsi devstack@n-api.service[114371]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=114371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.311867 dv-cinder-839793-11-iscsi devstack@n-api.service[114370]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=114370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.312092 dv-cinder-839793-11-iscsi devstack@n-api.service[114371]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=114371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.312176 dv-cinder-839793-11-iscsi devstack@n-api.service[114370]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=114370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.312403 dv-cinder-839793-11-iscsi devstack@n-api.service[114370]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=114370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.312500 dv-cinder-839793-11-iscsi devstack@n-api.service[114371]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=114371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.312710 dv-cinder-839793-11-iscsi devstack@n-api.service[114371]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=114371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.312795 dv-cinder-839793-11-iscsi devstack@n-api.service[114370]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=114370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.313019 dv-cinder-839793-11-iscsi devstack@n-api.service[114370]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=114370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.313110 dv-cinder-839793-11-iscsi devstack@n-api.service[114371]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=114371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.313326 dv-cinder-839793-11-iscsi devstack@n-api.service[114371]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=114371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.313412 dv-cinder-839793-11-iscsi devstack@n-api.service[114370]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=114370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.313643 dv-cinder-839793-11-iscsi devstack@n-api.service[114371]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=114371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.313727 dv-cinder-839793-11-iscsi devstack@n-api.service[114370]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=114370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.313951 dv-cinder-839793-11-iscsi devstack@n-api.service[114370]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=114370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.314041 dv-cinder-839793-11-iscsi devstack@n-api.service[114371]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=114371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.314271 dv-cinder-839793-11-iscsi devstack@n-api.service[114371]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=114371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.314400 dv-cinder-839793-11-iscsi devstack@n-api.service[114370]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=114370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.314602 dv-cinder-839793-11-iscsi devstack@n-api.service[114371]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=114371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.314687 dv-cinder-839793-11-iscsi devstack@n-api.service[114370]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=114370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.315438 dv-cinder-839793-11-iscsi devstack@n-api.service[114370]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=114370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.315577 dv-cinder-839793-11-iscsi devstack@n-api.service[114371]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=114371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.315796 dv-cinder-839793-11-iscsi devstack@n-api.service[114370]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=114370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.315998 dv-cinder-839793-11-iscsi devstack@n-api.service[114371]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=114371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.316237 dv-cinder-839793-11-iscsi devstack@n-api.service[114370]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=114370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.316363 dv-cinder-839793-11-iscsi devstack@n-api.service[114371]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=114371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.316556 dv-cinder-839793-11-iscsi devstack@n-api.service[114370]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=114370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.316649 dv-cinder-839793-11-iscsi devstack@n-api.service[114371]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=114371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.316877 dv-cinder-839793-11-iscsi devstack@n-api.service[114370]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=114370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.316962 dv-cinder-839793-11-iscsi devstack@n-api.service[114371]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=114371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.317209 dv-cinder-839793-11-iscsi devstack@n-api.service[114370]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=114370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.317343 dv-cinder-839793-11-iscsi devstack@n-api.service[114371]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=114371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.317547 dv-cinder-839793-11-iscsi devstack@n-api.service[114370]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=114370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.317641 dv-cinder-839793-11-iscsi devstack@n-api.service[114371]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=114371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.317863 dv-cinder-839793-11-iscsi devstack@n-api.service[114370]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=114370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.317960 dv-cinder-839793-11-iscsi devstack@n-api.service[114371]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=114371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.318171 dv-cinder-839793-11-iscsi devstack@n-api.service[114371]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=114371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.318263 dv-cinder-839793-11-iscsi devstack@n-api.service[114370]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=114370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.318512 dv-cinder-839793-11-iscsi devstack@n-api.service[114371]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=114371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.318608 dv-cinder-839793-11-iscsi devstack@n-api.service[114370]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=114370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.318826 dv-cinder-839793-11-iscsi devstack@n-api.service[114370]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=114370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.318910 dv-cinder-839793-11-iscsi devstack@n-api.service[114371]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=114371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.319131 dv-cinder-839793-11-iscsi devstack@n-api.service[114371]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=114371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.319214 dv-cinder-839793-11-iscsi devstack@n-api.service[114370]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=114370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.319439 dv-cinder-839793-11-iscsi devstack@n-api.service[114371]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=114371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.319533 dv-cinder-839793-11-iscsi devstack@n-api.service[114370]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=114370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.319747 dv-cinder-839793-11-iscsi devstack@n-api.service[114370]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=114370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.319830 dv-cinder-839793-11-iscsi devstack@n-api.service[114371]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=114371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.320059 dv-cinder-839793-11-iscsi devstack@n-api.service[114370]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=114370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.320144 dv-cinder-839793-11-iscsi devstack@n-api.service[114371]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=114371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.320365 dv-cinder-839793-11-iscsi devstack@n-api.service[114371]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=114371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.320450 dv-cinder-839793-11-iscsi devstack@n-api.service[114370]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=114370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.320675 dv-cinder-839793-11-iscsi devstack@n-api.service[114371]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=114371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.320769 dv-cinder-839793-11-iscsi devstack@n-api.service[114370]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=114370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.320983 dv-cinder-839793-11-iscsi devstack@n-api.service[114371]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=114371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.321069 dv-cinder-839793-11-iscsi devstack@n-api.service[114370]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=114370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.321293 dv-cinder-839793-11-iscsi devstack@n-api.service[114370]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=114370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.321379 dv-cinder-839793-11-iscsi devstack@n-api.service[114371]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=114371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.321600 dv-cinder-839793-11-iscsi devstack@n-api.service[114371]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=114371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.321684 dv-cinder-839793-11-iscsi devstack@n-api.service[114370]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=114370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.321905 dv-cinder-839793-11-iscsi devstack@n-api.service[114371]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=114371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.321998 dv-cinder-839793-11-iscsi devstack@n-api.service[114370]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=114370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.322210 dv-cinder-839793-11-iscsi devstack@n-api.service[114371]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=114371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.322296 dv-cinder-839793-11-iscsi devstack@n-api.service[114370]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=114370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.322539 dv-cinder-839793-11-iscsi devstack@n-api.service[114370]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=114370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.322622 dv-cinder-839793-11-iscsi devstack@n-api.service[114371]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=114371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.322848 dv-cinder-839793-11-iscsi devstack@n-api.service[114370]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=114370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.322932 dv-cinder-839793-11-iscsi devstack@n-api.service[114371]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=114371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.323157 dv-cinder-839793-11-iscsi devstack@n-api.service[114371]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=114371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.323242 dv-cinder-839793-11-iscsi devstack@n-api.service[114370]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=114370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.323479 dv-cinder-839793-11-iscsi devstack@n-api.service[114371]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=114371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.323571 dv-cinder-839793-11-iscsi devstack@n-api.service[114370]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=114370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.323792 dv-cinder-839793-11-iscsi devstack@n-api.service[114370]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=114370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.323884 dv-cinder-839793-11-iscsi devstack@n-api.service[114371]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=114371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.324095 dv-cinder-839793-11-iscsi devstack@n-api.service[114371]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=114371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.324180 dv-cinder-839793-11-iscsi devstack@n-api.service[114370]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=114370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.324402 dv-cinder-839793-11-iscsi devstack@n-api.service[114371]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=114371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.324535 dv-cinder-839793-11-iscsi devstack@n-api.service[114370]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=114370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.324724 dv-cinder-839793-11-iscsi devstack@n-api.service[114371]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=114371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.324829 dv-cinder-839793-11-iscsi devstack@n-api.service[114370]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=114370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.325028 dv-cinder-839793-11-iscsi devstack@n-api.service[114370]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=114370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.325111 dv-cinder-839793-11-iscsi devstack@n-api.service[114371]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=114371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.325331 dv-cinder-839793-11-iscsi devstack@n-api.service[114371]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=114371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.325421 dv-cinder-839793-11-iscsi devstack@n-api.service[114370]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=114370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.325637 dv-cinder-839793-11-iscsi devstack@n-api.service[114371]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=114371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.325733 dv-cinder-839793-11-iscsi devstack@n-api.service[114370]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=114370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.325945 dv-cinder-839793-11-iscsi devstack@n-api.service[114371]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=114371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.326030 dv-cinder-839793-11-iscsi devstack@n-api.service[114370]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=114370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.326257 dv-cinder-839793-11-iscsi devstack@n-api.service[114370]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=114370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.326360 dv-cinder-839793-11-iscsi devstack@n-api.service[114371]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=114371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.326589 dv-cinder-839793-11-iscsi devstack@n-api.service[114370]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=114370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.326687 dv-cinder-839793-11-iscsi devstack@n-api.service[114371]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=114371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.326924 dv-cinder-839793-11-iscsi devstack@n-api.service[114371]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=114371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.327014 dv-cinder-839793-11-iscsi devstack@n-api.service[114370]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=114370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.327237 dv-cinder-839793-11-iscsi devstack@n-api.service[114370]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=114370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.327330 dv-cinder-839793-11-iscsi devstack@n-api.service[114371]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=114371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.327547 dv-cinder-839793-11-iscsi devstack@n-api.service[114370]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=114370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.327646 dv-cinder-839793-11-iscsi devstack@n-api.service[114371]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=114371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.327855 dv-cinder-839793-11-iscsi devstack@n-api.service[114371]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=114371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.327946 dv-cinder-839793-11-iscsi devstack@n-api.service[114370]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=114370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.328170 dv-cinder-839793-11-iscsi devstack@n-api.service[114371]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=114371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.328262 dv-cinder-839793-11-iscsi devstack@n-api.service[114370]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=114370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.328482 dv-cinder-839793-11-iscsi devstack@n-api.service[114370]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=114370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.328567 dv-cinder-839793-11-iscsi devstack@n-api.service[114371]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=114371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.328789 dv-cinder-839793-11-iscsi devstack@n-api.service[114371]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=114371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.328872 dv-cinder-839793-11-iscsi devstack@n-api.service[114370]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=114370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.329101 dv-cinder-839793-11-iscsi devstack@n-api.service[114370]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=114370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.329183 dv-cinder-839793-11-iscsi devstack@n-api.service[114371]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=114371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.329412 dv-cinder-839793-11-iscsi devstack@n-api.service[114371]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=114371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.329506 dv-cinder-839793-11-iscsi devstack@n-api.service[114370]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=114370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.329720 dv-cinder-839793-11-iscsi devstack@n-api.service[114371]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=114371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.329805 dv-cinder-839793-11-iscsi devstack@n-api.service[114370]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=114370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.330030 dv-cinder-839793-11-iscsi devstack@n-api.service[114371]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=114371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.330116 dv-cinder-839793-11-iscsi devstack@n-api.service[114370]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=114370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.330358 dv-cinder-839793-11-iscsi devstack@n-api.service[114370]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=114370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.330446 dv-cinder-839793-11-iscsi devstack@n-api.service[114371]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=114371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.330766 dv-cinder-839793-11-iscsi devstack@n-api.service[114370]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=114370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.330854 dv-cinder-839793-11-iscsi devstack@n-api.service[114371]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=114371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.331083 dv-cinder-839793-11-iscsi devstack@n-api.service[114371]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=114371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.331177 dv-cinder-839793-11-iscsi devstack@n-api.service[114370]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=114370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.331433 dv-cinder-839793-11-iscsi devstack@n-api.service[114370]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=114370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.331519 dv-cinder-839793-11-iscsi devstack@n-api.service[114371]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=114371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.331742 dv-cinder-839793-11-iscsi devstack@n-api.service[114371]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=114371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.331827 dv-cinder-839793-11-iscsi devstack@n-api.service[114370]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=114370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.332054 dv-cinder-839793-11-iscsi devstack@n-api.service[114371]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=114371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.332153 dv-cinder-839793-11-iscsi devstack@n-api.service[114370]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=114370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.332366 dv-cinder-839793-11-iscsi devstack@n-api.service[114371]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=114371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.332452 dv-cinder-839793-11-iscsi devstack@n-api.service[114370]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=114370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.332671 dv-cinder-839793-11-iscsi devstack@n-api.service[114371]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=114371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.332755 dv-cinder-839793-11-iscsi devstack@n-api.service[114370]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=114370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.332979 dv-cinder-839793-11-iscsi devstack@n-api.service[114371]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=114371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.333071 dv-cinder-839793-11-iscsi devstack@n-api.service[114370]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=114370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.333285 dv-cinder-839793-11-iscsi devstack@n-api.service[114370]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=114370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.333369 dv-cinder-839793-11-iscsi devstack@n-api.service[114371]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=114371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.333597 dv-cinder-839793-11-iscsi devstack@n-api.service[114370]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=114370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.333850 dv-cinder-839793-11-iscsi devstack@n-api.service[114371]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=114371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.333944 dv-cinder-839793-11-iscsi devstack@n-api.service[114370]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=114370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.334188 dv-cinder-839793-11-iscsi devstack@n-api.service[114371]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=114371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.334495 dv-cinder-839793-11-iscsi devstack@n-api.service[114370]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=114370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.334583 dv-cinder-839793-11-iscsi devstack@n-api.service[114371]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=114371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.334837 dv-cinder-839793-11-iscsi devstack@n-api.service[114370]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=114370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.334930 dv-cinder-839793-11-iscsi devstack@n-api.service[114371]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=114371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.335154 dv-cinder-839793-11-iscsi devstack@n-api.service[114371]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=114371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.335240 dv-cinder-839793-11-iscsi devstack@n-api.service[114370]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=114370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.335476 dv-cinder-839793-11-iscsi devstack@n-api.service[114370]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=114370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.335559 dv-cinder-839793-11-iscsi devstack@n-api.service[114371]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=114371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.335801 dv-cinder-839793-11-iscsi devstack@n-api.service[114370]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=114370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.335892 dv-cinder-839793-11-iscsi devstack@n-api.service[114371]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=114371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.336129 dv-cinder-839793-11-iscsi devstack@n-api.service[114370]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=114370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.336261 dv-cinder-839793-11-iscsi devstack@n-api.service[114371]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=114371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.336466 dv-cinder-839793-11-iscsi devstack@n-api.service[114370]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=114370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.336551 dv-cinder-839793-11-iscsi devstack@n-api.service[114371]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=114371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.336771 dv-cinder-839793-11-iscsi devstack@n-api.service[114371]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=114371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.336863 dv-cinder-839793-11-iscsi devstack@n-api.service[114370]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=114370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.337082 dv-cinder-839793-11-iscsi devstack@n-api.service[114371]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=114371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.337176 dv-cinder-839793-11-iscsi devstack@n-api.service[114370]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=114370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.337389 dv-cinder-839793-11-iscsi devstack@n-api.service[114371]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=114371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.337523 dv-cinder-839793-11-iscsi devstack@n-api.service[114370]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=114370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.337696 dv-cinder-839793-11-iscsi devstack@n-api.service[114371]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=114371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.337781 dv-cinder-839793-11-iscsi devstack@n-api.service[114370]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=114370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.338008 dv-cinder-839793-11-iscsi devstack@n-api.service[114371]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=114371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.338093 dv-cinder-839793-11-iscsi devstack@n-api.service[114370]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=114370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.338335 dv-cinder-839793-11-iscsi devstack@n-api.service[114371]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=114371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.338425 dv-cinder-839793-11-iscsi devstack@n-api.service[114370]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=114370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.338641 dv-cinder-839793-11-iscsi devstack@n-api.service[114371]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=114371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.338726 dv-cinder-839793-11-iscsi devstack@n-api.service[114370]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=114370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.338947 dv-cinder-839793-11-iscsi devstack@n-api.service[114371]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=114371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.339031 dv-cinder-839793-11-iscsi devstack@n-api.service[114370]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=114370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.339258 dv-cinder-839793-11-iscsi devstack@n-api.service[114370]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=114370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.339344 dv-cinder-839793-11-iscsi devstack@n-api.service[114371]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=114371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.339559 dv-cinder-839793-11-iscsi devstack@n-api.service[114371]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=114371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.339643 dv-cinder-839793-11-iscsi devstack@n-api.service[114370]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=114370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.339866 dv-cinder-839793-11-iscsi devstack@n-api.service[114371]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=114371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.339950 dv-cinder-839793-11-iscsi devstack@n-api.service[114370]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=114370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.340171 dv-cinder-839793-11-iscsi devstack@n-api.service[114370]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=114370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.340256 dv-cinder-839793-11-iscsi devstack@n-api.service[114371]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=114371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.340474 dv-cinder-839793-11-iscsi devstack@n-api.service[114371]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=114371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.340560 dv-cinder-839793-11-iscsi devstack@n-api.service[114370]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=114370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.340782 dv-cinder-839793-11-iscsi devstack@n-api.service[114370]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=114370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.340865 dv-cinder-839793-11-iscsi devstack@n-api.service[114371]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=114371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.341087 dv-cinder-839793-11-iscsi devstack@n-api.service[114371]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=114371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.341172 dv-cinder-839793-11-iscsi devstack@n-api.service[114370]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=114370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.341398 dv-cinder-839793-11-iscsi devstack@n-api.service[114371]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=114371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.341483 dv-cinder-839793-11-iscsi devstack@n-api.service[114370]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=114370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.341702 dv-cinder-839793-11-iscsi devstack@n-api.service[114370]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=114370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.341795 dv-cinder-839793-11-iscsi devstack@n-api.service[114371]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=114371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.342016 dv-cinder-839793-11-iscsi devstack@n-api.service[114370]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=114370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.342109 dv-cinder-839793-11-iscsi devstack@n-api.service[114371]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=114371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.342350 dv-cinder-839793-11-iscsi devstack@n-api.service[114370]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=114370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.342439 dv-cinder-839793-11-iscsi devstack@n-api.service[114371]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=114371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.342648 dv-cinder-839793-11-iscsi devstack@n-api.service[114371]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=114371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.342743 dv-cinder-839793-11-iscsi devstack@n-api.service[114370]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=114370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.342954 dv-cinder-839793-11-iscsi devstack@n-api.service[114371]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=114371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.343040 dv-cinder-839793-11-iscsi devstack@n-api.service[114370]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=114370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.343260 dv-cinder-839793-11-iscsi devstack@n-api.service[114371]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=114371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.343344 dv-cinder-839793-11-iscsi devstack@n-api.service[114370]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=114370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.343568 dv-cinder-839793-11-iscsi devstack@n-api.service[114370]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=114370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.343661 dv-cinder-839793-11-iscsi devstack@n-api.service[114371]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=114371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.343877 dv-cinder-839793-11-iscsi devstack@n-api.service[114370]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=114370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.343962 dv-cinder-839793-11-iscsi devstack@n-api.service[114371]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=114371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.344218 dv-cinder-839793-11-iscsi devstack@n-api.service[114371]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=114371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.344302 dv-cinder-839793-11-iscsi devstack@n-api.service[114370]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=114370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.344524 dv-cinder-839793-11-iscsi devstack@n-api.service[114370]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=114370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.344616 dv-cinder-839793-11-iscsi devstack@n-api.service[114371]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=114371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.344864 dv-cinder-839793-11-iscsi devstack@n-api.service[114370]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=114370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.344948 dv-cinder-839793-11-iscsi devstack@n-api.service[114371]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=114371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.345167 dv-cinder-839793-11-iscsi devstack@n-api.service[114371]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=114371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.345251 dv-cinder-839793-11-iscsi devstack@n-api.service[114370]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=114370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.345474 dv-cinder-839793-11-iscsi devstack@n-api.service[114371]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=114371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.345561 dv-cinder-839793-11-iscsi devstack@n-api.service[114370]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=114370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.345803 dv-cinder-839793-11-iscsi devstack@n-api.service[114371]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=114371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.345889 dv-cinder-839793-11-iscsi devstack@n-api.service[114370]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=114370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.346109 dv-cinder-839793-11-iscsi devstack@n-api.service[114371]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=114371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.346745 dv-cinder-839793-11-iscsi devstack@n-api.service[114370]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=114370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.346993 dv-cinder-839793-11-iscsi devstack@n-api.service[114370]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=114370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.347131 dv-cinder-839793-11-iscsi devstack@n-api.service[114371]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=114371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.347305 dv-cinder-839793-11-iscsi devstack@n-api.service[114370]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=114370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.347465 dv-cinder-839793-11-iscsi devstack@n-api.service[114371]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=114371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.347615 dv-cinder-839793-11-iscsi devstack@n-api.service[114370]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=114370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.347778 dv-cinder-839793-11-iscsi devstack@n-api.service[114371]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=114371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.347924 dv-cinder-839793-11-iscsi devstack@n-api.service[114370]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=114370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.348089 dv-cinder-839793-11-iscsi devstack@n-api.service[114371]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=114371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.348236 dv-cinder-839793-11-iscsi devstack@n-api.service[114370]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=114370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.348393 dv-cinder-839793-11-iscsi devstack@n-api.service[114371]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=114371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.348546 dv-cinder-839793-11-iscsi devstack@n-api.service[114370]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=114370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.348705 dv-cinder-839793-11-iscsi devstack@n-api.service[114371]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=114371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.348852 dv-cinder-839793-11-iscsi devstack@n-api.service[114370]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=114370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.349015 dv-cinder-839793-11-iscsi devstack@n-api.service[114371]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=114371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.349165 dv-cinder-839793-11-iscsi devstack@n-api.service[114370]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=114370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.349325 dv-cinder-839793-11-iscsi devstack@n-api.service[114371]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=114371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.349476 dv-cinder-839793-11-iscsi devstack@n-api.service[114370]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=114370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.349634 dv-cinder-839793-11-iscsi devstack@n-api.service[114371]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=114371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.349788 dv-cinder-839793-11-iscsi devstack@n-api.service[114370]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=114370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.349939 dv-cinder-839793-11-iscsi devstack@n-api.service[114371]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=114371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.350101 dv-cinder-839793-11-iscsi devstack@n-api.service[114370]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=114370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.350249 dv-cinder-839793-11-iscsi devstack@n-api.service[114371]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=114371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.350430 dv-cinder-839793-11-iscsi devstack@n-api.service[114370]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=114370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.350581 dv-cinder-839793-11-iscsi devstack@n-api.service[114371]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=114371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.350742 dv-cinder-839793-11-iscsi devstack@n-api.service[114370]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=114370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.350896 dv-cinder-839793-11-iscsi devstack@n-api.service[114371]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=114371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.351047 dv-cinder-839793-11-iscsi devstack@n-api.service[114370]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=114370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.351204 dv-cinder-839793-11-iscsi devstack@n-api.service[114371]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=114371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.351363 dv-cinder-839793-11-iscsi devstack@n-api.service[114370]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=114370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.351508 dv-cinder-839793-11-iscsi devstack@n-api.service[114371]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=114371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.351674 dv-cinder-839793-11-iscsi devstack@n-api.service[114370]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=114370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.351810 dv-cinder-839793-11-iscsi devstack@n-api.service[114371]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=114371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.351979 dv-cinder-839793-11-iscsi devstack@n-api.service[114370]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=114370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.352122 dv-cinder-839793-11-iscsi devstack@n-api.service[114371]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=114371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.352285 dv-cinder-839793-11-iscsi devstack@n-api.service[114370]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=114370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.352431 dv-cinder-839793-11-iscsi devstack@n-api.service[114371]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=114371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.352597 dv-cinder-839793-11-iscsi devstack@n-api.service[114370]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=114370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.352733 dv-cinder-839793-11-iscsi devstack@n-api.service[114371]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=114371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.352906 dv-cinder-839793-11-iscsi devstack@n-api.service[114370]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=114370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.353042 dv-cinder-839793-11-iscsi devstack@n-api.service[114371]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=114371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.353210 dv-cinder-839793-11-iscsi devstack@n-api.service[114370]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=114370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.353345 dv-cinder-839793-11-iscsi devstack@n-api.service[114371]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=114371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.353520 dv-cinder-839793-11-iscsi devstack@n-api.service[114370]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=114370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.353661 dv-cinder-839793-11-iscsi devstack@n-api.service[114371]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=114371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.353823 dv-cinder-839793-11-iscsi devstack@n-api.service[114370]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=114370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.353965 dv-cinder-839793-11-iscsi devstack@n-api.service[114371]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=114371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.354142 dv-cinder-839793-11-iscsi devstack@n-api.service[114370]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=114370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.354270 dv-cinder-839793-11-iscsi devstack@n-api.service[114371]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=114371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.354474 dv-cinder-839793-11-iscsi devstack@n-api.service[114370]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=114370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.354603 dv-cinder-839793-11-iscsi devstack@n-api.service[114371]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=114371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.354782 dv-cinder-839793-11-iscsi devstack@n-api.service[114370]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=114370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.354915 dv-cinder-839793-11-iscsi devstack@n-api.service[114371]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=114371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.355089 dv-cinder-839793-11-iscsi devstack@n-api.service[114370]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=114370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.355224 dv-cinder-839793-11-iscsi devstack@n-api.service[114371]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=114371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.355656 dv-cinder-839793-11-iscsi devstack@n-api.service[114370]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=114370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.355784 dv-cinder-839793-11-iscsi devstack@n-api.service[114371]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=114371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.355968 dv-cinder-839793-11-iscsi devstack@n-api.service[114370]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=114370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.356106 dv-cinder-839793-11-iscsi devstack@n-api.service[114371]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=114371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.356275 dv-cinder-839793-11-iscsi devstack@n-api.service[114370]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=114370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.356422 dv-cinder-839793-11-iscsi devstack@n-api.service[114371]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=114371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.356606 dv-cinder-839793-11-iscsi devstack@n-api.service[114370]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=114370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.356729 dv-cinder-839793-11-iscsi devstack@n-api.service[114371]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=114371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.356919 dv-cinder-839793-11-iscsi devstack@n-api.service[114370]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=114370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.357017 dv-cinder-839793-11-iscsi devstack@n-api.service[114371]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=114371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.357225 dv-cinder-839793-11-iscsi devstack@n-api.service[114370]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=114370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.357312 dv-cinder-839793-11-iscsi devstack@n-api.service[114371]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=114371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.357532 dv-cinder-839793-11-iscsi devstack@n-api.service[114370]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=114370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.357617 dv-cinder-839793-11-iscsi devstack@n-api.service[114371]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=114371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.357844 dv-cinder-839793-11-iscsi devstack@n-api.service[114370]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=114370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.357937 dv-cinder-839793-11-iscsi devstack@n-api.service[114371]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=114371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.358149 dv-cinder-839793-11-iscsi devstack@n-api.service[114370]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=114370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.358234 dv-cinder-839793-11-iscsi devstack@n-api.service[114371]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=114371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.358477 dv-cinder-839793-11-iscsi devstack@n-api.service[114370]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=114370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.358564 dv-cinder-839793-11-iscsi devstack@n-api.service[114371]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=114371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.358791 dv-cinder-839793-11-iscsi devstack@n-api.service[114370]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=114370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.358888 dv-cinder-839793-11-iscsi devstack@n-api.service[114371]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=114371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.359115 dv-cinder-839793-11-iscsi devstack@n-api.service[114370]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=114370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.359200 dv-cinder-839793-11-iscsi devstack@n-api.service[114371]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=114371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.359423 dv-cinder-839793-11-iscsi devstack@n-api.service[114371]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=114371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.359506 dv-cinder-839793-11-iscsi devstack@n-api.service[114370]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=114370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.359727 dv-cinder-839793-11-iscsi devstack@n-api.service[114370]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=114370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.359823 dv-cinder-839793-11-iscsi devstack@n-api.service[114371]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=114371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.360029 dv-cinder-839793-11-iscsi devstack@n-api.service[114371]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=114371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.360113 dv-cinder-839793-11-iscsi devstack@n-api.service[114370]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=114370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.360332 dv-cinder-839793-11-iscsi devstack@n-api.service[114370]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=114370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.360415 dv-cinder-839793-11-iscsi devstack@n-api.service[114371]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=114371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.360635 dv-cinder-839793-11-iscsi devstack@n-api.service[114371]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=114371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.360721 dv-cinder-839793-11-iscsi devstack@n-api.service[114370]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=114370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.360937 dv-cinder-839793-11-iscsi devstack@n-api.service[114371]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=114371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.361029 dv-cinder-839793-11-iscsi devstack@n-api.service[114370]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=114370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.361240 dv-cinder-839793-11-iscsi devstack@n-api.service[114371]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=114371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.361324 dv-cinder-839793-11-iscsi devstack@n-api.service[114370]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=114370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.361541 dv-cinder-839793-11-iscsi devstack@n-api.service[114370]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=114370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.361634 dv-cinder-839793-11-iscsi devstack@n-api.service[114371]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=114371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.361884 dv-cinder-839793-11-iscsi devstack@n-api.service[114371]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=114371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.362523 dv-cinder-839793-11-iscsi devstack@n-api.service[114370]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=114370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.362699 dv-cinder-839793-11-iscsi devstack@n-api.service[114371]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=114371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.362784 dv-cinder-839793-11-iscsi devstack@n-api.service[114370]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=114370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.363020 dv-cinder-839793-11-iscsi devstack@n-api.service[114371]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=114371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.363107 dv-cinder-839793-11-iscsi devstack@n-api.service[114370]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=114370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.363330 dv-cinder-839793-11-iscsi devstack@n-api.service[114371]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=114371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.363427 dv-cinder-839793-11-iscsi devstack@n-api.service[114370]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=114370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.363634 dv-cinder-839793-11-iscsi devstack@n-api.service[114371]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=114371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.363720 dv-cinder-839793-11-iscsi devstack@n-api.service[114370]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=114370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.363941 dv-cinder-839793-11-iscsi devstack@n-api.service[114371]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=114371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.364028 dv-cinder-839793-11-iscsi devstack@n-api.service[114370]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=114370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.364242 dv-cinder-839793-11-iscsi devstack@n-api.service[114371]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=114371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.364337 dv-cinder-839793-11-iscsi devstack@n-api.service[114370]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=114370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.364573 dv-cinder-839793-11-iscsi devstack@n-api.service[114370]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=114370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.364666 dv-cinder-839793-11-iscsi devstack@n-api.service[114371]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=114371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.364875 dv-cinder-839793-11-iscsi devstack@n-api.service[114371]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=114371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.364959 dv-cinder-839793-11-iscsi devstack@n-api.service[114370]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=114370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.365217 dv-cinder-839793-11-iscsi devstack@n-api.service[114370]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=114370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.365300 dv-cinder-839793-11-iscsi devstack@n-api.service[114371]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=114371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.365523 dv-cinder-839793-11-iscsi devstack@n-api.service[114371]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=114371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.365616 dv-cinder-839793-11-iscsi devstack@n-api.service[114370]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=114370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.365844 dv-cinder-839793-11-iscsi devstack@n-api.service[114371]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=114371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.365968 dv-cinder-839793-11-iscsi devstack@n-api.service[114370]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=114370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.366169 dv-cinder-839793-11-iscsi devstack@n-api.service[114371]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=114371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.366256 dv-cinder-839793-11-iscsi devstack@n-api.service[114370]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=114370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.366508 dv-cinder-839793-11-iscsi devstack@n-api.service[114371]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=114371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.366609 dv-cinder-839793-11-iscsi devstack@n-api.service[114370]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=114370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.366818 dv-cinder-839793-11-iscsi devstack@n-api.service[114371]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=114371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.366948 dv-cinder-839793-11-iscsi devstack@n-api.service[114370]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=114370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.367133 dv-cinder-839793-11-iscsi devstack@n-api.service[114371]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=114371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.367220 dv-cinder-839793-11-iscsi devstack@n-api.service[114370]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=114370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.367437 dv-cinder-839793-11-iscsi devstack@n-api.service[114371]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=114371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.367535 dv-cinder-839793-11-iscsi devstack@n-api.service[114370]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=114370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.367752 dv-cinder-839793-11-iscsi devstack@n-api.service[114370]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=114370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.367837 dv-cinder-839793-11-iscsi devstack@n-api.service[114371]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=114371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.368061 dv-cinder-839793-11-iscsi devstack@n-api.service[114371]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=114371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.368146 dv-cinder-839793-11-iscsi devstack@n-api.service[114370]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=114370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.368375 dv-cinder-839793-11-iscsi devstack@n-api.service[114371]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=114371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.368461 dv-cinder-839793-11-iscsi devstack@n-api.service[114370]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=114370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.368678 dv-cinder-839793-11-iscsi devstack@n-api.service[114371]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=114371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.368763 dv-cinder-839793-11-iscsi devstack@n-api.service[114370]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=114370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.368981 dv-cinder-839793-11-iscsi devstack@n-api.service[114371]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=114371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.369065 dv-cinder-839793-11-iscsi devstack@n-api.service[114370]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=114370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.369288 dv-cinder-839793-11-iscsi devstack@n-api.service[114370]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=114370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.369380 dv-cinder-839793-11-iscsi devstack@n-api.service[114371]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=114371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.369595 dv-cinder-839793-11-iscsi devstack@n-api.service[114370]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=114370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.369679 dv-cinder-839793-11-iscsi devstack@n-api.service[114371]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=114371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.369901 dv-cinder-839793-11-iscsi devstack@n-api.service[114371]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=114371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.369992 dv-cinder-839793-11-iscsi devstack@n-api.service[114370]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=114370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.370218 dv-cinder-839793-11-iscsi devstack@n-api.service[114370]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=114370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.370303 dv-cinder-839793-11-iscsi devstack@n-api.service[114371]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=114371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.370557 dv-cinder-839793-11-iscsi devstack@n-api.service[114370]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=114370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.370642 dv-cinder-839793-11-iscsi devstack@n-api.service[114371]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=114371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.370880 dv-cinder-839793-11-iscsi devstack@n-api.service[114370]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=114370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.370965 dv-cinder-839793-11-iscsi devstack@n-api.service[114371]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=114371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.371184 dv-cinder-839793-11-iscsi devstack@n-api.service[114371]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=114371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.371270 dv-cinder-839793-11-iscsi devstack@n-api.service[114370]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=114370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.371495 dv-cinder-839793-11-iscsi devstack@n-api.service[114371]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=114371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.371579 dv-cinder-839793-11-iscsi devstack@n-api.service[114370]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=114370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.371804 dv-cinder-839793-11-iscsi devstack@n-api.service[114371]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=114371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.371889 dv-cinder-839793-11-iscsi devstack@n-api.service[114370]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=114370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.372114 dv-cinder-839793-11-iscsi devstack@n-api.service[114370]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=114370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.372207 dv-cinder-839793-11-iscsi devstack@n-api.service[114371]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=114371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.372424 dv-cinder-839793-11-iscsi devstack@n-api.service[114371]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=114371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.372516 dv-cinder-839793-11-iscsi devstack@n-api.service[114370]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=114370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.372733 dv-cinder-839793-11-iscsi devstack@n-api.service[114370]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=114370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.372827 dv-cinder-839793-11-iscsi devstack@n-api.service[114371]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=114371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.373043 dv-cinder-839793-11-iscsi devstack@n-api.service[114371]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=114371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.373127 dv-cinder-839793-11-iscsi devstack@n-api.service[114370]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=114370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.373351 dv-cinder-839793-11-iscsi devstack@n-api.service[114370]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=114370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.373434 dv-cinder-839793-11-iscsi devstack@n-api.service[114371]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=114371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.373660 dv-cinder-839793-11-iscsi devstack@n-api.service[114371]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=114371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.373756 dv-cinder-839793-11-iscsi devstack@n-api.service[114370]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=114370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.373971 dv-cinder-839793-11-iscsi devstack@n-api.service[114370]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=114370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.374062 dv-cinder-839793-11-iscsi devstack@n-api.service[114371]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=114371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.374279 dv-cinder-839793-11-iscsi devstack@n-api.service[114371]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=114371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.374424 dv-cinder-839793-11-iscsi devstack@n-api.service[114370]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=114370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.374617 dv-cinder-839793-11-iscsi devstack@n-api.service[114370]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=114370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.374714 dv-cinder-839793-11-iscsi devstack@n-api.service[114371]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=114371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.374926 dv-cinder-839793-11-iscsi devstack@n-api.service[114371]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=114371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.375011 dv-cinder-839793-11-iscsi devstack@n-api.service[114370]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=114370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.375234 dv-cinder-839793-11-iscsi devstack@n-api.service[114370]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=114370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.375318 dv-cinder-839793-11-iscsi devstack@n-api.service[114371]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=114371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.375538 dv-cinder-839793-11-iscsi devstack@n-api.service[114371]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=114371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.375637 dv-cinder-839793-11-iscsi devstack@n-api.service[114370]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=114370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.375849 dv-cinder-839793-11-iscsi devstack@n-api.service[114370]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=114370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.375932 dv-cinder-839793-11-iscsi devstack@n-api.service[114371]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=114371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.376158 dv-cinder-839793-11-iscsi devstack@n-api.service[114370]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=114370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.376243 dv-cinder-839793-11-iscsi devstack@n-api.service[114371]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=114371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.376460 dv-cinder-839793-11-iscsi devstack@n-api.service[114371]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=114371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.376545 dv-cinder-839793-11-iscsi devstack@n-api.service[114370]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=114370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.376771 dv-cinder-839793-11-iscsi devstack@n-api.service[114371]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=114371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.376857 dv-cinder-839793-11-iscsi devstack@n-api.service[114370]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=114370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.377080 dv-cinder-839793-11-iscsi devstack@n-api.service[114371]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=114371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.377187 dv-cinder-839793-11-iscsi devstack@n-api.service[114370]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=114370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.377419 dv-cinder-839793-11-iscsi devstack@n-api.service[114370]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=114370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.377554 dv-cinder-839793-11-iscsi devstack@n-api.service[114371]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=114371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.377737 dv-cinder-839793-11-iscsi devstack@n-api.service[114371]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=114371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.377823 dv-cinder-839793-11-iscsi devstack@n-api.service[114370]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=114370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.378162 dv-cinder-839793-11-iscsi devstack@n-api.service[114371]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=114371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.378289 dv-cinder-839793-11-iscsi devstack@n-api.service[114370]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=114370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.378500 dv-cinder-839793-11-iscsi devstack@n-api.service[114371]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=114371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.378624 dv-cinder-839793-11-iscsi devstack@n-api.service[114370]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=114370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.378811 dv-cinder-839793-11-iscsi devstack@n-api.service[114371]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=114371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.379068 dv-cinder-839793-11-iscsi devstack@n-api.service[114370]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=114370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.379154 dv-cinder-839793-11-iscsi devstack@n-api.service[114371]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=114371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.379389 dv-cinder-839793-11-iscsi devstack@n-api.service[114370]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=114370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.379477 dv-cinder-839793-11-iscsi devstack@n-api.service[114371]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=114371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.379706 dv-cinder-839793-11-iscsi devstack@n-api.service[114370]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=114370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.379790 dv-cinder-839793-11-iscsi devstack@n-api.service[114371]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=114371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.380016 dv-cinder-839793-11-iscsi devstack@n-api.service[114370]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=114370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.380101 dv-cinder-839793-11-iscsi devstack@n-api.service[114371]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=114371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.380330 dv-cinder-839793-11-iscsi devstack@n-api.service[114371]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=114371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.380416 dv-cinder-839793-11-iscsi devstack@n-api.service[114370]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=114370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.380635 dv-cinder-839793-11-iscsi devstack@n-api.service[114371]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=114371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.380719 dv-cinder-839793-11-iscsi devstack@n-api.service[114370]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=114370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.380951 dv-cinder-839793-11-iscsi devstack@n-api.service[114370]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=114370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.381042 dv-cinder-839793-11-iscsi devstack@n-api.service[114371]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=114371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.381270 dv-cinder-839793-11-iscsi devstack@n-api.service[114370]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=114370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.381356 dv-cinder-839793-11-iscsi devstack@n-api.service[114371]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=114371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.381581 dv-cinder-839793-11-iscsi devstack@n-api.service[114370]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=114370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.381672 dv-cinder-839793-11-iscsi devstack@n-api.service[114371]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=114371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.381952 dv-cinder-839793-11-iscsi devstack@n-api.service[114371]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=114371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.382043 dv-cinder-839793-11-iscsi devstack@n-api.service[114370]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=114370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.382260 dv-cinder-839793-11-iscsi devstack@n-api.service[114371]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=114371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.382363 dv-cinder-839793-11-iscsi devstack@n-api.service[114370]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=114370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.382592 dv-cinder-839793-11-iscsi devstack@n-api.service[114371]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=114371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.382713 dv-cinder-839793-11-iscsi devstack@n-api.service[114370]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=114370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.382906 dv-cinder-839793-11-iscsi devstack@n-api.service[114371]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=114371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.383000 dv-cinder-839793-11-iscsi devstack@n-api.service[114370]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=114370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.383231 dv-cinder-839793-11-iscsi devstack@n-api.service[114370]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=114370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.383323 dv-cinder-839793-11-iscsi devstack@n-api.service[114371]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=114371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.383534 dv-cinder-839793-11-iscsi devstack@n-api.service[114371]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=114371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.383619 dv-cinder-839793-11-iscsi devstack@n-api.service[114370]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=114370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.383840 dv-cinder-839793-11-iscsi devstack@n-api.service[114371]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=114371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.383939 dv-cinder-839793-11-iscsi devstack@n-api.service[114370]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=114370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.384146 dv-cinder-839793-11-iscsi devstack@n-api.service[114371]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=114371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.384231 dv-cinder-839793-11-iscsi devstack@n-api.service[114370]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=114370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.384459 dv-cinder-839793-11-iscsi devstack@n-api.service[114370]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=114370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.384543 dv-cinder-839793-11-iscsi devstack@n-api.service[114371]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=114371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.384763 dv-cinder-839793-11-iscsi devstack@n-api.service[114371]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=114371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.384857 dv-cinder-839793-11-iscsi devstack@n-api.service[114370]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=114370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.385068 dv-cinder-839793-11-iscsi devstack@n-api.service[114370]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=114370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.385153 dv-cinder-839793-11-iscsi devstack@n-api.service[114371]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=114371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.385393 dv-cinder-839793-11-iscsi devstack@n-api.service[114370]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=114370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.385485 dv-cinder-839793-11-iscsi devstack@n-api.service[114371]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=114371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.385702 dv-cinder-839793-11-iscsi devstack@n-api.service[114370]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=114370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.385799 dv-cinder-839793-11-iscsi devstack@n-api.service[114371]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=114371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.386025 dv-cinder-839793-11-iscsi devstack@n-api.service[114370]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=114370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.386110 dv-cinder-839793-11-iscsi devstack@n-api.service[114371]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=114371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.386465 dv-cinder-839793-11-iscsi devstack@n-api.service[114370]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=114370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.386554 dv-cinder-839793-11-iscsi devstack@n-api.service[114371]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=114371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.386790 dv-cinder-839793-11-iscsi devstack@n-api.service[114370]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=114370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.386877 dv-cinder-839793-11-iscsi devstack@n-api.service[114371]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=114371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.387099 dv-cinder-839793-11-iscsi devstack@n-api.service[114370]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=114370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.387242 dv-cinder-839793-11-iscsi devstack@n-api.service[114371]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=114371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.387419 dv-cinder-839793-11-iscsi devstack@n-api.service[114371]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=114371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.387510 dv-cinder-839793-11-iscsi devstack@n-api.service[114370]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=114370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.387745 dv-cinder-839793-11-iscsi devstack@n-api.service[114371]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=114371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.387832 dv-cinder-839793-11-iscsi devstack@n-api.service[114370]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=114370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.388072 dv-cinder-839793-11-iscsi devstack@n-api.service[114371]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=114371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.388156 dv-cinder-839793-11-iscsi devstack@n-api.service[114370]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=114370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.388379 dv-cinder-839793-11-iscsi devstack@n-api.service[114371]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=114371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.388464 dv-cinder-839793-11-iscsi devstack@n-api.service[114370]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=114370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.388696 dv-cinder-839793-11-iscsi devstack@n-api.service[114371]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=114371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.388782 dv-cinder-839793-11-iscsi devstack@n-api.service[114370]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=114370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.389007 dv-cinder-839793-11-iscsi devstack@n-api.service[114371]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=114371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.389103 dv-cinder-839793-11-iscsi devstack@n-api.service[114370]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=114370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.389332 dv-cinder-839793-11-iscsi devstack@n-api.service[114371]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=114371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.389425 dv-cinder-839793-11-iscsi devstack@n-api.service[114370]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=114370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.389644 dv-cinder-839793-11-iscsi devstack@n-api.service[114370]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=114370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.389735 dv-cinder-839793-11-iscsi devstack@n-api.service[114371]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=114371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.389954 dv-cinder-839793-11-iscsi devstack@n-api.service[114371]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=114371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.390040 dv-cinder-839793-11-iscsi devstack@n-api.service[114370]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=114370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.390269 dv-cinder-839793-11-iscsi devstack@n-api.service[114371]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=114371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.390416 dv-cinder-839793-11-iscsi devstack@n-api.service[114370]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=114370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.390604 dv-cinder-839793-11-iscsi devstack@n-api.service[114371]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=114371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.390689 dv-cinder-839793-11-iscsi devstack@n-api.service[114370]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=114370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.390920 dv-cinder-839793-11-iscsi devstack@n-api.service[114370]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=114370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.391014 dv-cinder-839793-11-iscsi devstack@n-api.service[114371]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=114371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.391240 dv-cinder-839793-11-iscsi devstack@n-api.service[114370]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=114370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.391325 dv-cinder-839793-11-iscsi devstack@n-api.service[114371]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=114371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.391549 dv-cinder-839793-11-iscsi devstack@n-api.service[114370]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=114370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.391634 dv-cinder-839793-11-iscsi devstack@n-api.service[114371]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=114371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.391871 dv-cinder-839793-11-iscsi devstack@n-api.service[114371]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=114371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.391958 dv-cinder-839793-11-iscsi devstack@n-api.service[114370]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=114370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.392195 dv-cinder-839793-11-iscsi devstack@n-api.service[114370]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=114370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.392287 dv-cinder-839793-11-iscsi devstack@n-api.service[114371]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=114371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.392514 dv-cinder-839793-11-iscsi devstack@n-api.service[114370]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=114370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.392608 dv-cinder-839793-11-iscsi devstack@n-api.service[114371]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=114371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.392849 dv-cinder-839793-11-iscsi devstack@n-api.service[114370]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=114370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.392934 dv-cinder-839793-11-iscsi devstack@n-api.service[114371]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=114371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.393269 dv-cinder-839793-11-iscsi devstack@n-api.service[114371]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=114371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.393356 dv-cinder-839793-11-iscsi devstack@n-api.service[114370]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=114370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.393600 dv-cinder-839793-11-iscsi devstack@n-api.service[114371]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=114371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.393695 dv-cinder-839793-11-iscsi devstack@n-api.service[114370]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=114370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.393908 dv-cinder-839793-11-iscsi devstack@n-api.service[114371]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=114371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.393993 dv-cinder-839793-11-iscsi devstack@n-api.service[114370]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=114370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.394213 dv-cinder-839793-11-iscsi devstack@n-api.service[114371]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=114371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.394339 dv-cinder-839793-11-iscsi devstack@n-api.service[114370]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=114370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.394551 dv-cinder-839793-11-iscsi devstack@n-api.service[114371]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=114371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.394650 dv-cinder-839793-11-iscsi devstack@n-api.service[114370]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=114370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.394859 dv-cinder-839793-11-iscsi devstack@n-api.service[114371]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=114371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.394944 dv-cinder-839793-11-iscsi devstack@n-api.service[114370]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=114370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.395166 dv-cinder-839793-11-iscsi devstack@n-api.service[114371]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=114371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.395251 dv-cinder-839793-11-iscsi devstack@n-api.service[114370]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=114370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.395490 dv-cinder-839793-11-iscsi devstack@n-api.service[114371]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=114371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.395584 dv-cinder-839793-11-iscsi devstack@n-api.service[114370]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=114370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.395797 dv-cinder-839793-11-iscsi devstack@n-api.service[114371]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=114371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.395895 dv-cinder-839793-11-iscsi devstack@n-api.service[114370]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=114370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.396105 dv-cinder-839793-11-iscsi devstack@n-api.service[114370]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=114370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.396191 dv-cinder-839793-11-iscsi devstack@n-api.service[114371]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=114371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.396414 dv-cinder-839793-11-iscsi devstack@n-api.service[114371]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=114371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.396538 dv-cinder-839793-11-iscsi devstack@n-api.service[114370]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=114370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.396723 dv-cinder-839793-11-iscsi devstack@n-api.service[114371]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=114371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.396810 dv-cinder-839793-11-iscsi devstack@n-api.service[114370]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=114370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.397027 dv-cinder-839793-11-iscsi devstack@n-api.service[114371]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=114371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.397112 dv-cinder-839793-11-iscsi devstack@n-api.service[114370]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=114370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.397335 dv-cinder-839793-11-iscsi devstack@n-api.service[114371]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=114371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.397433 dv-cinder-839793-11-iscsi devstack@n-api.service[114370]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=114370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.397642 dv-cinder-839793-11-iscsi devstack@n-api.service[114370]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=114370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.397726 dv-cinder-839793-11-iscsi devstack@n-api.service[114371]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=114371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.397947 dv-cinder-839793-11-iscsi devstack@n-api.service[114371]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=114371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.398032 dv-cinder-839793-11-iscsi devstack@n-api.service[114370]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=114370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.398253 dv-cinder-839793-11-iscsi devstack@n-api.service[114370]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=114370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.398368 dv-cinder-839793-11-iscsi devstack@n-api.service[114371]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=114371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.398603 dv-cinder-839793-11-iscsi devstack@n-api.service[114370]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=114370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.398689 dv-cinder-839793-11-iscsi devstack@n-api.service[114371]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=114371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.398914 dv-cinder-839793-11-iscsi devstack@n-api.service[114370]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=114370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.399001 dv-cinder-839793-11-iscsi devstack@n-api.service[114371]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=114371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.399235 dv-cinder-839793-11-iscsi devstack@n-api.service[114371]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=114371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.399328 dv-cinder-839793-11-iscsi devstack@n-api.service[114370]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=114370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.399541 dv-cinder-839793-11-iscsi devstack@n-api.service[114371]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=114371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.399627 dv-cinder-839793-11-iscsi devstack@n-api.service[114370]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=114370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.399862 dv-cinder-839793-11-iscsi devstack@n-api.service[114370]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=114370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.399959 dv-cinder-839793-11-iscsi devstack@n-api.service[114371]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=114371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.400168 dv-cinder-839793-11-iscsi devstack@n-api.service[114371]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=114371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.400253 dv-cinder-839793-11-iscsi devstack@n-api.service[114370]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=114370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.400471 dv-cinder-839793-11-iscsi devstack@n-api.service[114371]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=114371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.400559 dv-cinder-839793-11-iscsi devstack@n-api.service[114370]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=114370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.400778 dv-cinder-839793-11-iscsi devstack@n-api.service[114371]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=114371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.400874 dv-cinder-839793-11-iscsi devstack@n-api.service[114370]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=114370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.401082 dv-cinder-839793-11-iscsi devstack@n-api.service[114371]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=114371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.401174 dv-cinder-839793-11-iscsi devstack@n-api.service[114370]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=114370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.401387 dv-cinder-839793-11-iscsi devstack@n-api.service[114370]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=114370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.401473 dv-cinder-839793-11-iscsi devstack@n-api.service[114371]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=114371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.401696 dv-cinder-839793-11-iscsi devstack@n-api.service[114370]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=114370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.401795 dv-cinder-839793-11-iscsi devstack@n-api.service[114371]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=114371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.402004 dv-cinder-839793-11-iscsi devstack@n-api.service[114370]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=114370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.402089 dv-cinder-839793-11-iscsi devstack@n-api.service[114371]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=114371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.402361 dv-cinder-839793-11-iscsi devstack@n-api.service[114371]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=114371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.402461 dv-cinder-839793-11-iscsi devstack@n-api.service[114370]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=114370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.402674 dv-cinder-839793-11-iscsi devstack@n-api.service[114370]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=114370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.402771 dv-cinder-839793-11-iscsi devstack@n-api.service[114371]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=114371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.402991 dv-cinder-839793-11-iscsi devstack@n-api.service[114371]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=114371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.403084 dv-cinder-839793-11-iscsi devstack@n-api.service[114370]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=114370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.403321 dv-cinder-839793-11-iscsi devstack@n-api.service[114370]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=114370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.403406 dv-cinder-839793-11-iscsi devstack@n-api.service[114371]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=114371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.403649 dv-cinder-839793-11-iscsi devstack@n-api.service[114371]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=114371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.403737 dv-cinder-839793-11-iscsi devstack@n-api.service[114370]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=114370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.403959 dv-cinder-839793-11-iscsi devstack@n-api.service[114370]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=114370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.404043 dv-cinder-839793-11-iscsi devstack@n-api.service[114371]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=114371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.404276 dv-cinder-839793-11-iscsi devstack@n-api.service[114371]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=114371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.404360 dv-cinder-839793-11-iscsi devstack@n-api.service[114370]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=114370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.404602 dv-cinder-839793-11-iscsi devstack@n-api.service[114371]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=114371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.404688 dv-cinder-839793-11-iscsi devstack@n-api.service[114370]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=114370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.404907 dv-cinder-839793-11-iscsi devstack@n-api.service[114371]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=114371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.404992 dv-cinder-839793-11-iscsi devstack@n-api.service[114370]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=114370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.405210 dv-cinder-839793-11-iscsi devstack@n-api.service[114371]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=114371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.405303 dv-cinder-839793-11-iscsi devstack@n-api.service[114370]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=114370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.405523 dv-cinder-839793-11-iscsi devstack@n-api.service[114371]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=114371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.405611 dv-cinder-839793-11-iscsi devstack@n-api.service[114370]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=114370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.405828 dv-cinder-839793-11-iscsi devstack@n-api.service[114371]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=114371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.405913 dv-cinder-839793-11-iscsi devstack@n-api.service[114370]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=114370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.406132 dv-cinder-839793-11-iscsi devstack@n-api.service[114370]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=114370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.406227 dv-cinder-839793-11-iscsi devstack@n-api.service[114371]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=114371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.406466 dv-cinder-839793-11-iscsi devstack@n-api.service[114371]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=114371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.406563 dv-cinder-839793-11-iscsi devstack@n-api.service[114370]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=114370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.406776 dv-cinder-839793-11-iscsi devstack@n-api.service[114370]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=114370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.406860 dv-cinder-839793-11-iscsi devstack@n-api.service[114371]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=114371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.407075 dv-cinder-839793-11-iscsi devstack@n-api.service[114371]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=114371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.407167 dv-cinder-839793-11-iscsi devstack@n-api.service[114370]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=114370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.407382 dv-cinder-839793-11-iscsi devstack@n-api.service[114371]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=114371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.407493 dv-cinder-839793-11-iscsi devstack@n-api.service[114370]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=114370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.407687 dv-cinder-839793-11-iscsi devstack@n-api.service[114371]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=114371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.407779 dv-cinder-839793-11-iscsi devstack@n-api.service[114370]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=114370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.407991 dv-cinder-839793-11-iscsi devstack@n-api.service[114370]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=114370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.408097 dv-cinder-839793-11-iscsi devstack@n-api.service[114371]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=114371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.408295 dv-cinder-839793-11-iscsi devstack@n-api.service[114371]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=114371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.408394 dv-cinder-839793-11-iscsi devstack@n-api.service[114370]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=114370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.408598 dv-cinder-839793-11-iscsi devstack@n-api.service[114370]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=114370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.409202 dv-cinder-839793-11-iscsi devstack@n-api.service[114371]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=114371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.409424 dv-cinder-839793-11-iscsi devstack@n-api.service[114371]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=114371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.409563 dv-cinder-839793-11-iscsi devstack@n-api.service[114370]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=114370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.409730 dv-cinder-839793-11-iscsi devstack@n-api.service[114371]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=114371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.409824 dv-cinder-839793-11-iscsi devstack@n-api.service[114370]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=114370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.410037 dv-cinder-839793-11-iscsi devstack@n-api.service[114371]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=114371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.410130 dv-cinder-839793-11-iscsi devstack@n-api.service[114370]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=114370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.410359 dv-cinder-839793-11-iscsi devstack@n-api.service[114371]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=114371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.410451 dv-cinder-839793-11-iscsi devstack@n-api.service[114370]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=114370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.410686 dv-cinder-839793-11-iscsi devstack@n-api.service[114370]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=114370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.410782 dv-cinder-839793-11-iscsi devstack@n-api.service[114371]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=114371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.410994 dv-cinder-839793-11-iscsi devstack@n-api.service[114371]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=114371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.411078 dv-cinder-839793-11-iscsi devstack@n-api.service[114370]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=114370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.411298 dv-cinder-839793-11-iscsi devstack@n-api.service[114370]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=114370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.411393 dv-cinder-839793-11-iscsi devstack@n-api.service[114371]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=114371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.411631 dv-cinder-839793-11-iscsi devstack@n-api.service[114371]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=114371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.411716 dv-cinder-839793-11-iscsi devstack@n-api.service[114370]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=114370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.411937 dv-cinder-839793-11-iscsi devstack@n-api.service[114370]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=114370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.412023 dv-cinder-839793-11-iscsi devstack@n-api.service[114371]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=114371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.412267 dv-cinder-839793-11-iscsi devstack@n-api.service[114371]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=114371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.412354 dv-cinder-839793-11-iscsi devstack@n-api.service[114370]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=114370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.412579 dv-cinder-839793-11-iscsi devstack@n-api.service[114371]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=114371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.412668 dv-cinder-839793-11-iscsi devstack@n-api.service[114370]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=114370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.412901 dv-cinder-839793-11-iscsi devstack@n-api.service[114370]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=114370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.412985 dv-cinder-839793-11-iscsi devstack@n-api.service[114371]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=114371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.413215 dv-cinder-839793-11-iscsi devstack@n-api.service[114371]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=114371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.413301 dv-cinder-839793-11-iscsi devstack@n-api.service[114370]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=114370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.413528 dv-cinder-839793-11-iscsi devstack@n-api.service[114370]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=114370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.413612 dv-cinder-839793-11-iscsi devstack@n-api.service[114371]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=114371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.413853 dv-cinder-839793-11-iscsi devstack@n-api.service[114371]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=114371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.413939 dv-cinder-839793-11-iscsi devstack@n-api.service[114370]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=114370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.414170 dv-cinder-839793-11-iscsi devstack@n-api.service[114370]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=114370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.414262 dv-cinder-839793-11-iscsi devstack@n-api.service[114371]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=114371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.414515 dv-cinder-839793-11-iscsi devstack@n-api.service[114370]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=114370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.414601 dv-cinder-839793-11-iscsi devstack@n-api.service[114371]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=114371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.414833 dv-cinder-839793-11-iscsi devstack@n-api.service[114371]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=114371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.414929 dv-cinder-839793-11-iscsi devstack@n-api.service[114370]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=114370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.415149 dv-cinder-839793-11-iscsi devstack@n-api.service[114370]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=114370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.415233 dv-cinder-839793-11-iscsi devstack@n-api.service[114371]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=114371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.415459 dv-cinder-839793-11-iscsi devstack@n-api.service[114371]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=114371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.415555 dv-cinder-839793-11-iscsi devstack@n-api.service[114370]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=114370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.415776 dv-cinder-839793-11-iscsi devstack@n-api.service[114371]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=114371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.415870 dv-cinder-839793-11-iscsi devstack@n-api.service[114370]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=114370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.416092 dv-cinder-839793-11-iscsi devstack@n-api.service[114370]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=114370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.416185 dv-cinder-839793-11-iscsi devstack@n-api.service[114371]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=114371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.416409 dv-cinder-839793-11-iscsi devstack@n-api.service[114370]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=114370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.416495 dv-cinder-839793-11-iscsi devstack@n-api.service[114371]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=114371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.416727 dv-cinder-839793-11-iscsi devstack@n-api.service[114370]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=114370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.416933 dv-cinder-839793-11-iscsi devstack@n-api.service[114371]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=114371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.417053 dv-cinder-839793-11-iscsi devstack@n-api.service[114370]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=114370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.417266 dv-cinder-839793-11-iscsi devstack@n-api.service[114371]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=114371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.417374 dv-cinder-839793-11-iscsi devstack@n-api.service[114370]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=114370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.417598 dv-cinder-839793-11-iscsi devstack@n-api.service[114371]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=114371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.417885 dv-cinder-839793-11-iscsi devstack@n-api.service[114371]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=114371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.417980 dv-cinder-839793-11-iscsi devstack@n-api.service[114370]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=114370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.418200 dv-cinder-839793-11-iscsi devstack@n-api.service[114371]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=114371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.418298 dv-cinder-839793-11-iscsi devstack@n-api.service[114370]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=114370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.418542 dv-cinder-839793-11-iscsi devstack@n-api.service[114371]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=114371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.418629 dv-cinder-839793-11-iscsi devstack@n-api.service[114370]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=114370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.418857 dv-cinder-839793-11-iscsi devstack@n-api.service[114370]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=114370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.418951 dv-cinder-839793-11-iscsi devstack@n-api.service[114371]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=114371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.419170 dv-cinder-839793-11-iscsi devstack@n-api.service[114371]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=114371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.419257 dv-cinder-839793-11-iscsi devstack@n-api.service[114370]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=114370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.419483 dv-cinder-839793-11-iscsi devstack@n-api.service[114371]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=114371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.419570 dv-cinder-839793-11-iscsi devstack@n-api.service[114370]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=114370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.419794 dv-cinder-839793-11-iscsi devstack@n-api.service[114371]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=114371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.419881 dv-cinder-839793-11-iscsi devstack@n-api.service[114370]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=114370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.420105 dv-cinder-839793-11-iscsi devstack@n-api.service[114371]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=114371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.420197 dv-cinder-839793-11-iscsi devstack@n-api.service[114370]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=114370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.420417 dv-cinder-839793-11-iscsi devstack@n-api.service[114370]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=114370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.420501 dv-cinder-839793-11-iscsi devstack@n-api.service[114371]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=114371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.420730 dv-cinder-839793-11-iscsi devstack@n-api.service[114370]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=114370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.420833 dv-cinder-839793-11-iscsi devstack@n-api.service[114371]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=114371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.421044 dv-cinder-839793-11-iscsi devstack@n-api.service[114370]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=114370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.421137 dv-cinder-839793-11-iscsi devstack@n-api.service[114371]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=114371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.421373 dv-cinder-839793-11-iscsi devstack@n-api.service[114370]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=114370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.421468 dv-cinder-839793-11-iscsi devstack@n-api.service[114371]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=114371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.421689 dv-cinder-839793-11-iscsi devstack@n-api.service[114371]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=114371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.421775 dv-cinder-839793-11-iscsi devstack@n-api.service[114370]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=114370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.422006 dv-cinder-839793-11-iscsi devstack@n-api.service[114371]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=114371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.422090 dv-cinder-839793-11-iscsi devstack@n-api.service[114370]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=114370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.422334 dv-cinder-839793-11-iscsi devstack@n-api.service[114371]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=114371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.422436 dv-cinder-839793-11-iscsi devstack@n-api.service[114370]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=114370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.422661 dv-cinder-839793-11-iscsi devstack@n-api.service[114371]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=114371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.422747 dv-cinder-839793-11-iscsi devstack@n-api.service[114370]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=114370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.422980 dv-cinder-839793-11-iscsi devstack@n-api.service[114370]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=114370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.423064 dv-cinder-839793-11-iscsi devstack@n-api.service[114371]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=114371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.423299 dv-cinder-839793-11-iscsi devstack@n-api.service[114370]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=114370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.423386 dv-cinder-839793-11-iscsi devstack@n-api.service[114371]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=114371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.423614 dv-cinder-839793-11-iscsi devstack@n-api.service[114371]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=114371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.423698 dv-cinder-839793-11-iscsi devstack@n-api.service[114370]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=114370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.423931 dv-cinder-839793-11-iscsi devstack@n-api.service[114371]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=114371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.424023 dv-cinder-839793-11-iscsi devstack@n-api.service[114370]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=114370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.424268 dv-cinder-839793-11-iscsi devstack@n-api.service[114371]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=114371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.424391 dv-cinder-839793-11-iscsi devstack@n-api.service[114370]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=114370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.425104 dv-cinder-839793-11-iscsi devstack@n-api.service[114371]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=114371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.425186 dv-cinder-839793-11-iscsi devstack@n-api.service[114370]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=114370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.425421 dv-cinder-839793-11-iscsi devstack@n-api.service[114370]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=114370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.425587 dv-cinder-839793-11-iscsi devstack@n-api.service[114371]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=114371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.425740 dv-cinder-839793-11-iscsi devstack@n-api.service[114370]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=114370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.425904 dv-cinder-839793-11-iscsi devstack@n-api.service[114371]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=114371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.426060 dv-cinder-839793-11-iscsi devstack@n-api.service[114370]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=114370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.426221 dv-cinder-839793-11-iscsi devstack@n-api.service[114371]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=114371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.426395 dv-cinder-839793-11-iscsi devstack@n-api.service[114370]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=114370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.426570 dv-cinder-839793-11-iscsi devstack@n-api.service[114371]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=114371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.426710 dv-cinder-839793-11-iscsi devstack@n-api.service[114370]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=114370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.426886 dv-cinder-839793-11-iscsi devstack@n-api.service[114371]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=114371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.427032 dv-cinder-839793-11-iscsi devstack@n-api.service[114370]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=114370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.427199 dv-cinder-839793-11-iscsi devstack@n-api.service[114371]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=114371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.427348 dv-cinder-839793-11-iscsi devstack@n-api.service[114370]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=114370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.427515 dv-cinder-839793-11-iscsi devstack@n-api.service[114371]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=114371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.427666 dv-cinder-839793-11-iscsi devstack@n-api.service[114370]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=114370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.427836 dv-cinder-839793-11-iscsi devstack@n-api.service[114371]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=114371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.427977 dv-cinder-839793-11-iscsi devstack@n-api.service[114370]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=114370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.428160 dv-cinder-839793-11-iscsi devstack@n-api.service[114371]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=114371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.428294 dv-cinder-839793-11-iscsi devstack@n-api.service[114370]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=114370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.428500 dv-cinder-839793-11-iscsi devstack@n-api.service[114371]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=114371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.428605 dv-cinder-839793-11-iscsi devstack@n-api.service[114370]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=114370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.428824 dv-cinder-839793-11-iscsi devstack@n-api.service[114371]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=114371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.428921 dv-cinder-839793-11-iscsi devstack@n-api.service[114370]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=114370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.429140 dv-cinder-839793-11-iscsi devstack@n-api.service[114371]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=114371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.429247 dv-cinder-839793-11-iscsi devstack@n-api.service[114370]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=114370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.429454 dv-cinder-839793-11-iscsi devstack@n-api.service[114371]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=114371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.429557 dv-cinder-839793-11-iscsi devstack@n-api.service[114370]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=114370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.429770 dv-cinder-839793-11-iscsi devstack@n-api.service[114371]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=114371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.429872 dv-cinder-839793-11-iscsi devstack@n-api.service[114370]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=114370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.430153 dv-cinder-839793-11-iscsi devstack@n-api.service[114370]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=114370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.430295 dv-cinder-839793-11-iscsi devstack@n-api.service[114371]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=114371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.430496 dv-cinder-839793-11-iscsi devstack@n-api.service[114370]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=114370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.430638 dv-cinder-839793-11-iscsi devstack@n-api.service[114371]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=114371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.430974 dv-cinder-839793-11-iscsi devstack@n-api.service[114371]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=114371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.431059 dv-cinder-839793-11-iscsi devstack@n-api.service[114370]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=114370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.431302 dv-cinder-839793-11-iscsi devstack@n-api.service[114371]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=114371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.431400 dv-cinder-839793-11-iscsi devstack@n-api.service[114370]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=114370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.431629 dv-cinder-839793-11-iscsi devstack@n-api.service[114371]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=114371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.431715 dv-cinder-839793-11-iscsi devstack@n-api.service[114370]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=114370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.431947 dv-cinder-839793-11-iscsi devstack@n-api.service[114371]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=114371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.432032 dv-cinder-839793-11-iscsi devstack@n-api.service[114370]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=114370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.432267 dv-cinder-839793-11-iscsi devstack@n-api.service[114371]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=114371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.432354 dv-cinder-839793-11-iscsi devstack@n-api.service[114370]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=114370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.432585 dv-cinder-839793-11-iscsi devstack@n-api.service[114370]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=114370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.432669 dv-cinder-839793-11-iscsi devstack@n-api.service[114371]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=114371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.432889 dv-cinder-839793-11-iscsi devstack@n-api.service[114371]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=114371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.432973 dv-cinder-839793-11-iscsi devstack@n-api.service[114370]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=114370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.433195 dv-cinder-839793-11-iscsi devstack@n-api.service[114371]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=114371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.433282 dv-cinder-839793-11-iscsi devstack@n-api.service[114370]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=114370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.433508 dv-cinder-839793-11-iscsi devstack@n-api.service[114371]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=114371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.433592 dv-cinder-839793-11-iscsi devstack@n-api.service[114370]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=114370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.433813 dv-cinder-839793-11-iscsi devstack@n-api.service[114370]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=114370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.433896 dv-cinder-839793-11-iscsi devstack@n-api.service[114371]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=114371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.434113 dv-cinder-839793-11-iscsi devstack@n-api.service[114371]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=114371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.434199 dv-cinder-839793-11-iscsi devstack@n-api.service[114370]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=114370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.434447 dv-cinder-839793-11-iscsi devstack@n-api.service[114370]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=114370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.434547 dv-cinder-839793-11-iscsi devstack@n-api.service[114371]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=114371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.434757 dv-cinder-839793-11-iscsi devstack@n-api.service[114370]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=114370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.434844 dv-cinder-839793-11-iscsi devstack@n-api.service[114371]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=114371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.435058 dv-cinder-839793-11-iscsi devstack@n-api.service[114371]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=114371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.435144 dv-cinder-839793-11-iscsi devstack@n-api.service[114370]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=114370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.435379 dv-cinder-839793-11-iscsi devstack@n-api.service[114371]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=114371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.435471 dv-cinder-839793-11-iscsi devstack@n-api.service[114370]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=114370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.435682 dv-cinder-839793-11-iscsi devstack@n-api.service[114370]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=114370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.435780 dv-cinder-839793-11-iscsi devstack@n-api.service[114371]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=114371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.436004 dv-cinder-839793-11-iscsi devstack@n-api.service[114370]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=114370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.436213 dv-cinder-839793-11-iscsi devstack@n-api.service[114371]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=114371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.436299 dv-cinder-839793-11-iscsi devstack@n-api.service[114370]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=114370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.436564 dv-cinder-839793-11-iscsi devstack@n-api.service[114371]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=114371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.436849 dv-cinder-839793-11-iscsi devstack@n-api.service[114370]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=114370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.436987 dv-cinder-839793-11-iscsi devstack@n-api.service[114371]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=114371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.437193 dv-cinder-839793-11-iscsi devstack@n-api.service[114371]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=114371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.437287 dv-cinder-839793-11-iscsi devstack@n-api.service[114370]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=114370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.437515 dv-cinder-839793-11-iscsi devstack@n-api.service[114370]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=114370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.437599 dv-cinder-839793-11-iscsi devstack@n-api.service[114371]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=114371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.437830 dv-cinder-839793-11-iscsi devstack@n-api.service[114371]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=114371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.437940 dv-cinder-839793-11-iscsi devstack@n-api.service[114370]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=114370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.438135 dv-cinder-839793-11-iscsi devstack@n-api.service[114371]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=114371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.438221 dv-cinder-839793-11-iscsi devstack@n-api.service[114370]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=114370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.438483 dv-cinder-839793-11-iscsi devstack@n-api.service[114371]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=114371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.438587 dv-cinder-839793-11-iscsi devstack@n-api.service[114370]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=114370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.438792 dv-cinder-839793-11-iscsi devstack@n-api.service[114371]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=114371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.438888 dv-cinder-839793-11-iscsi devstack@n-api.service[114370]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=114370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.439096 dv-cinder-839793-11-iscsi devstack@n-api.service[114371]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=114371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.439190 dv-cinder-839793-11-iscsi devstack@n-api.service[114370]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=114370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.439414 dv-cinder-839793-11-iscsi devstack@n-api.service[114370]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=114370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.439505 dv-cinder-839793-11-iscsi devstack@n-api.service[114371]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=114371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.439724 dv-cinder-839793-11-iscsi devstack@n-api.service[114371]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=114371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.439810 dv-cinder-839793-11-iscsi devstack@n-api.service[114370]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=114370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.440065 dv-cinder-839793-11-iscsi devstack@n-api.service[114371]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=114371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.440166 dv-cinder-839793-11-iscsi devstack@n-api.service[114370]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=114370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.440368 dv-cinder-839793-11-iscsi devstack@n-api.service[114371]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=114371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.440655 dv-cinder-839793-11-iscsi devstack@n-api.service[114370]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=114370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.440749 dv-cinder-839793-11-iscsi devstack@n-api.service[114371]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=114371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.440974 dv-cinder-839793-11-iscsi devstack@n-api.service[114371]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=114371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.441058 dv-cinder-839793-11-iscsi devstack@n-api.service[114370]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=114370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.441277 dv-cinder-839793-11-iscsi devstack@n-api.service[114371]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=114371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.441363 dv-cinder-839793-11-iscsi devstack@n-api.service[114370]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=114370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.441586 dv-cinder-839793-11-iscsi devstack@n-api.service[114371]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=114371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.441682 dv-cinder-839793-11-iscsi devstack@n-api.service[114370]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=114370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.441890 dv-cinder-839793-11-iscsi devstack@n-api.service[114371]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=114371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.441976 dv-cinder-839793-11-iscsi devstack@n-api.service[114370]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=114370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.442198 dv-cinder-839793-11-iscsi devstack@n-api.service[114370]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=114370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.442282 dv-cinder-839793-11-iscsi devstack@n-api.service[114371]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=114371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.442530 dv-cinder-839793-11-iscsi devstack@n-api.service[114371]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=114371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.442618 dv-cinder-839793-11-iscsi devstack@n-api.service[114370]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=114370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.442836 dv-cinder-839793-11-iscsi devstack@n-api.service[114371]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=114371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.442922 dv-cinder-839793-11-iscsi devstack@n-api.service[114370]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=114370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.443140 dv-cinder-839793-11-iscsi devstack@n-api.service[114371]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=114371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.443226 dv-cinder-839793-11-iscsi devstack@n-api.service[114370]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=114370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.443449 dv-cinder-839793-11-iscsi devstack@n-api.service[114371]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=114371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.443536 dv-cinder-839793-11-iscsi devstack@n-api.service[114370]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=114370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.443753 dv-cinder-839793-11-iscsi devstack@n-api.service[114371]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=114371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.443845 dv-cinder-839793-11-iscsi devstack@n-api.service[114370]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=114370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.444055 dv-cinder-839793-11-iscsi devstack@n-api.service[114371]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=114371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.444141 dv-cinder-839793-11-iscsi devstack@n-api.service[114370]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=114370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.444362 dv-cinder-839793-11-iscsi devstack@n-api.service[114371]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=114371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.444449 dv-cinder-839793-11-iscsi devstack@n-api.service[114370]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=114370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.444664 dv-cinder-839793-11-iscsi devstack@n-api.service[114371]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=114371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.444749 dv-cinder-839793-11-iscsi devstack@n-api.service[114370]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=114370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.444970 dv-cinder-839793-11-iscsi devstack@n-api.service[114370]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=114370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.445054 dv-cinder-839793-11-iscsi devstack@n-api.service[114371]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=114371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.445272 dv-cinder-839793-11-iscsi devstack@n-api.service[114371]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=114371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.445367 dv-cinder-839793-11-iscsi devstack@n-api.service[114370]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=114370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.445575 dv-cinder-839793-11-iscsi devstack@n-api.service[114370]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=114370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.445660 dv-cinder-839793-11-iscsi devstack@n-api.service[114371]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=114371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.445877 dv-cinder-839793-11-iscsi devstack@n-api.service[114371]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=114371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.445972 dv-cinder-839793-11-iscsi devstack@n-api.service[114370]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=114370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.446187 dv-cinder-839793-11-iscsi devstack@n-api.service[114371]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=114371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.446272 dv-cinder-839793-11-iscsi devstack@n-api.service[114370]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=114370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.446522 dv-cinder-839793-11-iscsi devstack@n-api.service[114370]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=114370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.446617 dv-cinder-839793-11-iscsi devstack@n-api.service[114371]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=114371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.446829 dv-cinder-839793-11-iscsi devstack@n-api.service[114371]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=114371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.446922 dv-cinder-839793-11-iscsi devstack@n-api.service[114370]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=114370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.447146 dv-cinder-839793-11-iscsi devstack@n-api.service[114370]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=114370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.447231 dv-cinder-839793-11-iscsi devstack@n-api.service[114371]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=114371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.447457 dv-cinder-839793-11-iscsi devstack@n-api.service[114370]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=114370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.447544 dv-cinder-839793-11-iscsi devstack@n-api.service[114371]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=114371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.447769 dv-cinder-839793-11-iscsi devstack@n-api.service[114370]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=114370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.447877 dv-cinder-839793-11-iscsi devstack@n-api.service[114371]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=114371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.448073 dv-cinder-839793-11-iscsi devstack@n-api.service[114371]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=114371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.448169 dv-cinder-839793-11-iscsi devstack@n-api.service[114370]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=114370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.448387 dv-cinder-839793-11-iscsi devstack@n-api.service[114371]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=114371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.448479 dv-cinder-839793-11-iscsi devstack@n-api.service[114370]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=114370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.448709 dv-cinder-839793-11-iscsi devstack@n-api.service[114371]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=114371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.448817 dv-cinder-839793-11-iscsi devstack@n-api.service[114370]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=114370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.449024 dv-cinder-839793-11-iscsi devstack@n-api.service[114370]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=114370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.449119 dv-cinder-839793-11-iscsi devstack@n-api.service[114371]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=114371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.449331 dv-cinder-839793-11-iscsi devstack@n-api.service[114371]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=114371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.449422 dv-cinder-839793-11-iscsi devstack@n-api.service[114370]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=114370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.449642 dv-cinder-839793-11-iscsi devstack@n-api.service[114371]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=114371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.449740 dv-cinder-839793-11-iscsi devstack@n-api.service[114370]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=114370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.449965 dv-cinder-839793-11-iscsi devstack@n-api.service[114370]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=114370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.450050 dv-cinder-839793-11-iscsi devstack@n-api.service[114371]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=114371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.450283 dv-cinder-839793-11-iscsi devstack@n-api.service[114370]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=114370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.450433 dv-cinder-839793-11-iscsi devstack@n-api.service[114371]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=114371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.450624 dv-cinder-839793-11-iscsi devstack@n-api.service[114370]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=114370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.450847 dv-cinder-839793-11-iscsi devstack@n-api.service[114371]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=114371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.450985 dv-cinder-839793-11-iscsi devstack@n-api.service[114370]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=114370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.451182 dv-cinder-839793-11-iscsi devstack@n-api.service[114371]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=114371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.451305 dv-cinder-839793-11-iscsi devstack@n-api.service[114370]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=114370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.451502 dv-cinder-839793-11-iscsi devstack@n-api.service[114371]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=114371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.451835 dv-cinder-839793-11-iscsi devstack@n-api.service[114371]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=114371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.451929 dv-cinder-839793-11-iscsi devstack@n-api.service[114370]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=114370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.452166 dv-cinder-839793-11-iscsi devstack@n-api.service[114371]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=114371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.452252 dv-cinder-839793-11-iscsi devstack@n-api.service[114370]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=114370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.452475 dv-cinder-839793-11-iscsi devstack@n-api.service[114371]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=114371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.452560 dv-cinder-839793-11-iscsi devstack@n-api.service[114370]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=114370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.452782 dv-cinder-839793-11-iscsi devstack@n-api.service[114371]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=114371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.452878 dv-cinder-839793-11-iscsi devstack@n-api.service[114370]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=114370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.453089 dv-cinder-839793-11-iscsi devstack@n-api.service[114371]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=114371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.453175 dv-cinder-839793-11-iscsi devstack@n-api.service[114370]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=114370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.453415 dv-cinder-839793-11-iscsi devstack@n-api.service[114371]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=114371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.453508 dv-cinder-839793-11-iscsi devstack@n-api.service[114370]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=114370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.453723 dv-cinder-839793-11-iscsi devstack@n-api.service[114370]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=114370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.453807 dv-cinder-839793-11-iscsi devstack@n-api.service[114371]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=114371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.454032 dv-cinder-839793-11-iscsi devstack@n-api.service[114371]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=114371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.454118 dv-cinder-839793-11-iscsi devstack@n-api.service[114370]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=114370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.454364 dv-cinder-839793-11-iscsi devstack@n-api.service[114371]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=114371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.454535 dv-cinder-839793-11-iscsi devstack@n-api.service[114370]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=114370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.454680 dv-cinder-839793-11-iscsi devstack@n-api.service[114371]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=114371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.454769 dv-cinder-839793-11-iscsi devstack@n-api.service[114370]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=114370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.454990 dv-cinder-839793-11-iscsi devstack@n-api.service[114371]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=114371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.455076 dv-cinder-839793-11-iscsi devstack@n-api.service[114370]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=114370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.455300 dv-cinder-839793-11-iscsi devstack@n-api.service[114371]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=114371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.455398 dv-cinder-839793-11-iscsi devstack@n-api.service[114370]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=114370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.455657 dv-cinder-839793-11-iscsi devstack@n-api.service[114370]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=114370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.455756 dv-cinder-839793-11-iscsi devstack@n-api.service[114371]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=114371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.455975 dv-cinder-839793-11-iscsi devstack@n-api.service[114370]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=114370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.456058 dv-cinder-839793-11-iscsi devstack@n-api.service[114371]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=114371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.456284 dv-cinder-839793-11-iscsi devstack@n-api.service[114371]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=114371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.456378 dv-cinder-839793-11-iscsi devstack@n-api.service[114370]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=114370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.456595 dv-cinder-839793-11-iscsi devstack@n-api.service[114370]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=114370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.456692 dv-cinder-839793-11-iscsi devstack@n-api.service[114371]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=114371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.456906 dv-cinder-839793-11-iscsi devstack@n-api.service[114371]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=114371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.456999 dv-cinder-839793-11-iscsi devstack@n-api.service[114370]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=114370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.457218 dv-cinder-839793-11-iscsi devstack@n-api.service[114371]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=114371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.457304 dv-cinder-839793-11-iscsi devstack@n-api.service[114370]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=114370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.457527 dv-cinder-839793-11-iscsi devstack@n-api.service[114370]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=114370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.457611 dv-cinder-839793-11-iscsi devstack@n-api.service[114371]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=114371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.457842 dv-cinder-839793-11-iscsi devstack@n-api.service[114370]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=114370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.457974 dv-cinder-839793-11-iscsi devstack@n-api.service[114371]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=114371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.458157 dv-cinder-839793-11-iscsi devstack@n-api.service[114370]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=114370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.458253 dv-cinder-839793-11-iscsi devstack@n-api.service[114371]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=114371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.458500 dv-cinder-839793-11-iscsi devstack@n-api.service[114370]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=114370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.458588 dv-cinder-839793-11-iscsi devstack@n-api.service[114371]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=114371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.458814 dv-cinder-839793-11-iscsi devstack@n-api.service[114371]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=114371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.458898 dv-cinder-839793-11-iscsi devstack@n-api.service[114370]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=114370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.459132 dv-cinder-839793-11-iscsi devstack@n-api.service[114371]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=114371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.459230 dv-cinder-839793-11-iscsi devstack@n-api.service[114370]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=114370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.459441 dv-cinder-839793-11-iscsi devstack@n-api.service[114371]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=114371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.459526 dv-cinder-839793-11-iscsi devstack@n-api.service[114370]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=114370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.459750 dv-cinder-839793-11-iscsi devstack@n-api.service[114371]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=114371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.459849 dv-cinder-839793-11-iscsi devstack@n-api.service[114370]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=114370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.460059 dv-cinder-839793-11-iscsi devstack@n-api.service[114371]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=114371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.460146 dv-cinder-839793-11-iscsi devstack@n-api.service[114370]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=114370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.460368 dv-cinder-839793-11-iscsi devstack@n-api.service[114371]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=114371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.460453 dv-cinder-839793-11-iscsi devstack@n-api.service[114370]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=114370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.460678 dv-cinder-839793-11-iscsi devstack@n-api.service[114370]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=114370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.460771 dv-cinder-839793-11-iscsi devstack@n-api.service[114371]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=114371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.460992 dv-cinder-839793-11-iscsi devstack@n-api.service[114370]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=114370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.461084 dv-cinder-839793-11-iscsi devstack@n-api.service[114371]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=114371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.461303 dv-cinder-839793-11-iscsi devstack@n-api.service[114371]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=114371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.461388 dv-cinder-839793-11-iscsi devstack@n-api.service[114370]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=114370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.461609 dv-cinder-839793-11-iscsi devstack@n-api.service[114371]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=114371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.461703 dv-cinder-839793-11-iscsi devstack@n-api.service[114370]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=114370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.461939 dv-cinder-839793-11-iscsi devstack@n-api.service[114370]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=114370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.462032 dv-cinder-839793-11-iscsi devstack@n-api.service[114371]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=114371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.462258 dv-cinder-839793-11-iscsi devstack@n-api.service[114370]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=114370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.462378 dv-cinder-839793-11-iscsi devstack@n-api.service[114371]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=114371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.462593 dv-cinder-839793-11-iscsi devstack@n-api.service[114370]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=114370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.462681 dv-cinder-839793-11-iscsi devstack@n-api.service[114371]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=114371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.462953 dv-cinder-839793-11-iscsi devstack@n-api.service[114371]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=114371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.463096 dv-cinder-839793-11-iscsi devstack@n-api.service[114370]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=114370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.463265 dv-cinder-839793-11-iscsi devstack@n-api.service[114371]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=114371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.463353 dv-cinder-839793-11-iscsi devstack@n-api.service[114370]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=114370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.463588 dv-cinder-839793-11-iscsi devstack@n-api.service[114371]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=114371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.463675 dv-cinder-839793-11-iscsi devstack@n-api.service[114370]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=114370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.463910 dv-cinder-839793-11-iscsi devstack@n-api.service[114371]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=114371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.463996 dv-cinder-839793-11-iscsi devstack@n-api.service[114370]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=114370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.464221 dv-cinder-839793-11-iscsi devstack@n-api.service[114371]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=114371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.464307 dv-cinder-839793-11-iscsi devstack@n-api.service[114370]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=114370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.464541 dv-cinder-839793-11-iscsi devstack@n-api.service[114371]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=114371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.464628 dv-cinder-839793-11-iscsi devstack@n-api.service[114370]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=114370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.464851 dv-cinder-839793-11-iscsi devstack@n-api.service[114371]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=114371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.464936 dv-cinder-839793-11-iscsi devstack@n-api.service[114370]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=114370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.465165 dv-cinder-839793-11-iscsi devstack@n-api.service[114370]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=114370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.465258 dv-cinder-839793-11-iscsi devstack@n-api.service[114371]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=114371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.465490 dv-cinder-839793-11-iscsi devstack@n-api.service[114370]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=114370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.465583 dv-cinder-839793-11-iscsi devstack@n-api.service[114371]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=114371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.465806 dv-cinder-839793-11-iscsi devstack@n-api.service[114370]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=114370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.465891 dv-cinder-839793-11-iscsi devstack@n-api.service[114371]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=114371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.466128 dv-cinder-839793-11-iscsi devstack@n-api.service[114371]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=114371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.466224 dv-cinder-839793-11-iscsi devstack@n-api.service[114370]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=114370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.466465 dv-cinder-839793-11-iscsi devstack@n-api.service[114371]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=114371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.466555 dv-cinder-839793-11-iscsi devstack@n-api.service[114370]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=114370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.466774 dv-cinder-839793-11-iscsi devstack@n-api.service[114371]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=114371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.466871 dv-cinder-839793-11-iscsi devstack@n-api.service[114370]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=114370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.467080 dv-cinder-839793-11-iscsi devstack@n-api.service[114371]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=114371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.467183 dv-cinder-839793-11-iscsi devstack@n-api.service[114370]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=114370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.467388 dv-cinder-839793-11-iscsi devstack@n-api.service[114371]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=114371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.467476 dv-cinder-839793-11-iscsi devstack@n-api.service[114370]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=114370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.467708 dv-cinder-839793-11-iscsi devstack@n-api.service[114370]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=114370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.467801 dv-cinder-839793-11-iscsi devstack@n-api.service[114371]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=114371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.468018 dv-cinder-839793-11-iscsi devstack@n-api.service[114371]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=114371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.468103 dv-cinder-839793-11-iscsi devstack@n-api.service[114370]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=114370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.468323 dv-cinder-839793-11-iscsi devstack@n-api.service[114371]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=114371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.468409 dv-cinder-839793-11-iscsi devstack@n-api.service[114370]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=114370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.468627 dv-cinder-839793-11-iscsi devstack@n-api.service[114371]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=114371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.468719 dv-cinder-839793-11-iscsi devstack@n-api.service[114370]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=114370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.468938 dv-cinder-839793-11-iscsi devstack@n-api.service[114371]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=114371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.469025 dv-cinder-839793-11-iscsi devstack@n-api.service[114370]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=114370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.469242 dv-cinder-839793-11-iscsi devstack@n-api.service[114371]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=114371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.469326 dv-cinder-839793-11-iscsi devstack@n-api.service[114370]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=114370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.469546 dv-cinder-839793-11-iscsi devstack@n-api.service[114370]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=114370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.469630 dv-cinder-839793-11-iscsi devstack@n-api.service[114371]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=114371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.469851 dv-cinder-839793-11-iscsi devstack@n-api.service[114371]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=114371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.469937 dv-cinder-839793-11-iscsi devstack@n-api.service[114370]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=114370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.470158 dv-cinder-839793-11-iscsi devstack@n-api.service[114370]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=114370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.470243 dv-cinder-839793-11-iscsi devstack@n-api.service[114371]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=114371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.470513 dv-cinder-839793-11-iscsi devstack@n-api.service[114370]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=114370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.470600 dv-cinder-839793-11-iscsi devstack@n-api.service[114371]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=114371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.470817 dv-cinder-839793-11-iscsi devstack@n-api.service[114371]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=114371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.470907 dv-cinder-839793-11-iscsi devstack@n-api.service[114370]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=114370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.471616 dv-cinder-839793-11-iscsi devstack@n-api.service[114371]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=114371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.471721 dv-cinder-839793-11-iscsi devstack@n-api.service[114370]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=114370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.471947 dv-cinder-839793-11-iscsi devstack@n-api.service[114370]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=114370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.472031 dv-cinder-839793-11-iscsi devstack@n-api.service[114371]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=114371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.472251 dv-cinder-839793-11-iscsi devstack@n-api.service[114371]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=114371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.472336 dv-cinder-839793-11-iscsi devstack@n-api.service[114370]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=114370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.472558 dv-cinder-839793-11-iscsi devstack@n-api.service[114371]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=114371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.472643 dv-cinder-839793-11-iscsi devstack@n-api.service[114370]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=114370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.472862 dv-cinder-839793-11-iscsi devstack@n-api.service[114371]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=114371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.472955 dv-cinder-839793-11-iscsi devstack@n-api.service[114370]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=114370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.473173 dv-cinder-839793-11-iscsi devstack@n-api.service[114371]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=114371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.473302 dv-cinder-839793-11-iscsi devstack@n-api.service[114370]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=114370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.473481 dv-cinder-839793-11-iscsi devstack@n-api.service[114371]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=114371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.473566 dv-cinder-839793-11-iscsi devstack@n-api.service[114370]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=114370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.473787 dv-cinder-839793-11-iscsi devstack@n-api.service[114371]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=114371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.473884 dv-cinder-839793-11-iscsi devstack@n-api.service[114370]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=114370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.474091 dv-cinder-839793-11-iscsi devstack@n-api.service[114371]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=114371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.474176 dv-cinder-839793-11-iscsi devstack@n-api.service[114370]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=114370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.474421 dv-cinder-839793-11-iscsi devstack@n-api.service[114371]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=114371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.474511 dv-cinder-839793-11-iscsi devstack@n-api.service[114370]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=114370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.474730 dv-cinder-839793-11-iscsi devstack@n-api.service[114371]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=114371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.474826 dv-cinder-839793-11-iscsi devstack@n-api.service[114370]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=114370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.475040 dv-cinder-839793-11-iscsi devstack@n-api.service[114370]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=114370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.475164 dv-cinder-839793-11-iscsi devstack@n-api.service[114371]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=114371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.475353 dv-cinder-839793-11-iscsi devstack@n-api.service[114370]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=114370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.475439 dv-cinder-839793-11-iscsi devstack@n-api.service[114371]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=114371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.475662 dv-cinder-839793-11-iscsi devstack@n-api.service[114370]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=114370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.475750 dv-cinder-839793-11-iscsi devstack@n-api.service[114371]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=114371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.475990 dv-cinder-839793-11-iscsi devstack@n-api.service[114371]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=114371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.476075 dv-cinder-839793-11-iscsi devstack@n-api.service[114370]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=114370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.476300 dv-cinder-839793-11-iscsi devstack@n-api.service[114371]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=114371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.476392 dv-cinder-839793-11-iscsi devstack@n-api.service[114370]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=114370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.476622 dv-cinder-839793-11-iscsi devstack@n-api.service[114371]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=114371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.476708 dv-cinder-839793-11-iscsi devstack@n-api.service[114370]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=114370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.476937 dv-cinder-839793-11-iscsi devstack@n-api.service[114371]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=114371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.477029 dv-cinder-839793-11-iscsi devstack@n-api.service[114370]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=114370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.477253 dv-cinder-839793-11-iscsi devstack@n-api.service[114370]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=114370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.477338 dv-cinder-839793-11-iscsi devstack@n-api.service[114371]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=114371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.477575 dv-cinder-839793-11-iscsi devstack@n-api.service[114371]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=114371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.477674 dv-cinder-839793-11-iscsi devstack@n-api.service[114370]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=114370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.477887 dv-cinder-839793-11-iscsi devstack@n-api.service[114370]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=114370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.477972 dv-cinder-839793-11-iscsi devstack@n-api.service[114371]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=114371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.478196 dv-cinder-839793-11-iscsi devstack@n-api.service[114371]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=114371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.478281 dv-cinder-839793-11-iscsi devstack@n-api.service[114370]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=114370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.478549 dv-cinder-839793-11-iscsi devstack@n-api.service[114370]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=114370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.478637 dv-cinder-839793-11-iscsi devstack@n-api.service[114371]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=114371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.478860 dv-cinder-839793-11-iscsi devstack@n-api.service[114371]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=114371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.478945 dv-cinder-839793-11-iscsi devstack@n-api.service[114370]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=114370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.479174 dv-cinder-839793-11-iscsi devstack@n-api.service[114370]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=114370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.479276 dv-cinder-839793-11-iscsi devstack@n-api.service[114371]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=114371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.479485 dv-cinder-839793-11-iscsi devstack@n-api.service[114371]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=114371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.479570 dv-cinder-839793-11-iscsi devstack@n-api.service[114370]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=114370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.479808 dv-cinder-839793-11-iscsi devstack@n-api.service[114371]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=114371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.479903 dv-cinder-839793-11-iscsi devstack@n-api.service[114370]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=114370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.480121 dv-cinder-839793-11-iscsi devstack@n-api.service[114370]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=114370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.480249 dv-cinder-839793-11-iscsi devstack@n-api.service[114371]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=114371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.480686 dv-cinder-839793-11-iscsi devstack@n-api.service[114371]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=114371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.480771 dv-cinder-839793-11-iscsi devstack@n-api.service[114370]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=114370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.480999 dv-cinder-839793-11-iscsi devstack@n-api.service[114370]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=114370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.481084 dv-cinder-839793-11-iscsi devstack@n-api.service[114371]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=114371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.481315 dv-cinder-839793-11-iscsi devstack@n-api.service[114370]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=114370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.481409 dv-cinder-839793-11-iscsi devstack@n-api.service[114371]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=114371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.481622 dv-cinder-839793-11-iscsi devstack@n-api.service[114371]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=114371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.481706 dv-cinder-839793-11-iscsi devstack@n-api.service[114370]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=114370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.481948 dv-cinder-839793-11-iscsi devstack@n-api.service[114371]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=114371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.482040 dv-cinder-839793-11-iscsi devstack@n-api.service[114370]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=114370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.482265 dv-cinder-839793-11-iscsi devstack@n-api.service[114371]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=114371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.482398 dv-cinder-839793-11-iscsi devstack@n-api.service[114370]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=114370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.482602 dv-cinder-839793-11-iscsi devstack@n-api.service[114370]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=114370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.482686 dv-cinder-839793-11-iscsi devstack@n-api.service[114371]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=114371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.482916 dv-cinder-839793-11-iscsi devstack@n-api.service[114371]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=114371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.483009 dv-cinder-839793-11-iscsi devstack@n-api.service[114370]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=114370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.483231 dv-cinder-839793-11-iscsi devstack@n-api.service[114371]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=114371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.483356 dv-cinder-839793-11-iscsi devstack@n-api.service[114370]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=114370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.483555 dv-cinder-839793-11-iscsi devstack@n-api.service[114370]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=114370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.483640 dv-cinder-839793-11-iscsi devstack@n-api.service[114371]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=114371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.483864 dv-cinder-839793-11-iscsi devstack@n-api.service[114371]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=114371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.483948 dv-cinder-839793-11-iscsi devstack@n-api.service[114370]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=114370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.484176 dv-cinder-839793-11-iscsi devstack@n-api.service[114371]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=114371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.484265 dv-cinder-839793-11-iscsi devstack@n-api.service[114370]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=114370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.484491 dv-cinder-839793-11-iscsi devstack@n-api.service[114371]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=114371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.484577 dv-cinder-839793-11-iscsi devstack@n-api.service[114370]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=114370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.484801 dv-cinder-839793-11-iscsi devstack@n-api.service[114371]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=114371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.484895 dv-cinder-839793-11-iscsi devstack@n-api.service[114370]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=114370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.485115 dv-cinder-839793-11-iscsi devstack@n-api.service[114370]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=114370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.485206 dv-cinder-839793-11-iscsi devstack@n-api.service[114371]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=114371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.485430 dv-cinder-839793-11-iscsi devstack@n-api.service[114371]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=114371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.485514 dv-cinder-839793-11-iscsi devstack@n-api.service[114370]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=114370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.485742 dv-cinder-839793-11-iscsi devstack@n-api.service[114370]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=114370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.485835 dv-cinder-839793-11-iscsi devstack@n-api.service[114371]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=114371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.486061 dv-cinder-839793-11-iscsi devstack@n-api.service[114370]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=114370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.486159 dv-cinder-839793-11-iscsi devstack@n-api.service[114371]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=114371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.486408 dv-cinder-839793-11-iscsi devstack@n-api.service[114371]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=114371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.486497 dv-cinder-839793-11-iscsi devstack@n-api.service[114370]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=114370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.486721 dv-cinder-839793-11-iscsi devstack@n-api.service[114371]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=114371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.486883 dv-cinder-839793-11-iscsi devstack@n-api.service[114370]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=114370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.487615 dv-cinder-839793-11-iscsi devstack@n-api.service[114371]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=114371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.487791 dv-cinder-839793-11-iscsi devstack@n-api.service[114370]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=114370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.487944 dv-cinder-839793-11-iscsi devstack@n-api.service[114371]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=114371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.488210 dv-cinder-839793-11-iscsi devstack@n-api.service[114370]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=114370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.488295 dv-cinder-839793-11-iscsi devstack@n-api.service[114371]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=114371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.488530 dv-cinder-839793-11-iscsi devstack@n-api.service[114370]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=114370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.488625 dv-cinder-839793-11-iscsi devstack@n-api.service[114371]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=114371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.488864 dv-cinder-839793-11-iscsi devstack@n-api.service[114370]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=114370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.488959 dv-cinder-839793-11-iscsi devstack@n-api.service[114371]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=114371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.489197 dv-cinder-839793-11-iscsi devstack@n-api.service[114370]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=114370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.489290 dv-cinder-839793-11-iscsi devstack@n-api.service[114371]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=114371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.489536 dv-cinder-839793-11-iscsi devstack@n-api.service[114371]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=114371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.489621 dv-cinder-839793-11-iscsi devstack@n-api.service[114370]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=114370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.489846 dv-cinder-839793-11-iscsi devstack@n-api.service[114371]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=114371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.489943 dv-cinder-839793-11-iscsi devstack@n-api.service[114370]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=114370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.490152 dv-cinder-839793-11-iscsi devstack@n-api.service[114371]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=114371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.490251 dv-cinder-839793-11-iscsi devstack@n-api.service[114370]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=114370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.490424 dv-cinder-839793-11-iscsi devstack@n-api.service[114371]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=114371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} May 14 15:37:41.490524 dv-cinder-839793-11-iscsi devstack@n-api.service[114370]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=114370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.490842 dv-cinder-839793-11-iscsi devstack@n-api.service[114370]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=114370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.491160 dv-cinder-839793-11-iscsi devstack@n-api.service[114370]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=114370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.491474 dv-cinder-839793-11-iscsi devstack@n-api.service[114370]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=114370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:37:41.491722 dv-cinder-839793-11-iscsi devstack@n-api.service[114370]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=114370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} May 14 15:37:41.514354 dv-cinder-839793-11-iscsi devstack@n-api.service[114370]: DEBUG oslo_db.sqlalchemy.engines [None req-c1617c81-5073-4cf5-80af-07d9eb24e3d7 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=114370) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 14 15:37:41.515761 dv-cinder-839793-11-iscsi devstack@n-api.service[114371]: DEBUG oslo_db.sqlalchemy.engines [None req-a0e66460-01b7-4bfd-ad9a-6bf3b8cd3eb6 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=114371) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 14 15:37:41.577019 dv-cinder-839793-11-iscsi devstack@n-api.service[114370]: DEBUG nova.context [None req-c1617c81-5073-4cf5-80af-07d9eb24e3d7 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),793a8299-ce42-42ac-82e7-4dd54ffc49bf(cell1) {{(pid=114370) load_cells /opt/stack/nova/nova/context.py:464}} May 14 15:37:41.578292 dv-cinder-839793-11-iscsi devstack@n-api.service[114371]: DEBUG nova.context [None req-a0e66460-01b7-4bfd-ad9a-6bf3b8cd3eb6 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),793a8299-ce42-42ac-82e7-4dd54ffc49bf(cell1) {{(pid=114371) load_cells /opt/stack/nova/nova/context.py:464}} May 14 15:37:41.581521 dv-cinder-839793-11-iscsi devstack@n-api.service[114370]: DEBUG oslo_concurrency.lockutils [None req-c1617c81-5073-4cf5-80af-07d9eb24e3d7 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:37:41.582734 dv-cinder-839793-11-iscsi devstack@n-api.service[114371]: DEBUG oslo_concurrency.lockutils [None req-a0e66460-01b7-4bfd-ad9a-6bf3b8cd3eb6 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:37:41.583148 dv-cinder-839793-11-iscsi devstack@n-api.service[114370]: DEBUG oslo_concurrency.lockutils [None req-c1617c81-5073-4cf5-80af-07d9eb24e3d7 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=114370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:37:41.583952 dv-cinder-839793-11-iscsi devstack@n-api.service[114370]: DEBUG oslo_concurrency.lockutils [None req-c1617c81-5073-4cf5-80af-07d9eb24e3d7 None None] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:37:41.584344 dv-cinder-839793-11-iscsi devstack@n-api.service[114371]: DEBUG oslo_concurrency.lockutils [None req-a0e66460-01b7-4bfd-ad9a-6bf3b8cd3eb6 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=114371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:37:41.585129 dv-cinder-839793-11-iscsi devstack@n-api.service[114371]: DEBUG oslo_concurrency.lockutils [None req-a0e66460-01b7-4bfd-ad9a-6bf3b8cd3eb6 None None] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:37:41.585871 dv-cinder-839793-11-iscsi devstack@n-api.service[114370]: DEBUG oslo_concurrency.lockutils [None req-c1617c81-5073-4cf5-80af-07d9eb24e3d7 None None] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=114370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:37:41.587070 dv-cinder-839793-11-iscsi devstack@n-api.service[114371]: DEBUG oslo_concurrency.lockutils [None req-a0e66460-01b7-4bfd-ad9a-6bf3b8cd3eb6 None None] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=114371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:37:41.597439 dv-cinder-839793-11-iscsi devstack@n-api.service[114370]: DEBUG oslo_db.sqlalchemy.engines [None req-c1617c81-5073-4cf5-80af-07d9eb24e3d7 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=114370) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 14 15:37:41.600616 dv-cinder-839793-11-iscsi devstack@n-api.service[114370]: DEBUG oslo_db.sqlalchemy.engines [None req-c1617c81-5073-4cf5-80af-07d9eb24e3d7 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=114370) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 14 15:37:41.604283 dv-cinder-839793-11-iscsi devstack@n-api.service[114371]: DEBUG oslo_db.sqlalchemy.engines [None req-a0e66460-01b7-4bfd-ad9a-6bf3b8cd3eb6 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=114371) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 14 15:37:41.607914 dv-cinder-839793-11-iscsi devstack@n-api.service[114371]: DEBUG oslo_db.sqlalchemy.engines [None req-a0e66460-01b7-4bfd-ad9a-6bf3b8cd3eb6 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=114371) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 14 15:37:41.762050 dv-cinder-839793-11-iscsi devstack@n-api.service[114370]: DEBUG oslo_db.sqlalchemy.engines [None req-c1617c81-5073-4cf5-80af-07d9eb24e3d7 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=114370) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 14 15:37:41.775966 dv-cinder-839793-11-iscsi devstack@n-api.service[114371]: DEBUG oslo_db.sqlalchemy.engines [None req-a0e66460-01b7-4bfd-ad9a-6bf3b8cd3eb6 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=114371) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 14 15:37:42.103763 dv-cinder-839793-11-iscsi devstack@n-api.service[114370]: WARNING keystonemiddleware.auth_token [None req-c1617c81-5073-4cf5-80af-07d9eb24e3d7 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. May 14 15:37:42.109240 dv-cinder-839793-11-iscsi devstack@n-api.service[114371]: WARNING keystonemiddleware.auth_token [None req-a0e66460-01b7-4bfd-ad9a-6bf3b8cd3eb6 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. May 14 15:37:42.111381 dv-cinder-839793-11-iscsi devstack@n-api.service[114370]: WARNING keystonemiddleware.auth_token [None req-c1617c81-5073-4cf5-80af-07d9eb24e3d7 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint May 14 15:37:42.117139 dv-cinder-839793-11-iscsi devstack@n-api.service[114371]: WARNING keystonemiddleware.auth_token [None req-a0e66460-01b7-4bfd-ad9a-6bf3b8cd3eb6 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint May 14 15:37:42.457396 dv-cinder-839793-11-iscsi devstack@n-api.service[114370]: WARNING keystonemiddleware.auth_token [None req-c1617c81-5073-4cf5-80af-07d9eb24e3d7 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. May 14 15:37:42.462218 dv-cinder-839793-11-iscsi devstack@n-api.service[114371]: WARNING keystonemiddleware.auth_token [None req-a0e66460-01b7-4bfd-ad9a-6bf3b8cd3eb6 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. May 14 15:37:42.463417 dv-cinder-839793-11-iscsi devstack@n-api.service[114370]: WARNING keystonemiddleware.auth_token [None req-c1617c81-5073-4cf5-80af-07d9eb24e3d7 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint May 14 15:37:42.468372 dv-cinder-839793-11-iscsi devstack@n-api.service[114371]: WARNING keystonemiddleware.auth_token [None req-a0e66460-01b7-4bfd-ad9a-6bf3b8cd3eb6 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint May 14 15:37:42.469449 dv-cinder-839793-11-iscsi devstack@n-api.service[114370]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x5612919149c0 pid: 114370 (default app) May 14 15:37:42.471597 dv-cinder-839793-11-iscsi devstack@n-api.service[114370]: DEBUG nova.api.openstack.wsgi [None req-c1617c81-5073-4cf5-80af-07d9eb24e3d7 None None] Calling method '>' {{(pid=114370) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 15:37:42.472768 dv-cinder-839793-11-iscsi devstack@n-api.service[114370]: INFO nova.api.openstack.requestlog [None req-c1617c81-5073-4cf5-80af-07d9eb24e3d7 None None] 10.222.0.61 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001785 May 14 15:37:42.473183 dv-cinder-839793-11-iscsi devstack@n-api.service[114370]: [pid: 114370|app: 0|req: 1/1] 10.222.0.61 () {50 vars in 788 bytes} [Sat May 14 15:37:42 2022] GET /compute/v2.1/ => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 14 15:37:42.474489 dv-cinder-839793-11-iscsi devstack@n-api.service[114371]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x5612919149c0 pid: 114371 (default app) May 14 15:39:00.478779 dv-cinder-839793-11-iscsi devstack@n-api.service[114370]: DEBUG nova.api.openstack.wsgi [None req-c1617c81-5073-4cf5-80af-07d9eb24e3d7 None None] Calling method '>' {{(pid=114370) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 15:39:00.479878 dv-cinder-839793-11-iscsi devstack@n-api.service[114370]: INFO nova.api.openstack.requestlog [None req-c1617c81-5073-4cf5-80af-07d9eb24e3d7 None None] 10.222.0.61 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001626 May 14 15:39:00.480510 dv-cinder-839793-11-iscsi devstack@n-api.service[114370]: [pid: 114370|app: 0|req: 2/2] 10.222.0.61 () {54 vars in 930 bytes} [Sat May 14 15:39:00 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 14 15:39:00.890715 dv-cinder-839793-11-iscsi devstack@n-api.service[114371]: DEBUG nova.api.openstack.wsgi [None req-e241877f-6c2e-4202-8998-1867324d0b9f admin admin] Calling method '>' {{(pid=114371) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 15:39:00.920064 dv-cinder-839793-11-iscsi devstack@n-api.service[114371]: INFO nova.api.openstack.requestlog [None req-e241877f-6c2e-4202-8998-1867324d0b9f admin admin] 10.222.0.61 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.431928 May 14 15:39:00.920728 dv-cinder-839793-11-iscsi devstack@n-api.service[114371]: [pid: 114371|app: 0|req: 1/3] 10.222.0.61 () {60 vars in 1291 bytes} [Sat May 14 15:39:00 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 15:39:03.201128 dv-cinder-839793-11-iscsi devstack@n-api.service[114370]: DEBUG nova.api.openstack.wsgi [None req-c1617c81-5073-4cf5-80af-07d9eb24e3d7 None None] Calling method '>' {{(pid=114370) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 15:39:03.202130 dv-cinder-839793-11-iscsi devstack@n-api.service[114370]: INFO nova.api.openstack.requestlog [None req-c1617c81-5073-4cf5-80af-07d9eb24e3d7 None None] 10.222.0.61 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001423 May 14 15:39:03.202711 dv-cinder-839793-11-iscsi devstack@n-api.service[114370]: [pid: 114370|app: 0|req: 3/4] 10.222.0.61 () {54 vars in 930 bytes} [Sat May 14 15:39:03 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 14 15:39:03.270743 dv-cinder-839793-11-iscsi devstack@n-api.service[114371]: DEBUG nova.api.openstack.wsgi [None req-b3b40711-8838-4a54-b9a7-26e5b5440a5e admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "cirros256", "rxtx_factor": 1.0, "disk": 1, "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "id": "c1", "swap": 0, "vcpus": 1, "ram": 256}} {{(pid=114371) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 15:39:03.289769 dv-cinder-839793-11-iscsi devstack@n-api.service[114371]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 14 15:39:03.289769 dv-cinder-839793-11-iscsi devstack@n-api.service[114371]: warnings.warn(msg) May 14 15:39:03.318674 dv-cinder-839793-11-iscsi devstack@n-api.service[114371]: INFO nova.api.openstack.requestlog [None req-b3b40711-8838-4a54-b9a7-26e5b5440a5e admin admin] 10.222.0.61 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.109507 May 14 15:39:03.319244 dv-cinder-839793-11-iscsi devstack@n-api.service[114371]: [pid: 114371|app: 0|req: 2/5] 10.222.0.61 () {64 vars in 1282 bytes} [Sat May 14 15:39:03 2022] POST /compute/v2.1/flavors => generated 407 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 14 15:39:03.549366 dv-cinder-839793-11-iscsi devstack@n-api.service[114370]: DEBUG nova.api.openstack.wsgi [None req-5ebf10fb-c2ff-4d8c-8930-921f464a0d53 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=114370) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 15:39:03.551671 dv-cinder-839793-11-iscsi devstack@n-api.service[114370]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 14 15:39:03.551671 dv-cinder-839793-11-iscsi devstack@n-api.service[114370]: warnings.warn(msg) May 14 15:39:03.601058 dv-cinder-839793-11-iscsi devstack@n-api.service[114370]: INFO nova.api.openstack.requestlog [None req-5ebf10fb-c2ff-4d8c-8930-921f464a0d53 admin admin] 10.222.0.61 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.273760 May 14 15:39:03.601834 dv-cinder-839793-11-iscsi devstack@n-api.service[114370]: [pid: 114370|app: 0|req: 4/6] 10.222.0.61 () {64 vars in 1335 bytes} [Sat May 14 15:39:03 2022] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 15:39:05.925566 dv-cinder-839793-11-iscsi devstack@n-api.service[114371]: DEBUG nova.api.openstack.wsgi [None req-b3b40711-8838-4a54-b9a7-26e5b5440a5e admin admin] Calling method '>' {{(pid=114371) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 15:39:05.926724 dv-cinder-839793-11-iscsi devstack@n-api.service[114371]: INFO nova.api.openstack.requestlog [None req-b3b40711-8838-4a54-b9a7-26e5b5440a5e admin admin] 10.222.0.61 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001477 May 14 15:39:05.927439 dv-cinder-839793-11-iscsi devstack@n-api.service[114371]: [pid: 114371|app: 0|req: 3/7] 10.222.0.61 () {54 vars in 930 bytes} [Sat May 14 15:39:05 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 14 15:39:06.035253 dv-cinder-839793-11-iscsi devstack@n-api.service[114370]: DEBUG nova.api.openstack.wsgi [None req-3974983a-0aa3-4cff-a8e5-aac13cc648d0 admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 1, "ram": 512, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "swap": 0, "id": "d1", "rxtx_factor": 1.0, "name": "ds512M", "disk": 5}} {{(pid=114370) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 15:39:06.053037 dv-cinder-839793-11-iscsi devstack@n-api.service[114370]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 14 15:39:06.053037 dv-cinder-839793-11-iscsi devstack@n-api.service[114370]: warnings.warn(msg) May 14 15:39:06.071356 dv-cinder-839793-11-iscsi devstack@n-api.service[114370]: INFO nova.api.openstack.requestlog [None req-3974983a-0aa3-4cff-a8e5-aac13cc648d0 admin admin] 10.222.0.61 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.137709 May 14 15:39:06.072049 dv-cinder-839793-11-iscsi devstack@n-api.service[114370]: [pid: 114370|app: 0|req: 5/8] 10.222.0.61 () {64 vars in 1282 bytes} [Sat May 14 15:39:05 2022] POST /compute/v2.1/flavors => generated 404 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) May 14 15:39:06.084428 dv-cinder-839793-11-iscsi devstack@n-api.service[114371]: DEBUG nova.api.openstack.wsgi [None req-0a1095a6-74df-43cd-857b-ef74ad67e9e6 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=114371) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 15:39:06.085904 dv-cinder-839793-11-iscsi devstack@n-api.service[114371]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 14 15:39:06.085904 dv-cinder-839793-11-iscsi devstack@n-api.service[114371]: warnings.warn(msg) May 14 15:39:06.118112 dv-cinder-839793-11-iscsi devstack@n-api.service[114371]: INFO nova.api.openstack.requestlog [None req-0a1095a6-74df-43cd-857b-ef74ad67e9e6 admin admin] 10.222.0.61 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.037429 May 14 15:39:06.118733 dv-cinder-839793-11-iscsi devstack@n-api.service[114371]: [pid: 114371|app: 0|req: 4/9] 10.222.0.61 () {64 vars in 1335 bytes} [Sat May 14 15:39:06 2022] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 15:39:08.467819 dv-cinder-839793-11-iscsi devstack@n-api.service[114370]: DEBUG nova.api.openstack.wsgi [None req-3974983a-0aa3-4cff-a8e5-aac13cc648d0 admin admin] Calling method '>' {{(pid=114370) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 15:39:08.469379 dv-cinder-839793-11-iscsi devstack@n-api.service[114370]: INFO nova.api.openstack.requestlog [None req-3974983a-0aa3-4cff-a8e5-aac13cc648d0 admin admin] 10.222.0.61 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001486 May 14 15:39:08.474121 dv-cinder-839793-11-iscsi devstack@n-api.service[114370]: [pid: 114370|app: 0|req: 6/10] 10.222.0.61 () {54 vars in 930 bytes} [Sat May 14 15:39:08 2022] GET /compute/v2.1 => generated 388 bytes in 7 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 14 15:39:08.568676 dv-cinder-839793-11-iscsi devstack@n-api.service[114371]: DEBUG nova.api.openstack.wsgi [None req-ce7677ee-3ee6-4d80-bc5e-6634c1387002 admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "disk": 10, "name": "ds1G", "ram": 1024, "id": "d2", "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "vcpus": 1, "rxtx_factor": 1.0}} {{(pid=114371) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 15:39:08.599651 dv-cinder-839793-11-iscsi devstack@n-api.service[114371]: INFO nova.api.openstack.requestlog [None req-ce7677ee-3ee6-4d80-bc5e-6634c1387002 admin admin] 10.222.0.61 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.119340 May 14 15:39:08.600667 dv-cinder-839793-11-iscsi devstack@n-api.service[114371]: [pid: 114371|app: 0|req: 5/11] 10.222.0.61 () {64 vars in 1282 bytes} [Sat May 14 15:39:08 2022] POST /compute/v2.1/flavors => generated 404 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 14 15:39:08.613118 dv-cinder-839793-11-iscsi devstack@n-api.service[114370]: DEBUG nova.api.openstack.wsgi [None req-fd169137-38c0-453e-83c3-7eb1f5b180f5 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=114370) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 15:39:08.649328 dv-cinder-839793-11-iscsi devstack@n-api.service[114370]: INFO nova.api.openstack.requestlog [None req-fd169137-38c0-453e-83c3-7eb1f5b180f5 admin admin] 10.222.0.61 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.040297 May 14 15:39:08.659176 dv-cinder-839793-11-iscsi devstack@n-api.service[114370]: [pid: 114370|app: 0|req: 7/12] 10.222.0.61 () {64 vars in 1335 bytes} [Sat May 14 15:39:08 2022] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 15:39:10.959660 dv-cinder-839793-11-iscsi devstack@n-api.service[114371]: DEBUG nova.api.openstack.wsgi [None req-ce7677ee-3ee6-4d80-bc5e-6634c1387002 admin admin] Calling method '>' {{(pid=114371) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 15:39:10.960676 dv-cinder-839793-11-iscsi devstack@n-api.service[114371]: INFO nova.api.openstack.requestlog [None req-ce7677ee-3ee6-4d80-bc5e-6634c1387002 admin admin] 10.222.0.61 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001503 May 14 15:39:10.961242 dv-cinder-839793-11-iscsi devstack@n-api.service[114371]: [pid: 114371|app: 0|req: 6/13] 10.222.0.61 () {54 vars in 930 bytes} [Sat May 14 15:39:10 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 14 15:39:11.020705 dv-cinder-839793-11-iscsi devstack@n-api.service[114370]: DEBUG nova.api.openstack.wsgi [None req-30b13b1c-3e8d-4d76-9607-6b9458efd8cc admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 2, "name": "ds2G", "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 2048, "swap": 0, "disk": 10, "id": "d3", "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=114370) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 15:39:11.038940 dv-cinder-839793-11-iscsi devstack@n-api.service[114370]: INFO nova.api.openstack.requestlog [None req-30b13b1c-3e8d-4d76-9607-6b9458efd8cc admin admin] 10.222.0.61 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.071884 May 14 15:39:11.039626 dv-cinder-839793-11-iscsi devstack@n-api.service[114370]: [pid: 114370|app: 0|req: 8/14] 10.222.0.61 () {64 vars in 1282 bytes} [Sat May 14 15:39:10 2022] POST /compute/v2.1/flavors => generated 404 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) May 14 15:39:11.051613 dv-cinder-839793-11-iscsi devstack@n-api.service[114371]: DEBUG nova.api.openstack.wsgi [None req-7c80099a-4825-49d5-99f0-66f97fbef3a4 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=114371) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 15:39:11.073737 dv-cinder-839793-11-iscsi devstack@n-api.service[114371]: INFO nova.api.openstack.requestlog [None req-7c80099a-4825-49d5-99f0-66f97fbef3a4 admin admin] 10.222.0.61 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.025898 May 14 15:39:11.074333 dv-cinder-839793-11-iscsi devstack@n-api.service[114371]: [pid: 114371|app: 0|req: 7/15] 10.222.0.61 () {64 vars in 1335 bytes} [Sat May 14 15:39:11 2022] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 15:39:13.378387 dv-cinder-839793-11-iscsi devstack@n-api.service[114370]: DEBUG nova.api.openstack.wsgi [None req-30b13b1c-3e8d-4d76-9607-6b9458efd8cc admin admin] Calling method '>' {{(pid=114370) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 15:39:13.379388 dv-cinder-839793-11-iscsi devstack@n-api.service[114370]: INFO nova.api.openstack.requestlog [None req-30b13b1c-3e8d-4d76-9607-6b9458efd8cc admin admin] 10.222.0.61 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001460 May 14 15:39:13.379782 dv-cinder-839793-11-iscsi devstack@n-api.service[114370]: [pid: 114370|app: 0|req: 9/16] 10.222.0.61 () {54 vars in 930 bytes} [Sat May 14 15:39:13 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 14 15:39:13.439332 dv-cinder-839793-11-iscsi devstack@n-api.service[114371]: DEBUG nova.api.openstack.wsgi [None req-dc24be68-3c4a-4c89-ade5-34dd680299b7 admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "rxtx_factor": 1.0, "disk": 20, "swap": 0, "name": "ds4G", "vcpus": 4, "ram": 4096, "id": "d4"}} {{(pid=114371) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 15:39:13.458206 dv-cinder-839793-11-iscsi devstack@n-api.service[114371]: INFO nova.api.openstack.requestlog [None req-dc24be68-3c4a-4c89-ade5-34dd680299b7 admin admin] 10.222.0.61 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.072200 May 14 15:39:13.459676 dv-cinder-839793-11-iscsi devstack@n-api.service[114371]: [pid: 114371|app: 0|req: 8/17] 10.222.0.61 () {64 vars in 1282 bytes} [Sat May 14 15:39:13 2022] POST /compute/v2.1/flavors => generated 404 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 14 15:39:13.471835 dv-cinder-839793-11-iscsi devstack@n-api.service[114370]: DEBUG nova.api.openstack.wsgi [None req-43330974-f334-4e2d-8122-52229261599e admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=114370) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 15:39:13.494407 dv-cinder-839793-11-iscsi devstack@n-api.service[114370]: INFO nova.api.openstack.requestlog [None req-43330974-f334-4e2d-8122-52229261599e admin admin] 10.222.0.61 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.026991 May 14 15:39:13.495556 dv-cinder-839793-11-iscsi devstack@n-api.service[114370]: [pid: 114370|app: 0|req: 10/18] 10.222.0.61 () {64 vars in 1335 bytes} [Sat May 14 15:39:13 2022] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 15:39:15.852136 dv-cinder-839793-11-iscsi devstack@n-api.service[114371]: DEBUG nova.api.openstack.wsgi [None req-dc24be68-3c4a-4c89-ade5-34dd680299b7 admin admin] Calling method '>' {{(pid=114371) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 15:39:15.853724 dv-cinder-839793-11-iscsi devstack@n-api.service[114371]: INFO nova.api.openstack.requestlog [None req-dc24be68-3c4a-4c89-ade5-34dd680299b7 admin admin] 10.222.0.61 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002004 May 14 15:39:15.854283 dv-cinder-839793-11-iscsi devstack@n-api.service[114371]: [pid: 114371|app: 0|req: 9/19] 10.222.0.61 () {54 vars in 930 bytes} [Sat May 14 15:39:15 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 14 15:39:15.915293 dv-cinder-839793-11-iscsi devstack@n-api.service[114370]: DEBUG nova.api.openstack.wsgi [None req-9e32e7df-5927-4d68-827c-dbf120258306 admin admin] Calling method '>' {{(pid=114370) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 15:39:15.939775 dv-cinder-839793-11-iscsi devstack@n-api.service[114370]: INFO nova.api.openstack.requestlog [None req-9e32e7df-5927-4d68-827c-dbf120258306 admin admin] 10.222.0.61 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.079286 May 14 15:39:15.940333 dv-cinder-839793-11-iscsi devstack@n-api.service[114370]: [pid: 114370|app: 0|req: 11/20] 10.222.0.61 () {60 vars in 1291 bytes} [Sat May 14 15:39:15 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 14 15:39:18.472478 dv-cinder-839793-11-iscsi devstack@n-api.service[114371]: DEBUG nova.api.openstack.wsgi [None req-dc24be68-3c4a-4c89-ade5-34dd680299b7 admin admin] Calling method '>' {{(pid=114371) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 15:39:18.473685 dv-cinder-839793-11-iscsi devstack@n-api.service[114371]: INFO nova.api.openstack.requestlog [None req-dc24be68-3c4a-4c89-ade5-34dd680299b7 admin admin] 10.222.0.61 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001708 May 14 15:39:18.474156 dv-cinder-839793-11-iscsi devstack@n-api.service[114371]: [pid: 114371|app: 0|req: 10/21] 10.222.0.61 () {54 vars in 930 bytes} [Sat May 14 15:39:18 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 14 15:39:18.540205 dv-cinder-839793-11-iscsi devstack@n-api.service[114370]: DEBUG nova.api.openstack.wsgi [None req-7acc30d6-af3c-4b7f-b141-689677f0807d admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "vcpus": 1, "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "ram": 512, "disk": 1, "id": "1", "name": "m1.tiny"}} {{(pid=114370) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 15:39:18.558209 dv-cinder-839793-11-iscsi devstack@n-api.service[114370]: INFO nova.api.openstack.requestlog [None req-7acc30d6-af3c-4b7f-b141-689677f0807d admin admin] 10.222.0.61 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.076835 May 14 15:39:18.558806 dv-cinder-839793-11-iscsi devstack@n-api.service[114370]: [pid: 114370|app: 0|req: 12/22] 10.222.0.61 () {64 vars in 1282 bytes} [Sat May 14 15:39:18 2022] POST /compute/v2.1/flavors => generated 402 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 14 15:39:18.572170 dv-cinder-839793-11-iscsi devstack@n-api.service[114371]: DEBUG nova.api.openstack.wsgi [None req-a000bbcb-6bf2-4010-8bfe-c88bd5f61377 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=114371) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 15:39:18.598028 dv-cinder-839793-11-iscsi devstack@n-api.service[114371]: INFO nova.api.openstack.requestlog [None req-a000bbcb-6bf2-4010-8bfe-c88bd5f61377 admin admin] 10.222.0.61 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.029336 May 14 15:39:18.598875 dv-cinder-839793-11-iscsi devstack@n-api.service[114371]: [pid: 114371|app: 0|req: 11/23] 10.222.0.61 () {64 vars in 1332 bytes} [Sat May 14 15:39:18 2022] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 15:39:20.980669 dv-cinder-839793-11-iscsi devstack@n-api.service[114370]: DEBUG nova.api.openstack.wsgi [None req-7acc30d6-af3c-4b7f-b141-689677f0807d admin admin] Calling method '>' {{(pid=114370) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 15:39:20.981972 dv-cinder-839793-11-iscsi devstack@n-api.service[114370]: INFO nova.api.openstack.requestlog [None req-7acc30d6-af3c-4b7f-b141-689677f0807d admin admin] 10.222.0.61 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001526 May 14 15:39:20.982413 dv-cinder-839793-11-iscsi devstack@n-api.service[114370]: [pid: 114370|app: 0|req: 13/24] 10.222.0.61 () {54 vars in 930 bytes} [Sat May 14 15:39:20 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 14 15:39:21.044343 dv-cinder-839793-11-iscsi devstack@n-api.service[114371]: DEBUG nova.api.openstack.wsgi [None req-feed3e71-d8d0-4119-8ffc-f01c7f3182e0 admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "id": "2", "swap": 0, "os-flavor-access:is_public": true, "name": "m1.small", "rxtx_factor": 1.0, "disk": 20, "ram": 2048, "vcpus": 1}} {{(pid=114371) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 15:39:21.062219 dv-cinder-839793-11-iscsi devstack@n-api.service[114371]: INFO nova.api.openstack.requestlog [None req-feed3e71-d8d0-4119-8ffc-f01c7f3182e0 admin admin] 10.222.0.61 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.073096 May 14 15:39:21.063129 dv-cinder-839793-11-iscsi devstack@n-api.service[114371]: [pid: 114371|app: 0|req: 12/25] 10.222.0.61 () {64 vars in 1282 bytes} [Sat May 14 15:39:20 2022] POST /compute/v2.1/flavors => generated 405 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 14 15:39:21.074957 dv-cinder-839793-11-iscsi devstack@n-api.service[114370]: DEBUG nova.api.openstack.wsgi [None req-dbe2a724-5ce9-43d5-b4f7-0e4dc967a21d admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=114370) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 15:39:21.106100 dv-cinder-839793-11-iscsi devstack@n-api.service[114370]: INFO nova.api.openstack.requestlog [None req-dbe2a724-5ce9-43d5-b4f7-0e4dc967a21d admin admin] 10.222.0.61 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.034760 May 14 15:39:21.106920 dv-cinder-839793-11-iscsi devstack@n-api.service[114370]: [pid: 114370|app: 0|req: 14/26] 10.222.0.61 () {64 vars in 1332 bytes} [Sat May 14 15:39:21 2022] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 15:39:23.377181 dv-cinder-839793-11-iscsi devstack@n-api.service[114371]: DEBUG nova.api.openstack.wsgi [None req-feed3e71-d8d0-4119-8ffc-f01c7f3182e0 admin admin] Calling method '>' {{(pid=114371) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 15:39:23.378179 dv-cinder-839793-11-iscsi devstack@n-api.service[114371]: INFO nova.api.openstack.requestlog [None req-feed3e71-d8d0-4119-8ffc-f01c7f3182e0 admin admin] 10.222.0.61 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001421 May 14 15:39:23.379513 dv-cinder-839793-11-iscsi devstack@n-api.service[114371]: [pid: 114371|app: 0|req: 13/27] 10.222.0.61 () {54 vars in 930 bytes} [Sat May 14 15:39:23 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 14 15:39:23.435450 dv-cinder-839793-11-iscsi devstack@n-api.service[114370]: DEBUG nova.api.openstack.wsgi [None req-8aac558d-3f78-4433-9f54-7cd56a068359 admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "rxtx_factor": 1.0, "name": "m1.medium", "vcpus": 2, "swap": 0, "ram": 4096, "disk": 40, "OS-FLV-EXT-DATA:ephemeral": 0, "id": "3"}} {{(pid=114370) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 15:39:23.452610 dv-cinder-839793-11-iscsi devstack@n-api.service[114370]: INFO nova.api.openstack.requestlog [None req-8aac558d-3f78-4433-9f54-7cd56a068359 admin admin] 10.222.0.61 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.068413 May 14 15:39:23.453596 dv-cinder-839793-11-iscsi devstack@n-api.service[114370]: [pid: 114370|app: 0|req: 15/28] 10.222.0.61 () {64 vars in 1282 bytes} [Sat May 14 15:39:23 2022] POST /compute/v2.1/flavors => generated 406 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 14 15:39:23.465100 dv-cinder-839793-11-iscsi devstack@n-api.service[114371]: DEBUG nova.api.openstack.wsgi [None req-e0284625-57e2-4522-8db6-822735f5665a admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=114371) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 15:39:23.488825 dv-cinder-839793-11-iscsi devstack@n-api.service[114371]: INFO nova.api.openstack.requestlog [None req-e0284625-57e2-4522-8db6-822735f5665a admin admin] 10.222.0.61 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.027338 May 14 15:39:23.489412 dv-cinder-839793-11-iscsi devstack@n-api.service[114371]: [pid: 114371|app: 0|req: 14/29] 10.222.0.61 () {64 vars in 1332 bytes} [Sat May 14 15:39:23 2022] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 15:39:25.753943 dv-cinder-839793-11-iscsi devstack@n-api.service[114370]: DEBUG nova.api.openstack.wsgi [None req-8aac558d-3f78-4433-9f54-7cd56a068359 admin admin] Calling method '>' {{(pid=114370) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 15:39:25.754977 dv-cinder-839793-11-iscsi devstack@n-api.service[114370]: INFO nova.api.openstack.requestlog [None req-8aac558d-3f78-4433-9f54-7cd56a068359 admin admin] 10.222.0.61 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001472 May 14 15:39:25.755376 dv-cinder-839793-11-iscsi devstack@n-api.service[114370]: [pid: 114370|app: 0|req: 16/30] 10.222.0.61 () {54 vars in 930 bytes} [Sat May 14 15:39:25 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 14 15:39:25.811506 dv-cinder-839793-11-iscsi devstack@n-api.service[114371]: DEBUG nova.api.openstack.wsgi [None req-28c6ac31-3ed3-455a-a56b-a6cbe40aed56 admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "ram": 8192, "id": "4", "os-flavor-access:is_public": true, "vcpus": 4, "swap": 0, "rxtx_factor": 1.0, "name": "m1.large", "disk": 80}} {{(pid=114371) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 15:39:25.832273 dv-cinder-839793-11-iscsi devstack@n-api.service[114371]: INFO nova.api.openstack.requestlog [None req-28c6ac31-3ed3-455a-a56b-a6cbe40aed56 admin admin] 10.222.0.61 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.071206 May 14 15:39:25.832930 dv-cinder-839793-11-iscsi devstack@n-api.service[114371]: [pid: 114371|app: 0|req: 15/31] 10.222.0.61 () {64 vars in 1282 bytes} [Sat May 14 15:39:25 2022] POST /compute/v2.1/flavors => generated 405 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) May 14 15:39:25.845677 dv-cinder-839793-11-iscsi devstack@n-api.service[114370]: DEBUG nova.api.openstack.wsgi [None req-1f6f65ee-5ce2-463c-bf7a-ab000d6dd66d admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=114370) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 15:39:25.871977 dv-cinder-839793-11-iscsi devstack@n-api.service[114370]: INFO nova.api.openstack.requestlog [None req-1f6f65ee-5ce2-463c-bf7a-ab000d6dd66d admin admin] 10.222.0.61 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.030588 May 14 15:39:25.872739 dv-cinder-839793-11-iscsi devstack@n-api.service[114370]: [pid: 114370|app: 0|req: 17/32] 10.222.0.61 () {64 vars in 1332 bytes} [Sat May 14 15:39:25 2022] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 15:39:28.253835 dv-cinder-839793-11-iscsi devstack@n-api.service[114371]: DEBUG nova.api.openstack.wsgi [None req-28c6ac31-3ed3-455a-a56b-a6cbe40aed56 admin admin] Calling method '>' {{(pid=114371) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 15:39:28.254971 dv-cinder-839793-11-iscsi devstack@n-api.service[114371]: INFO nova.api.openstack.requestlog [None req-28c6ac31-3ed3-455a-a56b-a6cbe40aed56 admin admin] 10.222.0.61 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001579 May 14 15:39:28.255378 dv-cinder-839793-11-iscsi devstack@n-api.service[114371]: [pid: 114371|app: 0|req: 16/33] 10.222.0.61 () {54 vars in 930 bytes} [Sat May 14 15:39:28 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 14 15:39:28.321864 dv-cinder-839793-11-iscsi devstack@n-api.service[114370]: DEBUG nova.api.openstack.wsgi [None req-76afa9d3-aa08-4050-a663-82231c25d575 admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "5", "vcpus": 8, "os-flavor-access:is_public": true, "swap": 0, "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 160, "ram": 16384, "name": "m1.xlarge"}} {{(pid=114370) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 15:39:28.340338 dv-cinder-839793-11-iscsi devstack@n-api.service[114370]: INFO nova.api.openstack.requestlog [None req-76afa9d3-aa08-4050-a663-82231c25d575 admin admin] 10.222.0.61 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.079234 May 14 15:39:28.340895 dv-cinder-839793-11-iscsi devstack@n-api.service[114370]: [pid: 114370|app: 0|req: 18/34] 10.222.0.61 () {64 vars in 1282 bytes} [Sat May 14 15:39:28 2022] POST /compute/v2.1/flavors => generated 408 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) May 14 15:39:28.352950 dv-cinder-839793-11-iscsi devstack@n-api.service[114371]: DEBUG nova.api.openstack.wsgi [None req-8a9cae2b-587c-4856-9f94-70a1efc0e607 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=114371) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 15:39:28.379042 dv-cinder-839793-11-iscsi devstack@n-api.service[114371]: INFO nova.api.openstack.requestlog [None req-8a9cae2b-587c-4856-9f94-70a1efc0e607 admin admin] 10.222.0.61 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.030038 May 14 15:39:28.379925 dv-cinder-839793-11-iscsi devstack@n-api.service[114371]: [pid: 114371|app: 0|req: 17/35] 10.222.0.61 () {64 vars in 1332 bytes} [Sat May 14 15:39:28 2022] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 15:39:52.050212 dv-cinder-839793-11-iscsi devstack@n-api.service[114370]: DEBUG nova.api.openstack.wsgi [None req-76afa9d3-aa08-4050-a663-82231c25d575 admin admin] Calling method '>' {{(pid=114370) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 15:39:52.051272 dv-cinder-839793-11-iscsi devstack@n-api.service[114370]: INFO nova.api.openstack.requestlog [None req-76afa9d3-aa08-4050-a663-82231c25d575 admin admin] 10.222.0.61 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001520 May 14 15:39:52.051673 dv-cinder-839793-11-iscsi devstack@n-api.service[114370]: [pid: 114370|app: 0|req: 19/36] 10.222.0.61 () {54 vars in 930 bytes} [Sat May 14 15:39:52 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 14 15:39:52.108737 dv-cinder-839793-11-iscsi devstack@n-api.service[114371]: DEBUG nova.api.openstack.wsgi [None req-b7f60a8e-46a1-4614-bd69-f0d5785ce77f admin admin] Calling method '>' {{(pid=114371) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 15:39:52.127564 dv-cinder-839793-11-iscsi devstack@n-api.service[114371]: INFO nova.api.openstack.requestlog [None req-b7f60a8e-46a1-4614-bd69-f0d5785ce77f admin admin] 10.222.0.61 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.069935 May 14 15:39:52.128102 dv-cinder-839793-11-iscsi devstack@n-api.service[114371]: [pid: 114371|app: 0|req: 18/37] 10.222.0.61 () {60 vars in 1291 bytes} [Sat May 14 15:39:52 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 14 15:39:53.134992 dv-cinder-839793-11-iscsi devstack@n-api.service[114370]: DEBUG nova.api.openstack.wsgi [None req-76afa9d3-aa08-4050-a663-82231c25d575 admin admin] Calling method '>' {{(pid=114370) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 15:39:53.135991 dv-cinder-839793-11-iscsi devstack@n-api.service[114370]: INFO nova.api.openstack.requestlog [None req-76afa9d3-aa08-4050-a663-82231c25d575 admin admin] 10.222.0.61 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001447 May 14 15:39:53.136395 dv-cinder-839793-11-iscsi devstack@n-api.service[114370]: [pid: 114370|app: 0|req: 20/38] 10.222.0.61 () {56 vars in 1074 bytes} [Sat May 14 15:39:53 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 14 15:39:53.338118 dv-cinder-839793-11-iscsi devstack@n-api.service[114371]: DEBUG nova.api.openstack.wsgi [None req-cc9a3881-6de8-48ec-bb9a-a780177fea7c admin admin] Calling method '>' {{(pid=114371) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 15:39:53.343713 dv-cinder-839793-11-iscsi devstack@n-api.service[114371]: INFO nova.api.openstack.wsgi [None req-cc9a3881-6de8-48ec-bb9a-a780177fea7c admin admin] HTTP exception thrown: Flavor 42 could not be found. May 14 15:39:53.347001 dv-cinder-839793-11-iscsi devstack@n-api.service[114371]: DEBUG nova.api.openstack.wsgi [None req-cc9a3881-6de8-48ec-bb9a-a780177fea7c admin admin] Request method failure captured: May 14 15:39:53.347001 dv-cinder-839793-11-iscsi devstack@n-api.service[114371]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 May 14 15:39:53.347001 dv-cinder-839793-11-iscsi devstack@n-api.service[114371]: Accept: application/json May 14 15:39:53.347001 dv-cinder-839793-11-iscsi devstack@n-api.service[114371]: Accept-Encoding: gzip, deflate May 14 15:39:53.347001 dv-cinder-839793-11-iscsi devstack@n-api.service[114371]: Connection: keep-alive May 14 15:39:53.347001 dv-cinder-839793-11-iscsi devstack@n-api.service[114371]: Content-Length: 0 May 14 15:39:53.347001 dv-cinder-839793-11-iscsi devstack@n-api.service[114371]: Host: 10.222.0.61 May 14 15:39:53.347001 dv-cinder-839793-11-iscsi devstack@n-api.service[114371]: Openstack-Api-Version: compute 2.90 May 14 15:39:53.347001 dv-cinder-839793-11-iscsi devstack@n-api.service[114371]: Openstack-System-Scope: None May 14 15:39:53.347001 dv-cinder-839793-11-iscsi devstack@n-api.service[114371]: User-Agent: python-novaclient May 14 15:39:53.347001 dv-cinder-839793-11-iscsi devstack@n-api.service[114371]: X-Auth-Token: gAAAAABif81JQSnVlASpHHMIHn67i-tGn06fkAjcJ91l-ufKkUunAFqGtC8RQYF9fNwypCbZihP8MgTAgFoI9LS0XmUAYS44zBuA-sTU9a7gvsLj0WBnJ2hZhrbySAXHQd6lPKxcnnpHuXDmqT_6egimlZKICaAXlMYApKra1Wy16kxutFH0mbE May 14 15:39:53.347001 dv-cinder-839793-11-iscsi devstack@n-api.service[114371]: X-Domain-Id: None May 14 15:39:53.347001 dv-cinder-839793-11-iscsi devstack@n-api.service[114371]: X-Domain-Name: None May 14 15:39:53.347001 dv-cinder-839793-11-iscsi devstack@n-api.service[114371]: X-Identity-Status: Confirmed May 14 15:39:53.347001 dv-cinder-839793-11-iscsi devstack@n-api.service[114371]: X-Is-Admin-Project: True May 14 15:39:53.347001 dv-cinder-839793-11-iscsi devstack@n-api.service[114371]: X-Openstack-Nova-Api-Version: 2.90 May 14 15:39:53.347001 dv-cinder-839793-11-iscsi devstack@n-api.service[114371]: X-Project-Domain-Id: default May 14 15:39:53.347001 dv-cinder-839793-11-iscsi devstack@n-api.service[114371]: X-Project-Domain-Name: Default May 14 15:39:53.347001 dv-cinder-839793-11-iscsi devstack@n-api.service[114371]: X-Project-Id: 562024bfc95645e098dcd57dfe3300a0 May 14 15:39:53.347001 dv-cinder-839793-11-iscsi devstack@n-api.service[114371]: X-Project-Name: admin May 14 15:39:53.347001 dv-cinder-839793-11-iscsi devstack@n-api.service[114371]: X-Role: admin,reader,member May 14 15:39:53.347001 dv-cinder-839793-11-iscsi devstack@n-api.service[114371]: X-Roles: admin,reader,member May 14 15:39:53.348680 dv-cinder-839793-11-iscsi devstack@n-api.service[114371]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/562024bfc95645e098dcd57dfe3300a0"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/562024bfc95645e098dcd57dfe3300a0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/562024bfc95645e098dcd57dfe3300a0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_562024bfc95645e098dcd57dfe3300a0"}]}] May 14 15:39:53.348680 dv-cinder-839793-11-iscsi devstack@n-api.service[114371]: X-Tenant: admin May 14 15:39:53.348680 dv-cinder-839793-11-iscsi devstack@n-api.service[114371]: X-Tenant-Id: 562024bfc95645e098dcd57dfe3300a0 May 14 15:39:53.348680 dv-cinder-839793-11-iscsi devstack@n-api.service[114371]: X-Tenant-Name: admin May 14 15:39:53.348680 dv-cinder-839793-11-iscsi devstack@n-api.service[114371]: X-User: admin May 14 15:39:53.348680 dv-cinder-839793-11-iscsi devstack@n-api.service[114371]: X-User-Domain-Id: default May 14 15:39:53.348680 dv-cinder-839793-11-iscsi devstack@n-api.service[114371]: X-User-Domain-Name: Default May 14 15:39:53.348680 dv-cinder-839793-11-iscsi devstack@n-api.service[114371]: X-User-Id: a7162b13b2c54f8cadf583b1df8219b5 May 14 15:39:53.348680 dv-cinder-839793-11-iscsi devstack@n-api.service[114371]: X-User-Name: admin May 14 15:39:53.348680 dv-cinder-839793-11-iscsi devstack@n-api.service[114371]: method: > May 14 15:39:53.348680 dv-cinder-839793-11-iscsi devstack@n-api.service[114371]: exception: Flavor 42 could not be found. May 14 15:39:53.348680 dv-cinder-839793-11-iscsi devstack@n-api.service[114371]: action_args: {'id': '42'} May 14 15:39:53.348680 dv-cinder-839793-11-iscsi devstack@n-api.service[114371]: {{(pid=114371) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 14 15:39:53.348680 dv-cinder-839793-11-iscsi devstack@n-api.service[114371]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 15:39:53.349690 dv-cinder-839793-11-iscsi devstack@n-api.service[114371]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show May 14 15:39:53.349690 dv-cinder-839793-11-iscsi devstack@n-api.service[114371]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) May 14 15:39:53.349690 dv-cinder-839793-11-iscsi devstack@n-api.service[114371]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id May 14 15:39:53.349690 dv-cinder-839793-11-iscsi devstack@n-api.service[114371]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) May 14 15:39:53.349690 dv-cinder-839793-11-iscsi devstack@n-api.service[114371]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper May 14 15:39:53.349690 dv-cinder-839793-11-iscsi devstack@n-api.service[114371]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) May 14 15:39:53.349690 dv-cinder-839793-11-iscsi devstack@n-api.service[114371]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id May 14 15:39:53.349690 dv-cinder-839793-11-iscsi devstack@n-api.service[114371]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, May 14 15:39:53.349690 dv-cinder-839793-11-iscsi devstack@n-api.service[114371]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper May 14 15:39:53.349690 dv-cinder-839793-11-iscsi devstack@n-api.service[114371]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 14 15:39:53.349690 dv-cinder-839793-11-iscsi devstack@n-api.service[114371]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db May 14 15:39:53.349690 dv-cinder-839793-11-iscsi devstack@n-api.service[114371]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) May 14 15:39:53.349690 dv-cinder-839793-11-iscsi devstack@n-api.service[114371]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. May 14 15:39:53.349690 dv-cinder-839793-11-iscsi devstack@n-api.service[114371]: ERROR nova.api.openstack.wsgi May 14 15:39:53.349690 dv-cinder-839793-11-iscsi devstack@n-api.service[114371]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 14 15:39:53.349690 dv-cinder-839793-11-iscsi devstack@n-api.service[114371]: ERROR nova.api.openstack.wsgi May 14 15:39:53.349690 dv-cinder-839793-11-iscsi devstack@n-api.service[114371]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 15:39:53.349690 dv-cinder-839793-11-iscsi devstack@n-api.service[114371]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 14 15:39:53.349690 dv-cinder-839793-11-iscsi devstack@n-api.service[114371]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 14 15:39:53.350928 dv-cinder-839793-11-iscsi devstack@n-api.service[114371]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 14 15:39:53.350928 dv-cinder-839793-11-iscsi devstack@n-api.service[114371]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 14 15:39:53.350928 dv-cinder-839793-11-iscsi devstack@n-api.service[114371]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 14 15:39:53.350928 dv-cinder-839793-11-iscsi devstack@n-api.service[114371]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 14 15:39:53.350928 dv-cinder-839793-11-iscsi devstack@n-api.service[114371]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show May 14 15:39:53.350928 dv-cinder-839793-11-iscsi devstack@n-api.service[114371]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) May 14 15:39:53.350928 dv-cinder-839793-11-iscsi devstack@n-api.service[114371]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. May 14 15:39:53.350928 dv-cinder-839793-11-iscsi devstack@n-api.service[114371]: ERROR nova.api.openstack.wsgi May 14 15:39:53.350928 dv-cinder-839793-11-iscsi devstack@n-api.service[114371]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 14 15:39:53.350928 dv-cinder-839793-11-iscsi devstack@n-api.service[114371]: ERROR nova.api.openstack.wsgi May 14 15:39:53.350928 dv-cinder-839793-11-iscsi devstack@n-api.service[114371]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 15:39:53.350928 dv-cinder-839793-11-iscsi devstack@n-api.service[114371]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 14 15:39:53.350928 dv-cinder-839793-11-iscsi devstack@n-api.service[114371]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 14 15:39:53.350928 dv-cinder-839793-11-iscsi devstack@n-api.service[114371]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 14 15:39:53.350928 dv-cinder-839793-11-iscsi devstack@n-api.service[114371]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 14 15:39:53.350928 dv-cinder-839793-11-iscsi devstack@n-api.service[114371]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. May 14 15:39:53.350928 dv-cinder-839793-11-iscsi devstack@n-api.service[114371]: ERROR nova.api.openstack.wsgi May 14 15:39:53.350928 dv-cinder-839793-11-iscsi devstack@n-api.service[114371]: DEBUG nova.api.openstack.wsgi [None req-cc9a3881-6de8-48ec-bb9a-a780177fea7c admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=114371) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 14 15:39:53.351965 dv-cinder-839793-11-iscsi devstack@n-api.service[114371]: INFO nova.api.openstack.requestlog [None req-cc9a3881-6de8-48ec-bb9a-a780177fea7c admin admin] 10.222.0.61 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.060358 May 14 15:39:53.351965 dv-cinder-839793-11-iscsi devstack@n-api.service[114371]: [pid: 114371|app: 0|req: 19/39] 10.222.0.61 () {60 vars in 1190 bytes} [Sat May 14 15:39:53 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 61 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) May 14 15:39:53.358498 dv-cinder-839793-11-iscsi devstack@n-api.service[114370]: DEBUG nova.api.openstack.wsgi [None req-7716e547-6c5b-46c5-82c7-0bed24265253 admin admin] Calling method '>' {{(pid=114370) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 15:39:53.380449 dv-cinder-839793-11-iscsi devstack@n-api.service[114370]: INFO nova.api.openstack.requestlog [None req-7716e547-6c5b-46c5-82c7-0bed24265253 admin admin] 10.222.0.61 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.025936 May 14 15:39:53.380996 dv-cinder-839793-11-iscsi devstack@n-api.service[114370]: [pid: 114370|app: 0|req: 21/40] 10.222.0.61 () {60 vars in 1210 bytes} [Sat May 14 15:39:53 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 14 15:39:53.391078 dv-cinder-839793-11-iscsi devstack@n-api.service[114371]: DEBUG nova.api.openstack.wsgi [None req-6c953748-c130-4702-b1c2-89e67b1e7825 admin admin] Calling method '>' {{(pid=114371) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 15:39:53.411874 dv-cinder-839793-11-iscsi devstack@n-api.service[114371]: INFO nova.api.openstack.requestlog [None req-6c953748-c130-4702-b1c2-89e67b1e7825 admin admin] 10.222.0.61 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.024928 May 14 15:39:53.412405 dv-cinder-839793-11-iscsi devstack@n-api.service[114371]: [pid: 114371|app: 0|req: 20/41] 10.222.0.61 () {60 vars in 1210 bytes} [Sat May 14 15:39:53 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 14 15:39:53.421623 dv-cinder-839793-11-iscsi devstack@n-api.service[114370]: DEBUG nova.api.openstack.wsgi [None req-1bd39346-1ca3-46c9-97b1-6a920e5d560d admin admin] Calling method '>' {{(pid=114370) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 15:39:53.427105 dv-cinder-839793-11-iscsi devstack@n-api.service[114370]: INFO nova.api.openstack.wsgi [None req-1bd39346-1ca3-46c9-97b1-6a920e5d560d admin admin] HTTP exception thrown: Flavor 42 could not be found. May 14 15:39:53.430285 dv-cinder-839793-11-iscsi devstack@n-api.service[114370]: DEBUG nova.api.openstack.wsgi [None req-1bd39346-1ca3-46c9-97b1-6a920e5d560d admin admin] Request method failure captured: May 14 15:39:53.430285 dv-cinder-839793-11-iscsi devstack@n-api.service[114370]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 May 14 15:39:53.430285 dv-cinder-839793-11-iscsi devstack@n-api.service[114370]: Accept: application/json May 14 15:39:53.430285 dv-cinder-839793-11-iscsi devstack@n-api.service[114370]: Accept-Encoding: gzip, deflate May 14 15:39:53.430285 dv-cinder-839793-11-iscsi devstack@n-api.service[114370]: Connection: keep-alive May 14 15:39:53.430285 dv-cinder-839793-11-iscsi devstack@n-api.service[114370]: Content-Length: 0 May 14 15:39:53.430285 dv-cinder-839793-11-iscsi devstack@n-api.service[114370]: Host: 10.222.0.61 May 14 15:39:53.430285 dv-cinder-839793-11-iscsi devstack@n-api.service[114370]: Openstack-Api-Version: compute 2.90 May 14 15:39:53.430285 dv-cinder-839793-11-iscsi devstack@n-api.service[114370]: Openstack-System-Scope: None May 14 15:39:53.430285 dv-cinder-839793-11-iscsi devstack@n-api.service[114370]: User-Agent: python-novaclient May 14 15:39:53.430285 dv-cinder-839793-11-iscsi devstack@n-api.service[114370]: X-Auth-Token: gAAAAABif81JQSnVlASpHHMIHn67i-tGn06fkAjcJ91l-ufKkUunAFqGtC8RQYF9fNwypCbZihP8MgTAgFoI9LS0XmUAYS44zBuA-sTU9a7gvsLj0WBnJ2hZhrbySAXHQd6lPKxcnnpHuXDmqT_6egimlZKICaAXlMYApKra1Wy16kxutFH0mbE May 14 15:39:53.430285 dv-cinder-839793-11-iscsi devstack@n-api.service[114370]: X-Domain-Id: None May 14 15:39:53.430285 dv-cinder-839793-11-iscsi devstack@n-api.service[114370]: X-Domain-Name: None May 14 15:39:53.430285 dv-cinder-839793-11-iscsi devstack@n-api.service[114370]: X-Identity-Status: Confirmed May 14 15:39:53.430285 dv-cinder-839793-11-iscsi devstack@n-api.service[114370]: X-Is-Admin-Project: True May 14 15:39:53.430285 dv-cinder-839793-11-iscsi devstack@n-api.service[114370]: X-Openstack-Nova-Api-Version: 2.90 May 14 15:39:53.430285 dv-cinder-839793-11-iscsi devstack@n-api.service[114370]: X-Project-Domain-Id: default May 14 15:39:53.430285 dv-cinder-839793-11-iscsi devstack@n-api.service[114370]: X-Project-Domain-Name: Default May 14 15:39:53.430285 dv-cinder-839793-11-iscsi devstack@n-api.service[114370]: X-Project-Id: 562024bfc95645e098dcd57dfe3300a0 May 14 15:39:53.430285 dv-cinder-839793-11-iscsi devstack@n-api.service[114370]: X-Project-Name: admin May 14 15:39:53.430285 dv-cinder-839793-11-iscsi devstack@n-api.service[114370]: X-Role: admin,reader,member May 14 15:39:53.430285 dv-cinder-839793-11-iscsi devstack@n-api.service[114370]: X-Roles: admin,reader,member May 14 15:39:53.431813 dv-cinder-839793-11-iscsi devstack@n-api.service[114370]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/562024bfc95645e098dcd57dfe3300a0"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/562024bfc95645e098dcd57dfe3300a0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/562024bfc95645e098dcd57dfe3300a0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_562024bfc95645e098dcd57dfe3300a0"}]}] May 14 15:39:53.431813 dv-cinder-839793-11-iscsi devstack@n-api.service[114370]: X-Tenant: admin May 14 15:39:53.431813 dv-cinder-839793-11-iscsi devstack@n-api.service[114370]: X-Tenant-Id: 562024bfc95645e098dcd57dfe3300a0 May 14 15:39:53.431813 dv-cinder-839793-11-iscsi devstack@n-api.service[114370]: X-Tenant-Name: admin May 14 15:39:53.431813 dv-cinder-839793-11-iscsi devstack@n-api.service[114370]: X-User: admin May 14 15:39:53.431813 dv-cinder-839793-11-iscsi devstack@n-api.service[114370]: X-User-Domain-Id: default May 14 15:39:53.431813 dv-cinder-839793-11-iscsi devstack@n-api.service[114370]: X-User-Domain-Name: Default May 14 15:39:53.431813 dv-cinder-839793-11-iscsi devstack@n-api.service[114370]: X-User-Id: a7162b13b2c54f8cadf583b1df8219b5 May 14 15:39:53.431813 dv-cinder-839793-11-iscsi devstack@n-api.service[114370]: X-User-Name: admin May 14 15:39:53.431813 dv-cinder-839793-11-iscsi devstack@n-api.service[114370]: method: > May 14 15:39:53.431813 dv-cinder-839793-11-iscsi devstack@n-api.service[114370]: exception: Flavor 42 could not be found. May 14 15:39:53.431813 dv-cinder-839793-11-iscsi devstack@n-api.service[114370]: action_args: {'id': '42'} May 14 15:39:53.431813 dv-cinder-839793-11-iscsi devstack@n-api.service[114370]: {{(pid=114370) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 14 15:39:53.431813 dv-cinder-839793-11-iscsi devstack@n-api.service[114370]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 15:39:53.432784 dv-cinder-839793-11-iscsi devstack@n-api.service[114370]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show May 14 15:39:53.432784 dv-cinder-839793-11-iscsi devstack@n-api.service[114370]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) May 14 15:39:53.432784 dv-cinder-839793-11-iscsi devstack@n-api.service[114370]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id May 14 15:39:53.432784 dv-cinder-839793-11-iscsi devstack@n-api.service[114370]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) May 14 15:39:53.432784 dv-cinder-839793-11-iscsi devstack@n-api.service[114370]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper May 14 15:39:53.432784 dv-cinder-839793-11-iscsi devstack@n-api.service[114370]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) May 14 15:39:53.432784 dv-cinder-839793-11-iscsi devstack@n-api.service[114370]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id May 14 15:39:53.432784 dv-cinder-839793-11-iscsi devstack@n-api.service[114370]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, May 14 15:39:53.432784 dv-cinder-839793-11-iscsi devstack@n-api.service[114370]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper May 14 15:39:53.432784 dv-cinder-839793-11-iscsi devstack@n-api.service[114370]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 14 15:39:53.432784 dv-cinder-839793-11-iscsi devstack@n-api.service[114370]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db May 14 15:39:53.432784 dv-cinder-839793-11-iscsi devstack@n-api.service[114370]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) May 14 15:39:53.432784 dv-cinder-839793-11-iscsi devstack@n-api.service[114370]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. May 14 15:39:53.432784 dv-cinder-839793-11-iscsi devstack@n-api.service[114370]: ERROR nova.api.openstack.wsgi May 14 15:39:53.432784 dv-cinder-839793-11-iscsi devstack@n-api.service[114370]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 14 15:39:53.432784 dv-cinder-839793-11-iscsi devstack@n-api.service[114370]: ERROR nova.api.openstack.wsgi May 14 15:39:53.432784 dv-cinder-839793-11-iscsi devstack@n-api.service[114370]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 15:39:53.432784 dv-cinder-839793-11-iscsi devstack@n-api.service[114370]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 14 15:39:53.432784 dv-cinder-839793-11-iscsi devstack@n-api.service[114370]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 14 15:39:53.433845 dv-cinder-839793-11-iscsi devstack@n-api.service[114370]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 14 15:39:53.433845 dv-cinder-839793-11-iscsi devstack@n-api.service[114370]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 14 15:39:53.433845 dv-cinder-839793-11-iscsi devstack@n-api.service[114370]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 14 15:39:53.433845 dv-cinder-839793-11-iscsi devstack@n-api.service[114370]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 14 15:39:53.433845 dv-cinder-839793-11-iscsi devstack@n-api.service[114370]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show May 14 15:39:53.433845 dv-cinder-839793-11-iscsi devstack@n-api.service[114370]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) May 14 15:39:53.433845 dv-cinder-839793-11-iscsi devstack@n-api.service[114370]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. May 14 15:39:53.433845 dv-cinder-839793-11-iscsi devstack@n-api.service[114370]: ERROR nova.api.openstack.wsgi May 14 15:39:53.433845 dv-cinder-839793-11-iscsi devstack@n-api.service[114370]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 14 15:39:53.433845 dv-cinder-839793-11-iscsi devstack@n-api.service[114370]: ERROR nova.api.openstack.wsgi May 14 15:39:53.433845 dv-cinder-839793-11-iscsi devstack@n-api.service[114370]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 15:39:53.433845 dv-cinder-839793-11-iscsi devstack@n-api.service[114370]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 14 15:39:53.433845 dv-cinder-839793-11-iscsi devstack@n-api.service[114370]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 14 15:39:53.433845 dv-cinder-839793-11-iscsi devstack@n-api.service[114370]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 14 15:39:53.433845 dv-cinder-839793-11-iscsi devstack@n-api.service[114370]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 14 15:39:53.433845 dv-cinder-839793-11-iscsi devstack@n-api.service[114370]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. May 14 15:39:53.433845 dv-cinder-839793-11-iscsi devstack@n-api.service[114370]: ERROR nova.api.openstack.wsgi May 14 15:39:53.433845 dv-cinder-839793-11-iscsi devstack@n-api.service[114370]: DEBUG nova.api.openstack.wsgi [None req-1bd39346-1ca3-46c9-97b1-6a920e5d560d admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=114370) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 14 15:39:53.434892 dv-cinder-839793-11-iscsi devstack@n-api.service[114370]: INFO nova.api.openstack.requestlog [None req-1bd39346-1ca3-46c9-97b1-6a920e5d560d admin admin] 10.222.0.61 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.013623 May 14 15:39:53.434892 dv-cinder-839793-11-iscsi devstack@n-api.service[114370]: [pid: 114370|app: 0|req: 22/42] 10.222.0.61 () {60 vars in 1190 bytes} [Sat May 14 15:39:53 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 15 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) May 14 15:39:54.313011 dv-cinder-839793-11-iscsi devstack@n-api.service[114371]: DEBUG nova.api.openstack.wsgi [None req-6c953748-c130-4702-b1c2-89e67b1e7825 admin admin] Calling method '>' {{(pid=114371) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 15:39:54.314097 dv-cinder-839793-11-iscsi devstack@n-api.service[114371]: INFO nova.api.openstack.requestlog [None req-6c953748-c130-4702-b1c2-89e67b1e7825 admin admin] 10.222.0.61 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001504 May 14 15:39:54.314533 dv-cinder-839793-11-iscsi devstack@n-api.service[114371]: [pid: 114371|app: 0|req: 21/43] 10.222.0.61 () {56 vars in 1074 bytes} [Sat May 14 15:39:54 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 14 15:39:54.500700 dv-cinder-839793-11-iscsi devstack@n-api.service[114370]: DEBUG nova.api.openstack.wsgi [None req-02670982-e3be-4c97-b6c1-d1d3cfddce84 admin admin] Calling method '>' {{(pid=114370) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 15:39:54.506037 dv-cinder-839793-11-iscsi devstack@n-api.service[114370]: INFO nova.api.openstack.wsgi [None req-02670982-e3be-4c97-b6c1-d1d3cfddce84 admin admin] HTTP exception thrown: Flavor 84 could not be found. May 14 15:39:54.507611 dv-cinder-839793-11-iscsi devstack@n-api.service[114370]: DEBUG nova.api.openstack.wsgi [None req-02670982-e3be-4c97-b6c1-d1d3cfddce84 admin admin] Request method failure captured: May 14 15:39:54.507611 dv-cinder-839793-11-iscsi devstack@n-api.service[114370]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 May 14 15:39:54.507611 dv-cinder-839793-11-iscsi devstack@n-api.service[114370]: Accept: application/json May 14 15:39:54.507611 dv-cinder-839793-11-iscsi devstack@n-api.service[114370]: Accept-Encoding: gzip, deflate May 14 15:39:54.507611 dv-cinder-839793-11-iscsi devstack@n-api.service[114370]: Connection: keep-alive May 14 15:39:54.507611 dv-cinder-839793-11-iscsi devstack@n-api.service[114370]: Content-Length: 0 May 14 15:39:54.507611 dv-cinder-839793-11-iscsi devstack@n-api.service[114370]: Host: 10.222.0.61 May 14 15:39:54.507611 dv-cinder-839793-11-iscsi devstack@n-api.service[114370]: Openstack-Api-Version: compute 2.90 May 14 15:39:54.507611 dv-cinder-839793-11-iscsi devstack@n-api.service[114370]: Openstack-System-Scope: None May 14 15:39:54.507611 dv-cinder-839793-11-iscsi devstack@n-api.service[114370]: User-Agent: python-novaclient May 14 15:39:54.507611 dv-cinder-839793-11-iscsi devstack@n-api.service[114370]: X-Auth-Token: gAAAAABif81K5GPADEy9JzoGngyImSnvI6Gqg5J92exHPsOQnQRBwtjQ-7W3UuWU99OLlGRvvmVYgPdqwz0ASbe4uejKZzxT7Xjfx7lBxfz9iMeEcJt2Y3MKp60cSMhin8TD5C7nxN_wWxcph2RnDauQsYo0oCg_iyNVjJV1kLyBuilge72C7X8 May 14 15:39:54.507611 dv-cinder-839793-11-iscsi devstack@n-api.service[114370]: X-Domain-Id: None May 14 15:39:54.507611 dv-cinder-839793-11-iscsi devstack@n-api.service[114370]: X-Domain-Name: None May 14 15:39:54.507611 dv-cinder-839793-11-iscsi devstack@n-api.service[114370]: X-Identity-Status: Confirmed May 14 15:39:54.507611 dv-cinder-839793-11-iscsi devstack@n-api.service[114370]: X-Is-Admin-Project: True May 14 15:39:54.507611 dv-cinder-839793-11-iscsi devstack@n-api.service[114370]: X-Openstack-Nova-Api-Version: 2.90 May 14 15:39:54.507611 dv-cinder-839793-11-iscsi devstack@n-api.service[114370]: X-Project-Domain-Id: default May 14 15:39:54.507611 dv-cinder-839793-11-iscsi devstack@n-api.service[114370]: X-Project-Domain-Name: Default May 14 15:39:54.507611 dv-cinder-839793-11-iscsi devstack@n-api.service[114370]: X-Project-Id: 562024bfc95645e098dcd57dfe3300a0 May 14 15:39:54.507611 dv-cinder-839793-11-iscsi devstack@n-api.service[114370]: X-Project-Name: admin May 14 15:39:54.507611 dv-cinder-839793-11-iscsi devstack@n-api.service[114370]: X-Role: admin,reader,member May 14 15:39:54.507611 dv-cinder-839793-11-iscsi devstack@n-api.service[114370]: X-Roles: admin,reader,member May 14 15:39:54.509110 dv-cinder-839793-11-iscsi devstack@n-api.service[114370]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/562024bfc95645e098dcd57dfe3300a0"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/562024bfc95645e098dcd57dfe3300a0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/562024bfc95645e098dcd57dfe3300a0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_562024bfc95645e098dcd57dfe3300a0"}]}] May 14 15:39:54.509110 dv-cinder-839793-11-iscsi devstack@n-api.service[114370]: X-Tenant: admin May 14 15:39:54.509110 dv-cinder-839793-11-iscsi devstack@n-api.service[114370]: X-Tenant-Id: 562024bfc95645e098dcd57dfe3300a0 May 14 15:39:54.509110 dv-cinder-839793-11-iscsi devstack@n-api.service[114370]: X-Tenant-Name: admin May 14 15:39:54.509110 dv-cinder-839793-11-iscsi devstack@n-api.service[114370]: X-User: admin May 14 15:39:54.509110 dv-cinder-839793-11-iscsi devstack@n-api.service[114370]: X-User-Domain-Id: default May 14 15:39:54.509110 dv-cinder-839793-11-iscsi devstack@n-api.service[114370]: X-User-Domain-Name: Default May 14 15:39:54.509110 dv-cinder-839793-11-iscsi devstack@n-api.service[114370]: X-User-Id: a7162b13b2c54f8cadf583b1df8219b5 May 14 15:39:54.509110 dv-cinder-839793-11-iscsi devstack@n-api.service[114370]: X-User-Name: admin May 14 15:39:54.509110 dv-cinder-839793-11-iscsi devstack@n-api.service[114370]: method: > May 14 15:39:54.509110 dv-cinder-839793-11-iscsi devstack@n-api.service[114370]: exception: Flavor 84 could not be found. May 14 15:39:54.509110 dv-cinder-839793-11-iscsi devstack@n-api.service[114370]: action_args: {'id': '84'} May 14 15:39:54.509110 dv-cinder-839793-11-iscsi devstack@n-api.service[114370]: {{(pid=114370) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 14 15:39:54.509110 dv-cinder-839793-11-iscsi devstack@n-api.service[114370]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 15:39:54.510047 dv-cinder-839793-11-iscsi devstack@n-api.service[114370]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show May 14 15:39:54.510047 dv-cinder-839793-11-iscsi devstack@n-api.service[114370]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) May 14 15:39:54.510047 dv-cinder-839793-11-iscsi devstack@n-api.service[114370]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id May 14 15:39:54.510047 dv-cinder-839793-11-iscsi devstack@n-api.service[114370]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) May 14 15:39:54.510047 dv-cinder-839793-11-iscsi devstack@n-api.service[114370]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper May 14 15:39:54.510047 dv-cinder-839793-11-iscsi devstack@n-api.service[114370]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) May 14 15:39:54.510047 dv-cinder-839793-11-iscsi devstack@n-api.service[114370]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id May 14 15:39:54.510047 dv-cinder-839793-11-iscsi devstack@n-api.service[114370]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, May 14 15:39:54.510047 dv-cinder-839793-11-iscsi devstack@n-api.service[114370]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper May 14 15:39:54.510047 dv-cinder-839793-11-iscsi devstack@n-api.service[114370]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 14 15:39:54.510047 dv-cinder-839793-11-iscsi devstack@n-api.service[114370]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db May 14 15:39:54.510047 dv-cinder-839793-11-iscsi devstack@n-api.service[114370]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) May 14 15:39:54.510047 dv-cinder-839793-11-iscsi devstack@n-api.service[114370]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. May 14 15:39:54.510047 dv-cinder-839793-11-iscsi devstack@n-api.service[114370]: ERROR nova.api.openstack.wsgi May 14 15:39:54.510047 dv-cinder-839793-11-iscsi devstack@n-api.service[114370]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 14 15:39:54.510047 dv-cinder-839793-11-iscsi devstack@n-api.service[114370]: ERROR nova.api.openstack.wsgi May 14 15:39:54.510047 dv-cinder-839793-11-iscsi devstack@n-api.service[114370]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 15:39:54.510047 dv-cinder-839793-11-iscsi devstack@n-api.service[114370]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 14 15:39:54.510047 dv-cinder-839793-11-iscsi devstack@n-api.service[114370]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 14 15:39:54.511347 dv-cinder-839793-11-iscsi devstack@n-api.service[114370]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 14 15:39:54.511347 dv-cinder-839793-11-iscsi devstack@n-api.service[114370]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 14 15:39:54.511347 dv-cinder-839793-11-iscsi devstack@n-api.service[114370]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 14 15:39:54.511347 dv-cinder-839793-11-iscsi devstack@n-api.service[114370]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 14 15:39:54.511347 dv-cinder-839793-11-iscsi devstack@n-api.service[114370]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show May 14 15:39:54.511347 dv-cinder-839793-11-iscsi devstack@n-api.service[114370]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) May 14 15:39:54.511347 dv-cinder-839793-11-iscsi devstack@n-api.service[114370]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. May 14 15:39:54.511347 dv-cinder-839793-11-iscsi devstack@n-api.service[114370]: ERROR nova.api.openstack.wsgi May 14 15:39:54.511347 dv-cinder-839793-11-iscsi devstack@n-api.service[114370]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 14 15:39:54.511347 dv-cinder-839793-11-iscsi devstack@n-api.service[114370]: ERROR nova.api.openstack.wsgi May 14 15:39:54.511347 dv-cinder-839793-11-iscsi devstack@n-api.service[114370]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 15:39:54.511347 dv-cinder-839793-11-iscsi devstack@n-api.service[114370]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 14 15:39:54.511347 dv-cinder-839793-11-iscsi devstack@n-api.service[114370]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 14 15:39:54.511347 dv-cinder-839793-11-iscsi devstack@n-api.service[114370]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 14 15:39:54.511347 dv-cinder-839793-11-iscsi devstack@n-api.service[114370]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 14 15:39:54.511347 dv-cinder-839793-11-iscsi devstack@n-api.service[114370]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. May 14 15:39:54.511347 dv-cinder-839793-11-iscsi devstack@n-api.service[114370]: ERROR nova.api.openstack.wsgi May 14 15:39:54.511347 dv-cinder-839793-11-iscsi devstack@n-api.service[114370]: DEBUG nova.api.openstack.wsgi [None req-02670982-e3be-4c97-b6c1-d1d3cfddce84 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=114370) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 14 15:39:54.512595 dv-cinder-839793-11-iscsi devstack@n-api.service[114370]: INFO nova.api.openstack.requestlog [None req-02670982-e3be-4c97-b6c1-d1d3cfddce84 admin admin] 10.222.0.61 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.060723 May 14 15:39:54.512595 dv-cinder-839793-11-iscsi devstack@n-api.service[114370]: [pid: 114370|app: 0|req: 23/44] 10.222.0.61 () {60 vars in 1190 bytes} [Sat May 14 15:39:54 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 62 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) May 14 15:39:54.519272 dv-cinder-839793-11-iscsi devstack@n-api.service[114371]: DEBUG nova.api.openstack.wsgi [None req-24b63e9e-8c55-48c1-9557-e0f6105d3971 admin admin] Calling method '>' {{(pid=114371) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 15:39:54.533389 dv-cinder-839793-11-iscsi devstack@n-api.service[114371]: INFO nova.api.openstack.requestlog [None req-24b63e9e-8c55-48c1-9557-e0f6105d3971 admin admin] 10.222.0.61 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.017592 May 14 15:39:54.533849 dv-cinder-839793-11-iscsi devstack@n-api.service[114371]: [pid: 114371|app: 0|req: 22/45] 10.222.0.61 () {60 vars in 1210 bytes} [Sat May 14 15:39:54 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 14 15:39:54.545289 dv-cinder-839793-11-iscsi devstack@n-api.service[114370]: DEBUG nova.api.openstack.wsgi [None req-5c954024-3e1c-4478-b3a0-48e62d779177 admin admin] Calling method '>' {{(pid=114370) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 15:39:54.559071 dv-cinder-839793-11-iscsi devstack@n-api.service[114370]: INFO nova.api.openstack.requestlog [None req-5c954024-3e1c-4478-b3a0-48e62d779177 admin admin] 10.222.0.61 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.019689 May 14 15:39:54.559611 dv-cinder-839793-11-iscsi devstack@n-api.service[114370]: [pid: 114370|app: 0|req: 24/46] 10.222.0.61 () {60 vars in 1210 bytes} [Sat May 14 15:39:54 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 21 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 14 15:39:54.568678 dv-cinder-839793-11-iscsi devstack@n-api.service[114371]: DEBUG nova.api.openstack.wsgi [None req-0ad8363e-8589-41f3-b898-b5b6219222fe admin admin] Calling method '>' {{(pid=114371) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 15:39:54.574207 dv-cinder-839793-11-iscsi devstack@n-api.service[114371]: INFO nova.api.openstack.wsgi [None req-0ad8363e-8589-41f3-b898-b5b6219222fe admin admin] HTTP exception thrown: Flavor 84 could not be found. May 14 15:39:54.575735 dv-cinder-839793-11-iscsi devstack@n-api.service[114371]: DEBUG nova.api.openstack.wsgi [None req-0ad8363e-8589-41f3-b898-b5b6219222fe admin admin] Request method failure captured: May 14 15:39:54.575735 dv-cinder-839793-11-iscsi devstack@n-api.service[114371]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 May 14 15:39:54.575735 dv-cinder-839793-11-iscsi devstack@n-api.service[114371]: Accept: application/json May 14 15:39:54.575735 dv-cinder-839793-11-iscsi devstack@n-api.service[114371]: Accept-Encoding: gzip, deflate May 14 15:39:54.575735 dv-cinder-839793-11-iscsi devstack@n-api.service[114371]: Connection: keep-alive May 14 15:39:54.575735 dv-cinder-839793-11-iscsi devstack@n-api.service[114371]: Content-Length: 0 May 14 15:39:54.575735 dv-cinder-839793-11-iscsi devstack@n-api.service[114371]: Host: 10.222.0.61 May 14 15:39:54.575735 dv-cinder-839793-11-iscsi devstack@n-api.service[114371]: Openstack-Api-Version: compute 2.90 May 14 15:39:54.575735 dv-cinder-839793-11-iscsi devstack@n-api.service[114371]: Openstack-System-Scope: None May 14 15:39:54.575735 dv-cinder-839793-11-iscsi devstack@n-api.service[114371]: User-Agent: python-novaclient May 14 15:39:54.575735 dv-cinder-839793-11-iscsi devstack@n-api.service[114371]: X-Auth-Token: gAAAAABif81K5GPADEy9JzoGngyImSnvI6Gqg5J92exHPsOQnQRBwtjQ-7W3UuWU99OLlGRvvmVYgPdqwz0ASbe4uejKZzxT7Xjfx7lBxfz9iMeEcJt2Y3MKp60cSMhin8TD5C7nxN_wWxcph2RnDauQsYo0oCg_iyNVjJV1kLyBuilge72C7X8 May 14 15:39:54.575735 dv-cinder-839793-11-iscsi devstack@n-api.service[114371]: X-Domain-Id: None May 14 15:39:54.575735 dv-cinder-839793-11-iscsi devstack@n-api.service[114371]: X-Domain-Name: None May 14 15:39:54.575735 dv-cinder-839793-11-iscsi devstack@n-api.service[114371]: X-Identity-Status: Confirmed May 14 15:39:54.575735 dv-cinder-839793-11-iscsi devstack@n-api.service[114371]: X-Is-Admin-Project: True May 14 15:39:54.575735 dv-cinder-839793-11-iscsi devstack@n-api.service[114371]: X-Openstack-Nova-Api-Version: 2.90 May 14 15:39:54.575735 dv-cinder-839793-11-iscsi devstack@n-api.service[114371]: X-Project-Domain-Id: default May 14 15:39:54.575735 dv-cinder-839793-11-iscsi devstack@n-api.service[114371]: X-Project-Domain-Name: Default May 14 15:39:54.575735 dv-cinder-839793-11-iscsi devstack@n-api.service[114371]: X-Project-Id: 562024bfc95645e098dcd57dfe3300a0 May 14 15:39:54.575735 dv-cinder-839793-11-iscsi devstack@n-api.service[114371]: X-Project-Name: admin May 14 15:39:54.575735 dv-cinder-839793-11-iscsi devstack@n-api.service[114371]: X-Role: admin,reader,member May 14 15:39:54.575735 dv-cinder-839793-11-iscsi devstack@n-api.service[114371]: X-Roles: admin,reader,member May 14 15:39:54.577828 dv-cinder-839793-11-iscsi devstack@n-api.service[114371]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/562024bfc95645e098dcd57dfe3300a0"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/562024bfc95645e098dcd57dfe3300a0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/562024bfc95645e098dcd57dfe3300a0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_562024bfc95645e098dcd57dfe3300a0"}]}] May 14 15:39:54.577828 dv-cinder-839793-11-iscsi devstack@n-api.service[114371]: X-Tenant: admin May 14 15:39:54.577828 dv-cinder-839793-11-iscsi devstack@n-api.service[114371]: X-Tenant-Id: 562024bfc95645e098dcd57dfe3300a0 May 14 15:39:54.577828 dv-cinder-839793-11-iscsi devstack@n-api.service[114371]: X-Tenant-Name: admin May 14 15:39:54.577828 dv-cinder-839793-11-iscsi devstack@n-api.service[114371]: X-User: admin May 14 15:39:54.577828 dv-cinder-839793-11-iscsi devstack@n-api.service[114371]: X-User-Domain-Id: default May 14 15:39:54.577828 dv-cinder-839793-11-iscsi devstack@n-api.service[114371]: X-User-Domain-Name: Default May 14 15:39:54.577828 dv-cinder-839793-11-iscsi devstack@n-api.service[114371]: X-User-Id: a7162b13b2c54f8cadf583b1df8219b5 May 14 15:39:54.577828 dv-cinder-839793-11-iscsi devstack@n-api.service[114371]: X-User-Name: admin May 14 15:39:54.577828 dv-cinder-839793-11-iscsi devstack@n-api.service[114371]: method: > May 14 15:39:54.577828 dv-cinder-839793-11-iscsi devstack@n-api.service[114371]: exception: Flavor 84 could not be found. May 14 15:39:54.577828 dv-cinder-839793-11-iscsi devstack@n-api.service[114371]: action_args: {'id': '84'} May 14 15:39:54.577828 dv-cinder-839793-11-iscsi devstack@n-api.service[114371]: {{(pid=114371) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 14 15:39:54.577828 dv-cinder-839793-11-iscsi devstack@n-api.service[114371]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 15:39:54.578826 dv-cinder-839793-11-iscsi devstack@n-api.service[114371]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show May 14 15:39:54.578826 dv-cinder-839793-11-iscsi devstack@n-api.service[114371]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) May 14 15:39:54.578826 dv-cinder-839793-11-iscsi devstack@n-api.service[114371]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id May 14 15:39:54.578826 dv-cinder-839793-11-iscsi devstack@n-api.service[114371]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) May 14 15:39:54.578826 dv-cinder-839793-11-iscsi devstack@n-api.service[114371]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper May 14 15:39:54.578826 dv-cinder-839793-11-iscsi devstack@n-api.service[114371]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) May 14 15:39:54.578826 dv-cinder-839793-11-iscsi devstack@n-api.service[114371]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id May 14 15:39:54.578826 dv-cinder-839793-11-iscsi devstack@n-api.service[114371]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, May 14 15:39:54.578826 dv-cinder-839793-11-iscsi devstack@n-api.service[114371]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper May 14 15:39:54.578826 dv-cinder-839793-11-iscsi devstack@n-api.service[114371]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 14 15:39:54.578826 dv-cinder-839793-11-iscsi devstack@n-api.service[114371]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db May 14 15:39:54.578826 dv-cinder-839793-11-iscsi devstack@n-api.service[114371]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) May 14 15:39:54.578826 dv-cinder-839793-11-iscsi devstack@n-api.service[114371]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. May 14 15:39:54.578826 dv-cinder-839793-11-iscsi devstack@n-api.service[114371]: ERROR nova.api.openstack.wsgi May 14 15:39:54.578826 dv-cinder-839793-11-iscsi devstack@n-api.service[114371]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 14 15:39:54.578826 dv-cinder-839793-11-iscsi devstack@n-api.service[114371]: ERROR nova.api.openstack.wsgi May 14 15:39:54.578826 dv-cinder-839793-11-iscsi devstack@n-api.service[114371]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 15:39:54.578826 dv-cinder-839793-11-iscsi devstack@n-api.service[114371]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 14 15:39:54.578826 dv-cinder-839793-11-iscsi devstack@n-api.service[114371]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 14 15:39:54.580258 dv-cinder-839793-11-iscsi devstack@n-api.service[114371]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 14 15:39:54.580258 dv-cinder-839793-11-iscsi devstack@n-api.service[114371]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 14 15:39:54.580258 dv-cinder-839793-11-iscsi devstack@n-api.service[114371]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 14 15:39:54.580258 dv-cinder-839793-11-iscsi devstack@n-api.service[114371]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 14 15:39:54.580258 dv-cinder-839793-11-iscsi devstack@n-api.service[114371]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show May 14 15:39:54.580258 dv-cinder-839793-11-iscsi devstack@n-api.service[114371]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) May 14 15:39:54.580258 dv-cinder-839793-11-iscsi devstack@n-api.service[114371]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. May 14 15:39:54.580258 dv-cinder-839793-11-iscsi devstack@n-api.service[114371]: ERROR nova.api.openstack.wsgi May 14 15:39:54.580258 dv-cinder-839793-11-iscsi devstack@n-api.service[114371]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 14 15:39:54.580258 dv-cinder-839793-11-iscsi devstack@n-api.service[114371]: ERROR nova.api.openstack.wsgi May 14 15:39:54.580258 dv-cinder-839793-11-iscsi devstack@n-api.service[114371]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 15:39:54.580258 dv-cinder-839793-11-iscsi devstack@n-api.service[114371]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 14 15:39:54.580258 dv-cinder-839793-11-iscsi devstack@n-api.service[114371]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 14 15:39:54.580258 dv-cinder-839793-11-iscsi devstack@n-api.service[114371]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 14 15:39:54.580258 dv-cinder-839793-11-iscsi devstack@n-api.service[114371]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 14 15:39:54.580258 dv-cinder-839793-11-iscsi devstack@n-api.service[114371]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. May 14 15:39:54.580258 dv-cinder-839793-11-iscsi devstack@n-api.service[114371]: ERROR nova.api.openstack.wsgi May 14 15:39:54.580258 dv-cinder-839793-11-iscsi devstack@n-api.service[114371]: DEBUG nova.api.openstack.wsgi [None req-0ad8363e-8589-41f3-b898-b5b6219222fe admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=114371) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 14 15:39:54.581560 dv-cinder-839793-11-iscsi devstack@n-api.service[114371]: INFO nova.api.openstack.requestlog [None req-0ad8363e-8589-41f3-b898-b5b6219222fe admin admin] 10.222.0.61 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.011917 May 14 15:39:54.581560 dv-cinder-839793-11-iscsi devstack@n-api.service[114371]: [pid: 114371|app: 0|req: 23/47] 10.222.0.61 () {60 vars in 1190 bytes} [Sat May 14 15:39:54 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 14 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) May 14 15:39:55.457145 dv-cinder-839793-11-iscsi devstack@n-api.service[114370]: DEBUG nova.api.openstack.wsgi [None req-5c954024-3e1c-4478-b3a0-48e62d779177 admin admin] Calling method '>' {{(pid=114370) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 15:39:55.458136 dv-cinder-839793-11-iscsi devstack@n-api.service[114370]: INFO nova.api.openstack.requestlog [None req-5c954024-3e1c-4478-b3a0-48e62d779177 admin admin] 10.222.0.61 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001401 May 14 15:39:55.458569 dv-cinder-839793-11-iscsi devstack@n-api.service[114370]: [pid: 114370|app: 0|req: 25/48] 10.222.0.61 () {56 vars in 1074 bytes} [Sat May 14 15:39:55 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 14 15:39:55.645061 dv-cinder-839793-11-iscsi devstack@n-api.service[114371]: DEBUG nova.api.openstack.wsgi [None req-188bbfa7-5b4c-4396-94b2-73e1a2de9962 admin admin] Calling method '>' {{(pid=114371) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 15:39:55.650590 dv-cinder-839793-11-iscsi devstack@n-api.service[114371]: INFO nova.api.openstack.wsgi [None req-188bbfa7-5b4c-4396-94b2-73e1a2de9962 admin admin] HTTP exception thrown: Flavor 451 could not be found. May 14 15:39:55.652092 dv-cinder-839793-11-iscsi devstack@n-api.service[114371]: DEBUG nova.api.openstack.wsgi [None req-188bbfa7-5b4c-4396-94b2-73e1a2de9962 admin admin] Request method failure captured: May 14 15:39:55.652092 dv-cinder-839793-11-iscsi devstack@n-api.service[114371]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 May 14 15:39:55.652092 dv-cinder-839793-11-iscsi devstack@n-api.service[114371]: Accept: application/json May 14 15:39:55.652092 dv-cinder-839793-11-iscsi devstack@n-api.service[114371]: Accept-Encoding: gzip, deflate May 14 15:39:55.652092 dv-cinder-839793-11-iscsi devstack@n-api.service[114371]: Connection: keep-alive May 14 15:39:55.652092 dv-cinder-839793-11-iscsi devstack@n-api.service[114371]: Content-Length: 0 May 14 15:39:55.652092 dv-cinder-839793-11-iscsi devstack@n-api.service[114371]: Host: 10.222.0.61 May 14 15:39:55.652092 dv-cinder-839793-11-iscsi devstack@n-api.service[114371]: Openstack-Api-Version: compute 2.90 May 14 15:39:55.652092 dv-cinder-839793-11-iscsi devstack@n-api.service[114371]: Openstack-System-Scope: None May 14 15:39:55.652092 dv-cinder-839793-11-iscsi devstack@n-api.service[114371]: User-Agent: python-novaclient May 14 15:39:55.652092 dv-cinder-839793-11-iscsi devstack@n-api.service[114371]: X-Auth-Token: gAAAAABif81L3m7SwZGfkeRHzk_sMKnRs1rUzx13KP51ZH-vtDEJUCLR6wTyJ-0FFjec7mXB8MpbOtb9beVi_WLHPLIG_7jlvf4gWV8KQJHR1ixsYfS5L6wfuU32wNsyQJfNHWtLfeIbt6P8QxaN4lJbgsXXN2rTRYhmF4vHm92sjvn5uFYVhNk May 14 15:39:55.652092 dv-cinder-839793-11-iscsi devstack@n-api.service[114371]: X-Domain-Id: None May 14 15:39:55.652092 dv-cinder-839793-11-iscsi devstack@n-api.service[114371]: X-Domain-Name: None May 14 15:39:55.652092 dv-cinder-839793-11-iscsi devstack@n-api.service[114371]: X-Identity-Status: Confirmed May 14 15:39:55.652092 dv-cinder-839793-11-iscsi devstack@n-api.service[114371]: X-Is-Admin-Project: True May 14 15:39:55.652092 dv-cinder-839793-11-iscsi devstack@n-api.service[114371]: X-Openstack-Nova-Api-Version: 2.90 May 14 15:39:55.652092 dv-cinder-839793-11-iscsi devstack@n-api.service[114371]: X-Project-Domain-Id: default May 14 15:39:55.652092 dv-cinder-839793-11-iscsi devstack@n-api.service[114371]: X-Project-Domain-Name: Default May 14 15:39:55.652092 dv-cinder-839793-11-iscsi devstack@n-api.service[114371]: X-Project-Id: 562024bfc95645e098dcd57dfe3300a0 May 14 15:39:55.652092 dv-cinder-839793-11-iscsi devstack@n-api.service[114371]: X-Project-Name: admin May 14 15:39:55.652092 dv-cinder-839793-11-iscsi devstack@n-api.service[114371]: X-Role: admin,reader,member May 14 15:39:55.652092 dv-cinder-839793-11-iscsi devstack@n-api.service[114371]: X-Roles: admin,reader,member May 14 15:39:55.653344 dv-cinder-839793-11-iscsi devstack@n-api.service[114371]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/562024bfc95645e098dcd57dfe3300a0"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/562024bfc95645e098dcd57dfe3300a0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/562024bfc95645e098dcd57dfe3300a0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_562024bfc95645e098dcd57dfe3300a0"}]}] May 14 15:39:55.653344 dv-cinder-839793-11-iscsi devstack@n-api.service[114371]: X-Tenant: admin May 14 15:39:55.653344 dv-cinder-839793-11-iscsi devstack@n-api.service[114371]: X-Tenant-Id: 562024bfc95645e098dcd57dfe3300a0 May 14 15:39:55.653344 dv-cinder-839793-11-iscsi devstack@n-api.service[114371]: X-Tenant-Name: admin May 14 15:39:55.653344 dv-cinder-839793-11-iscsi devstack@n-api.service[114371]: X-User: admin May 14 15:39:55.653344 dv-cinder-839793-11-iscsi devstack@n-api.service[114371]: X-User-Domain-Id: default May 14 15:39:55.653344 dv-cinder-839793-11-iscsi devstack@n-api.service[114371]: X-User-Domain-Name: Default May 14 15:39:55.653344 dv-cinder-839793-11-iscsi devstack@n-api.service[114371]: X-User-Id: a7162b13b2c54f8cadf583b1df8219b5 May 14 15:39:55.653344 dv-cinder-839793-11-iscsi devstack@n-api.service[114371]: X-User-Name: admin May 14 15:39:55.653344 dv-cinder-839793-11-iscsi devstack@n-api.service[114371]: method: > May 14 15:39:55.653344 dv-cinder-839793-11-iscsi devstack@n-api.service[114371]: exception: Flavor 451 could not be found. May 14 15:39:55.653344 dv-cinder-839793-11-iscsi devstack@n-api.service[114371]: action_args: {'id': '451'} May 14 15:39:55.653344 dv-cinder-839793-11-iscsi devstack@n-api.service[114371]: {{(pid=114371) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 14 15:39:55.653344 dv-cinder-839793-11-iscsi devstack@n-api.service[114371]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 15:39:55.654301 dv-cinder-839793-11-iscsi devstack@n-api.service[114371]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show May 14 15:39:55.654301 dv-cinder-839793-11-iscsi devstack@n-api.service[114371]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) May 14 15:39:55.654301 dv-cinder-839793-11-iscsi devstack@n-api.service[114371]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id May 14 15:39:55.654301 dv-cinder-839793-11-iscsi devstack@n-api.service[114371]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) May 14 15:39:55.654301 dv-cinder-839793-11-iscsi devstack@n-api.service[114371]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper May 14 15:39:55.654301 dv-cinder-839793-11-iscsi devstack@n-api.service[114371]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) May 14 15:39:55.654301 dv-cinder-839793-11-iscsi devstack@n-api.service[114371]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id May 14 15:39:55.654301 dv-cinder-839793-11-iscsi devstack@n-api.service[114371]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, May 14 15:39:55.654301 dv-cinder-839793-11-iscsi devstack@n-api.service[114371]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper May 14 15:39:55.654301 dv-cinder-839793-11-iscsi devstack@n-api.service[114371]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 14 15:39:55.654301 dv-cinder-839793-11-iscsi devstack@n-api.service[114371]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db May 14 15:39:55.654301 dv-cinder-839793-11-iscsi devstack@n-api.service[114371]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) May 14 15:39:55.654301 dv-cinder-839793-11-iscsi devstack@n-api.service[114371]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. May 14 15:39:55.654301 dv-cinder-839793-11-iscsi devstack@n-api.service[114371]: ERROR nova.api.openstack.wsgi May 14 15:39:55.654301 dv-cinder-839793-11-iscsi devstack@n-api.service[114371]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 14 15:39:55.654301 dv-cinder-839793-11-iscsi devstack@n-api.service[114371]: ERROR nova.api.openstack.wsgi May 14 15:39:55.654301 dv-cinder-839793-11-iscsi devstack@n-api.service[114371]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 15:39:55.654301 dv-cinder-839793-11-iscsi devstack@n-api.service[114371]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 14 15:39:55.654301 dv-cinder-839793-11-iscsi devstack@n-api.service[114371]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 14 15:39:55.656462 dv-cinder-839793-11-iscsi devstack@n-api.service[114371]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 14 15:39:55.656462 dv-cinder-839793-11-iscsi devstack@n-api.service[114371]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 14 15:39:55.656462 dv-cinder-839793-11-iscsi devstack@n-api.service[114371]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 14 15:39:55.656462 dv-cinder-839793-11-iscsi devstack@n-api.service[114371]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 14 15:39:55.656462 dv-cinder-839793-11-iscsi devstack@n-api.service[114371]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show May 14 15:39:55.656462 dv-cinder-839793-11-iscsi devstack@n-api.service[114371]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) May 14 15:39:55.656462 dv-cinder-839793-11-iscsi devstack@n-api.service[114371]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. May 14 15:39:55.656462 dv-cinder-839793-11-iscsi devstack@n-api.service[114371]: ERROR nova.api.openstack.wsgi May 14 15:39:55.656462 dv-cinder-839793-11-iscsi devstack@n-api.service[114371]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 14 15:39:55.656462 dv-cinder-839793-11-iscsi devstack@n-api.service[114371]: ERROR nova.api.openstack.wsgi May 14 15:39:55.656462 dv-cinder-839793-11-iscsi devstack@n-api.service[114371]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 15:39:55.656462 dv-cinder-839793-11-iscsi devstack@n-api.service[114371]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 14 15:39:55.656462 dv-cinder-839793-11-iscsi devstack@n-api.service[114371]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 14 15:39:55.656462 dv-cinder-839793-11-iscsi devstack@n-api.service[114371]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 14 15:39:55.656462 dv-cinder-839793-11-iscsi devstack@n-api.service[114371]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 14 15:39:55.656462 dv-cinder-839793-11-iscsi devstack@n-api.service[114371]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. May 14 15:39:55.656462 dv-cinder-839793-11-iscsi devstack@n-api.service[114371]: ERROR nova.api.openstack.wsgi May 14 15:39:55.656462 dv-cinder-839793-11-iscsi devstack@n-api.service[114371]: DEBUG nova.api.openstack.wsgi [None req-188bbfa7-5b4c-4396-94b2-73e1a2de9962 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=114371) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 14 15:39:55.657915 dv-cinder-839793-11-iscsi devstack@n-api.service[114371]: INFO nova.api.openstack.requestlog [None req-188bbfa7-5b4c-4396-94b2-73e1a2de9962 admin admin] 10.222.0.61 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.058662 May 14 15:39:55.657915 dv-cinder-839793-11-iscsi devstack@n-api.service[114371]: [pid: 114371|app: 0|req: 24/49] 10.222.0.61 () {60 vars in 1193 bytes} [Sat May 14 15:39:55 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 60 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) May 14 15:39:55.664271 dv-cinder-839793-11-iscsi devstack@n-api.service[114370]: DEBUG nova.api.openstack.wsgi [None req-2f518f01-43b7-4675-bed0-ffb51a601d1a admin admin] Calling method '>' {{(pid=114370) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 15:39:55.678494 dv-cinder-839793-11-iscsi devstack@n-api.service[114370]: INFO nova.api.openstack.requestlog [None req-2f518f01-43b7-4675-bed0-ffb51a601d1a admin admin] 10.222.0.61 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.017739 May 14 15:39:55.678960 dv-cinder-839793-11-iscsi devstack@n-api.service[114370]: [pid: 114370|app: 0|req: 26/50] 10.222.0.61 () {60 vars in 1210 bytes} [Sat May 14 15:39:55 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 14 15:39:55.688207 dv-cinder-839793-11-iscsi devstack@n-api.service[114371]: DEBUG nova.api.openstack.wsgi [None req-d36f9976-b3db-4c0e-9177-6125e1ad1e60 admin admin] Calling method '>' {{(pid=114371) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 15:39:55.701488 dv-cinder-839793-11-iscsi devstack@n-api.service[114371]: INFO nova.api.openstack.requestlog [None req-d36f9976-b3db-4c0e-9177-6125e1ad1e60 admin admin] 10.222.0.61 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.016869 May 14 15:39:55.702127 dv-cinder-839793-11-iscsi devstack@n-api.service[114371]: [pid: 114371|app: 0|req: 25/51] 10.222.0.61 () {60 vars in 1210 bytes} [Sat May 14 15:39:55 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 18 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 14 15:39:55.711014 dv-cinder-839793-11-iscsi devstack@n-api.service[114370]: DEBUG nova.api.openstack.wsgi [None req-b2b9a14a-ca20-4eea-a53c-75a8e1ffc57c admin admin] Calling method '>' {{(pid=114370) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 15:39:55.716094 dv-cinder-839793-11-iscsi devstack@n-api.service[114370]: INFO nova.api.openstack.wsgi [None req-b2b9a14a-ca20-4eea-a53c-75a8e1ffc57c admin admin] HTTP exception thrown: Flavor 451 could not be found. May 14 15:39:55.718268 dv-cinder-839793-11-iscsi devstack@n-api.service[114370]: DEBUG nova.api.openstack.wsgi [None req-b2b9a14a-ca20-4eea-a53c-75a8e1ffc57c admin admin] Request method failure captured: May 14 15:39:55.718268 dv-cinder-839793-11-iscsi devstack@n-api.service[114370]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 May 14 15:39:55.718268 dv-cinder-839793-11-iscsi devstack@n-api.service[114370]: Accept: application/json May 14 15:39:55.718268 dv-cinder-839793-11-iscsi devstack@n-api.service[114370]: Accept-Encoding: gzip, deflate May 14 15:39:55.718268 dv-cinder-839793-11-iscsi devstack@n-api.service[114370]: Connection: keep-alive May 14 15:39:55.718268 dv-cinder-839793-11-iscsi devstack@n-api.service[114370]: Content-Length: 0 May 14 15:39:55.718268 dv-cinder-839793-11-iscsi devstack@n-api.service[114370]: Host: 10.222.0.61 May 14 15:39:55.718268 dv-cinder-839793-11-iscsi devstack@n-api.service[114370]: Openstack-Api-Version: compute 2.90 May 14 15:39:55.718268 dv-cinder-839793-11-iscsi devstack@n-api.service[114370]: Openstack-System-Scope: None May 14 15:39:55.718268 dv-cinder-839793-11-iscsi devstack@n-api.service[114370]: User-Agent: python-novaclient May 14 15:39:55.718268 dv-cinder-839793-11-iscsi devstack@n-api.service[114370]: X-Auth-Token: gAAAAABif81L3m7SwZGfkeRHzk_sMKnRs1rUzx13KP51ZH-vtDEJUCLR6wTyJ-0FFjec7mXB8MpbOtb9beVi_WLHPLIG_7jlvf4gWV8KQJHR1ixsYfS5L6wfuU32wNsyQJfNHWtLfeIbt6P8QxaN4lJbgsXXN2rTRYhmF4vHm92sjvn5uFYVhNk May 14 15:39:55.718268 dv-cinder-839793-11-iscsi devstack@n-api.service[114370]: X-Domain-Id: None May 14 15:39:55.718268 dv-cinder-839793-11-iscsi devstack@n-api.service[114370]: X-Domain-Name: None May 14 15:39:55.718268 dv-cinder-839793-11-iscsi devstack@n-api.service[114370]: X-Identity-Status: Confirmed May 14 15:39:55.718268 dv-cinder-839793-11-iscsi devstack@n-api.service[114370]: X-Is-Admin-Project: True May 14 15:39:55.718268 dv-cinder-839793-11-iscsi devstack@n-api.service[114370]: X-Openstack-Nova-Api-Version: 2.90 May 14 15:39:55.718268 dv-cinder-839793-11-iscsi devstack@n-api.service[114370]: X-Project-Domain-Id: default May 14 15:39:55.718268 dv-cinder-839793-11-iscsi devstack@n-api.service[114370]: X-Project-Domain-Name: Default May 14 15:39:55.718268 dv-cinder-839793-11-iscsi devstack@n-api.service[114370]: X-Project-Id: 562024bfc95645e098dcd57dfe3300a0 May 14 15:39:55.718268 dv-cinder-839793-11-iscsi devstack@n-api.service[114370]: X-Project-Name: admin May 14 15:39:55.718268 dv-cinder-839793-11-iscsi devstack@n-api.service[114370]: X-Role: admin,reader,member May 14 15:39:55.718268 dv-cinder-839793-11-iscsi devstack@n-api.service[114370]: X-Roles: admin,reader,member May 14 15:39:55.720031 dv-cinder-839793-11-iscsi devstack@n-api.service[114370]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/562024bfc95645e098dcd57dfe3300a0"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/562024bfc95645e098dcd57dfe3300a0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/562024bfc95645e098dcd57dfe3300a0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_562024bfc95645e098dcd57dfe3300a0"}]}] May 14 15:39:55.720031 dv-cinder-839793-11-iscsi devstack@n-api.service[114370]: X-Tenant: admin May 14 15:39:55.720031 dv-cinder-839793-11-iscsi devstack@n-api.service[114370]: X-Tenant-Id: 562024bfc95645e098dcd57dfe3300a0 May 14 15:39:55.720031 dv-cinder-839793-11-iscsi devstack@n-api.service[114370]: X-Tenant-Name: admin May 14 15:39:55.720031 dv-cinder-839793-11-iscsi devstack@n-api.service[114370]: X-User: admin May 14 15:39:55.720031 dv-cinder-839793-11-iscsi devstack@n-api.service[114370]: X-User-Domain-Id: default May 14 15:39:55.720031 dv-cinder-839793-11-iscsi devstack@n-api.service[114370]: X-User-Domain-Name: Default May 14 15:39:55.720031 dv-cinder-839793-11-iscsi devstack@n-api.service[114370]: X-User-Id: a7162b13b2c54f8cadf583b1df8219b5 May 14 15:39:55.720031 dv-cinder-839793-11-iscsi devstack@n-api.service[114370]: X-User-Name: admin May 14 15:39:55.720031 dv-cinder-839793-11-iscsi devstack@n-api.service[114370]: method: > May 14 15:39:55.720031 dv-cinder-839793-11-iscsi devstack@n-api.service[114370]: exception: Flavor 451 could not be found. May 14 15:39:55.720031 dv-cinder-839793-11-iscsi devstack@n-api.service[114370]: action_args: {'id': '451'} May 14 15:39:55.720031 dv-cinder-839793-11-iscsi devstack@n-api.service[114370]: {{(pid=114370) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 14 15:39:55.720031 dv-cinder-839793-11-iscsi devstack@n-api.service[114370]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 15:39:55.720966 dv-cinder-839793-11-iscsi devstack@n-api.service[114370]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show May 14 15:39:55.720966 dv-cinder-839793-11-iscsi devstack@n-api.service[114370]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) May 14 15:39:55.720966 dv-cinder-839793-11-iscsi devstack@n-api.service[114370]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id May 14 15:39:55.720966 dv-cinder-839793-11-iscsi devstack@n-api.service[114370]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) May 14 15:39:55.720966 dv-cinder-839793-11-iscsi devstack@n-api.service[114370]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper May 14 15:39:55.720966 dv-cinder-839793-11-iscsi devstack@n-api.service[114370]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) May 14 15:39:55.720966 dv-cinder-839793-11-iscsi devstack@n-api.service[114370]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id May 14 15:39:55.720966 dv-cinder-839793-11-iscsi devstack@n-api.service[114370]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, May 14 15:39:55.720966 dv-cinder-839793-11-iscsi devstack@n-api.service[114370]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper May 14 15:39:55.720966 dv-cinder-839793-11-iscsi devstack@n-api.service[114370]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 14 15:39:55.720966 dv-cinder-839793-11-iscsi devstack@n-api.service[114370]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db May 14 15:39:55.720966 dv-cinder-839793-11-iscsi devstack@n-api.service[114370]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) May 14 15:39:55.720966 dv-cinder-839793-11-iscsi devstack@n-api.service[114370]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. May 14 15:39:55.720966 dv-cinder-839793-11-iscsi devstack@n-api.service[114370]: ERROR nova.api.openstack.wsgi May 14 15:39:55.720966 dv-cinder-839793-11-iscsi devstack@n-api.service[114370]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 14 15:39:55.720966 dv-cinder-839793-11-iscsi devstack@n-api.service[114370]: ERROR nova.api.openstack.wsgi May 14 15:39:55.720966 dv-cinder-839793-11-iscsi devstack@n-api.service[114370]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 15:39:55.720966 dv-cinder-839793-11-iscsi devstack@n-api.service[114370]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 14 15:39:55.720966 dv-cinder-839793-11-iscsi devstack@n-api.service[114370]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 14 15:39:55.722019 dv-cinder-839793-11-iscsi devstack@n-api.service[114370]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 14 15:39:55.722019 dv-cinder-839793-11-iscsi devstack@n-api.service[114370]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 14 15:39:55.722019 dv-cinder-839793-11-iscsi devstack@n-api.service[114370]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 14 15:39:55.722019 dv-cinder-839793-11-iscsi devstack@n-api.service[114370]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 14 15:39:55.722019 dv-cinder-839793-11-iscsi devstack@n-api.service[114370]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show May 14 15:39:55.722019 dv-cinder-839793-11-iscsi devstack@n-api.service[114370]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) May 14 15:39:55.722019 dv-cinder-839793-11-iscsi devstack@n-api.service[114370]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. May 14 15:39:55.722019 dv-cinder-839793-11-iscsi devstack@n-api.service[114370]: ERROR nova.api.openstack.wsgi May 14 15:39:55.722019 dv-cinder-839793-11-iscsi devstack@n-api.service[114370]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 14 15:39:55.722019 dv-cinder-839793-11-iscsi devstack@n-api.service[114370]: ERROR nova.api.openstack.wsgi May 14 15:39:55.722019 dv-cinder-839793-11-iscsi devstack@n-api.service[114370]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 15:39:55.722019 dv-cinder-839793-11-iscsi devstack@n-api.service[114370]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 14 15:39:55.722019 dv-cinder-839793-11-iscsi devstack@n-api.service[114370]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 14 15:39:55.722019 dv-cinder-839793-11-iscsi devstack@n-api.service[114370]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 14 15:39:55.722019 dv-cinder-839793-11-iscsi devstack@n-api.service[114370]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 14 15:39:55.722019 dv-cinder-839793-11-iscsi devstack@n-api.service[114370]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. May 14 15:39:55.722019 dv-cinder-839793-11-iscsi devstack@n-api.service[114370]: ERROR nova.api.openstack.wsgi May 14 15:39:55.722019 dv-cinder-839793-11-iscsi devstack@n-api.service[114370]: DEBUG nova.api.openstack.wsgi [None req-b2b9a14a-ca20-4eea-a53c-75a8e1ffc57c admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=114370) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 14 15:39:55.723088 dv-cinder-839793-11-iscsi devstack@n-api.service[114370]: INFO nova.api.openstack.requestlog [None req-b2b9a14a-ca20-4eea-a53c-75a8e1ffc57c admin admin] 10.222.0.61 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.012131 May 14 15:39:55.723088 dv-cinder-839793-11-iscsi devstack@n-api.service[114370]: [pid: 114370|app: 0|req: 27/52] 10.222.0.61 () {60 vars in 1193 bytes} [Sat May 14 15:39:55 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) May 14 15:39:56.604938 dv-cinder-839793-11-iscsi devstack@n-api.service[114371]: DEBUG nova.api.openstack.wsgi [None req-d36f9976-b3db-4c0e-9177-6125e1ad1e60 admin admin] Calling method '>' {{(pid=114371) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 15:39:56.605949 dv-cinder-839793-11-iscsi devstack@n-api.service[114371]: INFO nova.api.openstack.requestlog [None req-d36f9976-b3db-4c0e-9177-6125e1ad1e60 admin admin] 10.222.0.61 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001462 May 14 15:39:56.606518 dv-cinder-839793-11-iscsi devstack@n-api.service[114371]: [pid: 114371|app: 0|req: 26/53] 10.222.0.61 () {56 vars in 1074 bytes} [Sat May 14 15:39:56 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 14 15:39:56.793719 dv-cinder-839793-11-iscsi devstack@n-api.service[114370]: DEBUG nova.api.openstack.wsgi [None req-50a0305d-3c7e-4f81-8c74-a3eb4dfc533c admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=114370) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 15:39:56.811397 dv-cinder-839793-11-iscsi devstack@n-api.service[114370]: INFO nova.api.openstack.requestlog [None req-50a0305d-3c7e-4f81-8c74-a3eb4dfc533c admin admin] 10.222.0.61 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.90 time: 0.068129 May 14 15:39:56.811932 dv-cinder-839793-11-iscsi devstack@n-api.service[114370]: [pid: 114370|app: 0|req: 28/54] 10.222.0.61 () {64 vars in 1235 bytes} [Sat May 14 15:39:56 2022] POST /compute/v2.1/flavors => generated 404 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 14 15:39:57.700930 dv-cinder-839793-11-iscsi devstack@n-api.service[114371]: DEBUG nova.api.openstack.wsgi [None req-d36f9976-b3db-4c0e-9177-6125e1ad1e60 admin admin] Calling method '>' {{(pid=114371) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 15:39:57.702602 dv-cinder-839793-11-iscsi devstack@n-api.service[114371]: INFO nova.api.openstack.requestlog [None req-d36f9976-b3db-4c0e-9177-6125e1ad1e60 admin admin] 10.222.0.61 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001416 May 14 15:39:57.702998 dv-cinder-839793-11-iscsi devstack@n-api.service[114371]: [pid: 114371|app: 0|req: 27/55] 10.222.0.61 () {56 vars in 1074 bytes} [Sat May 14 15:39:57 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 14 15:39:57.889798 dv-cinder-839793-11-iscsi devstack@n-api.service[114370]: DEBUG nova.api.openstack.wsgi [None req-60634a84-16b6-46d6-b721-092012252513 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=114370) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 15:39:57.907045 dv-cinder-839793-11-iscsi devstack@n-api.service[114370]: INFO nova.api.openstack.requestlog [None req-60634a84-16b6-46d6-b721-092012252513 admin admin] 10.222.0.61 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.90 time: 0.068297 May 14 15:39:57.907588 dv-cinder-839793-11-iscsi devstack@n-api.service[114370]: [pid: 114370|app: 0|req: 29/56] 10.222.0.61 () {64 vars in 1235 bytes} [Sat May 14 15:39:57 2022] POST /compute/v2.1/flavors => generated 405 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 14 15:39:58.785334 dv-cinder-839793-11-iscsi devstack@n-api.service[114371]: DEBUG nova.api.openstack.wsgi [None req-d36f9976-b3db-4c0e-9177-6125e1ad1e60 admin admin] Calling method '>' {{(pid=114371) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 15:39:58.786354 dv-cinder-839793-11-iscsi devstack@n-api.service[114371]: INFO nova.api.openstack.requestlog [None req-d36f9976-b3db-4c0e-9177-6125e1ad1e60 admin admin] 10.222.0.61 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001409 May 14 15:39:58.786753 dv-cinder-839793-11-iscsi devstack@n-api.service[114371]: [pid: 114371|app: 0|req: 28/57] 10.222.0.61 () {56 vars in 1074 bytes} [Sat May 14 15:39:58 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 14 15:39:58.975147 dv-cinder-839793-11-iscsi devstack@n-api.service[114370]: DEBUG nova.api.openstack.wsgi [None req-0fc20b19-21e4-4931-8c8f-0a0dc32befbf admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=114370) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 15:39:58.992662 dv-cinder-839793-11-iscsi devstack@n-api.service[114370]: INFO nova.api.openstack.requestlog [None req-0fc20b19-21e4-4931-8c8f-0a0dc32befbf admin admin] 10.222.0.61 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.90 time: 0.068894 May 14 15:39:58.993215 dv-cinder-839793-11-iscsi devstack@n-api.service[114370]: [pid: 114370|app: 0|req: 30/58] 10.222.0.61 () {64 vars in 1235 bytes} [Sat May 14 15:39:58 2022] POST /compute/v2.1/flavors => generated 407 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 14 15:39:59.869515 dv-cinder-839793-11-iscsi devstack@n-api.service[114371]: DEBUG nova.api.openstack.wsgi [None req-d36f9976-b3db-4c0e-9177-6125e1ad1e60 admin admin] Calling method '>' {{(pid=114371) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 15:39:59.870587 dv-cinder-839793-11-iscsi devstack@n-api.service[114371]: INFO nova.api.openstack.requestlog [None req-d36f9976-b3db-4c0e-9177-6125e1ad1e60 admin admin] 10.222.0.61 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001481 May 14 15:39:59.870988 dv-cinder-839793-11-iscsi devstack@n-api.service[114371]: [pid: 114371|app: 0|req: 29/59] 10.222.0.61 () {56 vars in 1074 bytes} [Sat May 14 15:39:59 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 14 15:40:00.057822 dv-cinder-839793-11-iscsi devstack@n-api.service[114370]: DEBUG nova.api.openstack.wsgi [None req-b6032bd5-1553-48c7-8fbc-87a9abc9c5a3 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=114370) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 15:40:00.075807 dv-cinder-839793-11-iscsi devstack@n-api.service[114370]: INFO nova.api.openstack.requestlog [None req-b6032bd5-1553-48c7-8fbc-87a9abc9c5a3 admin admin] 10.222.0.61 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.90 time: 0.070035 May 14 15:40:00.076346 dv-cinder-839793-11-iscsi devstack@n-api.service[114370]: [pid: 114370|app: 0|req: 31/60] 10.222.0.61 () {64 vars in 1235 bytes} [Sat May 14 15:40:00 2022] POST /compute/v2.1/flavors => generated 409 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 14 15:40:00.963329 dv-cinder-839793-11-iscsi devstack@n-api.service[114371]: DEBUG nova.api.openstack.wsgi [None req-d36f9976-b3db-4c0e-9177-6125e1ad1e60 admin admin] Calling method '>' {{(pid=114371) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 15:40:00.964340 dv-cinder-839793-11-iscsi devstack@n-api.service[114371]: INFO nova.api.openstack.requestlog [None req-d36f9976-b3db-4c0e-9177-6125e1ad1e60 admin admin] 10.222.0.61 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001418 May 14 15:40:00.964748 dv-cinder-839793-11-iscsi devstack@n-api.service[114371]: [pid: 114371|app: 0|req: 30/61] 10.222.0.61 () {56 vars in 1074 bytes} [Sat May 14 15:40:00 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 14 15:40:01.151668 dv-cinder-839793-11-iscsi devstack@n-api.service[114370]: DEBUG nova.api.openstack.wsgi [None req-edde4377-a79f-44c7-89dc-d2e7767816b3 admin admin] Calling method '>' {{(pid=114370) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 15:40:01.171145 dv-cinder-839793-11-iscsi devstack@n-api.service[114370]: INFO nova.api.openstack.requestlog [None req-edde4377-a79f-44c7-89dc-d2e7767816b3 admin admin] 10.222.0.61 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.90 time: 0.070706 May 14 15:40:01.171673 dv-cinder-839793-11-iscsi devstack@n-api.service[114370]: [pid: 114370|app: 0|req: 32/62] 10.222.0.61 () {60 vars in 1202 bytes} [Sat May 14 15:40:01 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 14 15:41:02.879457 dv-cinder-839793-11-iscsi devstack@n-api.service[114371]: DEBUG nova.api.openstack.wsgi [None req-d36f9976-b3db-4c0e-9177-6125e1ad1e60 admin admin] Calling method '>' {{(pid=114371) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 15:41:02.880466 dv-cinder-839793-11-iscsi devstack@n-api.service[114371]: INFO nova.api.openstack.requestlog [None req-d36f9976-b3db-4c0e-9177-6125e1ad1e60 admin admin] 10.222.0.61 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001425 May 14 15:41:02.880871 dv-cinder-839793-11-iscsi devstack@n-api.service[114371]: [pid: 114371|app: 0|req: 31/63] 10.222.0.61 () {54 vars in 930 bytes} [Sat May 14 15:41:02 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 14 15:41:02.938472 dv-cinder-839793-11-iscsi devstack@n-api.service[114370]: DEBUG nova.api.openstack.wsgi [None req-210b77a7-5347-4f9f-ab38-7e97d77ed7c5 admin admin] Calling method '>' {{(pid=114370) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 15:41:02.957876 dv-cinder-839793-11-iscsi devstack@n-api.service[114370]: INFO nova.api.openstack.requestlog [None req-210b77a7-5347-4f9f-ab38-7e97d77ed7c5 admin admin] 10.222.0.61 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.070893 May 14 15:41:02.958421 dv-cinder-839793-11-iscsi devstack@n-api.service[114370]: [pid: 114370|app: 0|req: 33/64] 10.222.0.61 () {60 vars in 1291 bytes} [Sat May 14 15:41:02 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 14 15:41:02.980906 dv-cinder-839793-11-iscsi devstack@n-api.service[114371]: DEBUG nova.api.openstack.wsgi [None req-6cec431f-9d07-4e1d-9b2e-aa681dd2ebf0 admin admin] Calling method '>' {{(pid=114371) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 15:41:02.988896 dv-cinder-839793-11-iscsi devstack@n-api.service[114371]: INFO nova.api.openstack.requestlog [None req-6cec431f-9d07-4e1d-9b2e-aa681dd2ebf0 admin admin] 10.222.0.61 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.012271 May 14 15:41:02.989412 dv-cinder-839793-11-iscsi devstack@n-api.service[114371]: [pid: 114371|app: 0|req: 32/65] 10.222.0.61 () {60 vars in 1282 bytes} [Sat May 14 15:41:02 2022] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 15:41:03.000943 dv-cinder-839793-11-iscsi devstack@n-api.service[114370]: DEBUG nova.api.openstack.wsgi [None req-6fbe8999-69f5-4c0c-8123-7021326b8d5a admin admin] Calling method '>' {{(pid=114370) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 15:41:03.008340 dv-cinder-839793-11-iscsi devstack@n-api.service[114370]: INFO nova.api.openstack.requestlog [None req-6fbe8999-69f5-4c0c-8123-7021326b8d5a admin admin] 10.222.0.61 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011497 May 14 15:41:03.008863 dv-cinder-839793-11-iscsi devstack@n-api.service[114370]: [pid: 114370|app: 0|req: 34/66] 10.222.0.61 () {60 vars in 1285 bytes} [Sat May 14 15:41:02 2022] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 15:41:03.020404 dv-cinder-839793-11-iscsi devstack@n-api.service[114371]: DEBUG nova.api.openstack.wsgi [None req-1775c43b-fb1b-44c8-bc63-ff2baa43e163 admin admin] Calling method '>' {{(pid=114371) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 15:41:03.027804 dv-cinder-839793-11-iscsi devstack@n-api.service[114371]: INFO nova.api.openstack.requestlog [None req-1775c43b-fb1b-44c8-bc63-ff2baa43e163 admin admin] 10.222.0.61 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.010790 May 14 15:41:03.028408 dv-cinder-839793-11-iscsi devstack@n-api.service[114371]: [pid: 114371|app: 0|req: 33/67] 10.222.0.61 () {60 vars in 1285 bytes} [Sat May 14 15:41:03 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 15:41:03.039915 dv-cinder-839793-11-iscsi devstack@n-api.service[114370]: DEBUG nova.api.openstack.wsgi [None req-47546d06-1c01-46d4-b9c8-2d564710e9b4 admin admin] Calling method '>' {{(pid=114370) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 15:41:03.048489 dv-cinder-839793-11-iscsi devstack@n-api.service[114370]: INFO nova.api.openstack.requestlog [None req-47546d06-1c01-46d4-b9c8-2d564710e9b4 admin admin] 10.222.0.61 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.012157 May 14 15:41:03.049020 dv-cinder-839793-11-iscsi devstack@n-api.service[114370]: [pid: 114370|app: 0|req: 35/68] 10.222.0.61 () {60 vars in 1282 bytes} [Sat May 14 15:41:03 2022] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 15:44:18.871737 dv-cinder-839793-11-iscsi devstack@n-api.service[114371]: DEBUG nova.api.openstack.wsgi [None req-1775c43b-fb1b-44c8-bc63-ff2baa43e163 admin admin] Calling method '>' {{(pid=114371) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 15:44:18.872735 dv-cinder-839793-11-iscsi devstack@n-api.service[114371]: INFO nova.api.openstack.requestlog [None req-1775c43b-fb1b-44c8-bc63-ff2baa43e163 admin admin] 10.222.0.61 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001425 May 14 15:44:18.873127 dv-cinder-839793-11-iscsi devstack@n-api.service[114371]: [pid: 114371|app: 0|req: 34/69] 10.222.0.61 () {56 vars in 1074 bytes} [Sat May 14 15:44:18 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 14 15:44:19.137353 dv-cinder-839793-11-iscsi devstack@n-api.service[114370]: DEBUG nova.api.openstack.wsgi [None req-c462ef86-0082-4733-b3cc-a1c8505a7c75 admin admin] Calling method '>' {{(pid=114370) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 15:44:19.138547 dv-cinder-839793-11-iscsi devstack@n-api.service[114370]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 14 15:44:19.138547 dv-cinder-839793-11-iscsi devstack@n-api.service[114370]: warnings.warn(msg) May 14 15:44:19.139734 dv-cinder-839793-11-iscsi devstack@n-api.service[114370]: DEBUG oslo_concurrency.lockutils [None req-c462ef86-0082-4733-b3cc-a1c8505a7c75 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:44:19.140171 dv-cinder-839793-11-iscsi devstack@n-api.service[114370]: DEBUG oslo_concurrency.lockutils [None req-c462ef86-0082-4733-b3cc-a1c8505a7c75 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:44:19.140982 dv-cinder-839793-11-iscsi devstack@n-api.service[114370]: DEBUG oslo_concurrency.lockutils [None req-c462ef86-0082-4733-b3cc-a1c8505a7c75 admin admin] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:44:19.141411 dv-cinder-839793-11-iscsi devstack@n-api.service[114370]: DEBUG oslo_concurrency.lockutils [None req-c462ef86-0082-4733-b3cc-a1c8505a7c75 admin admin] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:44:19.173706 dv-cinder-839793-11-iscsi devstack@n-api.service[114370]: INFO nova.api.openstack.requestlog [None req-c462ef86-0082-4733-b3cc-a1c8505a7c75 admin admin] 10.222.0.61 "GET /compute/v2.1/os-services" status: 200 len: 794 microversion: 2.90 time: 0.147006 May 14 15:44:19.174259 dv-cinder-839793-11-iscsi devstack@n-api.service[114370]: [pid: 114370|app: 0|req: 36/70] 10.222.0.61 () {60 vars in 1193 bytes} [Sat May 14 15:44:19 2022] GET /compute/v2.1/os-services => generated 794 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) May 14 15:44:20.062695 dv-cinder-839793-11-iscsi devstack@n-api.service[114371]: DEBUG nova.api.openstack.wsgi [None req-1775c43b-fb1b-44c8-bc63-ff2baa43e163 admin admin] Calling method '>' {{(pid=114371) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 15:44:20.063696 dv-cinder-839793-11-iscsi devstack@n-api.service[114371]: INFO nova.api.openstack.requestlog [None req-1775c43b-fb1b-44c8-bc63-ff2baa43e163 admin admin] 10.222.0.61 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001438 May 14 15:44:20.064090 dv-cinder-839793-11-iscsi devstack@n-api.service[114371]: [pid: 114371|app: 0|req: 35/71] 10.222.0.61 () {56 vars in 1074 bytes} [Sat May 14 15:44:20 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 14 15:44:20.251802 dv-cinder-839793-11-iscsi devstack@n-api.service[114370]: DEBUG nova.api.openstack.wsgi [None req-9cbb6df1-75f3-4033-8d6f-3e64b23e6ca1 admin admin] Calling method '>' {{(pid=114370) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 15:44:20.252992 dv-cinder-839793-11-iscsi devstack@n-api.service[114370]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 14 15:44:20.252992 dv-cinder-839793-11-iscsi devstack@n-api.service[114370]: warnings.warn(msg) May 14 15:44:20.254170 dv-cinder-839793-11-iscsi devstack@n-api.service[114370]: DEBUG oslo_concurrency.lockutils [None req-9cbb6df1-75f3-4033-8d6f-3e64b23e6ca1 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:44:20.254658 dv-cinder-839793-11-iscsi devstack@n-api.service[114370]: DEBUG oslo_concurrency.lockutils [None req-9cbb6df1-75f3-4033-8d6f-3e64b23e6ca1 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:44:20.255447 dv-cinder-839793-11-iscsi devstack@n-api.service[114370]: DEBUG oslo_concurrency.lockutils [None req-9cbb6df1-75f3-4033-8d6f-3e64b23e6ca1 admin admin] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:44:20.255869 dv-cinder-839793-11-iscsi devstack@n-api.service[114370]: DEBUG oslo_concurrency.lockutils [None req-9cbb6df1-75f3-4033-8d6f-3e64b23e6ca1 admin admin] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:44:20.274718 dv-cinder-839793-11-iscsi devstack@n-api.service[114370]: INFO nova.api.openstack.requestlog [None req-9cbb6df1-75f3-4033-8d6f-3e64b23e6ca1 admin admin] 10.222.0.61 "GET /compute/v2.1/os-services" status: 200 len: 794 microversion: 2.90 time: 0.073706 May 14 15:44:20.275963 dv-cinder-839793-11-iscsi devstack@n-api.service[114370]: [pid: 114370|app: 0|req: 37/72] 10.222.0.61 () {60 vars in 1193 bytes} [Sat May 14 15:44:20 2022] GET /compute/v2.1/os-services => generated 794 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 14 15:44:31.600666 dv-cinder-839793-11-iscsi devstack@n-api.service[114371]: DEBUG nova.api.openstack.wsgi [None req-1775c43b-fb1b-44c8-bc63-ff2baa43e163 admin admin] Calling method '>' {{(pid=114371) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 15:44:31.601670 dv-cinder-839793-11-iscsi devstack@n-api.service[114371]: INFO nova.api.openstack.requestlog [None req-1775c43b-fb1b-44c8-bc63-ff2baa43e163 admin admin] 10.222.0.61 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001411 May 14 15:44:31.602067 dv-cinder-839793-11-iscsi devstack@n-api.service[114371]: [pid: 114371|app: 0|req: 36/73] 10.222.0.61 () {56 vars in 1074 bytes} [Sat May 14 15:44:31 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 14 15:44:31.792310 dv-cinder-839793-11-iscsi devstack@n-api.service[114370]: DEBUG nova.api.openstack.wsgi [None req-b2dac80c-46d4-4aef-af5f-f4c5ee29b5bd admin admin] Calling method '>' {{(pid=114370) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 15:44:31.793623 dv-cinder-839793-11-iscsi devstack@n-api.service[114370]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 14 15:44:31.793623 dv-cinder-839793-11-iscsi devstack@n-api.service[114370]: warnings.warn(msg) May 14 15:44:31.794815 dv-cinder-839793-11-iscsi devstack@n-api.service[114370]: DEBUG oslo_concurrency.lockutils [None req-b2dac80c-46d4-4aef-af5f-f4c5ee29b5bd admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:44:31.795279 dv-cinder-839793-11-iscsi devstack@n-api.service[114370]: DEBUG oslo_concurrency.lockutils [None req-b2dac80c-46d4-4aef-af5f-f4c5ee29b5bd admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:44:31.796048 dv-cinder-839793-11-iscsi devstack@n-api.service[114370]: DEBUG oslo_concurrency.lockutils [None req-b2dac80c-46d4-4aef-af5f-f4c5ee29b5bd admin admin] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:44:31.796469 dv-cinder-839793-11-iscsi devstack@n-api.service[114370]: DEBUG oslo_concurrency.lockutils [None req-b2dac80c-46d4-4aef-af5f-f4c5ee29b5bd admin admin] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:44:31.820885 dv-cinder-839793-11-iscsi devstack@n-api.service[114370]: INFO nova.api.openstack.requestlog [None req-b2dac80c-46d4-4aef-af5f-f4c5ee29b5bd admin admin] 10.222.0.61 "GET /compute/v2.1/os-services" status: 200 len: 1038 microversion: 2.90 time: 0.080796 May 14 15:44:31.821432 dv-cinder-839793-11-iscsi devstack@n-api.service[114370]: [pid: 114370|app: 0|req: 38/74] 10.222.0.61 () {60 vars in 1193 bytes} [Sat May 14 15:44:31 2022] GET /compute/v2.1/os-services => generated 1038 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 14 15:44:32.712314 dv-cinder-839793-11-iscsi devstack@n-api.service[114371]: DEBUG nova.api.openstack.wsgi [None req-1775c43b-fb1b-44c8-bc63-ff2baa43e163 admin admin] Calling method '>' {{(pid=114371) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 15:44:32.713447 dv-cinder-839793-11-iscsi devstack@n-api.service[114371]: INFO nova.api.openstack.requestlog [None req-1775c43b-fb1b-44c8-bc63-ff2baa43e163 admin admin] 10.222.0.61 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001429 May 14 15:44:32.714297 dv-cinder-839793-11-iscsi devstack@n-api.service[114371]: [pid: 114371|app: 0|req: 37/75] 10.222.0.61 () {56 vars in 1074 bytes} [Sat May 14 15:44:32 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 14 15:44:32.904281 dv-cinder-839793-11-iscsi devstack@n-api.service[114370]: DEBUG nova.api.openstack.wsgi [None req-01fda2c5-8959-4e22-9d49-5068c226f9c4 admin admin] Calling method '>' {{(pid=114370) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 15:44:32.905448 dv-cinder-839793-11-iscsi devstack@n-api.service[114370]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 14 15:44:32.905448 dv-cinder-839793-11-iscsi devstack@n-api.service[114370]: warnings.warn(msg) May 14 15:44:32.906687 dv-cinder-839793-11-iscsi devstack@n-api.service[114370]: DEBUG oslo_concurrency.lockutils [None req-01fda2c5-8959-4e22-9d49-5068c226f9c4 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:44:32.907126 dv-cinder-839793-11-iscsi devstack@n-api.service[114370]: DEBUG oslo_concurrency.lockutils [None req-01fda2c5-8959-4e22-9d49-5068c226f9c4 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:44:32.907922 dv-cinder-839793-11-iscsi devstack@n-api.service[114370]: DEBUG oslo_concurrency.lockutils [None req-01fda2c5-8959-4e22-9d49-5068c226f9c4 admin admin] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:44:32.908347 dv-cinder-839793-11-iscsi devstack@n-api.service[114370]: DEBUG oslo_concurrency.lockutils [None req-01fda2c5-8959-4e22-9d49-5068c226f9c4 admin admin] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:44:32.931081 dv-cinder-839793-11-iscsi devstack@n-api.service[114370]: INFO nova.api.openstack.requestlog [None req-01fda2c5-8959-4e22-9d49-5068c226f9c4 admin admin] 10.222.0.61 "GET /compute/v2.1/os-services" status: 200 len: 1038 microversion: 2.90 time: 0.077900 May 14 15:44:32.931562 dv-cinder-839793-11-iscsi devstack@n-api.service[114370]: [pid: 114370|app: 0|req: 39/76] 10.222.0.61 () {60 vars in 1193 bytes} [Sat May 14 15:44:32 2022] GET /compute/v2.1/os-services => generated 1038 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 14 15:45:27.936674 dv-cinder-839793-11-iscsi systemd[1]: Stopping Devstack devstack@n-api.service... May 14 15:45:27.937633 dv-cinder-839793-11-iscsi devstack@n-api.service[114369]: Sat May 14 15:45:27 2022 - graceful shutdown triggered... May 14 15:45:27.938131 dv-cinder-839793-11-iscsi devstack@n-api.service[114370]: Gracefully killing worker 1 (pid: 114370)... May 14 15:45:27.938534 dv-cinder-839793-11-iscsi devstack@n-api.service[114371]: Gracefully killing worker 2 (pid: 114371)... May 14 15:45:28.938773 dv-cinder-839793-11-iscsi devstack@n-api.service[114369]: worker 1 buried after 1 seconds May 14 15:45:28.939279 dv-cinder-839793-11-iscsi devstack@n-api.service[114369]: worker 2 buried after 1 seconds May 14 15:45:28.939279 dv-cinder-839793-11-iscsi devstack@n-api.service[114369]: goodbye to uWSGI. May 14 15:45:28.940373 dv-cinder-839793-11-iscsi systemd[1]: devstack@n-api.service: Succeeded. May 14 15:45:28.940977 dv-cinder-839793-11-iscsi systemd[1]: Stopped Devstack devstack@n-api.service. May 14 15:45:28.944037 dv-cinder-839793-11-iscsi systemd[1]: Starting Devstack devstack@n-api.service... May 14 15:45:28.954058 dv-cinder-839793-11-iscsi devstack@n-api.service[128712]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini May 14 15:45:28.971010 dv-cinder-839793-11-iscsi devstack@n-api.service[128712]: *** Starting uWSGI 2.0.18-debian (64bit) on [Sat May 14 15:45:28 2022] *** May 14 15:45:28.971010 dv-cinder-839793-11-iscsi devstack@n-api.service[128712]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 May 14 15:45:28.971010 dv-cinder-839793-11-iscsi devstack@n-api.service[128712]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 May 14 15:45:28.971010 dv-cinder-839793-11-iscsi devstack@n-api.service[128712]: nodename: dv-cinder-839793-11-iscsi May 14 15:45:28.971010 dv-cinder-839793-11-iscsi devstack@n-api.service[128712]: machine: x86_64 May 14 15:45:28.971010 dv-cinder-839793-11-iscsi devstack@n-api.service[128712]: clock source: unix May 14 15:45:28.971010 dv-cinder-839793-11-iscsi devstack@n-api.service[128712]: pcre jit disabled May 14 15:45:28.971010 dv-cinder-839793-11-iscsi devstack@n-api.service[128712]: detected number of CPU cores: 4 May 14 15:45:28.971010 dv-cinder-839793-11-iscsi devstack@n-api.service[128712]: current working directory: / May 14 15:45:28.971010 dv-cinder-839793-11-iscsi devstack@n-api.service[128712]: detected binary path: /usr/bin/uwsgi-core May 14 15:45:28.971010 dv-cinder-839793-11-iscsi devstack@n-api.service[128712]: your processes number limit is 47680 May 14 15:45:28.972252 dv-cinder-839793-11-iscsi devstack@n-api.service[128712]: your memory page size is 4096 bytes May 14 15:45:28.972252 dv-cinder-839793-11-iscsi devstack@n-api.service[128712]: detected max file descriptor number: 2048 May 14 15:45:28.972252 dv-cinder-839793-11-iscsi devstack@n-api.service[128712]: lock engine: pthread robust mutexes May 14 15:45:28.972252 dv-cinder-839793-11-iscsi devstack@n-api.service[128712]: thunder lock: enabled May 14 15:45:28.972252 dv-cinder-839793-11-iscsi devstack@n-api.service[128712]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 May 14 15:45:28.972252 dv-cinder-839793-11-iscsi devstack@n-api.service[128712]: Python version: 3.8.10 (default, Mar 15 2022, 12:22:08) [GCC 9.4.0] May 14 15:45:29.017522 dv-cinder-839793-11-iscsi devstack@n-api.service[128712]: Python main interpreter initialized at 0x55ba00e209c0 May 14 15:45:29.017522 dv-cinder-839793-11-iscsi devstack@n-api.service[128712]: python threads support enabled May 14 15:45:29.017522 dv-cinder-839793-11-iscsi devstack@n-api.service[128712]: your server socket listen backlog is limited to 100 connections May 14 15:45:29.017522 dv-cinder-839793-11-iscsi devstack@n-api.service[128712]: your mercy for graceful operations on workers is 90 seconds May 14 15:45:29.017969 dv-cinder-839793-11-iscsi devstack@n-api.service[128712]: mapped 403077 bytes (393 KB) for 2 cores May 14 15:45:29.017969 dv-cinder-839793-11-iscsi devstack@n-api.service[128712]: *** Operational MODE: preforking *** May 14 15:45:29.018221 dv-cinder-839793-11-iscsi devstack@n-api.service[128712]: *** uWSGI is running in multiple interpreter mode *** May 14 15:45:29.018221 dv-cinder-839793-11-iscsi devstack@n-api.service[128712]: spawned uWSGI master process (pid: 128712) May 14 15:45:29.018445 dv-cinder-839793-11-iscsi systemd[1]: Started Devstack devstack@n-api.service. May 14 15:45:29.019599 dv-cinder-839793-11-iscsi devstack@n-api.service[128712]: spawned uWSGI worker 1 (pid: 128728, cores: 1) May 14 15:45:29.019599 dv-cinder-839793-11-iscsi devstack@n-api.service[128712]: spawned uWSGI worker 2 (pid: 128729, cores: 1) May 14 15:45:29.019599 dv-cinder-839793-11-iscsi devstack@n-api.service[128712]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... May 14 15:45:30.239332 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. May 14 15:45:30.243476 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. May 14 15:45:31.044273 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 14 15:45:31.044273 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: from cryptography.utils import int_from_bytes May 14 15:45:31.045154 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 14 15:45:31.045154 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: from cryptography.utils import int_from_bytes May 14 15:45:31.045313 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 14 15:45:31.045313 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: from cryptography.utils import int_from_bytes May 14 15:45:31.045459 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 14 15:45:31.045459 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: from cryptography.utils import int_from_bytes May 14 15:45:33.486648 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=128729) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} May 14 15:45:33.487306 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=128728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} May 14 15:45:33.487682 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=128729) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} May 14 15:45:33.487798 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=128728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} May 14 15:45:33.488061 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=128729) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} May 14 15:45:33.488157 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=128728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} May 14 15:45:33.488454 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=128728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} May 14 15:45:33.488557 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=128729) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} May 14 15:45:33.488717 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=128728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} May 14 15:45:33.488819 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=128729) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} May 14 15:45:33.489115 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=128728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 15:45:33.489207 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=128729) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 15:45:33.489452 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=128728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 15:45:33.489564 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=128729) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 15:45:33.489779 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=128728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 15:45:33.489885 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=128729) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 15:45:33.490106 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=128728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 15:45:33.490199 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=128729) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 15:45:33.490479 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=128728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 15:45:33.490574 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=128729) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 15:45:33.490799 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=128728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 15:45:33.490892 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=128729) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 15:45:33.491131 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=128729) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 15:45:33.491235 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=128728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 15:45:33.491457 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=128728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 15:45:33.491554 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=128729) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 15:45:33.491792 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=128728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 15:45:33.491895 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=128729) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 15:45:33.492058 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=128729) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 15:45:33.492155 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=128728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 15:45:33.492378 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=128728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 15:45:33.492488 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=128729) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 15:45:33.492711 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-839793-11-iscsi {{(pid=128728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 15:45:33.492854 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-839793-11-iscsi {{(pid=128729) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 15:45:33.493043 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=128728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 15:45:33.493299 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=128729) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 15:45:33.493390 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=128728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 15:45:33.493628 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=128729) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 15:45:33.493726 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=128728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 15:45:33.493952 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=128729) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 15:45:33.494048 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=128728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 15:45:33.494271 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=128728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 15:45:33.494389 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=128729) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 15:45:33.494626 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=128729) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 15:45:33.494717 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=128728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 15:45:33.494936 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=128728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 15:45:33.495035 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=128729) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 15:45:33.495268 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=128729) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 15:45:33.495437 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=128728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 15:45:33.495809 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=128729) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 15:45:33.496158 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=128729) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 15:45:33.496297 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=128728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 15:45:33.496472 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=128729) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 15:45:33.496599 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=128728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 15:45:33.496790 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=128728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 15:45:33.496932 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=128729) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 15:45:33.497137 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=128729) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 15:45:33.497231 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=128728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 15:45:33.497989 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=128728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 15:45:33.498283 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=128729) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 15:45:33.498409 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=128728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 15:45:33.498495 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=128729) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 15:45:33.498727 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=128728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 15:45:33.498871 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=128729) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 15:45:33.499047 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=128728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 15:45:33.499149 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=128729) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 15:45:33.499386 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=128728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 15:45:33.499537 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=128729) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 15:45:33.499706 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=128728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 15:45:33.499837 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=128729) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 15:45:33.500113 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-839793-11-iscsi {{(pid=128728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 15:45:33.500208 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-839793-11-iscsi {{(pid=128729) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 15:45:33.500440 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=128728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 15:45:33.500581 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=128729) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 15:45:33.500763 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=128729) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 15:45:33.500868 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=128728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 15:45:33.501084 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=128728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 15:45:33.501173 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=128729) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 15:45:33.501506 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=128729) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 15:45:33.501607 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=128728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 15:45:33.501827 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=128728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 15:45:33.501943 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=128729) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 15:45:33.502145 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=128728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 15:45:33.502500 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=128728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 15:45:33.502835 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=128728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 15:45:33.503004 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=128729) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 15:45:33.503157 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=128728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 15:45:33.503316 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=128729) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 15:45:33.503458 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=128728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 15:45:33.503621 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=128729) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 15:45:33.503786 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=128728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 15:45:33.503931 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=128729) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 15:45:33.504114 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=128728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 15:45:33.504264 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=128729) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 15:45:33.504444 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=128728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 15:45:33.504591 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=128729) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 15:45:33.504756 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=128728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 15:45:33.504902 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=128729) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 15:45:33.505073 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=128728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 15:45:33.505218 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=128729) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 15:45:33.505387 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=128728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 15:45:33.505541 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=128729) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 15:45:33.505793 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=128729) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 15:45:33.505940 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=128728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 15:45:33.506117 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=128729) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 15:45:33.506369 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=128728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 15:45:33.506468 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=128728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 15:45:33.506559 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=128729) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 15:45:33.506711 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=128728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 15:45:33.506814 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=128729) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 15:45:33.507027 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=128728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 15:45:33.507118 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=128729) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 15:45:33.507316 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=128729) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 15:45:33.507412 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=128728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 15:45:33.507632 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=128729) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 15:45:33.507732 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=128728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 15:45:33.507964 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=128729) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 15:45:33.508056 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=128728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 15:45:33.508231 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=128728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 15:45:33.508331 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=128729) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 15:45:33.508487 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=128728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 15:45:33.508595 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=128729) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 15:45:33.508818 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=128728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 15:45:33.508932 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=128729) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 15:45:33.509130 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=128729) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 15:45:33.509231 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=128728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 15:45:33.509447 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=128728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 15:45:33.509542 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=128729) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 15:45:33.509765 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=128728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 15:45:33.509871 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=128729) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 15:45:33.510079 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=128729) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 15:45:33.510184 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=128728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 15:45:33.510415 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=128728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 15:45:33.510523 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=128729) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 15:45:33.510732 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=128729) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 15:45:33.510834 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=128728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 15:45:33.511045 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=128728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 15:45:33.511146 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=128729) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 15:45:33.511357 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=128729) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 15:45:33.511455 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=128728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 15:45:33.511668 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=128728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 15:45:33.511765 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=128729) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 15:45:33.511980 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=128729) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 15:45:33.512078 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=128728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 15:45:33.512294 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=128729) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 15:45:33.512397 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=128728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 15:45:33.512622 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=128728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 15:45:33.512731 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=128729) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 15:45:33.512939 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=128728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 15:45:33.513602 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=128729) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 15:45:33.513919 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=128729) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 15:45:33.514020 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=128728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 15:45:33.514352 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=128729) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 15:45:33.514482 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.61 {{(pid=128728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 15:45:33.514622 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.61 {{(pid=128728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 15:45:33.514734 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=128729) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 15:45:33.514941 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=128728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 15:45:33.515097 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.61 {{(pid=128729) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 15:45:33.515291 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=128728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 15:45:33.515392 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.61 {{(pid=128729) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 15:45:33.515623 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=128728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 15:45:33.515722 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=128729) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 15:45:33.515941 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=128728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 15:45:33.516033 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=128729) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 15:45:33.516272 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=128728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 15:45:33.516362 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=128729) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 15:45:33.516604 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=128728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 15:45:33.516711 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=128729) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 15:45:33.516922 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=128728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 15:45:33.517021 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=128729) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 15:45:33.517237 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=128728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 15:45:33.517377 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=128729) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 15:45:33.517555 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=128728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 15:45:33.517649 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=128729) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 15:45:33.517877 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=128729) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 15:45:33.518014 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=128728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 15:45:33.518198 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=128729) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 15:45:33.518365 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=128728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 15:45:33.518533 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=128728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 15:45:33.518632 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=128729) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 15:45:33.518792 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=128728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 15:45:33.518935 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=128729) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 15:45:33.519103 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=128728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 15:45:33.519258 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=128729) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 15:45:33.519416 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=128728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 15:45:33.519515 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=128729) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 15:45:33.519744 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=128728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 15:45:33.519836 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=128729) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 15:45:33.520061 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=128728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 15:45:33.520162 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=128729) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 15:45:33.520376 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=128728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 15:45:33.520473 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=128729) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 15:45:33.520696 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=128728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 15:45:33.520790 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=128729) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 15:45:33.521007 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=128728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 15:45:33.521106 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=128729) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 15:45:33.521322 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=128728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 15:45:33.521414 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=128729) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 15:45:33.521636 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=128728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 15:45:33.521735 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=128729) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 15:45:33.521948 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=128729) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 15:45:33.522053 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=128728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 15:45:33.522260 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=128728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 15:45:33.522371 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=128729) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 15:45:33.522614 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=128728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 15:45:33.522752 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=128729) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 15:45:33.522909 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=128729) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 15:45:33.523026 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=128728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 15:45:33.523223 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=128728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 15:45:33.523333 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=128729) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 15:45:33.523530 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=128729) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 15:45:33.523618 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=128728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 15:45:33.523840 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=128728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 15:45:33.523949 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=128729) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 15:45:33.524167 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=128728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 15:45:33.524266 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=128729) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 15:45:33.524498 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=128728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 15:45:33.524662 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=128729) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 15:45:33.524813 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=128728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 15:45:33.524998 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=128729) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 15:45:33.525125 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=128728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 15:45:33.525332 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=128729) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 15:45:33.525430 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=128728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 15:45:33.525649 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=128729) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 15:45:33.525753 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=128728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 15:45:33.525966 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=128729) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 15:45:33.526102 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=128728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 15:45:33.526282 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=128729) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 15:45:33.526413 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=128728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 15:45:33.526621 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=128729) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 15:45:33.526797 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=128728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 15:45:33.526978 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=128729) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 15:45:33.527072 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=128728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 15:45:33.527291 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=128728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 15:45:33.527382 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=128729) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 15:45:33.527604 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=128729) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 15:45:33.527708 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=128728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 15:45:33.527930 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=128728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 15:45:33.528029 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=128729) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 15:45:33.528243 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=128729) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 15:45:33.528342 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=128728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 15:45:33.528555 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=128728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 15:45:33.528690 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=128729) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 15:45:33.528907 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=128728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 15:45:33.529000 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=128729) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 15:45:33.529299 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=128729) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 15:45:33.529388 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=128728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 15:45:33.529618 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=128729) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 15:45:33.529718 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=128728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 15:45:33.529946 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=128728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 15:45:33.530044 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=128729) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 15:45:33.530255 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=128729) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 15:45:33.530379 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=128728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 15:45:33.530592 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=128728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 15:45:33.530682 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=128729) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 15:45:33.530910 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=128728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 15:45:33.531010 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=128729) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 15:45:33.531222 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=128729) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 15:45:33.531320 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=128728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 15:45:33.531531 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=128728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 15:45:33.531621 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=128729) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 15:45:33.531840 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=128729) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 15:45:33.531937 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=128728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 15:45:33.532148 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=128728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 15:45:33.532239 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=128729) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 15:45:33.532457 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=128729) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 15:45:33.532548 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=128728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 15:45:33.532762 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=128728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 15:45:33.532869 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=128729) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 15:45:33.533071 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=128729) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 15:45:33.533173 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=128728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 15:45:33.533385 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=128729) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 15:45:33.533487 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=128728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 15:45:33.533696 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=128729) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 15:45:33.533786 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=128728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 15:45:33.534014 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=128728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 15:45:33.534126 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=128729) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 15:45:33.534346 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=128728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 15:45:33.534465 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=128729) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 15:45:33.534678 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=128728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 15:45:33.534791 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=128729) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 15:45:33.535002 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=128729) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 15:45:33.535113 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=128728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.535318 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=128729) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 15:45:33.535411 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=128728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.535647 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=128729) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 15:45:33.535749 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=128728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.535990 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=128729) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.536090 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=128728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.536331 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=128728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.536480 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=128729) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.536672 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=128728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.536809 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=128729) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.536990 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=128729) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.537137 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=128728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.537308 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=128728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.537444 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=128729) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.537631 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=128728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.537773 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=128729) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.537968 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=128728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.538109 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=128729) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.538285 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=128729) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.538446 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=128728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.538626 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=128728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.538724 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=128729) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.538946 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=128728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.539045 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=128729) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.539263 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=128729) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.539353 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=128728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.539583 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=128729) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.539688 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=128728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.539902 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=128729) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.539993 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=128728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.540228 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=128729) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.540333 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=128728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.540554 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=128728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.540644 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=128729) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.540881 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=128728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.540973 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=128729) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.541200 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=128728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.541299 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=128729) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.541522 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=128729) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.541612 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=128728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.541848 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=128729) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.541939 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=128728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.542166 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=128729) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.542264 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=128728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.542508 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=128728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.542600 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=128729) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.542846 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=128729) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.542989 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=128728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.543174 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=128729) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.543272 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=128728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.543499 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=128729) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.543601 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=128728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.543826 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=128728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.543926 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=128729) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.544160 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=128728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.544275 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=128729) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.544491 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=128729) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.544689 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=128728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.544825 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=128729) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.545122 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=128728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.545226 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=128729) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.545448 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=128728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.545539 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=128729) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.545763 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=128729) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.545863 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=128728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.546082 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=128729) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.546182 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=128728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.546436 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=128729) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.546543 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=128728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.546768 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=128728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.546866 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=128729) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.547086 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=128729) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.547184 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=128728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.547405 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=128728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.547502 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=128729) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.547723 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=128729) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.547821 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=128728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.548039 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=128728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.548129 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=128729) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.548355 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=128729) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.548454 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=128728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.548674 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=128729) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.548775 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=128728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.548992 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=128729) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.549098 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=128728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.549322 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=128728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.549430 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=128729) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.549638 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=128728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.549808 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=128729) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.550005 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=128728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.550125 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=128729) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.550319 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=128728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.550435 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=128729) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.550658 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=128728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.550749 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=128729) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.550975 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=128729) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.551116 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=128728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.551288 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=128728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.551391 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=128729) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.551600 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=128728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.551699 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=128729) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.551915 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=128728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.552013 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=128729) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.552231 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=128728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.552332 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=128729) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.552542 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=128728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.552637 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=128729) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.552859 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=128729) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.552953 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=128728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.553177 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=128729) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.553302 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=128728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.553575 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=128729) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.553679 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=128728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.553844 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=128729) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.553943 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=128728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.554161 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=128729) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.554351 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=128728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.554528 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=128729) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.554620 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=128728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.554842 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=128729) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.554945 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=128728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.555157 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=128728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.555257 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=128729) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.555472 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=128728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.555564 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=128729) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.555785 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=128729) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.555882 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=128728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.556098 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=128729) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.556199 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=128728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.556408 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=128728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.556498 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=128729) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.556721 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=128729) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.556823 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=128728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.557036 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=128729) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.557129 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=128728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.557346 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=128728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.557444 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=128729) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.557673 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=128729) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.557771 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=128728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.557985 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=128728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.558076 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=128729) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.558299 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=128728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.558423 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=128729) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.558639 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=128728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.558740 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=128729) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.558951 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=128729) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.559040 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=128728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.559266 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=128728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.559363 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=128729) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.559582 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=128729) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.559684 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=128728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.560474 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=128728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.560939 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=128728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.561057 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=128729) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.561261 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=128728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.561366 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=128729) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.561585 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=128728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.561684 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=128729) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.561925 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=128729) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.562015 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=128728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.562259 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=128729) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.562388 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=128728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.562600 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=128728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.562752 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=128729) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.562935 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=128728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.563026 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=128729) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.563269 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=128728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.563405 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=128729) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.563585 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=128729) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.563738 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=128728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.563898 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=128728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.563995 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=128729) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.564233 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=128728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.564345 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=128729) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.564529 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=128728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.564621 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=128729) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.564846 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=128728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.564944 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=128729) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.565162 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=128728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.565254 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=128729) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.565480 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=128728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.565580 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=128729) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.565795 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=128729) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.565896 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=128728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.566107 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=128728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.566198 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=128729) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.566451 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=128728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.566548 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=128729) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.566770 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=128728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.566861 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=128729) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.567085 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=128728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.567185 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=128729) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.567398 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=128729) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.567487 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=128728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.567716 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=128729) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.567808 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=128728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.568028 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=128728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.568118 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=128729) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.568341 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=128728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.568433 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=128729) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.568653 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=128728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.568757 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=128729) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.568965 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=128729) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.569055 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=128728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.569279 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=128729) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.569377 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=128728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.569591 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=128729) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.569697 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=128728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.569946 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=128729) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.570047 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=128728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.570262 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=128729) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.570368 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=128728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.570631 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=128728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.570739 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=128729) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.570953 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=128728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.571044 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=128729) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.571279 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=128728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.571369 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=128729) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.571599 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=128728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.571698 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=128729) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.571917 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=128729) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.572015 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=128728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.572233 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=128728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.572323 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=128729) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.572550 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=128729) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.572640 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=128728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.572871 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=128729) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.572969 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=128728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.573186 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=128728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.573283 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=128729) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.573504 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=128729) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.573594 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=128728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.573821 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=128728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.573912 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=128729) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.574146 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=128729) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.574237 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=128728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.574473 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=128728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.574568 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=128729) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.574803 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=128728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.574902 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=128729) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.575118 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=128728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.575209 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=128729) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.575443 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=128728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.576097 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=128729) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.576333 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=128728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.576462 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=128729) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.576684 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=128729) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.576841 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=128728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.577011 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=128729) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.577203 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=128728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.577388 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=128729) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.577534 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=128728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.577736 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=128729) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.577891 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=128728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.578062 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=128729) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.578201 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=128728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.578420 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=128729) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.578558 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=128728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.578742 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=128729) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.578890 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=128728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.579068 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=128729) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.579211 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=128728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.579389 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=128728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.579532 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=128729) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.579706 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=128729) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.579848 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=128728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.580023 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=128728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.580157 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=128729) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.580341 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=128729) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.580476 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=128728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.580666 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=128728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.580826 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=128729) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.580967 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=128729) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.581105 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=128728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.581294 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=128729) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.581426 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=128728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.581617 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=128729) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.581759 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=128728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.581934 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=128728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.582073 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=128729) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.582266 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=128729) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.582459 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=128728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.582610 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=128729) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.582789 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=128728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.582946 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=128729) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.583095 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=128728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.583243 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=128729) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.583401 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=128728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.583580 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=128729) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.583718 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=128728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.583924 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=128729) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.584061 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=128728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.584247 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=128729) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.584382 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=128728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.584625 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=128729) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.584775 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=128728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.584924 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=128729) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.585063 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=128728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.585208 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=128729) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.585422 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=128728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.585568 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=128729) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.585709 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=128728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.585847 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=128729) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.585984 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=128728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.586121 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=128729) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.586271 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=128728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.586435 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=128729) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.586580 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=128728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.586722 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=128729) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.586870 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=128728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.587055 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=128729) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.587204 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=128728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.587370 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=128729) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.587507 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=128728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.587648 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=128729) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.587742 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=128728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.587963 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=128729) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.588067 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=128728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.588284 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=128729) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.588383 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=128728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.588600 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=128729) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.588690 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=128728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.588914 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=128729) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.589014 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=128728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.589225 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=128729) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.589323 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=128728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.589543 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=128729) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.589634 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=128728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.589877 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=128729) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.589969 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=128728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.590198 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=128729) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.590288 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=128728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.590536 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=128728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.590629 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=128729) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.590868 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=128728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.590957 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=128729) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.591219 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=128728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.591341 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=128729) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.591566 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=128729) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.591716 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=128728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.591935 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=128729) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.592080 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=128728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.592257 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=128729) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.592406 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=128728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.592572 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=128729) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.592715 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=128728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.592890 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=128729) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.593034 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=128728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.593185 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=128729) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.593324 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=128728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.593539 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=128729) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.593653 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=128728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.593857 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=128729) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.594001 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=128728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.594175 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=128729) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.594344 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=128728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.594526 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=128729) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.594713 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=128728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.594848 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=128729) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.594996 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=128728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.595148 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=128728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.595293 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=128729) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.595470 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=128729) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.595617 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=128728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.595788 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=128728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.595928 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=128729) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.596101 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=128729) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.596255 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=128728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.596418 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=128728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.596569 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=128729) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.596741 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=128728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.596866 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=128729) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.597052 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=128728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.597156 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=128729) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.597375 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=128728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.597481 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=128729) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.597689 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=128729) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.597780 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=128728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.598007 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=128729) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.598105 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=128728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.598344 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=128728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.598497 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=128729) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.598648 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=128728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.598788 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=128729) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.598964 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=128728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.599106 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=128729) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.599285 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=128728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.599435 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=128729) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.599609 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=128728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.599750 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=128729) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.599947 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=128729) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.600192 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=128728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.600342 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=128729) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.600540 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=128728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.600681 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=128729) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.600866 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=128728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.601138 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=128729) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.601291 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=128728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.601486 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=128729) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.601643 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=128728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.601799 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=128729) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.601936 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=128728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.602137 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=128729) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.602280 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=128728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.602494 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=128729) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.602589 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=128728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.602825 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=128729) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.602918 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=128728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.603148 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=128728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.603246 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=128729) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.603468 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=128728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.603609 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=128729) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.603785 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=128728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.603878 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=128729) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.604099 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=128728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.604202 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=128729) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.604418 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=128728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.604524 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=128729) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.604781 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=128728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.604892 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=128729) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.605042 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=128728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.605156 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=128729) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.605356 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=128728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.605456 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=128729) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.605671 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=128729) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.605770 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=128728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.605980 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=128728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.606088 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=128729) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.606291 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=128728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.606428 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=128729) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.606630 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=128729) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.607228 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=128728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.607472 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=128729) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.607726 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=128728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.607935 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=128729) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.608094 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=128728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.608257 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=128729) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.608415 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=128728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.608574 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=128729) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.608742 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=128728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.608899 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=128729) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.609059 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=128728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.609214 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=128729) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.609396 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=128728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.609535 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=128729) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.609719 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=128728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.610101 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=128729) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.610292 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=128728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.610473 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=128729) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.610631 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=128728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.610796 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=128729) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.610954 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=128728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.611113 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=128729) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.611309 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=128728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.611429 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=128729) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.611624 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=128728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.611745 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=128729) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.611977 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=128728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.612083 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=128729) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.612317 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=128728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.612416 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=128729) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.612671 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=128728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.612772 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=128729) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.612987 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=128728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.613086 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=128729) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.613301 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=128728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.613392 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=128729) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.613638 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=128728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.613731 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=128729) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.613954 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=128728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.614052 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=128729) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.614267 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=128728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.614380 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=128729) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.614605 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=128728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.614706 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=128729) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.614927 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=128728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.615050 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=128729) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.615245 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=128728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.615361 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=128729) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.615555 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=128728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.615666 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=128729) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.615870 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=128729) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.615970 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=128728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.616181 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=128729) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.616282 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=128728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.616498 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=128728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.616603 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=128729) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.616812 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=128729) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.616904 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=128728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.617121 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=128728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.617230 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=128729) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.617437 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=128729) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.617548 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=128728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.617747 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=128728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.617856 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=128729) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.618057 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=128729) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.618159 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=128728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.618391 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=128729) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.618489 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=128728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.618703 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=128728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.618795 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=128729) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.619013 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=128728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.619120 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=128729) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.619323 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=128729) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.619414 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=128728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.619634 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=128729) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.619725 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=128728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.619941 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=128728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.620040 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=128729) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.620254 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=128729) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.620390 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=128728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.620563 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=128728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.620687 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=128729) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.620877 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=128729) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.620977 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=128728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.621186 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=128729) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.621279 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=128728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.621495 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=128728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.621594 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=128729) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.621807 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=128728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.621899 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=128729) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.622116 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=128729) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.622219 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=128728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.622494 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=128728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.622652 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=128729) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.622810 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=128728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.623141 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=128729) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.623241 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=128728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.623457 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=128728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.623555 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=128729) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.623772 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=128728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.623937 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=128729) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.624078 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=128728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.624174 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=128729) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.624387 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=128728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.624501 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=128729) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.624701 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=128728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.624798 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=128729) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.625014 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=128728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.625136 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=128729) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.625329 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=128729) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.625440 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=128728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.625642 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=128729) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.625752 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=128728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.625955 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=128729) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.626063 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=128728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.626273 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=128728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.626404 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=128729) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.626613 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=128728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.626716 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=128729) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.626925 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=128728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.627023 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=128729) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.627238 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=128729) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.627329 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=128728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.627549 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=128728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.627649 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=128729) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.627860 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=128729) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.627959 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=128728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.628167 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=128728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.628273 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=128729) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.628476 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=128729) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.628568 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=128728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.628780 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=128728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.628877 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=128729) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.629091 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=128729) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.629207 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=128728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.629397 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=128728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.629502 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=128729) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.629703 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=128729) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.629808 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=128728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.630014 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=128729) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.630116 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=128728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.630337 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=128729) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.630441 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=128728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.630676 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=128729) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.630783 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=128728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.630991 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=128729) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.631098 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=128728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.631304 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=128729) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.631396 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=128728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.631617 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=128729) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.631720 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=128728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.631929 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=128729) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.632022 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=128728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.632279 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=128729) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.632380 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=128728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.632591 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=128729) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.632683 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=128728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.632928 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=128728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.633019 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=128729) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.633248 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=128728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.633341 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=128729) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.633570 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=128728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.633670 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=128729) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.633890 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=128728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.633985 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=128729) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.634208 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=128728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.634325 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=128729) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.634557 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=128728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.634661 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=128729) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.634877 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=128728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.634992 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=128729) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.635190 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=128729) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.635299 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=128728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.635505 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=128728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.635606 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=128729) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.635814 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=128728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.635923 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=128729) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.636134 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=128729) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.636233 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=128728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.636448 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=128729) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.636558 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=128728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.636758 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=128729) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.636858 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=128728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.637085 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=128728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.637191 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=128729) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.637402 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=128729) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.637511 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=128728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.637720 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=128729) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.637828 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=128728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.638585 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=128728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.638688 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=128729) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.638912 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=128728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.639067 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=128729) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.639229 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=128728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.639381 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=128729) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.639546 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=128728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.639698 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=128729) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.639864 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=128728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.640016 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=128729) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.640180 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=128728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.640333 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=128729) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.640497 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=128728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.640650 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=128729) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.640816 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=128728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.640969 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=128729) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.641136 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=128728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.641284 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=128729) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.641460 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=128728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.641601 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=128729) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.641778 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=128728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.641920 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=128729) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.642089 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=128728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.642239 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=128729) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.642428 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=128728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.642584 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=128729) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.642744 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=128728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.642903 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=128729) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.643055 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=128728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.643215 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=128729) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.643387 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=128728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.643531 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=128729) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.643705 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=128728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.643846 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=128729) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.644018 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=128728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.644157 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=128729) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.644335 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=128728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.644491 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=128729) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.644648 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=128728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.644807 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=128729) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.644964 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=128728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.645118 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=128729) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.645296 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=128728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.645448 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=128729) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.645709 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=128728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.645845 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=128729) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.646030 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=128728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.646171 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=128729) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.646368 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=128728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.646482 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=128729) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.646684 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=128728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.646805 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=128729) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.647003 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=128728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.647125 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=128729) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.647321 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=128728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.647446 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=128729) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.647646 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=128728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.647759 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=128729) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.647967 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=128728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.648111 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=128729) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.648279 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=128728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.648372 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=128729) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.648693 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=128729) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.648819 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=128728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.649012 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=128728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.649121 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=128729) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.649321 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=128729) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.649422 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=128728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.649635 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=128728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.649735 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=128729) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.649976 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=128728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.650160 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=128729) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.650444 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=128728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.650618 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=128729) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.650767 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=128728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.650918 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=128729) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.651068 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=128728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.651217 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=128729) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.651397 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=128728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.651494 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=128729) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.651586 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=128728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.651678 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=128729) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.651830 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=128728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.651935 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=128729) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.652162 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=128728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.652253 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=128729) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.652476 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=128728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.652566 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=128729) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.652794 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=128729) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.652893 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=128728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.653124 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=128729) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.653215 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=128728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.653436 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=128729) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.653537 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=128728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.653897 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=128728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.654113 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=128729) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.654345 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=128728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.654576 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=128729) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.654669 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=128728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.654900 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=128729) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.655004 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=128728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.655216 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=128729) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.655313 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=128728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.655617 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=128728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.655719 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=128729) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.655947 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=128728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.656055 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=128729) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.656259 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=128728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.656359 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=128729) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.656581 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=128728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.656672 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=128729) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.656899 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=128728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.657004 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=128729) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.657231 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=128728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.657333 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=128729) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.657543 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=128729) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.657647 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=128728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.657867 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=128729) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.657968 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=128728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.658186 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=128729) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.658277 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=128728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.658519 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=128728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.658621 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=128729) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.658857 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=128728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.658992 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=128729) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.659174 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=128729) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.659285 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=128728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.659496 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=128729) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.659609 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=128728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.659811 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=128729) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.659921 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=128728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.660146 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=128729) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.660248 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=128728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.660479 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=128729) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.660594 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=128728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.660804 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=128729) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.660907 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=128728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.661138 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=128729) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.661240 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=128728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.661502 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=128728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.661601 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=128729) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.661815 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=128728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.661915 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=128729) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.662129 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=128728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.662240 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=128729) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.662491 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=128728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.662598 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=128729) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.662786 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=128728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.662895 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=128729) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.663098 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=128728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.663191 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=128729) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.663433 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=128728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.663534 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=128729) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.663747 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=128728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.663839 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=128729) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.664059 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=128729) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.664149 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=128728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.664374 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=128728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.664465 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=128729) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.664690 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=128728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.664782 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=128729) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.665000 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=128728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.665103 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=128729) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.665315 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=128728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.665429 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=128729) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.665662 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=128728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.665771 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=128729) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.665956 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=128728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.666068 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=128729) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.666266 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=128729) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.666431 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=128728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.666601 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=128729) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.666713 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=128728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.666933 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=128729) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.667040 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=128728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.667245 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=128729) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.667338 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=128728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.667560 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=128728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.667652 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=128729) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.667882 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=128729) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.667985 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=128728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.668214 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=128728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.668305 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=128729) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.668507 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=128728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.668608 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=128729) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.668821 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=128728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.668915 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=128729) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.669136 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=128728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.669933 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=128729) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.670098 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=128729) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.670239 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=128728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.670442 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=128729) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.670540 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=128728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.670625 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=128729) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.670708 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=128728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.670904 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=128729) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.671048 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=128728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.671255 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=128729) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.671390 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=128728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.671570 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=128729) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.671720 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=128728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.671900 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=128729) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.672061 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=128728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.672242 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=128729) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.672398 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=128728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.672580 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=128729) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.672723 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=128728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.672901 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=128729) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.673049 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=128728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.673243 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=128729) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.673384 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=128728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.673578 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=128729) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.673700 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=128728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.673901 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=128729) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.674008 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=128728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.674227 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=128729) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.674389 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=128728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.674587 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=128729) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.674699 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=128728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.674899 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=128729) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.675049 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=128728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.675211 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=128729) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.675311 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=128728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.675529 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=128729) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.675646 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=128728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.675838 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=128728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.675940 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=128729) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.676149 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=128728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.676241 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=128729) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.676459 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=128728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.676559 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=128729) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.676771 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=128729) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.676873 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=128728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.677094 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=128728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.677195 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=128729) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.677426 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=128728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.677689 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=128729) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.677791 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=128728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.678070 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=128728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.678222 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=128729) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.678425 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=128728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.678529 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=128729) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.678737 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=128728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.678857 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=128729) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.679094 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=128728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.679415 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=128728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.679642 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=128729) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.679748 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=128728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.679976 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=128729) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.680085 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=128728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.680298 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=128729) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.680396 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=128728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.680619 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=128729) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.680724 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=128728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.680935 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=128729) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.681033 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=128728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.681292 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=128729) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.681390 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=128728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.681610 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=128729) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.681708 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=128728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.681952 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=128728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.682048 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=128729) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.682275 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=128728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.682405 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=128729) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.682623 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=128728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.682736 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=128729) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.683101 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=128728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.683424 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=128728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.683749 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=128728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.684169 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=128729) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.684290 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=128728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.684431 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=128729) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.684522 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=128728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.684746 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=128728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.684985 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=128729) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.685683 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=128728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.685885 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=128729) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.686213 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=128729) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.686384 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=128728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.686582 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=128729) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.686675 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=128728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.686919 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=128729) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.687024 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=128728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.687243 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=128728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.687336 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=128729) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.687566 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=128728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.687667 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=128729) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.687891 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=128728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.687990 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=128729) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.688215 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=128729) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.688306 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=128728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.688535 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=128728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.688624 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=128729) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.688856 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=128728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.688947 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=128729) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.689177 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=128728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.689271 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=128729) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.689498 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=128728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.689734 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=128729) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.689834 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=128728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.690076 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=128729) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.690169 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=128728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.690435 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=128729) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.690531 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=128728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.690762 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=128729) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.690864 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=128728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.691085 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=128729) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.691182 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=128728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.691411 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=128729) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.691513 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=128728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.691735 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=128729) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.691828 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=128728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.692056 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=128729) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.692157 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=128728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.692378 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=128729) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.692470 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=128728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.692700 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=128729) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.692826 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=128728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.693097 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=128729) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.693235 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=128728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.693354 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=128728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.693464 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=128729) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.693661 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=128728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.693798 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=128729) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.693984 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=128728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.694085 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=128729) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.694346 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=128728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.694470 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=128729) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.694712 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=128729) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.694818 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=128728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.694990 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=128729) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.695090 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=128728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.695315 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=128729) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.695409 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=128728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.695638 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=128728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.695784 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=128729) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.696014 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=128728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.696118 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=128729) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.696277 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=128728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.696379 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=128729) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.696599 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=128728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.696699 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=128729) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.696933 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=128728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.697026 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=128729) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.697256 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=128729) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.697361 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=128728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.697580 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=128729) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.697673 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=128728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.697901 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=128728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.697993 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=128729) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.698219 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=128729) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.698345 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=128728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.698567 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=128729) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.698659 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=128728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.698892 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=128729) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.699098 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=128728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.699198 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=128729) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.699424 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=128728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.699517 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=128729) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.699767 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=128728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.699858 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=128729) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.700101 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=128728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.700205 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=128729) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.700435 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=128728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.700563 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=128729) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.700814 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=128728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.700974 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=128729) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.701211 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=128728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.701313 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=128729) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.701449 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=128729) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.701541 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=128728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.701770 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=128728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.701870 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=128729) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.702084 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=128728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.702197 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=128729) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.702427 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=128728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.702650 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=128729) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.702756 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=128728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.702973 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=128729) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.703080 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=128728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.703323 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=128729) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.703420 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=128728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.703637 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=128729) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.703745 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=128728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.703968 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=128728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.704069 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=128729) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.704288 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=128729) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.704378 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=128728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.704600 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=128728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.704719 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=128729) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.704935 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=128729) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.705144 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=128728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.705247 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=128729) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.705520 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=128728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.705707 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=128729) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.705845 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=128728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.706197 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=128728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.706718 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=128729) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.707057 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=128729) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.707320 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=128728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.707474 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=128729) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.707703 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=128729) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.707872 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=128728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.708017 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=128729) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.708158 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=128728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.708333 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=128729) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.708483 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=128728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.708665 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=128729) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.708828 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=128728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.708972 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=128729) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.709120 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=128728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.709311 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=128728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.709518 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=128729) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.709668 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=128728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.709937 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=128728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.710126 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=128729) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.710284 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=128728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.710552 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=128729) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.710696 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=128728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.710848 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=128729) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.711000 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=128728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.711149 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=128729) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.711319 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=128728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.711469 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=128729) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.711638 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=128728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.711811 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=128729) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.711964 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=128728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.712082 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=128729) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.712271 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=128728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.712398 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=128729) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.712586 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=128728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.712716 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=128729) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.712901 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=128728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.713041 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=128729) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.713217 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=128728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.713364 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=128729) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.713541 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=128728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.713694 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=128729) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.713857 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=128728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.713971 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=128729) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.714171 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=128728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.714265 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=128729) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.714680 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=128729) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.714831 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=128728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.714981 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=128729) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.715118 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=128728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.715206 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=128729) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.715383 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=128728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.715553 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=128729) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.715699 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=128728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.715890 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=128729) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.716025 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=128728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.716237 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=128729) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.716502 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=128728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.716606 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=128729) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.716734 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=128728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.716956 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=128728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.717089 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=128729) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.717274 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=128728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.717380 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=128729) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.717629 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=128728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.717731 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=128729) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.717965 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=128728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.718065 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=128729) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.718277 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=128728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.718424 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=128729) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.718629 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=128729) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.718748 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=128728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.718954 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=128729) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.719081 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=128728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.719268 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=128729) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.719404 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=128728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.719587 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=128729) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.719708 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=128728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.719901 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=128729) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.720000 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=128728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.720277 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=128729) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.720384 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=128728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.720595 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=128729) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.720695 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=128728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.720916 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=128729) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.721015 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=128728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.721280 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=128729) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.721508 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=128728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.721601 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=128729) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.721852 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=128728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.721953 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=128729) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.722184 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=128728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.722286 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=128729) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.722553 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=128729) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.722657 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=128728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.722872 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=128729) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.722965 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=128728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.723198 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=128728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.723301 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=128729) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.723518 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=128728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.723654 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=128729) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.723829 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=128729) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.723933 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=128728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.724158 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=128728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.724274 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=128729) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.724479 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=128728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.724588 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=128729) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.724794 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=128728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.725027 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=128729) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.725155 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=128728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.725371 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=128729) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.725472 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=128728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.725701 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=128729) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.725793 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=128728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.726019 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=128728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.726119 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=128729) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.726474 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=128728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.726581 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=128729) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.726665 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=128728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.726747 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=128729) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.726971 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=128728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.727079 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=128729) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.727285 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=128728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.727378 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=128729) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.727603 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=128728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.727696 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=128729) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.727916 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=128728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.728021 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=128729) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.728232 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=128729) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.728323 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=128728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.728550 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=128729) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.728641 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=128728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.728869 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=128729) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.728970 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=128728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.729186 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=128729) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.729278 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=128728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.729503 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=128729) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.729647 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=128728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.729818 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=128729) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.729920 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=128728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.730133 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=128728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.730224 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=128729) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.730476 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=128728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.730604 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=128729) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.730791 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=128729) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.730910 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=128728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.731108 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=128728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.731199 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=128729) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.731422 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=128729) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.731524 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=128728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.732275 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=128729) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.732378 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=128728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.732630 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=128729) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.732850 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=128728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.732962 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=128729) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.733177 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=128728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.733278 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=128729) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.733603 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=128729) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.733734 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=128728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.733930 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=128729) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.734056 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=128728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.734250 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=128729) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.734388 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=128728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.734606 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=128728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.734699 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=128729) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.735184 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=128729) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.735350 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=128728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.735504 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=128729) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.735667 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=128728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.735806 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=128729) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.735947 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=128728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.736140 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=128729) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.736291 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=128728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.736468 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=128729) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.736687 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=128728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.736835 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=128729) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.736977 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=128728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.737182 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=128728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.737332 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=128729) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.737510 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=128729) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.737662 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=128728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.737838 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=128729) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.737987 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=128728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.738168 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=128729) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.738356 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=128728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.738513 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=128729) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.738603 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=128728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.738817 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=128728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.738909 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=128729) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.739133 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=128728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.739226 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=128729) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.739451 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=128728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.739545 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=128729) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.739778 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=128729) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.739869 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=128728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.740092 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=128728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.740191 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=128729) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.740406 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=128728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.740497 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=128729) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.740719 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=128728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.740819 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=128729) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.741036 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=128728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.741129 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=128729) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.741349 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=128728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.741449 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=128729) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.741668 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=128728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.741768 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=128729) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.741978 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=128728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.742079 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=128729) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.742289 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=128728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.742423 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=128729) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.742628 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=128728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.742730 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=128729) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.742941 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=128728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.743033 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=128729) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.743253 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=128728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.743352 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=128729) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.743563 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=128729) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.743669 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=128728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.743872 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=128728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.743963 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=128729) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.744182 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=128728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.744285 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=128729) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.744492 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=128729) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.744594 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=128728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.744805 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=128729) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.744896 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=128728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.745115 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=128728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.745227 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=128729) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.745426 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=128729) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.745535 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=128728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.745747 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=128728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.745894 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=128729) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.746063 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=128728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.746261 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=128729) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.746438 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=128728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.746730 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=128728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.747086 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=128728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.747248 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=128729) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.747992 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=128728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.748190 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=128729) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.748526 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=128729) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.748677 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=128728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.748832 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=128729) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.748983 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=128728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.749152 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=128729) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.749308 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=128728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.749461 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=128729) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.749605 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=128728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.749779 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=128729) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.750019 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=128728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.750168 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=128729) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.750364 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=128728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.750528 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=128729) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.750712 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=128728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.750862 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=128729) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.751015 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=128728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.751157 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=128729) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.751308 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=128728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.751451 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=128729) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.751602 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=128728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.751753 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=128729) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.751896 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=128728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.752038 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=128729) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.752192 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=128728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.752336 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=128729) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.752485 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=128728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.752637 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=128728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.752789 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=128729) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.752938 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=128728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.753091 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=128729) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.753259 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=128729) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.753359 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=128728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.753593 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=128728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.753691 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=128729) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.753909 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=128728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.754060 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=128729) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.754257 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=128728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.754421 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=128729) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.754607 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=128728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.754760 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=128729) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.754949 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=128728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.755066 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=128729) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.755274 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=128728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.755563 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=128729) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.755680 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=128728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.755906 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=128729) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.756010 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=128728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.756229 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=128729) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.756321 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=128728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.756559 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=128729) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.756773 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=128728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.756928 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=128729) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.757110 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=128728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.757204 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=128729) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.757431 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=128728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.757525 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=128729) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.757753 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=128728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.757889 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=128729) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.758095 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=128728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.758452 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=128728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.758622 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=128729) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.758793 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=128728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.758980 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=128729) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.759123 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=128728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.759316 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=128729) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.759436 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=128728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.759763 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=128728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.759895 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=128729) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.760112 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=128728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.760234 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=128729) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.760443 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=128729) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.760548 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=128728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.760787 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=128729) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.760890 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=128728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.761114 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=128729) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.761209 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=128728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.761439 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=128729) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.761531 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=128728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.761768 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=128729) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.761860 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=128728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.762090 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=128728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.762206 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=128729) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.762423 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=128728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.762605 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=128729) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.762724 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=128728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} May 14 15:45:33.762916 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=128729) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.763270 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=128729) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.763669 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=128729) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.764055 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=128729) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.764410 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=128729) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.764934 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=128729) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.765353 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=128729) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.765749 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=128729) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.766088 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=128729) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.766477 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=128729) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.766924 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=128729) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.767260 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=128729) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.767585 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=128729) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.767902 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=128729) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:45:33.768155 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=128729) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} May 14 15:45:33.787087 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_db.sqlalchemy.engines [None req-48c0f1c2-f1e1-4f7b-b878-91e4f00cc868 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=128728) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 14 15:45:33.791528 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_db.sqlalchemy.engines [None req-c2340bd7-0188-4980-87d9-d952b55a98e5 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=128729) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 14 15:45:33.856557 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.context [None req-48c0f1c2-f1e1-4f7b-b878-91e4f00cc868 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),793a8299-ce42-42ac-82e7-4dd54ffc49bf(cell1) {{(pid=128728) load_cells /opt/stack/nova/nova/context.py:464}} May 14 15:45:33.860305 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.context [None req-c2340bd7-0188-4980-87d9-d952b55a98e5 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),793a8299-ce42-42ac-82e7-4dd54ffc49bf(cell1) {{(pid=128729) load_cells /opt/stack/nova/nova/context.py:464}} May 14 15:45:33.863244 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-48c0f1c2-f1e1-4f7b-b878-91e4f00cc868 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:45:33.864911 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-48c0f1c2-f1e1-4f7b-b878-91e4f00cc868 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:45:33.865041 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-c2340bd7-0188-4980-87d9-d952b55a98e5 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:45:33.865740 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-48c0f1c2-f1e1-4f7b-b878-91e4f00cc868 None None] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:45:33.866549 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-c2340bd7-0188-4980-87d9-d952b55a98e5 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:45:33.867372 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-c2340bd7-0188-4980-87d9-d952b55a98e5 None None] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:45:33.867760 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-48c0f1c2-f1e1-4f7b-b878-91e4f00cc868 None None] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:45:33.869373 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-c2340bd7-0188-4980-87d9-d952b55a98e5 None None] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:45:33.879899 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_db.sqlalchemy.engines [None req-48c0f1c2-f1e1-4f7b-b878-91e4f00cc868 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=128728) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 14 15:45:33.881055 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_db.sqlalchemy.engines [None req-48c0f1c2-f1e1-4f7b-b878-91e4f00cc868 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=128728) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 14 15:45:33.883559 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_db.sqlalchemy.engines [None req-c2340bd7-0188-4980-87d9-d952b55a98e5 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=128729) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 14 15:45:33.887354 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_db.sqlalchemy.engines [None req-c2340bd7-0188-4980-87d9-d952b55a98e5 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=128729) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 14 15:45:34.046792 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_db.sqlalchemy.engines [None req-48c0f1c2-f1e1-4f7b-b878-91e4f00cc868 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=128728) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 14 15:45:34.051143 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_db.sqlalchemy.engines [None req-c2340bd7-0188-4980-87d9-d952b55a98e5 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=128729) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 14 15:45:34.373269 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: WARNING keystonemiddleware.auth_token [None req-c2340bd7-0188-4980-87d9-d952b55a98e5 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. May 14 15:45:34.374409 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: WARNING keystonemiddleware.auth_token [None req-48c0f1c2-f1e1-4f7b-b878-91e4f00cc868 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. May 14 15:45:34.381110 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: WARNING keystonemiddleware.auth_token [None req-c2340bd7-0188-4980-87d9-d952b55a98e5 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint May 14 15:45:34.382122 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: WARNING keystonemiddleware.auth_token [None req-48c0f1c2-f1e1-4f7b-b878-91e4f00cc868 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint May 14 15:45:34.728191 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: WARNING keystonemiddleware.auth_token [None req-c2340bd7-0188-4980-87d9-d952b55a98e5 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. May 14 15:45:34.728870 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: WARNING keystonemiddleware.auth_token [None req-48c0f1c2-f1e1-4f7b-b878-91e4f00cc868 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. May 14 15:45:34.734402 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: WARNING keystonemiddleware.auth_token [None req-c2340bd7-0188-4980-87d9-d952b55a98e5 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint May 14 15:45:34.735404 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: WARNING keystonemiddleware.auth_token [None req-48c0f1c2-f1e1-4f7b-b878-91e4f00cc868 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint May 14 15:45:34.740003 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x55ba00e209c0 pid: 128729 (default app) May 14 15:45:34.740684 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x55ba00e209c0 pid: 128728 (default app) May 14 15:46:17.522302 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi [None req-67283811-1d3c-4cf4-bca2-aa418de96db7 tempest-DeleteServersTestJSON-2100051872 tempest-DeleteServersTestJSON-2100051872-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1526026473", "imageRef": "1381e3d5-fc27-4fa7-ab03-5d86278a0546", "flavorRef": "452", "networks": [{"uuid": "79ec16e7-0db8-48bf-949b-d9757455ca2e"}]}} {{(pid=128729) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 15:46:18.283038 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi [None req-f05d7530-8f2e-4b35-ac4b-59451071354a tempest-VolumesGetTestJSON-944156410 tempest-VolumesGetTestJSON-944156410-project] Action: 'create', calling method: .version_select at 0x7f77d9e7e280>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-385012525", "metadata": {"Type": "work"}}} {{(pid=128728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 15:46:18.928789 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.network.neutron [None req-67283811-1d3c-4cf4-bca2-aa418de96db7 tempest-DeleteServersTestJSON-2100051872 tempest-DeleteServersTestJSON-2100051872-project] validate_networks() for [('79ec16e7-0db8-48bf-949b-d9757455ca2e', None, None, None, None, None)] {{(pid=128729) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 14 15:46:20.267103 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.virt.hardware [None req-67283811-1d3c-4cf4-bca2-aa418de96db7 tempest-DeleteServersTestJSON-2100051872 tempest-DeleteServersTestJSON-2100051872-project] Flavor limits 0:0:0 {{(pid=128729) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 14 15:46:20.267796 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.virt.hardware [None req-67283811-1d3c-4cf4-bca2-aa418de96db7 tempest-DeleteServersTestJSON-2100051872 tempest-DeleteServersTestJSON-2100051872-project] Image limits 0:0:0 {{(pid=128729) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 14 15:46:20.267972 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.virt.hardware [None req-67283811-1d3c-4cf4-bca2-aa418de96db7 tempest-DeleteServersTestJSON-2100051872 tempest-DeleteServersTestJSON-2100051872-project] Flavor pref 0:0:0 {{(pid=128729) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 14 15:46:20.268576 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.virt.hardware [None req-67283811-1d3c-4cf4-bca2-aa418de96db7 tempest-DeleteServersTestJSON-2100051872 tempest-DeleteServersTestJSON-2100051872-project] Image pref 0:0:0 {{(pid=128729) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 14 15:46:20.269200 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.virt.hardware [None req-67283811-1d3c-4cf4-bca2-aa418de96db7 tempest-DeleteServersTestJSON-2100051872 tempest-DeleteServersTestJSON-2100051872-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128729) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 14 15:46:20.319054 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-67283811-1d3c-4cf4-bca2-aa418de96db7 tempest-DeleteServersTestJSON-2100051872 tempest-DeleteServersTestJSON-2100051872-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:46:20.319509 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-67283811-1d3c-4cf4-bca2-aa418de96db7 tempest-DeleteServersTestJSON-2100051872 tempest-DeleteServersTestJSON-2100051872-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:46:20.320433 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-67283811-1d3c-4cf4-bca2-aa418de96db7 tempest-DeleteServersTestJSON-2100051872 tempest-DeleteServersTestJSON-2100051872-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:46:20.320933 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-67283811-1d3c-4cf4-bca2-aa418de96db7 tempest-DeleteServersTestJSON-2100051872 tempest-DeleteServersTestJSON-2100051872-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:46:20.427016 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.quota [None req-67283811-1d3c-4cf4-bca2-aa418de96db7 tempest-DeleteServersTestJSON-2100051872 tempest-DeleteServersTestJSON-2100051872-project] Getting quotas for project 6388da70b0dc48c1952570af4332dd6d. Resources: {'instances', 'cores', 'ram'} {{(pid=128729) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 14 15:46:20.444501 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.quota [None req-67283811-1d3c-4cf4-bca2-aa418de96db7 tempest-DeleteServersTestJSON-2100051872 tempest-DeleteServersTestJSON-2100051872-project] Getting quotas for user aad828d8ff314a2d82f07fb6d84f36a8 and project 6388da70b0dc48c1952570af4332dd6d. Resources: {'instances', 'cores', 'ram'} {{(pid=128729) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 14 15:46:20.479997 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.compute.api [None req-67283811-1d3c-4cf4-bca2-aa418de96db7 tempest-DeleteServersTestJSON-2100051872 tempest-DeleteServersTestJSON-2100051872-project] Going to run 1 instances... {{(pid=128729) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 14 15:46:20.485727 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.compute.api [None req-67283811-1d3c-4cf4-bca2-aa418de96db7 tempest-DeleteServersTestJSON-2100051872 tempest-DeleteServersTestJSON-2100051872-project] [instance: 75ca93de-6825-44ce-af10-44cba59218a1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='1381e3d5-fc27-4fa7-ab03-5d86278a0546',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128729) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 14 15:46:20.529376 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: INFO nova.api.openstack.requestlog [None req-f05d7530-8f2e-4b35-ac4b-59451071354a tempest-VolumesGetTestJSON-944156410 tempest-VolumesGetTestJSON-944156410-project] 10.222.0.61 "POST /compute/v2.1/os-volumes" status: 200 len: 352 microversion: 2.1 time: 3.716544 May 14 15:46:20.530019 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: [pid: 128728|app: 0|req: 1/1] 10.222.0.61 () {60 vars in 1155 bytes} [Sat May 14 15:46:16 2022] POST /compute/v2.1/os-volumes => generated 352 bytes in 3719 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) May 14 15:46:20.664730 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: INFO nova.api.openstack.requestlog [None req-67283811-1d3c-4cf4-bca2-aa418de96db7 tempest-DeleteServersTestJSON-2100051872 tempest-DeleteServersTestJSON-2100051872-project] 10.222.0.61 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 4.786219 May 14 15:46:20.666418 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: [pid: 128729|app: 0|req: 1/2] 10.222.0.61 () {60 vars in 1146 bytes} [Sat May 14 15:46:15 2022] POST /compute/v2.1/servers => generated 380 bytes in 4797 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 14 15:46:20.674168 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi [None req-440570b3-5a33-4265-b7e4-c76e8687bb51 tempest-VolumesGetTestJSON-944156410 tempest-VolumesGetTestJSON-944156410-project] Calling method '.version_select at 0x7f77d9480280>' {{(pid=128729) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 15:46:20.887568 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: INFO nova.api.openstack.requestlog [None req-440570b3-5a33-4265-b7e4-c76e8687bb51 tempest-VolumesGetTestJSON-944156410 tempest-VolumesGetTestJSON-944156410-project] 10.222.0.61 "GET /compute/v2.1/os-volumes/91d8bd25-0bee-41e6-ae87-cc2959d2efa8" status: 200 len: 352 microversion: 2.1 time: 0.218064 May 14 15:46:20.888780 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: [pid: 128729|app: 0|req: 2/3] 10.222.0.61 () {58 vars in 1244 bytes} [Sat May 14 15:46:20 2022] GET /compute/v2.1/os-volumes/91d8bd25-0bee-41e6-ae87-cc2959d2efa8 => generated 352 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 14 15:46:20.895607 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi [None req-93a7c703-d88f-4786-aae1-525351b810f5 tempest-DeleteServersTestJSON-2100051872 tempest-DeleteServersTestJSON-2100051872-project] Calling method '>' {{(pid=128729) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 15:46:20.897016 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.compute.api [None req-93a7c703-d88f-4786-aae1-525351b810f5 tempest-DeleteServersTestJSON-2100051872 tempest-DeleteServersTestJSON-2100051872-project] [instance: 75ca93de-6825-44ce-af10-44cba59218a1] Fetching instance by UUID {{(pid=128729) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 15:46:20.924328 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi [None req-146bfdbb-bc77-43ed-99ae-49d7ec8c2caa tempest-VolumesSnapshotsTestJSON-180423719 tempest-VolumesSnapshotsTestJSON-180423719-project] Action: 'create', calling method: .version_select at 0x7f77d9cd91f0>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-1888986601"}} {{(pid=128728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 15:46:21.116570 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.policy [None req-93a7c703-d88f-4786-aae1-525351b810f5 tempest-DeleteServersTestJSON-2100051872 tempest-DeleteServersTestJSON-2100051872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aad828d8ff314a2d82f07fb6d84f36a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6388da70b0dc48c1952570af4332dd6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128729) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:46:21.154965 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: INFO nova.api.openstack.requestlog [None req-93a7c703-d88f-4786-aae1-525351b810f5 tempest-DeleteServersTestJSON-2100051872 tempest-DeleteServersTestJSON-2100051872-project] 10.222.0.61 "GET /compute/v2.1/servers/75ca93de-6825-44ce-af10-44cba59218a1" status: 200 len: 1215 microversion: 2.1 time: 0.264688 May 14 15:46:21.169816 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: [pid: 128729|app: 0|req: 3/4] 10.222.0.61 () {58 vars in 1235 bytes} [Sat May 14 15:46:20 2022] GET /compute/v2.1/servers/75ca93de-6825-44ce-af10-44cba59218a1 => generated 1215 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 15:46:21.764453 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: INFO nova.api.openstack.requestlog [None req-146bfdbb-bc77-43ed-99ae-49d7ec8c2caa tempest-VolumesSnapshotsTestJSON-180423719 tempest-VolumesSnapshotsTestJSON-180423719-project] 10.222.0.61 "POST /compute/v2.1/os-volumes" status: 200 len: 345 microversion: 2.1 time: 1.232056 May 14 15:46:21.765369 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: [pid: 128728|app: 0|req: 2/5] 10.222.0.61 () {60 vars in 1154 bytes} [Sat May 14 15:46:20 2022] POST /compute/v2.1/os-volumes => generated 345 bytes in 1234 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) May 14 15:46:21.776902 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi [None req-b40df08c-3429-4b7b-a3f8-913039f40cdf tempest-VolumesSnapshotsTestJSON-180423719 tempest-VolumesSnapshotsTestJSON-180423719-project] Calling method '.version_select at 0x7f77d8be3dc0>' {{(pid=128729) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 15:46:21.852873 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: INFO nova.api.openstack.requestlog [None req-b40df08c-3429-4b7b-a3f8-913039f40cdf tempest-VolumesSnapshotsTestJSON-180423719 tempest-VolumesSnapshotsTestJSON-180423719-project] 10.222.0.61 "GET /compute/v2.1/os-volumes/8c2d3ae3-87aa-4d95-b72c-d32fa9b5aa8b" status: 200 len: 345 microversion: 2.1 time: 0.079838 May 14 15:46:21.858973 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: [pid: 128729|app: 0|req: 4/6] 10.222.0.61 () {58 vars in 1244 bytes} [Sat May 14 15:46:21 2022] GET /compute/v2.1/os-volumes/8c2d3ae3-87aa-4d95-b72c-d32fa9b5aa8b => generated 345 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 14 15:46:21.900259 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi [None req-a36ea1d9-f433-4034-93c8-88d9bae9d576 tempest-VolumesGetTestJSON-944156410 tempest-VolumesGetTestJSON-944156410-project] Calling method '.version_select at 0x7f77d9cd9820>' {{(pid=128728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 15:46:21.994573 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: INFO nova.api.openstack.requestlog [None req-a36ea1d9-f433-4034-93c8-88d9bae9d576 tempest-VolumesGetTestJSON-944156410 tempest-VolumesGetTestJSON-944156410-project] 10.222.0.61 "GET /compute/v2.1/os-volumes/91d8bd25-0bee-41e6-ae87-cc2959d2efa8" status: 200 len: 352 microversion: 2.1 time: 0.097919 May 14 15:46:21.995742 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: [pid: 128728|app: 0|req: 3/7] 10.222.0.61 () {58 vars in 1244 bytes} [Sat May 14 15:46:21 2022] GET /compute/v2.1/os-volumes/91d8bd25-0bee-41e6-ae87-cc2959d2efa8 => generated 352 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 14 15:46:22.175705 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi [None req-970e3a98-a1f7-4ae7-b3ec-8781bfa7ec37 tempest-DeleteServersTestJSON-2100051872 tempest-DeleteServersTestJSON-2100051872-project] Calling method '>' {{(pid=128729) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 15:46:22.176946 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.compute.api [None req-970e3a98-a1f7-4ae7-b3ec-8781bfa7ec37 tempest-DeleteServersTestJSON-2100051872 tempest-DeleteServersTestJSON-2100051872-project] [instance: 75ca93de-6825-44ce-af10-44cba59218a1] Fetching instance by UUID {{(pid=128729) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 15:46:22.468134 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.policy [None req-970e3a98-a1f7-4ae7-b3ec-8781bfa7ec37 tempest-DeleteServersTestJSON-2100051872 tempest-DeleteServersTestJSON-2100051872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aad828d8ff314a2d82f07fb6d84f36a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6388da70b0dc48c1952570af4332dd6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128729) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:46:22.486548 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: INFO nova.api.openstack.requestlog [None req-970e3a98-a1f7-4ae7-b3ec-8781bfa7ec37 tempest-DeleteServersTestJSON-2100051872 tempest-DeleteServersTestJSON-2100051872-project] 10.222.0.61 "GET /compute/v2.1/servers/75ca93de-6825-44ce-af10-44cba59218a1" status: 200 len: 1215 microversion: 2.1 time: 0.314399 May 14 15:46:22.487980 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: [pid: 128729|app: 0|req: 5/8] 10.222.0.61 () {58 vars in 1235 bytes} [Sat May 14 15:46:22 2022] GET /compute/v2.1/servers/75ca93de-6825-44ce-af10-44cba59218a1 => generated 1215 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 15:46:22.867745 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi [None req-0b1848f8-5fde-4d9b-81dc-a6a2c22784b5 tempest-VolumesSnapshotsTestJSON-180423719 tempest-VolumesSnapshotsTestJSON-180423719-project] Calling method '.version_select at 0x7f77d9cd9040>' {{(pid=128728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 15:46:22.999797 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: INFO nova.api.openstack.requestlog [None req-0b1848f8-5fde-4d9b-81dc-a6a2c22784b5 tempest-VolumesSnapshotsTestJSON-180423719 tempest-VolumesSnapshotsTestJSON-180423719-project] 10.222.0.61 "GET /compute/v2.1/os-volumes/8c2d3ae3-87aa-4d95-b72c-d32fa9b5aa8b" status: 200 len: 346 microversion: 2.1 time: 0.136877 May 14 15:46:23.007268 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: [pid: 128728|app: 0|req: 4/9] 10.222.0.61 () {58 vars in 1244 bytes} [Sat May 14 15:46:22 2022] GET /compute/v2.1/os-volumes/8c2d3ae3-87aa-4d95-b72c-d32fa9b5aa8b => generated 346 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 14 15:46:23.008891 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi [None req-0c8859ee-ba31-4cf6-b8a7-9c44ba3db6c4 tempest-VolumesGetTestJSON-944156410 tempest-VolumesGetTestJSON-944156410-project] Calling method '.version_select at 0x7f77d8b8bee0>' {{(pid=128729) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 15:46:23.012630 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi [None req-bfe095ec-8649-4a37-8657-c36e0414dc8c tempest-VolumesSnapshotsTestJSON-180423719 tempest-VolumesSnapshotsTestJSON-180423719-project] Action: 'create', calling method: .version_select at 0x7f77d9ce00d0>, body: {"snapshot": {"volume_id": "8c2d3ae3-87aa-4d95-b72c-d32fa9b5aa8b", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-342376133"}} {{(pid=128728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 15:46:23.136675 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: INFO nova.api.openstack.requestlog [None req-0c8859ee-ba31-4cf6-b8a7-9c44ba3db6c4 tempest-VolumesGetTestJSON-944156410 tempest-VolumesGetTestJSON-944156410-project] 10.222.0.61 "GET /compute/v2.1/os-volumes/91d8bd25-0bee-41e6-ae87-cc2959d2efa8" status: 200 len: 353 microversion: 2.1 time: 0.130314 May 14 15:46:23.144663 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: [pid: 128729|app: 0|req: 6/10] 10.222.0.61 () {58 vars in 1244 bytes} [Sat May 14 15:46:23 2022] GET /compute/v2.1/os-volumes/91d8bd25-0bee-41e6-ae87-cc2959d2efa8 => generated 353 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 14 15:46:23.158145 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi [None req-380a1a8c-9f92-4e55-b922-d45016970064 tempest-VolumesGetTestJSON-944156410 tempest-VolumesGetTestJSON-944156410-project] Calling method '.version_select at 0x7f77d8b8b4c0>' {{(pid=128729) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 15:46:23.463420 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: INFO nova.api.openstack.requestlog [None req-380a1a8c-9f92-4e55-b922-d45016970064 tempest-VolumesGetTestJSON-944156410 tempest-VolumesGetTestJSON-944156410-project] 10.222.0.61 "GET /compute/v2.1/os-volumes/91d8bd25-0bee-41e6-ae87-cc2959d2efa8" status: 200 len: 353 microversion: 2.1 time: 0.316845 May 14 15:46:23.463839 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: [pid: 128729|app: 0|req: 7/11] 10.222.0.61 () {58 vars in 1244 bytes} [Sat May 14 15:46:23 2022] GET /compute/v2.1/os-volumes/91d8bd25-0bee-41e6-ae87-cc2959d2efa8 => generated 353 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 14 15:46:23.486226 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi [None req-4f55070b-9257-4032-a870-f33b427829b5 tempest-VolumesGetTestJSON-944156410 tempest-VolumesGetTestJSON-944156410-project] Calling method '.version_select at 0x7f77d8bee790>' {{(pid=128729) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 15:46:23.685026 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: INFO nova.api.openstack.requestlog [None req-4f55070b-9257-4032-a870-f33b427829b5 tempest-VolumesGetTestJSON-944156410 tempest-VolumesGetTestJSON-944156410-project] 10.222.0.61 "DELETE /compute/v2.1/os-volumes/91d8bd25-0bee-41e6-ae87-cc2959d2efa8" status: 202 len: 0 microversion: 2.1 time: 0.201857 May 14 15:46:23.686687 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: [pid: 128729|app: 0|req: 8/12] 10.222.0.61 () {58 vars in 1247 bytes} [Sat May 14 15:46:23 2022] DELETE /compute/v2.1/os-volumes/91d8bd25-0bee-41e6-ae87-cc2959d2efa8 => generated 0 bytes in 205 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) May 14 15:46:23.694144 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi [None req-5ab21673-4dda-4f2d-a29a-42aadb6d8e74 tempest-DeleteServersTestJSON-2100051872 tempest-DeleteServersTestJSON-2100051872-project] Calling method '>' {{(pid=128729) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 15:46:23.695494 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.compute.api [None req-5ab21673-4dda-4f2d-a29a-42aadb6d8e74 tempest-DeleteServersTestJSON-2100051872 tempest-DeleteServersTestJSON-2100051872-project] [instance: 75ca93de-6825-44ce-af10-44cba59218a1] Fetching instance by UUID {{(pid=128729) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 15:46:23.697381 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: INFO nova.api.openstack.requestlog [None req-bfe095ec-8649-4a37-8657-c36e0414dc8c tempest-VolumesSnapshotsTestJSON-180423719 tempest-VolumesSnapshotsTestJSON-180423719-project] 10.222.0.61 "POST /compute/v2.1/os-snapshots" status: 200 len: 286 microversion: 2.1 time: 0.688159 May 14 15:46:23.697993 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: [pid: 128728|app: 0|req: 5/13] 10.222.0.61 () {60 vars in 1161 bytes} [Sat May 14 15:46:23 2022] POST /compute/v2.1/os-snapshots => generated 286 bytes in 690 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 14 15:46:23.708774 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi [None req-ce638e6c-5740-4a65-8b52-88e1f2d99d52 tempest-VolumesGetTestJSON-944156410 tempest-VolumesGetTestJSON-944156410-project] Calling method '.version_select at 0x7f77d9cd9b80>' {{(pid=128728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 15:46:23.729540 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-5ab21673-4dda-4f2d-a29a-42aadb6d8e74 tempest-DeleteServersTestJSON-2100051872 tempest-DeleteServersTestJSON-2100051872-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:46:23.732413 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-5ab21673-4dda-4f2d-a29a-42aadb6d8e74 tempest-DeleteServersTestJSON-2100051872 tempest-DeleteServersTestJSON-2100051872-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:46:23.733572 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-5ab21673-4dda-4f2d-a29a-42aadb6d8e74 tempest-DeleteServersTestJSON-2100051872 tempest-DeleteServersTestJSON-2100051872-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:46:23.735815 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-5ab21673-4dda-4f2d-a29a-42aadb6d8e74 tempest-DeleteServersTestJSON-2100051872 tempest-DeleteServersTestJSON-2100051872-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:46:23.858592 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: INFO nova.api.openstack.requestlog [None req-ce638e6c-5740-4a65-8b52-88e1f2d99d52 tempest-VolumesGetTestJSON-944156410 tempest-VolumesGetTestJSON-944156410-project] 10.222.0.61 "GET /compute/v2.1/os-volumes/91d8bd25-0bee-41e6-ae87-cc2959d2efa8" status: 200 len: 352 microversion: 2.1 time: 0.154170 May 14 15:46:23.859896 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: [pid: 128728|app: 0|req: 6/14] 10.222.0.61 () {58 vars in 1244 bytes} [Sat May 14 15:46:23 2022] GET /compute/v2.1/os-volumes/91d8bd25-0bee-41e6-ae87-cc2959d2efa8 => generated 352 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 14 15:46:23.865702 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi [None req-1792e15a-e387-4383-8fa3-b2e1cfae7d70 tempest-VolumesSnapshotsTestJSON-180423719 tempest-VolumesSnapshotsTestJSON-180423719-project] Calling method '.version_select at 0x7f77d9cd9670>' {{(pid=128728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 15:46:23.912437 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: INFO nova.api.openstack.requestlog [None req-1792e15a-e387-4383-8fa3-b2e1cfae7d70 tempest-VolumesSnapshotsTestJSON-180423719 tempest-VolumesSnapshotsTestJSON-180423719-project] 10.222.0.61 "GET /compute/v2.1/os-snapshots/499db537-656a-4475-9d95-e3501f965c0f" status: 200 len: 286 microversion: 2.1 time: 0.051622 May 14 15:46:23.917100 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: [pid: 128728|app: 0|req: 7/15] 10.222.0.61 () {58 vars in 1250 bytes} [Sat May 14 15:46:23 2022] GET /compute/v2.1/os-snapshots/499db537-656a-4475-9d95-e3501f965c0f => generated 286 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 14 15:46:23.924129 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi [None req-27ae24fc-8cdc-46b5-a1b1-d8b10108fdd6 tempest-VolumesSnapshotsTestJSON-180423719 tempest-VolumesSnapshotsTestJSON-180423719-project] Calling method '.version_select at 0x7f77d9ce08b0>' {{(pid=128728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 15:46:24.034608 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: INFO nova.api.openstack.requestlog [None req-27ae24fc-8cdc-46b5-a1b1-d8b10108fdd6 tempest-VolumesSnapshotsTestJSON-180423719 tempest-VolumesSnapshotsTestJSON-180423719-project] 10.222.0.61 "GET /compute/v2.1/os-snapshots" status: 200 len: 289 microversion: 2.1 time: 0.114731 May 14 15:46:24.035802 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: [pid: 128728|app: 0|req: 8/16] 10.222.0.61 () {58 vars in 1139 bytes} [Sat May 14 15:46:23 2022] GET /compute/v2.1/os-snapshots => generated 289 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 14 15:46:24.046302 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi [None req-099c7d8e-1bec-48a1-8440-38a769c9724e tempest-VolumesSnapshotsTestJSON-180423719 tempest-VolumesSnapshotsTestJSON-180423719-project] Calling method '.version_select at 0x7f77d9cd9280>' {{(pid=128728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 15:46:24.124672 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.policy [None req-5ab21673-4dda-4f2d-a29a-42aadb6d8e74 tempest-DeleteServersTestJSON-2100051872 tempest-DeleteServersTestJSON-2100051872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aad828d8ff314a2d82f07fb6d84f36a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6388da70b0dc48c1952570af4332dd6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128729) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:46:24.132965 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: INFO nova.api.openstack.requestlog [None req-099c7d8e-1bec-48a1-8440-38a769c9724e tempest-VolumesSnapshotsTestJSON-180423719 tempest-VolumesSnapshotsTestJSON-180423719-project] 10.222.0.61 "GET /compute/v2.1/os-snapshots/499db537-656a-4475-9d95-e3501f965c0f" status: 200 len: 286 microversion: 2.1 time: 0.088339 May 14 15:46:24.134225 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: [pid: 128728|app: 0|req: 9/17] 10.222.0.61 () {58 vars in 1250 bytes} [Sat May 14 15:46:24 2022] GET /compute/v2.1/os-snapshots/499db537-656a-4475-9d95-e3501f965c0f => generated 286 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 14 15:46:24.146742 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: INFO nova.api.openstack.requestlog [None req-5ab21673-4dda-4f2d-a29a-42aadb6d8e74 tempest-DeleteServersTestJSON-2100051872 tempest-DeleteServersTestJSON-2100051872-project] 10.222.0.61 "GET /compute/v2.1/servers/75ca93de-6825-44ce-af10-44cba59218a1" status: 200 len: 1267 microversion: 2.1 time: 0.458632 May 14 15:46:24.147667 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: [pid: 128729|app: 0|req: 9/18] 10.222.0.61 () {58 vars in 1235 bytes} [Sat May 14 15:46:23 2022] GET /compute/v2.1/servers/75ca93de-6825-44ce-af10-44cba59218a1 => generated 1267 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 15:46:24.871389 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi [None req-7b6cdc30-ddd8-4b1f-b7a9-6d9dfb234b2d tempest-VolumesGetTestJSON-944156410 tempest-VolumesGetTestJSON-944156410-project] Calling method '.version_select at 0x7f77d9cd9c10>' {{(pid=128728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 15:46:24.968687 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: INFO nova.api.openstack.requestlog [None req-7b6cdc30-ddd8-4b1f-b7a9-6d9dfb234b2d tempest-VolumesGetTestJSON-944156410 tempest-VolumesGetTestJSON-944156410-project] 10.222.0.61 "GET /compute/v2.1/os-volumes/91d8bd25-0bee-41e6-ae87-cc2959d2efa8" status: 200 len: 352 microversion: 2.1 time: 0.101919 May 14 15:46:24.970793 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: [pid: 128728|app: 0|req: 10/19] 10.222.0.61 () {58 vars in 1244 bytes} [Sat May 14 15:46:24 2022] GET /compute/v2.1/os-volumes/91d8bd25-0bee-41e6-ae87-cc2959d2efa8 => generated 352 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 14 15:46:25.151316 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi [None req-1bbd33fc-51e3-484f-980c-b4b2cd5ab5ad tempest-VolumesSnapshotsTestJSON-180423719 tempest-VolumesSnapshotsTestJSON-180423719-project] Calling method '.version_select at 0x7f77d8b17670>' {{(pid=128729) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 15:46:25.164066 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi [None req-5834cb55-9501-4131-be38-e215fb3b5cf0 tempest-DeleteServersTestJSON-2100051872 tempest-DeleteServersTestJSON-2100051872-project] Calling method '>' {{(pid=128728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 15:46:25.165402 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.compute.api [None req-5834cb55-9501-4131-be38-e215fb3b5cf0 tempest-DeleteServersTestJSON-2100051872 tempest-DeleteServersTestJSON-2100051872-project] [instance: 75ca93de-6825-44ce-af10-44cba59218a1] Fetching instance by UUID {{(pid=128728) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 15:46:25.195535 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-5834cb55-9501-4131-be38-e215fb3b5cf0 tempest-DeleteServersTestJSON-2100051872 tempest-DeleteServersTestJSON-2100051872-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:46:25.196134 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-5834cb55-9501-4131-be38-e215fb3b5cf0 tempest-DeleteServersTestJSON-2100051872 tempest-DeleteServersTestJSON-2100051872-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:46:25.199115 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-5834cb55-9501-4131-be38-e215fb3b5cf0 tempest-DeleteServersTestJSON-2100051872 tempest-DeleteServersTestJSON-2100051872-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:46:25.199115 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-5834cb55-9501-4131-be38-e215fb3b5cf0 tempest-DeleteServersTestJSON-2100051872 tempest-DeleteServersTestJSON-2100051872-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:46:25.291645 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: INFO nova.api.openstack.requestlog [None req-1bbd33fc-51e3-484f-980c-b4b2cd5ab5ad tempest-VolumesSnapshotsTestJSON-180423719 tempest-VolumesSnapshotsTestJSON-180423719-project] 10.222.0.61 "GET /compute/v2.1/os-snapshots/499db537-656a-4475-9d95-e3501f965c0f" status: 200 len: 286 microversion: 2.1 time: 0.149978 May 14 15:46:25.292230 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: [pid: 128729|app: 0|req: 10/20] 10.222.0.61 () {58 vars in 1250 bytes} [Sat May 14 15:46:25 2022] GET /compute/v2.1/os-snapshots/499db537-656a-4475-9d95-e3501f965c0f => generated 286 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 14 15:46:25.678718 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.policy [None req-5834cb55-9501-4131-be38-e215fb3b5cf0 tempest-DeleteServersTestJSON-2100051872 tempest-DeleteServersTestJSON-2100051872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aad828d8ff314a2d82f07fb6d84f36a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6388da70b0dc48c1952570af4332dd6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128728) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:46:25.708315 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: INFO nova.api.openstack.requestlog [None req-5834cb55-9501-4131-be38-e215fb3b5cf0 tempest-DeleteServersTestJSON-2100051872 tempest-DeleteServersTestJSON-2100051872-project] 10.222.0.61 "GET /compute/v2.1/servers/75ca93de-6825-44ce-af10-44cba59218a1" status: 200 len: 1273 microversion: 2.1 time: 0.547979 May 14 15:46:25.709478 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: [pid: 128728|app: 0|req: 11/21] 10.222.0.61 () {58 vars in 1235 bytes} [Sat May 14 15:46:25 2022] GET /compute/v2.1/servers/75ca93de-6825-44ce-af10-44cba59218a1 => generated 1273 bytes in 550 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 15:46:25.983462 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi [None req-b411ea64-07a3-4113-8f70-417aa4be38fc tempest-VolumesGetTestJSON-944156410 tempest-VolumesGetTestJSON-944156410-project] Calling method '.version_select at 0x7f77d8b22040>' {{(pid=128729) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 15:46:26.149195 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: INFO nova.api.openstack.requestlog [None req-b411ea64-07a3-4113-8f70-417aa4be38fc tempest-VolumesGetTestJSON-944156410 tempest-VolumesGetTestJSON-944156410-project] 10.222.0.61 "GET /compute/v2.1/os-volumes/91d8bd25-0bee-41e6-ae87-cc2959d2efa8" status: 200 len: 352 microversion: 2.1 time: 0.170142 May 14 15:46:26.150409 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: [pid: 128729|app: 0|req: 11/22] 10.222.0.61 () {58 vars in 1244 bytes} [Sat May 14 15:46:25 2022] GET /compute/v2.1/os-volumes/91d8bd25-0bee-41e6-ae87-cc2959d2efa8 => generated 352 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 14 15:46:26.303456 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi [None req-8ad15c2c-8ae4-4a01-ad41-2f8555e1d17a tempest-VolumesSnapshotsTestJSON-180423719 tempest-VolumesSnapshotsTestJSON-180423719-project] Calling method '.version_select at 0x7f77d9c120d0>' {{(pid=128728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 15:46:26.381789 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: INFO nova.api.openstack.requestlog [None req-8ad15c2c-8ae4-4a01-ad41-2f8555e1d17a tempest-VolumesSnapshotsTestJSON-180423719 tempest-VolumesSnapshotsTestJSON-180423719-project] 10.222.0.61 "GET /compute/v2.1/os-snapshots/499db537-656a-4475-9d95-e3501f965c0f" status: 200 len: 286 microversion: 2.1 time: 0.082754 May 14 15:46:26.382402 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: [pid: 128728|app: 0|req: 12/23] 10.222.0.61 () {58 vars in 1250 bytes} [Sat May 14 15:46:26 2022] GET /compute/v2.1/os-snapshots/499db537-656a-4475-9d95-e3501f965c0f => generated 286 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 14 15:46:26.730025 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi [None req-965fc0bf-78dc-429a-8ae2-28aabed3c0bf tempest-DeleteServersTestJSON-2100051872 tempest-DeleteServersTestJSON-2100051872-project] Calling method '>' {{(pid=128728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 15:46:26.731402 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.compute.api [None req-965fc0bf-78dc-429a-8ae2-28aabed3c0bf tempest-DeleteServersTestJSON-2100051872 tempest-DeleteServersTestJSON-2100051872-project] [instance: 75ca93de-6825-44ce-af10-44cba59218a1] Fetching instance by UUID {{(pid=128728) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 15:46:26.742219 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-965fc0bf-78dc-429a-8ae2-28aabed3c0bf tempest-DeleteServersTestJSON-2100051872 tempest-DeleteServersTestJSON-2100051872-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:46:26.745689 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-965fc0bf-78dc-429a-8ae2-28aabed3c0bf tempest-DeleteServersTestJSON-2100051872 tempest-DeleteServersTestJSON-2100051872-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:46:26.747900 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-965fc0bf-78dc-429a-8ae2-28aabed3c0bf tempest-DeleteServersTestJSON-2100051872 tempest-DeleteServersTestJSON-2100051872-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:46:26.749852 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-965fc0bf-78dc-429a-8ae2-28aabed3c0bf tempest-DeleteServersTestJSON-2100051872 tempest-DeleteServersTestJSON-2100051872-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:46:26.788502 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi [None req-fc89720a-9796-48b5-9b1c-42930ddfa2a9 tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] Action: 'create', calling method: .version_select at 0x7f77d8b42160>, body: {"keypair": {"name": "tempest-keypair-1260306284", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNIs1xhFeG7Q8/sYOEWm9CBwBJKtFh+lYhC4zO9SpvrqRMUF/bzg3xT8n96gR1bfemNzB9OfnIrAKAZpQRId7zXmORu8PLPHXh8AH5kQDAxDZ4pcqnR5zdGefIij73yIsw=="}} {{(pid=128729) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 15:46:26.861434 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.quota [None req-fc89720a-9796-48b5-9b1c-42930ddfa2a9 tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] Getting quotas for project 7905689c95d44a5c9169249c70f7de57. Resources: {'key_pairs'} {{(pid=128729) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 14 15:46:26.872195 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.quota [None req-fc89720a-9796-48b5-9b1c-42930ddfa2a9 tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] Getting quotas for user dc43895177134e9c9c030a9d87f94aaa and project 7905689c95d44a5c9169249c70f7de57. Resources: {'key_pairs'} {{(pid=128729) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 14 15:46:26.881044 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.policy [None req-965fc0bf-78dc-429a-8ae2-28aabed3c0bf tempest-DeleteServersTestJSON-2100051872 tempest-DeleteServersTestJSON-2100051872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aad828d8ff314a2d82f07fb6d84f36a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6388da70b0dc48c1952570af4332dd6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128728) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:46:26.890263 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: INFO nova.api.openstack.requestlog [None req-965fc0bf-78dc-429a-8ae2-28aabed3c0bf tempest-DeleteServersTestJSON-2100051872 tempest-DeleteServersTestJSON-2100051872-project] 10.222.0.61 "GET /compute/v2.1/servers/75ca93de-6825-44ce-af10-44cba59218a1" status: 200 len: 1273 microversion: 2.1 time: 0.165519 May 14 15:46:26.899761 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: [pid: 128728|app: 0|req: 13/24] 10.222.0.61 () {58 vars in 1235 bytes} [Sat May 14 15:46:26 2022] GET /compute/v2.1/servers/75ca93de-6825-44ce-af10-44cba59218a1 => generated 1273 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 15:46:27.001694 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: INFO nova.api.openstack.requestlog [None req-fc89720a-9796-48b5-9b1c-42930ddfa2a9 tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] 10.222.0.61 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.514654 May 14 15:46:27.002689 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: [pid: 128729|app: 0|req: 12/25] 10.222.0.61 () {60 vars in 1158 bytes} [Sat May 14 15:46:26 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 14 15:46:27.162849 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi [None req-f37508c5-9368-4d77-90c9-fa058617d2b9 tempest-VolumesGetTestJSON-944156410 tempest-VolumesGetTestJSON-944156410-project] Calling method '.version_select at 0x7f77d9bdc700>' {{(pid=128728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 15:46:27.283034 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: INFO nova.api.openstack.requestlog [None req-f37508c5-9368-4d77-90c9-fa058617d2b9 tempest-VolumesGetTestJSON-944156410 tempest-VolumesGetTestJSON-944156410-project] 10.222.0.61 "GET /compute/v2.1/os-volumes/91d8bd25-0bee-41e6-ae87-cc2959d2efa8" status: 200 len: 352 microversion: 2.1 time: 0.123789 May 14 15:46:27.283737 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: [pid: 128728|app: 0|req: 14/26] 10.222.0.61 () {58 vars in 1244 bytes} [Sat May 14 15:46:27 2022] GET /compute/v2.1/os-volumes/91d8bd25-0bee-41e6-ae87-cc2959d2efa8 => generated 352 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 14 15:46:27.394776 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi [None req-813a5453-d4a5-419f-8d3a-572e6e6db07a tempest-VolumesSnapshotsTestJSON-180423719 tempest-VolumesSnapshotsTestJSON-180423719-project] Calling method '.version_select at 0x7f77d8c000d0>' {{(pid=128729) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 15:46:27.484336 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: INFO nova.api.openstack.requestlog [None req-813a5453-d4a5-419f-8d3a-572e6e6db07a tempest-VolumesSnapshotsTestJSON-180423719 tempest-VolumesSnapshotsTestJSON-180423719-project] 10.222.0.61 "GET /compute/v2.1/os-snapshots/499db537-656a-4475-9d95-e3501f965c0f" status: 200 len: 286 microversion: 2.1 time: 0.094908 May 14 15:46:27.489875 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: [pid: 128729|app: 0|req: 13/27] 10.222.0.61 () {58 vars in 1250 bytes} [Sat May 14 15:46:27 2022] GET /compute/v2.1/os-snapshots/499db537-656a-4475-9d95-e3501f965c0f => generated 286 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 14 15:46:27.916945 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi [None req-9d18f64c-238b-4f0f-a65c-b87ff54bf7fb tempest-DeleteServersTestJSON-2100051872 tempest-DeleteServersTestJSON-2100051872-project] Calling method '>' {{(pid=128728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 15:46:27.918154 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.compute.api [None req-9d18f64c-238b-4f0f-a65c-b87ff54bf7fb tempest-DeleteServersTestJSON-2100051872 tempest-DeleteServersTestJSON-2100051872-project] [instance: 75ca93de-6825-44ce-af10-44cba59218a1] Fetching instance by UUID {{(pid=128728) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 15:46:27.927121 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-9d18f64c-238b-4f0f-a65c-b87ff54bf7fb tempest-DeleteServersTestJSON-2100051872 tempest-DeleteServersTestJSON-2100051872-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:46:27.932567 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-9d18f64c-238b-4f0f-a65c-b87ff54bf7fb tempest-DeleteServersTestJSON-2100051872 tempest-DeleteServersTestJSON-2100051872-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:46:27.934167 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-9d18f64c-238b-4f0f-a65c-b87ff54bf7fb tempest-DeleteServersTestJSON-2100051872 tempest-DeleteServersTestJSON-2100051872-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:46:27.934855 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-9d18f64c-238b-4f0f-a65c-b87ff54bf7fb tempest-DeleteServersTestJSON-2100051872 tempest-DeleteServersTestJSON-2100051872-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:46:28.135669 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.policy [None req-9d18f64c-238b-4f0f-a65c-b87ff54bf7fb tempest-DeleteServersTestJSON-2100051872 tempest-DeleteServersTestJSON-2100051872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aad828d8ff314a2d82f07fb6d84f36a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6388da70b0dc48c1952570af4332dd6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128728) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:46:28.142935 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: INFO nova.api.openstack.requestlog [None req-9d18f64c-238b-4f0f-a65c-b87ff54bf7fb tempest-DeleteServersTestJSON-2100051872 tempest-DeleteServersTestJSON-2100051872-project] 10.222.0.61 "GET /compute/v2.1/servers/75ca93de-6825-44ce-af10-44cba59218a1" status: 200 len: 1273 microversion: 2.1 time: 0.229990 May 14 15:46:28.143513 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: [pid: 128728|app: 0|req: 15/28] 10.222.0.61 () {58 vars in 1235 bytes} [Sat May 14 15:46:27 2022] GET /compute/v2.1/servers/75ca93de-6825-44ce-af10-44cba59218a1 => generated 1273 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 15:46:28.296300 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi [None req-e223bc96-3b56-4f5b-b767-15b93d6a65ea tempest-VolumesGetTestJSON-944156410 tempest-VolumesGetTestJSON-944156410-project] Calling method '.version_select at 0x7f77d9bdc9d0>' {{(pid=128728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 15:46:28.453824 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi [None req-34f08f3f-4838-470e-96a1-7c616e80e9a1 tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1161342375", "imageRef": "1381e3d5-fc27-4fa7-ab03-5d86278a0546", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=128729) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 15:46:28.458231 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: INFO nova.api.openstack.requestlog [None req-e223bc96-3b56-4f5b-b767-15b93d6a65ea tempest-VolumesGetTestJSON-944156410 tempest-VolumesGetTestJSON-944156410-project] 10.222.0.61 "GET /compute/v2.1/os-volumes/91d8bd25-0bee-41e6-ae87-cc2959d2efa8" status: 200 len: 352 microversion: 2.1 time: 0.166565 May 14 15:46:28.458835 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: [pid: 128728|app: 0|req: 16/29] 10.222.0.61 () {58 vars in 1244 bytes} [Sat May 14 15:46:28 2022] GET /compute/v2.1/os-volumes/91d8bd25-0bee-41e6-ae87-cc2959d2efa8 => generated 352 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 14 15:46:28.496625 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi [None req-5e7a39df-f7dd-4e32-b0a7-4bc91c52c5e2 tempest-VolumesSnapshotsTestJSON-180423719 tempest-VolumesSnapshotsTestJSON-180423719-project] Calling method '.version_select at 0x7f77d9bdcc10>' {{(pid=128728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 15:46:28.557911 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.network.neutron [None req-34f08f3f-4838-470e-96a1-7c616e80e9a1 tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] validate_networks() for [('3e026b24-9d5e-4f74-ac5a-5d47dc1338b8', None, None, None, None, None)] {{(pid=128729) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 14 15:46:28.585056 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: INFO nova.api.openstack.requestlog [None req-5e7a39df-f7dd-4e32-b0a7-4bc91c52c5e2 tempest-VolumesSnapshotsTestJSON-180423719 tempest-VolumesSnapshotsTestJSON-180423719-project] 10.222.0.61 "GET /compute/v2.1/os-snapshots/499db537-656a-4475-9d95-e3501f965c0f" status: 200 len: 286 microversion: 2.1 time: 0.092281 May 14 15:46:28.585609 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: [pid: 128728|app: 0|req: 17/30] 10.222.0.61 () {58 vars in 1250 bytes} [Sat May 14 15:46:28 2022] GET /compute/v2.1/os-snapshots/499db537-656a-4475-9d95-e3501f965c0f => generated 286 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 14 15:46:29.159657 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi [None req-db2d6b5f-608e-483f-a7bd-767b206358d1 tempest-DeleteServersTestJSON-2100051872 tempest-DeleteServersTestJSON-2100051872-project] Calling method '>' {{(pid=128728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 15:46:29.160275 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.compute.api [None req-db2d6b5f-608e-483f-a7bd-767b206358d1 tempest-DeleteServersTestJSON-2100051872 tempest-DeleteServersTestJSON-2100051872-project] [instance: 75ca93de-6825-44ce-af10-44cba59218a1] Fetching instance by UUID {{(pid=128728) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 15:46:29.173699 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-db2d6b5f-608e-483f-a7bd-767b206358d1 tempest-DeleteServersTestJSON-2100051872 tempest-DeleteServersTestJSON-2100051872-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:46:29.174433 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-db2d6b5f-608e-483f-a7bd-767b206358d1 tempest-DeleteServersTestJSON-2100051872 tempest-DeleteServersTestJSON-2100051872-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:46:29.175372 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-db2d6b5f-608e-483f-a7bd-767b206358d1 tempest-DeleteServersTestJSON-2100051872 tempest-DeleteServersTestJSON-2100051872-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:46:29.175944 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-db2d6b5f-608e-483f-a7bd-767b206358d1 tempest-DeleteServersTestJSON-2100051872 tempest-DeleteServersTestJSON-2100051872-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:46:29.668572 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.policy [None req-db2d6b5f-608e-483f-a7bd-767b206358d1 tempest-DeleteServersTestJSON-2100051872 tempest-DeleteServersTestJSON-2100051872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aad828d8ff314a2d82f07fb6d84f36a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6388da70b0dc48c1952570af4332dd6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128728) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:46:29.693642 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: INFO nova.api.openstack.requestlog [None req-db2d6b5f-608e-483f-a7bd-767b206358d1 tempest-DeleteServersTestJSON-2100051872 tempest-DeleteServersTestJSON-2100051872-project] 10.222.0.61 "GET /compute/v2.1/servers/75ca93de-6825-44ce-af10-44cba59218a1" status: 200 len: 1273 microversion: 2.1 time: 0.537546 May 14 15:46:29.698620 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: [pid: 128728|app: 0|req: 18/31] 10.222.0.61 () {58 vars in 1235 bytes} [Sat May 14 15:46:29 2022] GET /compute/v2.1/servers/75ca93de-6825-44ce-af10-44cba59218a1 => generated 1273 bytes in 543 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 15:46:29.717271 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi [None req-e0e60b8a-e0ac-493e-83a5-20fb0c081f95 tempest-VolumesGetTestJSON-944156410 tempest-VolumesGetTestJSON-944156410-project] Calling method '.version_select at 0x7f77d9bdc430>' {{(pid=128728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 15:46:29.877909 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: INFO nova.api.openstack.requestlog [None req-e0e60b8a-e0ac-493e-83a5-20fb0c081f95 tempest-VolumesGetTestJSON-944156410 tempest-VolumesGetTestJSON-944156410-project] 10.222.0.61 "GET /compute/v2.1/os-volumes/91d8bd25-0bee-41e6-ae87-cc2959d2efa8" status: 200 len: 352 microversion: 2.1 time: 0.177178 May 14 15:46:29.878728 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: [pid: 128728|app: 0|req: 19/32] 10.222.0.61 () {58 vars in 1244 bytes} [Sat May 14 15:46:29 2022] GET /compute/v2.1/os-volumes/91d8bd25-0bee-41e6-ae87-cc2959d2efa8 => generated 352 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 14 15:46:29.890702 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi [None req-81e09bb9-04dd-4f68-8b66-dc794a80fef7 tempest-VolumesSnapshotsTestJSON-180423719 tempest-VolumesSnapshotsTestJSON-180423719-project] Calling method '.version_select at 0x7f77d9bdc4c0>' {{(pid=128728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 15:46:30.041161 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: INFO nova.api.openstack.requestlog [None req-81e09bb9-04dd-4f68-8b66-dc794a80fef7 tempest-VolumesSnapshotsTestJSON-180423719 tempest-VolumesSnapshotsTestJSON-180423719-project] 10.222.0.61 "GET /compute/v2.1/os-snapshots/499db537-656a-4475-9d95-e3501f965c0f" status: 200 len: 287 microversion: 2.1 time: 0.161306 May 14 15:46:30.041981 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: [pid: 128728|app: 0|req: 20/33] 10.222.0.61 () {58 vars in 1250 bytes} [Sat May 14 15:46:29 2022] GET /compute/v2.1/os-snapshots/499db537-656a-4475-9d95-e3501f965c0f => generated 287 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 14 15:46:30.057194 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi [None req-f0095c49-d7f7-42f6-bf48-ebc8085d489e tempest-VolumesSnapshotsTestJSON-180423719 tempest-VolumesSnapshotsTestJSON-180423719-project] Calling method '.version_select at 0x7f77d9be9790>' {{(pid=128728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 15:46:30.247854 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: INFO nova.api.openstack.requestlog [None req-f0095c49-d7f7-42f6-bf48-ebc8085d489e tempest-VolumesSnapshotsTestJSON-180423719 tempest-VolumesSnapshotsTestJSON-180423719-project] 10.222.0.61 "DELETE /compute/v2.1/os-snapshots/499db537-656a-4475-9d95-e3501f965c0f" status: 202 len: 0 microversion: 2.1 time: 0.197730 May 14 15:46:30.252588 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: [pid: 128728|app: 0|req: 21/34] 10.222.0.61 () {58 vars in 1253 bytes} [Sat May 14 15:46:30 2022] DELETE /compute/v2.1/os-snapshots/499db537-656a-4475-9d95-e3501f965c0f => generated 0 bytes in 201 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 14 15:46:30.260308 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi [None req-1531243d-0c1d-4810-9736-f583e52881d6 tempest-VolumesSnapshotsTestJSON-180423719 tempest-VolumesSnapshotsTestJSON-180423719-project] Calling method '.version_select at 0x7f77d9bdcaf0>' {{(pid=128728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 15:46:30.336651 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: INFO nova.api.openstack.requestlog [None req-1531243d-0c1d-4810-9736-f583e52881d6 tempest-VolumesSnapshotsTestJSON-180423719 tempest-VolumesSnapshotsTestJSON-180423719-project] 10.222.0.61 "GET /compute/v2.1/os-snapshots/499db537-656a-4475-9d95-e3501f965c0f" status: 200 len: 286 microversion: 2.1 time: 0.082436 May 14 15:46:30.337979 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: [pid: 128728|app: 0|req: 22/35] 10.222.0.61 () {58 vars in 1250 bytes} [Sat May 14 15:46:30 2022] GET /compute/v2.1/os-snapshots/499db537-656a-4475-9d95-e3501f965c0f => generated 286 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 14 15:46:30.495176 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.virt.hardware [None req-34f08f3f-4838-470e-96a1-7c616e80e9a1 tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Flavor limits 0:0:0 {{(pid=128729) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 14 15:46:30.497797 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.virt.hardware [None req-34f08f3f-4838-470e-96a1-7c616e80e9a1 tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Image limits 0:0:0 {{(pid=128729) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 14 15:46:30.500283 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.virt.hardware [None req-34f08f3f-4838-470e-96a1-7c616e80e9a1 tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Flavor pref 0:0:0 {{(pid=128729) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 14 15:46:30.500855 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.virt.hardware [None req-34f08f3f-4838-470e-96a1-7c616e80e9a1 tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Image pref 0:0:0 {{(pid=128729) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 14 15:46:30.501889 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.virt.hardware [None req-34f08f3f-4838-470e-96a1-7c616e80e9a1 tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128729) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 14 15:46:30.523481 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-34f08f3f-4838-470e-96a1-7c616e80e9a1 tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:46:30.525766 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-34f08f3f-4838-470e-96a1-7c616e80e9a1 tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:46:30.532094 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-34f08f3f-4838-470e-96a1-7c616e80e9a1 tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:46:30.533753 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-34f08f3f-4838-470e-96a1-7c616e80e9a1 tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:46:30.599481 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.quota [None req-34f08f3f-4838-470e-96a1-7c616e80e9a1 tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Getting quotas for project 5d2517d5440a4d30949f3dd36a46d813. Resources: {'instances', 'cores', 'ram'} {{(pid=128729) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 14 15:46:30.617202 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.quota [None req-34f08f3f-4838-470e-96a1-7c616e80e9a1 tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Getting quotas for user 7b896317d96a40d6a137db0dcf5f98f2 and project 5d2517d5440a4d30949f3dd36a46d813. Resources: {'instances', 'cores', 'ram'} {{(pid=128729) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 14 15:46:30.655404 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.compute.api [None req-34f08f3f-4838-470e-96a1-7c616e80e9a1 tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Going to run 1 instances... {{(pid=128729) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 14 15:46:30.660908 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.compute.api [None req-34f08f3f-4838-470e-96a1-7c616e80e9a1 tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] [instance: 9fbb269d-11cd-49ed-81ac-570e721c15cd] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='1381e3d5-fc27-4fa7-ab03-5d86278a0546',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128729) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 14 15:46:30.715648 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi [None req-79ca7bd1-e46d-4329-8d1b-37fcd363fc98 tempest-DeleteServersTestJSON-2100051872 tempest-DeleteServersTestJSON-2100051872-project] Calling method '>' {{(pid=128728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 15:46:30.716744 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.compute.api [None req-79ca7bd1-e46d-4329-8d1b-37fcd363fc98 tempest-DeleteServersTestJSON-2100051872 tempest-DeleteServersTestJSON-2100051872-project] [instance: 75ca93de-6825-44ce-af10-44cba59218a1] Fetching instance by UUID {{(pid=128728) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 15:46:30.729254 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-79ca7bd1-e46d-4329-8d1b-37fcd363fc98 tempest-DeleteServersTestJSON-2100051872 tempest-DeleteServersTestJSON-2100051872-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:46:30.730815 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-79ca7bd1-e46d-4329-8d1b-37fcd363fc98 tempest-DeleteServersTestJSON-2100051872 tempest-DeleteServersTestJSON-2100051872-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:46:30.738333 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-79ca7bd1-e46d-4329-8d1b-37fcd363fc98 tempest-DeleteServersTestJSON-2100051872 tempest-DeleteServersTestJSON-2100051872-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:46:30.742654 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-79ca7bd1-e46d-4329-8d1b-37fcd363fc98 tempest-DeleteServersTestJSON-2100051872 tempest-DeleteServersTestJSON-2100051872-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:46:30.773338 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: INFO nova.api.openstack.requestlog [None req-34f08f3f-4838-470e-96a1-7c616e80e9a1 tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] 10.222.0.61 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 2.814645 May 14 15:46:30.775979 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: [pid: 128729|app: 0|req: 14/36] 10.222.0.61 () {60 vars in 1146 bytes} [Sat May 14 15:46:27 2022] POST /compute/v2.1/servers => generated 383 bytes in 2820 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 14 15:46:30.791163 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi [None req-b4c38649-cb63-448a-b9b4-d4797c59030b tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Calling method '>' {{(pid=128729) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 15:46:30.794219 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.compute.api [None req-b4c38649-cb63-448a-b9b4-d4797c59030b tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] [instance: 9fbb269d-11cd-49ed-81ac-570e721c15cd] Fetching instance by UUID {{(pid=128729) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 15:46:31.136672 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.policy [None req-b4c38649-cb63-448a-b9b4-d4797c59030b tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b896317d96a40d6a137db0dcf5f98f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d2517d5440a4d30949f3dd36a46d813', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128729) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:46:31.156181 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.policy [None req-79ca7bd1-e46d-4329-8d1b-37fcd363fc98 tempest-DeleteServersTestJSON-2100051872 tempest-DeleteServersTestJSON-2100051872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aad828d8ff314a2d82f07fb6d84f36a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6388da70b0dc48c1952570af4332dd6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128728) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:46:31.161775 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: INFO nova.api.openstack.requestlog [None req-b4c38649-cb63-448a-b9b4-d4797c59030b tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] 10.222.0.61 "GET /compute/v2.1/servers/9fbb269d-11cd-49ed-81ac-570e721c15cd" status: 200 len: 1222 microversion: 2.1 time: 0.380260 May 14 15:46:31.166031 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: [pid: 128729|app: 0|req: 15/37] 10.222.0.61 () {58 vars in 1235 bytes} [Sat May 14 15:46:30 2022] GET /compute/v2.1/servers/9fbb269d-11cd-49ed-81ac-570e721c15cd => generated 1222 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 15:46:31.177689 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi [None req-08a42f3e-0bd9-4bf2-bfa0-abeddeebed83 tempest-VolumesGetTestJSON-944156410 tempest-VolumesGetTestJSON-944156410-project] Calling method '.version_select at 0x7f77d8af6af0>' {{(pid=128729) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 15:46:31.180985 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: INFO nova.api.openstack.requestlog [None req-79ca7bd1-e46d-4329-8d1b-37fcd363fc98 tempest-DeleteServersTestJSON-2100051872 tempest-DeleteServersTestJSON-2100051872-project] 10.222.0.61 "GET /compute/v2.1/servers/75ca93de-6825-44ce-af10-44cba59218a1" status: 200 len: 1273 microversion: 2.1 time: 0.470227 May 14 15:46:31.182136 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: [pid: 128728|app: 0|req: 23/38] 10.222.0.61 () {58 vars in 1235 bytes} [Sat May 14 15:46:30 2022] GET /compute/v2.1/servers/75ca93de-6825-44ce-af10-44cba59218a1 => generated 1273 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 15:46:31.278676 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: INFO nova.api.openstack.wsgi [None req-08a42f3e-0bd9-4bf2-bfa0-abeddeebed83 tempest-VolumesGetTestJSON-944156410 tempest-VolumesGetTestJSON-944156410-project] HTTP exception thrown: Volume 91d8bd25-0bee-41e6-ae87-cc2959d2efa8 could not be found. May 14 15:46:31.284094 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi [None req-08a42f3e-0bd9-4bf2-bfa0-abeddeebed83 tempest-VolumesGetTestJSON-944156410 tempest-VolumesGetTestJSON-944156410-project] Request method failure captured: May 14 15:46:31.284094 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: request: GET /compute/v2.1/os-volumes/91d8bd25-0bee-41e6-ae87-cc2959d2efa8 HTTP/1.1 May 14 15:46:31.284094 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: Accept: application/json May 14 15:46:31.284094 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: Accept-Encoding: identity May 14 15:46:31.284094 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: Connection: close May 14 15:46:31.284094 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: Content-Length: 0 May 14 15:46:31.284094 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: Content-Type: application/json May 14 15:46:31.284094 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: Host: 10.222.0.61 May 14 15:46:31.284094 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: Openstack-System-Scope: None May 14 15:46:31.284094 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: User-Agent: python-urllib3/1.26.9 May 14 15:46:31.284094 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: X-Auth-Token: gAAAAABif87IP-bEj_G-89rOHt5UGEadzleQGPQL8DVNGj28bEqzjj3wUp3XZSRsKTLb6M6_hl7ZzHc_VdRpd63Zwr1jussJeYN9RgHNLUfU9iW7SaaN7E_G6sNY78zduZxa-aozA5mj0KUgMP8IcNGGhQw_XKGbPMzh_WN8pk6SkyEFYwNFtNg May 14 15:46:31.284094 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: X-Domain-Id: None May 14 15:46:31.284094 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: X-Domain-Name: None May 14 15:46:31.284094 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: X-Identity-Status: Confirmed May 14 15:46:31.284094 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: X-Is-Admin-Project: True May 14 15:46:31.284094 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: X-Project-Domain-Id: default May 14 15:46:31.284094 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: X-Project-Domain-Name: Default May 14 15:46:31.284094 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: X-Project-Id: 8a926765ff1b48c09ae97181c680dc32 May 14 15:46:31.284094 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: X-Project-Name: tempest-VolumesGetTestJSON-944156410 May 14 15:46:31.284094 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: X-Role: reader,member May 14 15:46:31.284094 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: X-Roles: reader,member May 14 15:46:31.285449 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/8a926765ff1b48c09ae97181c680dc32"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/8a926765ff1b48c09ae97181c680dc32"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/8a926765ff1b48c09ae97181c680dc32"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_8a926765ff1b48c09ae97181c680dc32"}]}] May 14 15:46:31.285449 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: X-Tenant: tempest-VolumesGetTestJSON-944156410 May 14 15:46:31.285449 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: X-Tenant-Id: 8a926765ff1b48c09ae97181c680dc32 May 14 15:46:31.285449 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: X-Tenant-Name: tempest-VolumesGetTestJSON-944156410 May 14 15:46:31.285449 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: X-User: tempest-VolumesGetTestJSON-944156410-project May 14 15:46:31.285449 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: X-User-Domain-Id: default May 14 15:46:31.285449 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: X-User-Domain-Name: Default May 14 15:46:31.285449 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: X-User-Id: a2c83fd0cfa64b9bbdea991e485317ad May 14 15:46:31.285449 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: X-User-Name: tempest-VolumesGetTestJSON-944156410-project May 14 15:46:31.285449 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: method: May 14 15:46:31.285449 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: exception: Volume 91d8bd25-0bee-41e6-ae87-cc2959d2efa8 could not be found. May 14 15:46:31.285449 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: action_args: {'id': '91d8bd25-0bee-41e6-ae87-cc2959d2efa8'} May 14 15:46:31.285449 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: {{(pid=128729) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 14 15:46:31.286446 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 15:46:31.286446 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 14 15:46:31.286446 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 14 15:46:31.286446 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get May 14 15:46:31.286446 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: ERROR nova.api.openstack.wsgi item = cinderclient( May 14 15:46:31.286446 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get May 14 15:46:31.286446 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") May 14 15:46:31.286446 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 14 15:46:31.286446 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 14 15:46:31.286446 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 14 15:46:31.286446 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 14 15:46:31.286446 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 14 15:46:31.286446 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 14 15:46:31.286446 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 14 15:46:31.286446 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 14 15:46:31.286446 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 91d8bd25-0bee-41e6-ae87-cc2959d2efa8 could not be found. (HTTP 404) (Request-ID: req-7408ffcf-3f59-4f1d-ab80-bca363ec102b) May 14 15:46:31.286446 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: ERROR nova.api.openstack.wsgi May 14 15:46:31.286446 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 14 15:46:31.286446 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: ERROR nova.api.openstack.wsgi May 14 15:46:31.287450 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 15:46:31.287450 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show May 14 15:46:31.287450 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) May 14 15:46:31.287450 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 14 15:46:31.287450 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 14 15:46:31.287450 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper May 14 15:46:31.287450 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) May 14 15:46:31.287450 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise May 14 15:46:31.287450 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) May 14 15:46:31.287450 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 14 15:46:31.287450 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 14 15:46:31.287450 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get May 14 15:46:31.287450 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: ERROR nova.api.openstack.wsgi item = cinderclient( May 14 15:46:31.287450 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get May 14 15:46:31.287450 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") May 14 15:46:31.287450 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 14 15:46:31.287450 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 14 15:46:31.287450 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 14 15:46:31.287450 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 14 15:46:31.288379 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 14 15:46:31.288379 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 14 15:46:31.288379 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 14 15:46:31.288379 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 14 15:46:31.288379 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 91d8bd25-0bee-41e6-ae87-cc2959d2efa8 could not be found. May 14 15:46:31.288379 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: ERROR nova.api.openstack.wsgi May 14 15:46:31.288379 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 14 15:46:31.288379 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: ERROR nova.api.openstack.wsgi May 14 15:46:31.288379 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 15:46:31.288379 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 14 15:46:31.288379 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 14 15:46:31.288379 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 14 15:46:31.288379 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 14 15:46:31.288379 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 14 15:46:31.288379 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 14 15:46:31.288379 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 14 15:46:31.288379 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 14 15:46:31.288379 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show May 14 15:46:31.288379 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 14 15:46:31.289452 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 91d8bd25-0bee-41e6-ae87-cc2959d2efa8 could not be found. May 14 15:46:31.289452 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: ERROR nova.api.openstack.wsgi May 14 15:46:31.289452 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 14 15:46:31.289452 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: ERROR nova.api.openstack.wsgi May 14 15:46:31.289452 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 15:46:31.289452 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 14 15:46:31.289452 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 14 15:46:31.289452 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 14 15:46:31.289452 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 14 15:46:31.289452 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 91d8bd25-0bee-41e6-ae87-cc2959d2efa8 could not be found. May 14 15:46:31.289452 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: ERROR nova.api.openstack.wsgi May 14 15:46:31.292441 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi [None req-08a42f3e-0bd9-4bf2-bfa0-abeddeebed83 tempest-VolumesGetTestJSON-944156410 tempest-VolumesGetTestJSON-944156410-project] Returning 404 to user: Volume 91d8bd25-0bee-41e6-ae87-cc2959d2efa8 could not be found. {{(pid=128729) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 14 15:46:31.293767 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: INFO nova.api.openstack.requestlog [None req-08a42f3e-0bd9-4bf2-bfa0-abeddeebed83 tempest-VolumesGetTestJSON-944156410 tempest-VolumesGetTestJSON-944156410-project] 10.222.0.61 "GET /compute/v2.1/os-volumes/91d8bd25-0bee-41e6-ae87-cc2959d2efa8" status: 404 len: 109 microversion: 2.1 time: 0.126367 May 14 15:46:31.296367 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: [pid: 128729|app: 0|req: 16/39] 10.222.0.61 () {58 vars in 1244 bytes} [Sat May 14 15:46:31 2022] GET /compute/v2.1/os-volumes/91d8bd25-0bee-41e6-ae87-cc2959d2efa8 => generated 109 bytes in 130 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 14 15:46:31.350810 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi [None req-98ba9bc7-2e99-46d0-8cd9-e1729753c6d5 tempest-VolumesSnapshotsTestJSON-180423719 tempest-VolumesSnapshotsTestJSON-180423719-project] Calling method '.version_select at 0x7f77d9bdc700>' {{(pid=128728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 15:46:31.428269 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: INFO nova.api.openstack.wsgi [None req-98ba9bc7-2e99-46d0-8cd9-e1729753c6d5 tempest-VolumesSnapshotsTestJSON-180423719 tempest-VolumesSnapshotsTestJSON-180423719-project] HTTP exception thrown: Snapshot 499db537-656a-4475-9d95-e3501f965c0f could not be found. May 14 15:46:31.433154 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi [None req-98ba9bc7-2e99-46d0-8cd9-e1729753c6d5 tempest-VolumesSnapshotsTestJSON-180423719 tempest-VolumesSnapshotsTestJSON-180423719-project] Request method failure captured: May 14 15:46:31.433154 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: request: GET /compute/v2.1/os-snapshots/499db537-656a-4475-9d95-e3501f965c0f HTTP/1.1 May 14 15:46:31.433154 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: Accept: application/json May 14 15:46:31.433154 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: Accept-Encoding: identity May 14 15:46:31.433154 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: Connection: close May 14 15:46:31.433154 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: Content-Length: 0 May 14 15:46:31.433154 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: Content-Type: application/json May 14 15:46:31.433154 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: Host: 10.222.0.61 May 14 15:46:31.433154 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: Openstack-System-Scope: None May 14 15:46:31.433154 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: User-Agent: python-urllib3/1.26.9 May 14 15:46:31.433154 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: X-Auth-Token: gAAAAABif87ISzP8fj_fXFhbce4U7_Wnh_x5fV-wvCpst3LdHDNmpUvVYbFSfq7I9VhjuItwSJr2qMsj0DdePytRp_GwYXAZRWgP_g8NhwEOoQrAS-vBFuMhrWlomdJlCSAK4eTdHDRA7d71O9gWOz-VUgeuGe_FZT1CrwT79UTGKDQ8GJvhhLk May 14 15:46:31.433154 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: X-Domain-Id: None May 14 15:46:31.433154 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: X-Domain-Name: None May 14 15:46:31.433154 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: X-Identity-Status: Confirmed May 14 15:46:31.433154 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: X-Is-Admin-Project: True May 14 15:46:31.433154 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: X-Project-Domain-Id: default May 14 15:46:31.433154 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: X-Project-Domain-Name: Default May 14 15:46:31.433154 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: X-Project-Id: b97938b286404711bf362311d1daca56 May 14 15:46:31.433154 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-180423719 May 14 15:46:31.433154 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: X-Role: reader,member May 14 15:46:31.433154 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: X-Roles: reader,member May 14 15:46:31.434498 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/b97938b286404711bf362311d1daca56"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/b97938b286404711bf362311d1daca56"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/b97938b286404711bf362311d1daca56"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_b97938b286404711bf362311d1daca56"}]}] May 14 15:46:31.434498 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: X-Tenant: tempest-VolumesSnapshotsTestJSON-180423719 May 14 15:46:31.434498 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: X-Tenant-Id: b97938b286404711bf362311d1daca56 May 14 15:46:31.434498 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-180423719 May 14 15:46:31.434498 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: X-User: tempest-VolumesSnapshotsTestJSON-180423719-project May 14 15:46:31.434498 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: X-User-Domain-Id: default May 14 15:46:31.434498 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: X-User-Domain-Name: Default May 14 15:46:31.434498 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: X-User-Id: 92367a7cee05488e8227ef625e4e240c May 14 15:46:31.434498 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: X-User-Name: tempest-VolumesSnapshotsTestJSON-180423719-project May 14 15:46:31.434498 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: method: May 14 15:46:31.434498 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: exception: Snapshot 499db537-656a-4475-9d95-e3501f965c0f could not be found. May 14 15:46:31.434498 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: action_args: {'id': '499db537-656a-4475-9d95-e3501f965c0f'} May 14 15:46:31.434498 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: {{(pid=128728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 14 15:46:31.435309 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 15:46:31.435309 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper May 14 15:46:31.435309 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) May 14 15:46:31.435309 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot May 14 15:46:31.435309 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) May 14 15:46:31.435309 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get May 14 15:46:31.435309 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") May 14 15:46:31.435309 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 14 15:46:31.435309 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 14 15:46:31.435309 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 14 15:46:31.435309 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 14 15:46:31.435309 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 14 15:46:31.435309 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 14 15:46:31.435309 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 14 15:46:31.435309 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 14 15:46:31.435309 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Snapshot 499db537-656a-4475-9d95-e3501f965c0f could not be found. (HTTP 404) (Request-ID: req-044eeb47-e343-4328-9561-8c8ffc5e8516) May 14 15:46:31.435309 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: ERROR nova.api.openstack.wsgi May 14 15:46:31.435309 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 14 15:46:31.436473 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: ERROR nova.api.openstack.wsgi May 14 15:46:31.436473 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 15:46:31.436473 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 617, in show May 14 15:46:31.436473 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get_snapshot(context, id) May 14 15:46:31.436473 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 14 15:46:31.436473 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 14 15:46:31.436473 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper May 14 15:46:31.436473 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: ERROR nova.api.openstack.wsgi _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id)) May 14 15:46:31.436473 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise May 14 15:46:31.436473 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) May 14 15:46:31.436473 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper May 14 15:46:31.436473 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) May 14 15:46:31.436473 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot May 14 15:46:31.436473 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) May 14 15:46:31.436473 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get May 14 15:46:31.436473 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") May 14 15:46:31.436473 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 14 15:46:31.436473 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 14 15:46:31.436473 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 14 15:46:31.437549 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 14 15:46:31.437549 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 14 15:46:31.437549 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 14 15:46:31.437549 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 14 15:46:31.437549 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 14 15:46:31.437549 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: ERROR nova.api.openstack.wsgi nova.exception.SnapshotNotFound: Snapshot 499db537-656a-4475-9d95-e3501f965c0f could not be found. May 14 15:46:31.437549 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: ERROR nova.api.openstack.wsgi May 14 15:46:31.437549 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 14 15:46:31.437549 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: ERROR nova.api.openstack.wsgi May 14 15:46:31.437549 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 15:46:31.437549 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 14 15:46:31.437549 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 14 15:46:31.437549 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 14 15:46:31.437549 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 14 15:46:31.437549 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 14 15:46:31.437549 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 14 15:46:31.437549 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 14 15:46:31.437549 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 14 15:46:31.437549 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 619, in show May 14 15:46:31.437549 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 14 15:46:31.438634 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Snapshot 499db537-656a-4475-9d95-e3501f965c0f could not be found. May 14 15:46:31.438634 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: ERROR nova.api.openstack.wsgi May 14 15:46:31.438634 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 14 15:46:31.438634 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: ERROR nova.api.openstack.wsgi May 14 15:46:31.438634 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 15:46:31.438634 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 14 15:46:31.438634 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 14 15:46:31.438634 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 14 15:46:31.438634 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 14 15:46:31.438634 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Snapshot 499db537-656a-4475-9d95-e3501f965c0f could not be found. May 14 15:46:31.438634 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: ERROR nova.api.openstack.wsgi May 14 15:46:31.438634 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi [None req-98ba9bc7-2e99-46d0-8cd9-e1729753c6d5 tempest-VolumesSnapshotsTestJSON-180423719 tempest-VolumesSnapshotsTestJSON-180423719-project] Returning 404 to user: Snapshot 499db537-656a-4475-9d95-e3501f965c0f could not be found. {{(pid=128728) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 14 15:46:31.438634 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: INFO nova.api.openstack.requestlog [None req-98ba9bc7-2e99-46d0-8cd9-e1729753c6d5 tempest-VolumesSnapshotsTestJSON-180423719 tempest-VolumesSnapshotsTestJSON-180423719-project] 10.222.0.61 "GET /compute/v2.1/os-snapshots/499db537-656a-4475-9d95-e3501f965c0f" status: 404 len: 111 microversion: 2.1 time: 0.088226 May 14 15:46:31.438634 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: [pid: 128728|app: 0|req: 24/40] 10.222.0.61 () {58 vars in 1250 bytes} [Sat May 14 15:46:31 2022] GET /compute/v2.1/os-snapshots/499db537-656a-4475-9d95-e3501f965c0f => generated 111 bytes in 89 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 14 15:46:31.445397 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi [None req-198fd946-10cc-48d3-bfa6-4c1d5bbbf25b tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-904279580", "imageRef": "1381e3d5-fc27-4fa7-ab03-5d86278a0546", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=128729) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 15:46:31.446660 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi [None req-5beb6fdb-54bf-479f-87e5-4b182bbc0847 tempest-VolumesSnapshotsTestJSON-180423719 tempest-VolumesSnapshotsTestJSON-180423719-project] Calling method '.version_select at 0x7f77d9db8c10>' {{(pid=128728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 15:46:31.710689 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.network.neutron [None req-198fd946-10cc-48d3-bfa6-4c1d5bbbf25b tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] validate_networks() for [('3e026b24-9d5e-4f74-ac5a-5d47dc1338b8', None, None, None, None, None)] {{(pid=128729) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 14 15:46:31.758003 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: INFO nova.api.openstack.requestlog [None req-5beb6fdb-54bf-479f-87e5-4b182bbc0847 tempest-VolumesSnapshotsTestJSON-180423719 tempest-VolumesSnapshotsTestJSON-180423719-project] 10.222.0.61 "DELETE /compute/v2.1/os-volumes/8c2d3ae3-87aa-4d95-b72c-d32fa9b5aa8b" status: 202 len: 0 microversion: 2.1 time: 0.317553 May 14 15:46:31.767124 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: [pid: 128728|app: 0|req: 25/41] 10.222.0.61 () {58 vars in 1247 bytes} [Sat May 14 15:46:31 2022] DELETE /compute/v2.1/os-volumes/8c2d3ae3-87aa-4d95-b72c-d32fa9b5aa8b => generated 0 bytes in 327 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) May 14 15:46:31.772037 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi [None req-2ffb48fd-ac6d-406f-a70f-c8f6dd98b5ba tempest-VolumesSnapshotsTestJSON-180423719 tempest-VolumesSnapshotsTestJSON-180423719-project] Calling method '.version_select at 0x7f77d9c12dc0>' {{(pid=128728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 15:46:31.980695 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: INFO nova.api.openstack.requestlog [None req-2ffb48fd-ac6d-406f-a70f-c8f6dd98b5ba tempest-VolumesSnapshotsTestJSON-180423719 tempest-VolumesSnapshotsTestJSON-180423719-project] 10.222.0.61 "GET /compute/v2.1/os-volumes/8c2d3ae3-87aa-4d95-b72c-d32fa9b5aa8b" status: 200 len: 345 microversion: 2.1 time: 0.212178 May 14 15:46:31.981500 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: [pid: 128728|app: 0|req: 26/42] 10.222.0.61 () {58 vars in 1244 bytes} [Sat May 14 15:46:31 2022] GET /compute/v2.1/os-volumes/8c2d3ae3-87aa-4d95-b72c-d32fa9b5aa8b => generated 345 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 14 15:46:32.199964 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi [None req-65924aa8-e8db-460a-b985-e44c7b7e6ab5 tempest-DeleteServersTestJSON-2100051872 tempest-DeleteServersTestJSON-2100051872-project] Calling method '>' {{(pid=128728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 15:46:32.200418 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.compute.api [None req-65924aa8-e8db-460a-b985-e44c7b7e6ab5 tempest-DeleteServersTestJSON-2100051872 tempest-DeleteServersTestJSON-2100051872-project] [instance: 75ca93de-6825-44ce-af10-44cba59218a1] Fetching instance by UUID {{(pid=128728) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 15:46:32.207712 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-65924aa8-e8db-460a-b985-e44c7b7e6ab5 tempest-DeleteServersTestJSON-2100051872 tempest-DeleteServersTestJSON-2100051872-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:46:32.208165 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-65924aa8-e8db-460a-b985-e44c7b7e6ab5 tempest-DeleteServersTestJSON-2100051872 tempest-DeleteServersTestJSON-2100051872-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:46:32.220400 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-65924aa8-e8db-460a-b985-e44c7b7e6ab5 tempest-DeleteServersTestJSON-2100051872 tempest-DeleteServersTestJSON-2100051872-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:46:32.220982 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-65924aa8-e8db-460a-b985-e44c7b7e6ab5 tempest-DeleteServersTestJSON-2100051872 tempest-DeleteServersTestJSON-2100051872-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:46:34.599992 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.virt.hardware [None req-198fd946-10cc-48d3-bfa6-4c1d5bbbf25b tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Flavor limits 0:0:0 {{(pid=128729) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 14 15:46:34.600492 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.virt.hardware [None req-198fd946-10cc-48d3-bfa6-4c1d5bbbf25b tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Image limits 0:0:0 {{(pid=128729) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 14 15:46:34.601171 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.virt.hardware [None req-198fd946-10cc-48d3-bfa6-4c1d5bbbf25b tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Flavor pref 0:0:0 {{(pid=128729) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 14 15:46:34.601690 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.virt.hardware [None req-198fd946-10cc-48d3-bfa6-4c1d5bbbf25b tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Image pref 0:0:0 {{(pid=128729) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 14 15:46:34.602490 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.virt.hardware [None req-198fd946-10cc-48d3-bfa6-4c1d5bbbf25b tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128729) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 14 15:46:34.621688 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-198fd946-10cc-48d3-bfa6-4c1d5bbbf25b tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:46:34.623995 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-198fd946-10cc-48d3-bfa6-4c1d5bbbf25b tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:46:34.627077 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-198fd946-10cc-48d3-bfa6-4c1d5bbbf25b tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:46:34.627931 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-198fd946-10cc-48d3-bfa6-4c1d5bbbf25b tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:46:34.697304 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.quota [None req-198fd946-10cc-48d3-bfa6-4c1d5bbbf25b tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Getting quotas for project 5d2517d5440a4d30949f3dd36a46d813. Resources: {'instances', 'cores', 'ram'} {{(pid=128729) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 14 15:46:34.708191 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.quota [None req-198fd946-10cc-48d3-bfa6-4c1d5bbbf25b tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Getting quotas for user 7b896317d96a40d6a137db0dcf5f98f2 and project 5d2517d5440a4d30949f3dd36a46d813. Resources: {'instances', 'cores', 'ram'} {{(pid=128729) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 14 15:46:34.744123 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.compute.api [None req-198fd946-10cc-48d3-bfa6-4c1d5bbbf25b tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Going to run 1 instances... {{(pid=128729) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 14 15:46:34.749033 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.compute.api [None req-198fd946-10cc-48d3-bfa6-4c1d5bbbf25b tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] [instance: 563c74e0-060d-49d5-abc5-389cee4bd9d5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='1381e3d5-fc27-4fa7-ab03-5d86278a0546',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128729) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 14 15:46:34.793030 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.policy [None req-65924aa8-e8db-460a-b985-e44c7b7e6ab5 tempest-DeleteServersTestJSON-2100051872 tempest-DeleteServersTestJSON-2100051872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aad828d8ff314a2d82f07fb6d84f36a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6388da70b0dc48c1952570af4332dd6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128728) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:46:34.802245 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: INFO nova.api.openstack.requestlog [None req-65924aa8-e8db-460a-b985-e44c7b7e6ab5 tempest-DeleteServersTestJSON-2100051872 tempest-DeleteServersTestJSON-2100051872-project] 10.222.0.61 "GET /compute/v2.1/servers/75ca93de-6825-44ce-af10-44cba59218a1" status: 200 len: 1315 microversion: 2.1 time: 2.606289 May 14 15:46:34.807308 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: [pid: 128728|app: 0|req: 27/43] 10.222.0.61 () {58 vars in 1235 bytes} [Sat May 14 15:46:32 2022] GET /compute/v2.1/servers/75ca93de-6825-44ce-af10-44cba59218a1 => generated 1315 bytes in 2612 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 15:46:34.836095 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi [None req-b0711f58-628e-4b21-aa7c-76a69a6a201a tempest-VolumesSnapshotsTestJSON-180423719 tempest-VolumesSnapshotsTestJSON-180423719-project] Calling method '.version_select at 0x7f77d9c32e50>' {{(pid=128728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 15:46:34.900324 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: INFO nova.api.openstack.requestlog [None req-198fd946-10cc-48d3-bfa6-4c1d5bbbf25b tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] 10.222.0.61 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 3.469007 May 14 15:46:34.909367 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: [pid: 128729|app: 0|req: 17/44] 10.222.0.61 () {60 vars in 1146 bytes} [Sat May 14 15:46:31 2022] POST /compute/v2.1/servers => generated 383 bytes in 3479 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) May 14 15:46:34.920412 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi [None req-6a25c829-457f-4061-b9aa-f74b54d6a138 tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-879129003", "imageRef": "1381e3d5-fc27-4fa7-ab03-5d86278a0546", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "722d2578-8e0a-4535-bc1b-444c13327ab8"}], "security_groups": [{"name": "tempest-securitygroup--714534168"}], "key_name": "tempest-keypair-1260306284", "user_data": "}} {{(pid=128729) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 15:46:34.949061 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: INFO nova.api.openstack.wsgi [None req-b0711f58-628e-4b21-aa7c-76a69a6a201a tempest-VolumesSnapshotsTestJSON-180423719 tempest-VolumesSnapshotsTestJSON-180423719-project] HTTP exception thrown: Volume 8c2d3ae3-87aa-4d95-b72c-d32fa9b5aa8b could not be found. May 14 15:46:34.953340 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi [None req-b0711f58-628e-4b21-aa7c-76a69a6a201a tempest-VolumesSnapshotsTestJSON-180423719 tempest-VolumesSnapshotsTestJSON-180423719-project] Request method failure captured: May 14 15:46:34.953340 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: request: GET /compute/v2.1/os-volumes/8c2d3ae3-87aa-4d95-b72c-d32fa9b5aa8b HTTP/1.1 May 14 15:46:34.953340 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: Accept: application/json May 14 15:46:34.953340 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: Accept-Encoding: identity May 14 15:46:34.953340 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: Connection: close May 14 15:46:34.953340 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: Content-Length: 0 May 14 15:46:34.953340 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: Content-Type: application/json May 14 15:46:34.953340 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: Host: 10.222.0.61 May 14 15:46:34.953340 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: Openstack-System-Scope: None May 14 15:46:34.953340 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: User-Agent: python-urllib3/1.26.9 May 14 15:46:34.953340 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: X-Auth-Token: gAAAAABif87ISzP8fj_fXFhbce4U7_Wnh_x5fV-wvCpst3LdHDNmpUvVYbFSfq7I9VhjuItwSJr2qMsj0DdePytRp_GwYXAZRWgP_g8NhwEOoQrAS-vBFuMhrWlomdJlCSAK4eTdHDRA7d71O9gWOz-VUgeuGe_FZT1CrwT79UTGKDQ8GJvhhLk May 14 15:46:34.953340 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: X-Domain-Id: None May 14 15:46:34.953340 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: X-Domain-Name: None May 14 15:46:34.953340 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: X-Identity-Status: Confirmed May 14 15:46:34.953340 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: X-Is-Admin-Project: True May 14 15:46:34.953340 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: X-Project-Domain-Id: default May 14 15:46:34.953340 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: X-Project-Domain-Name: Default May 14 15:46:34.953340 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: X-Project-Id: b97938b286404711bf362311d1daca56 May 14 15:46:34.953340 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-180423719 May 14 15:46:34.953340 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: X-Role: reader,member May 14 15:46:34.953340 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: X-Roles: reader,member May 14 15:46:34.954651 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/b97938b286404711bf362311d1daca56"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/b97938b286404711bf362311d1daca56"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/b97938b286404711bf362311d1daca56"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_b97938b286404711bf362311d1daca56"}]}] May 14 15:46:34.954651 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: X-Tenant: tempest-VolumesSnapshotsTestJSON-180423719 May 14 15:46:34.954651 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: X-Tenant-Id: b97938b286404711bf362311d1daca56 May 14 15:46:34.954651 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-180423719 May 14 15:46:34.954651 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: X-User: tempest-VolumesSnapshotsTestJSON-180423719-project May 14 15:46:34.954651 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: X-User-Domain-Id: default May 14 15:46:34.954651 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: X-User-Domain-Name: Default May 14 15:46:34.954651 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: X-User-Id: 92367a7cee05488e8227ef625e4e240c May 14 15:46:34.954651 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: X-User-Name: tempest-VolumesSnapshotsTestJSON-180423719-project May 14 15:46:34.954651 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: method: May 14 15:46:34.954651 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: exception: Volume 8c2d3ae3-87aa-4d95-b72c-d32fa9b5aa8b could not be found. May 14 15:46:34.954651 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: action_args: {'id': '8c2d3ae3-87aa-4d95-b72c-d32fa9b5aa8b'} May 14 15:46:34.954651 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: {{(pid=128728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 14 15:46:34.955472 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 15:46:34.955472 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 14 15:46:34.955472 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 14 15:46:34.955472 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get May 14 15:46:34.955472 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: ERROR nova.api.openstack.wsgi item = cinderclient( May 14 15:46:34.955472 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get May 14 15:46:34.955472 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") May 14 15:46:34.955472 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 14 15:46:34.955472 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 14 15:46:34.955472 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 14 15:46:34.955472 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 14 15:46:34.955472 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 14 15:46:34.955472 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 14 15:46:34.955472 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 14 15:46:34.955472 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 14 15:46:34.955472 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 8c2d3ae3-87aa-4d95-b72c-d32fa9b5aa8b could not be found. (HTTP 404) (Request-ID: req-db61329e-a736-43a7-8060-b382d5e23a98) May 14 15:46:34.955472 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: ERROR nova.api.openstack.wsgi May 14 15:46:34.955472 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 14 15:46:34.955472 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: ERROR nova.api.openstack.wsgi May 14 15:46:34.956637 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 15:46:34.956637 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show May 14 15:46:34.956637 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) May 14 15:46:34.956637 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 14 15:46:34.956637 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 14 15:46:34.956637 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper May 14 15:46:34.956637 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) May 14 15:46:34.956637 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise May 14 15:46:34.956637 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) May 14 15:46:34.956637 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 14 15:46:34.956637 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 14 15:46:34.956637 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get May 14 15:46:34.956637 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: ERROR nova.api.openstack.wsgi item = cinderclient( May 14 15:46:34.956637 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get May 14 15:46:34.956637 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") May 14 15:46:34.956637 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 14 15:46:34.956637 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 14 15:46:34.956637 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 14 15:46:34.956637 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 14 15:46:34.957645 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 14 15:46:34.957645 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 14 15:46:34.957645 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 14 15:46:34.957645 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 14 15:46:34.957645 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 8c2d3ae3-87aa-4d95-b72c-d32fa9b5aa8b could not be found. May 14 15:46:34.957645 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: ERROR nova.api.openstack.wsgi May 14 15:46:34.957645 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 14 15:46:34.957645 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: ERROR nova.api.openstack.wsgi May 14 15:46:34.957645 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 15:46:34.957645 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 14 15:46:34.957645 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 14 15:46:34.957645 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 14 15:46:34.957645 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 14 15:46:34.957645 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 14 15:46:34.957645 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 14 15:46:34.957645 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 14 15:46:34.957645 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 14 15:46:34.957645 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show May 14 15:46:34.957645 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 14 15:46:34.958850 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 8c2d3ae3-87aa-4d95-b72c-d32fa9b5aa8b could not be found. May 14 15:46:34.958850 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: ERROR nova.api.openstack.wsgi May 14 15:46:34.958850 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 14 15:46:34.958850 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: ERROR nova.api.openstack.wsgi May 14 15:46:34.958850 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 15:46:34.958850 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 14 15:46:34.958850 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 14 15:46:34.958850 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 14 15:46:34.958850 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 14 15:46:34.958850 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 8c2d3ae3-87aa-4d95-b72c-d32fa9b5aa8b could not be found. May 14 15:46:34.958850 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: ERROR nova.api.openstack.wsgi May 14 15:46:34.960357 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi [None req-b0711f58-628e-4b21-aa7c-76a69a6a201a tempest-VolumesSnapshotsTestJSON-180423719 tempest-VolumesSnapshotsTestJSON-180423719-project] Returning 404 to user: Volume 8c2d3ae3-87aa-4d95-b72c-d32fa9b5aa8b could not be found. {{(pid=128728) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 14 15:46:34.961542 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: INFO nova.api.openstack.requestlog [None req-b0711f58-628e-4b21-aa7c-76a69a6a201a tempest-VolumesSnapshotsTestJSON-180423719 tempest-VolumesSnapshotsTestJSON-180423719-project] 10.222.0.61 "GET /compute/v2.1/os-volumes/8c2d3ae3-87aa-4d95-b72c-d32fa9b5aa8b" status: 404 len: 109 microversion: 2.1 time: 0.150528 May 14 15:46:34.962244 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: [pid: 128728|app: 0|req: 28/45] 10.222.0.61 () {58 vars in 1244 bytes} [Sat May 14 15:46:34 2022] GET /compute/v2.1/os-volumes/8c2d3ae3-87aa-4d95-b72c-d32fa9b5aa8b => generated 109 bytes in 152 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 14 15:46:34.979175 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi [None req-e6b73111-8bf8-4ad2-bfe5-e3f0bc5ec72f tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Calling method '>' {{(pid=128728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 15:46:34.980694 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.compute.api [None req-e6b73111-8bf8-4ad2-bfe5-e3f0bc5ec72f tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] [instance: 563c74e0-060d-49d5-abc5-389cee4bd9d5] Fetching instance by UUID {{(pid=128728) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 15:46:35.424152 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.policy [None req-e6b73111-8bf8-4ad2-bfe5-e3f0bc5ec72f tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b896317d96a40d6a137db0dcf5f98f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d2517d5440a4d30949f3dd36a46d813', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128728) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:46:35.469217 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.network.neutron [None req-6a25c829-457f-4061-b9aa-f74b54d6a138 tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] validate_networks() for [('722d2578-8e0a-4535-bc1b-444c13327ab8', None, None, None, None, None)] {{(pid=128729) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 14 15:46:35.473636 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: INFO nova.api.openstack.requestlog [None req-e6b73111-8bf8-4ad2-bfe5-e3f0bc5ec72f tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] 10.222.0.61 "GET /compute/v2.1/servers/563c74e0-060d-49d5-abc5-389cee4bd9d5" status: 200 len: 1221 microversion: 2.1 time: 0.494767 May 14 15:46:35.474381 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: [pid: 128728|app: 0|req: 29/46] 10.222.0.61 () {58 vars in 1235 bytes} [Sat May 14 15:46:34 2022] GET /compute/v2.1/servers/563c74e0-060d-49d5-abc5-389cee4bd9d5 => generated 1221 bytes in 511 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 15:46:35.503001 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi [None req-174fdae5-4bfb-4835-92b5-97fd6f878e3f tempest-VolumesSnapshotsTestJSON-180423719 tempest-VolumesSnapshotsTestJSON-180423719-project] Calling method '.version_select at 0x7f77d9bf2280>' {{(pid=128728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 15:46:35.649775 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: INFO nova.api.openstack.wsgi [None req-174fdae5-4bfb-4835-92b5-97fd6f878e3f tempest-VolumesSnapshotsTestJSON-180423719 tempest-VolumesSnapshotsTestJSON-180423719-project] HTTP exception thrown: Volume 8c2d3ae3-87aa-4d95-b72c-d32fa9b5aa8b could not be found. May 14 15:46:35.651782 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi [None req-174fdae5-4bfb-4835-92b5-97fd6f878e3f tempest-VolumesSnapshotsTestJSON-180423719 tempest-VolumesSnapshotsTestJSON-180423719-project] Request method failure captured: May 14 15:46:35.651782 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: request: DELETE /compute/v2.1/os-volumes/8c2d3ae3-87aa-4d95-b72c-d32fa9b5aa8b HTTP/1.1 May 14 15:46:35.651782 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: Accept: application/json May 14 15:46:35.651782 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: Accept-Encoding: identity May 14 15:46:35.651782 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: Connection: close May 14 15:46:35.651782 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: Content-Length: 0 May 14 15:46:35.651782 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: Content-Type: application/json May 14 15:46:35.651782 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: Host: 10.222.0.61 May 14 15:46:35.651782 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: Openstack-System-Scope: None May 14 15:46:35.651782 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: User-Agent: python-urllib3/1.26.9 May 14 15:46:35.651782 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: X-Auth-Token: gAAAAABif87ISzP8fj_fXFhbce4U7_Wnh_x5fV-wvCpst3LdHDNmpUvVYbFSfq7I9VhjuItwSJr2qMsj0DdePytRp_GwYXAZRWgP_g8NhwEOoQrAS-vBFuMhrWlomdJlCSAK4eTdHDRA7d71O9gWOz-VUgeuGe_FZT1CrwT79UTGKDQ8GJvhhLk May 14 15:46:35.651782 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: X-Domain-Id: None May 14 15:46:35.651782 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: X-Domain-Name: None May 14 15:46:35.651782 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: X-Identity-Status: Confirmed May 14 15:46:35.651782 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: X-Is-Admin-Project: True May 14 15:46:35.651782 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: X-Project-Domain-Id: default May 14 15:46:35.651782 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: X-Project-Domain-Name: Default May 14 15:46:35.651782 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: X-Project-Id: b97938b286404711bf362311d1daca56 May 14 15:46:35.651782 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-180423719 May 14 15:46:35.651782 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: X-Role: reader,member May 14 15:46:35.651782 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: X-Roles: reader,member May 14 15:46:35.653532 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/b97938b286404711bf362311d1daca56"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/b97938b286404711bf362311d1daca56"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/b97938b286404711bf362311d1daca56"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_b97938b286404711bf362311d1daca56"}]}] May 14 15:46:35.653532 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: X-Tenant: tempest-VolumesSnapshotsTestJSON-180423719 May 14 15:46:35.653532 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: X-Tenant-Id: b97938b286404711bf362311d1daca56 May 14 15:46:35.653532 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-180423719 May 14 15:46:35.653532 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: X-User: tempest-VolumesSnapshotsTestJSON-180423719-project May 14 15:46:35.653532 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: X-User-Domain-Id: default May 14 15:46:35.653532 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: X-User-Domain-Name: Default May 14 15:46:35.653532 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: X-User-Id: 92367a7cee05488e8227ef625e4e240c May 14 15:46:35.653532 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: X-User-Name: tempest-VolumesSnapshotsTestJSON-180423719-project May 14 15:46:35.653532 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: method: May 14 15:46:35.653532 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: exception: Volume 8c2d3ae3-87aa-4d95-b72c-d32fa9b5aa8b could not be found. May 14 15:46:35.653532 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: action_args: {'id': '8c2d3ae3-87aa-4d95-b72c-d32fa9b5aa8b'} May 14 15:46:35.653532 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: {{(pid=128728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 14 15:46:35.654256 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 15:46:35.654256 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 14 15:46:35.654256 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 14 15:46:35.654256 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete May 14 15:46:35.654256 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) May 14 15:46:35.654256 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete May 14 15:46:35.654256 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: ERROR nova.api.openstack.wsgi return self._delete(loc) May 14 15:46:35.654256 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete May 14 15:46:35.654256 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) May 14 15:46:35.654256 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete May 14 15:46:35.654256 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) May 14 15:46:35.654256 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 14 15:46:35.654256 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 14 15:46:35.654256 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 14 15:46:35.654256 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 14 15:46:35.654256 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 8c2d3ae3-87aa-4d95-b72c-d32fa9b5aa8b could not be found. (HTTP 404) (Request-ID: req-4ae9d824-7986-40f6-a485-4f7ad2f5f221) May 14 15:46:35.654256 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: ERROR nova.api.openstack.wsgi May 14 15:46:35.654256 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 14 15:46:35.654256 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: ERROR nova.api.openstack.wsgi May 14 15:46:35.655269 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 15:46:35.655269 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete May 14 15:46:35.655269 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) May 14 15:46:35.655269 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 14 15:46:35.655269 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 14 15:46:35.655269 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper May 14 15:46:35.655269 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) May 14 15:46:35.655269 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise May 14 15:46:35.655269 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) May 14 15:46:35.655269 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 14 15:46:35.655269 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 14 15:46:35.655269 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete May 14 15:46:35.655269 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) May 14 15:46:35.655269 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete May 14 15:46:35.655269 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: ERROR nova.api.openstack.wsgi return self._delete(loc) May 14 15:46:35.655269 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete May 14 15:46:35.655269 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) May 14 15:46:35.655269 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete May 14 15:46:35.655269 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) May 14 15:46:35.656340 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 14 15:46:35.656340 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 14 15:46:35.656340 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 14 15:46:35.656340 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 14 15:46:35.656340 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 8c2d3ae3-87aa-4d95-b72c-d32fa9b5aa8b could not be found. May 14 15:46:35.656340 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: ERROR nova.api.openstack.wsgi May 14 15:46:35.656340 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 14 15:46:35.656340 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: ERROR nova.api.openstack.wsgi May 14 15:46:35.656340 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 15:46:35.656340 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 14 15:46:35.656340 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 14 15:46:35.656340 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 14 15:46:35.656340 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 14 15:46:35.656340 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 14 15:46:35.656340 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 14 15:46:35.656340 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 14 15:46:35.656340 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 14 15:46:35.656340 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete May 14 15:46:35.656340 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 14 15:46:35.657343 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 8c2d3ae3-87aa-4d95-b72c-d32fa9b5aa8b could not be found. May 14 15:46:35.657343 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: ERROR nova.api.openstack.wsgi May 14 15:46:35.657343 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 14 15:46:35.657343 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: ERROR nova.api.openstack.wsgi May 14 15:46:35.657343 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 15:46:35.657343 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 14 15:46:35.657343 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 14 15:46:35.657343 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 14 15:46:35.657343 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 14 15:46:35.657343 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 8c2d3ae3-87aa-4d95-b72c-d32fa9b5aa8b could not be found. May 14 15:46:35.657343 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: ERROR nova.api.openstack.wsgi May 14 15:46:35.657343 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi [None req-174fdae5-4bfb-4835-92b5-97fd6f878e3f tempest-VolumesSnapshotsTestJSON-180423719 tempest-VolumesSnapshotsTestJSON-180423719-project] Returning 404 to user: Volume 8c2d3ae3-87aa-4d95-b72c-d32fa9b5aa8b could not be found. {{(pid=128728) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 14 15:46:35.657343 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: INFO nova.api.openstack.requestlog [None req-174fdae5-4bfb-4835-92b5-97fd6f878e3f tempest-VolumesSnapshotsTestJSON-180423719 tempest-VolumesSnapshotsTestJSON-180423719-project] 10.222.0.61 "DELETE /compute/v2.1/os-volumes/8c2d3ae3-87aa-4d95-b72c-d32fa9b5aa8b" status: 404 len: 109 microversion: 2.1 time: 0.167444 May 14 15:46:35.657343 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: [pid: 128728|app: 0|req: 30/47] 10.222.0.61 () {58 vars in 1247 bytes} [Sat May 14 15:46:35 2022] DELETE /compute/v2.1/os-volumes/8c2d3ae3-87aa-4d95-b72c-d32fa9b5aa8b => generated 109 bytes in 180 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 14 15:46:35.711309 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi [None req-b0b41b69-c35f-43a1-96f1-88dbefb3d852 tempest-VolumesSnapshotsTestJSON-180423719 tempest-VolumesSnapshotsTestJSON-180423719-project] Calling method '.version_select at 0x7f77d9c05820>' {{(pid=128728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 15:46:35.898624 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: INFO nova.api.openstack.wsgi [None req-b0b41b69-c35f-43a1-96f1-88dbefb3d852 tempest-VolumesSnapshotsTestJSON-180423719 tempest-VolumesSnapshotsTestJSON-180423719-project] HTTP exception thrown: Volume 8c2d3ae3-87aa-4d95-b72c-d32fa9b5aa8b could not be found. May 14 15:46:35.901015 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi [None req-b0b41b69-c35f-43a1-96f1-88dbefb3d852 tempest-VolumesSnapshotsTestJSON-180423719 tempest-VolumesSnapshotsTestJSON-180423719-project] Request method failure captured: May 14 15:46:35.901015 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: request: GET /compute/v2.1/os-volumes/8c2d3ae3-87aa-4d95-b72c-d32fa9b5aa8b HTTP/1.1 May 14 15:46:35.901015 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: Accept: application/json May 14 15:46:35.901015 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: Accept-Encoding: identity May 14 15:46:35.901015 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: Connection: close May 14 15:46:35.901015 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: Content-Length: 0 May 14 15:46:35.901015 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: Content-Type: application/json May 14 15:46:35.901015 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: Host: 10.222.0.61 May 14 15:46:35.901015 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: Openstack-System-Scope: None May 14 15:46:35.901015 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: User-Agent: python-urllib3/1.26.9 May 14 15:46:35.901015 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: X-Auth-Token: gAAAAABif87ISzP8fj_fXFhbce4U7_Wnh_x5fV-wvCpst3LdHDNmpUvVYbFSfq7I9VhjuItwSJr2qMsj0DdePytRp_GwYXAZRWgP_g8NhwEOoQrAS-vBFuMhrWlomdJlCSAK4eTdHDRA7d71O9gWOz-VUgeuGe_FZT1CrwT79UTGKDQ8GJvhhLk May 14 15:46:35.901015 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: X-Domain-Id: None May 14 15:46:35.901015 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: X-Domain-Name: None May 14 15:46:35.901015 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: X-Identity-Status: Confirmed May 14 15:46:35.901015 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: X-Is-Admin-Project: True May 14 15:46:35.901015 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: X-Project-Domain-Id: default May 14 15:46:35.901015 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: X-Project-Domain-Name: Default May 14 15:46:35.901015 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: X-Project-Id: b97938b286404711bf362311d1daca56 May 14 15:46:35.901015 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-180423719 May 14 15:46:35.901015 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: X-Role: reader,member May 14 15:46:35.901015 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: X-Roles: reader,member May 14 15:46:35.902552 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/b97938b286404711bf362311d1daca56"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/b97938b286404711bf362311d1daca56"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/b97938b286404711bf362311d1daca56"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_b97938b286404711bf362311d1daca56"}]}] May 14 15:46:35.902552 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: X-Tenant: tempest-VolumesSnapshotsTestJSON-180423719 May 14 15:46:35.902552 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: X-Tenant-Id: b97938b286404711bf362311d1daca56 May 14 15:46:35.902552 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-180423719 May 14 15:46:35.902552 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: X-User: tempest-VolumesSnapshotsTestJSON-180423719-project May 14 15:46:35.902552 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: X-User-Domain-Id: default May 14 15:46:35.902552 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: X-User-Domain-Name: Default May 14 15:46:35.902552 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: X-User-Id: 92367a7cee05488e8227ef625e4e240c May 14 15:46:35.902552 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: X-User-Name: tempest-VolumesSnapshotsTestJSON-180423719-project May 14 15:46:35.902552 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: method: May 14 15:46:35.902552 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: exception: Volume 8c2d3ae3-87aa-4d95-b72c-d32fa9b5aa8b could not be found. May 14 15:46:35.902552 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: action_args: {'id': '8c2d3ae3-87aa-4d95-b72c-d32fa9b5aa8b'} May 14 15:46:35.902552 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: {{(pid=128728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 14 15:46:35.903281 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 15:46:35.903281 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 14 15:46:35.903281 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 14 15:46:35.903281 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get May 14 15:46:35.903281 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: ERROR nova.api.openstack.wsgi item = cinderclient( May 14 15:46:35.903281 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get May 14 15:46:35.903281 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") May 14 15:46:35.903281 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 14 15:46:35.903281 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 14 15:46:35.903281 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 14 15:46:35.903281 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 14 15:46:35.903281 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 14 15:46:35.903281 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 14 15:46:35.903281 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 14 15:46:35.903281 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 14 15:46:35.903281 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 8c2d3ae3-87aa-4d95-b72c-d32fa9b5aa8b could not be found. (HTTP 404) (Request-ID: req-876e4da8-c5bf-4916-9464-3c17eaf2411c) May 14 15:46:35.903281 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: ERROR nova.api.openstack.wsgi May 14 15:46:35.903281 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 14 15:46:35.903281 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: ERROR nova.api.openstack.wsgi May 14 15:46:35.904239 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 15:46:35.904239 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show May 14 15:46:35.904239 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) May 14 15:46:35.904239 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 14 15:46:35.904239 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 14 15:46:35.904239 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper May 14 15:46:35.904239 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) May 14 15:46:35.904239 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise May 14 15:46:35.904239 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) May 14 15:46:35.904239 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 14 15:46:35.904239 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 14 15:46:35.904239 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get May 14 15:46:35.904239 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: ERROR nova.api.openstack.wsgi item = cinderclient( May 14 15:46:35.904239 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get May 14 15:46:35.904239 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") May 14 15:46:35.904239 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 14 15:46:35.904239 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 14 15:46:35.904239 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 14 15:46:35.904239 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 14 15:46:35.905120 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 14 15:46:35.905120 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 14 15:46:35.905120 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 14 15:46:35.905120 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 14 15:46:35.905120 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 8c2d3ae3-87aa-4d95-b72c-d32fa9b5aa8b could not be found. May 14 15:46:35.905120 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: ERROR nova.api.openstack.wsgi May 14 15:46:35.905120 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 14 15:46:35.905120 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: ERROR nova.api.openstack.wsgi May 14 15:46:35.905120 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 15:46:35.905120 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 14 15:46:35.905120 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 14 15:46:35.905120 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 14 15:46:35.905120 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 14 15:46:35.905120 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 14 15:46:35.905120 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 14 15:46:35.905120 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 14 15:46:35.905120 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 14 15:46:35.905120 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show May 14 15:46:35.905120 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 14 15:46:35.906002 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 8c2d3ae3-87aa-4d95-b72c-d32fa9b5aa8b could not be found. May 14 15:46:35.906002 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: ERROR nova.api.openstack.wsgi May 14 15:46:35.906002 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 14 15:46:35.906002 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: ERROR nova.api.openstack.wsgi May 14 15:46:35.906002 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 15:46:35.906002 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 14 15:46:35.906002 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 14 15:46:35.906002 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 14 15:46:35.906002 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 14 15:46:35.906002 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 8c2d3ae3-87aa-4d95-b72c-d32fa9b5aa8b could not be found. May 14 15:46:35.906002 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: ERROR nova.api.openstack.wsgi May 14 15:46:35.906002 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi [None req-b0b41b69-c35f-43a1-96f1-88dbefb3d852 tempest-VolumesSnapshotsTestJSON-180423719 tempest-VolumesSnapshotsTestJSON-180423719-project] Returning 404 to user: Volume 8c2d3ae3-87aa-4d95-b72c-d32fa9b5aa8b could not be found. {{(pid=128728) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 14 15:46:35.906002 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: INFO nova.api.openstack.requestlog [None req-b0b41b69-c35f-43a1-96f1-88dbefb3d852 tempest-VolumesSnapshotsTestJSON-180423719 tempest-VolumesSnapshotsTestJSON-180423719-project] 10.222.0.61 "GET /compute/v2.1/os-volumes/8c2d3ae3-87aa-4d95-b72c-d32fa9b5aa8b" status: 404 len: 109 microversion: 2.1 time: 0.238316 May 14 15:46:35.906002 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: [pid: 128728|app: 0|req: 31/48] 10.222.0.61 () {58 vars in 1244 bytes} [Sat May 14 15:46:35 2022] GET /compute/v2.1/os-volumes/8c2d3ae3-87aa-4d95-b72c-d32fa9b5aa8b => generated 109 bytes in 241 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 14 15:46:35.927768 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi [None req-ade135d5-76e8-4462-b06d-7b7d4623e0e1 tempest-DeleteServersTestJSON-2100051872 tempest-DeleteServersTestJSON-2100051872-project] Calling method '>' {{(pid=128728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 15:46:35.932995 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.compute.api [None req-ade135d5-76e8-4462-b06d-7b7d4623e0e1 tempest-DeleteServersTestJSON-2100051872 tempest-DeleteServersTestJSON-2100051872-project] [instance: 75ca93de-6825-44ce-af10-44cba59218a1] Fetching instance by UUID {{(pid=128728) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 15:46:35.971389 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-ade135d5-76e8-4462-b06d-7b7d4623e0e1 tempest-DeleteServersTestJSON-2100051872 tempest-DeleteServersTestJSON-2100051872-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:46:35.971869 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-ade135d5-76e8-4462-b06d-7b7d4623e0e1 tempest-DeleteServersTestJSON-2100051872 tempest-DeleteServersTestJSON-2100051872-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:46:35.983260 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-ade135d5-76e8-4462-b06d-7b7d4623e0e1 tempest-DeleteServersTestJSON-2100051872 tempest-DeleteServersTestJSON-2100051872-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:46:35.985275 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-ade135d5-76e8-4462-b06d-7b7d4623e0e1 tempest-DeleteServersTestJSON-2100051872 tempest-DeleteServersTestJSON-2100051872-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:46:37.088512 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.policy [None req-ade135d5-76e8-4462-b06d-7b7d4623e0e1 tempest-DeleteServersTestJSON-2100051872 tempest-DeleteServersTestJSON-2100051872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aad828d8ff314a2d82f07fb6d84f36a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6388da70b0dc48c1952570af4332dd6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128728) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:46:37.098477 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: INFO nova.api.openstack.requestlog [None req-ade135d5-76e8-4462-b06d-7b7d4623e0e1 tempest-DeleteServersTestJSON-2100051872 tempest-DeleteServersTestJSON-2100051872-project] 10.222.0.61 "GET /compute/v2.1/servers/75ca93de-6825-44ce-af10-44cba59218a1" status: 200 len: 1315 microversion: 2.1 time: 1.191796 May 14 15:46:37.110302 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: [pid: 128728|app: 0|req: 32/49] 10.222.0.61 () {58 vars in 1235 bytes} [Sat May 14 15:46:35 2022] GET /compute/v2.1/servers/75ca93de-6825-44ce-af10-44cba59218a1 => generated 1315 bytes in 1204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 15:46:37.125142 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi [None req-ace06ac7-f27f-4a1e-b1d6-cfa29ee05208 tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Calling method '>' {{(pid=128728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 15:46:37.125768 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.compute.api [None req-ace06ac7-f27f-4a1e-b1d6-cfa29ee05208 tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] [instance: 563c74e0-060d-49d5-abc5-389cee4bd9d5] Fetching instance by UUID {{(pid=128728) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 15:46:37.139279 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-ace06ac7-f27f-4a1e-b1d6-cfa29ee05208 tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:46:37.143884 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-ace06ac7-f27f-4a1e-b1d6-cfa29ee05208 tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:46:37.145104 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-ace06ac7-f27f-4a1e-b1d6-cfa29ee05208 tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:46:37.146714 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-ace06ac7-f27f-4a1e-b1d6-cfa29ee05208 tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:46:37.445665 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.policy [None req-ace06ac7-f27f-4a1e-b1d6-cfa29ee05208 tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b896317d96a40d6a137db0dcf5f98f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d2517d5440a4d30949f3dd36a46d813', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128728) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:46:37.461180 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: INFO nova.api.openstack.requestlog [None req-ace06ac7-f27f-4a1e-b1d6-cfa29ee05208 tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] 10.222.0.61 "GET /compute/v2.1/servers/563c74e0-060d-49d5-abc5-389cee4bd9d5" status: 200 len: 1273 microversion: 2.1 time: 0.348909 May 14 15:46:37.462669 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: [pid: 128728|app: 0|req: 33/50] 10.222.0.61 () {58 vars in 1235 bytes} [Sat May 14 15:46:37 2022] GET /compute/v2.1/servers/563c74e0-060d-49d5-abc5-389cee4bd9d5 => generated 1273 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 15:46:37.616776 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.virt.hardware [None req-6a25c829-457f-4061-b9aa-f74b54d6a138 tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] Flavor limits 0:0:0 {{(pid=128729) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 14 15:46:37.617492 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.virt.hardware [None req-6a25c829-457f-4061-b9aa-f74b54d6a138 tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] Image limits 0:0:0 {{(pid=128729) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 14 15:46:37.618743 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.virt.hardware [None req-6a25c829-457f-4061-b9aa-f74b54d6a138 tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] Flavor pref 0:0:0 {{(pid=128729) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 14 15:46:37.619440 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.virt.hardware [None req-6a25c829-457f-4061-b9aa-f74b54d6a138 tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] Image pref 0:0:0 {{(pid=128729) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 14 15:46:37.620180 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.virt.hardware [None req-6a25c829-457f-4061-b9aa-f74b54d6a138 tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128729) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 14 15:46:37.651558 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-6a25c829-457f-4061-b9aa-f74b54d6a138 tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:46:37.654702 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-6a25c829-457f-4061-b9aa-f74b54d6a138 tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:46:37.659608 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-6a25c829-457f-4061-b9aa-f74b54d6a138 tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:46:37.663636 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-6a25c829-457f-4061-b9aa-f74b54d6a138 tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:46:37.789088 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.quota [None req-6a25c829-457f-4061-b9aa-f74b54d6a138 tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] Getting quotas for project 7905689c95d44a5c9169249c70f7de57. Resources: {'instances', 'cores', 'ram'} {{(pid=128729) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 14 15:46:37.803128 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.quota [None req-6a25c829-457f-4061-b9aa-f74b54d6a138 tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] Getting quotas for user dc43895177134e9c9c030a9d87f94aaa and project 7905689c95d44a5c9169249c70f7de57. Resources: {'instances', 'cores', 'ram'} {{(pid=128729) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 14 15:46:37.888809 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.compute.api [None req-6a25c829-457f-4061-b9aa-f74b54d6a138 tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] Going to run 1 instances... {{(pid=128729) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 14 15:46:37.894520 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.compute.api [None req-6a25c829-457f-4061-b9aa-f74b54d6a138 tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] [instance: 113f6b52-519c-45f4-9bc2-37168d644e15] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='1381e3d5-fc27-4fa7-ab03-5d86278a0546',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128729) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 14 15:46:38.100261 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: INFO nova.api.openstack.requestlog [None req-6a25c829-457f-4061-b9aa-f74b54d6a138 tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] 10.222.0.61 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 3.189351 May 14 15:46:38.107128 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: [pid: 128729|app: 0|req: 18/51] 10.222.0.61 () {60 vars in 1146 bytes} [Sat May 14 15:46:34 2022] POST /compute/v2.1/servers => generated 401 bytes in 3197 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 14 15:46:38.129285 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi [None req-87dbf1cd-71d1-46af-bafd-2066584bfe37 tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] Calling method '>' {{(pid=128729) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 15:46:38.130701 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.compute.api [None req-87dbf1cd-71d1-46af-bafd-2066584bfe37 tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] [instance: 113f6b52-519c-45f4-9bc2-37168d644e15] Fetching instance by UUID {{(pid=128729) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 15:46:38.218646 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi [None req-5cc5516b-d518-4ae5-8e67-9f8cf0c47882 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Action: 'create', calling method: .version_select at 0x7f77d9bdcca0>, body: {"keypair": {"name": "tempest-keypair-1822933638", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBG9/KrJojMzE+y3D2jmIhrfr5QILT7C3+o2qYo9rNOSvyAUQUZeDbGLkfUAQ0KNDUpdhItPECYMXHbO5gwdQefE/NGYuySWhfw0M6aQ9OAMWaTHFPThtuYiHXahC4jPI8Q=="}} {{(pid=128728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 15:46:38.445613 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.quota [None req-5cc5516b-d518-4ae5-8e67-9f8cf0c47882 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Getting quotas for project 0672be3fa3f7414da1c1a5b7300abbe7. Resources: {'key_pairs'} {{(pid=128728) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 14 15:46:38.471580 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.quota [None req-5cc5516b-d518-4ae5-8e67-9f8cf0c47882 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Getting quotas for user 58bfb7417bc94583963401ae0fe9d39a and project 0672be3fa3f7414da1c1a5b7300abbe7. Resources: {'key_pairs'} {{(pid=128728) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 14 15:46:38.582962 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: INFO nova.api.openstack.requestlog [None req-5cc5516b-d518-4ae5-8e67-9f8cf0c47882 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] 10.222.0.61 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 1.119011 May 14 15:46:38.584488 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: [pid: 128728|app: 0|req: 34/52] 10.222.0.61 () {62 vars in 1199 bytes} [Sat May 14 15:46:37 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 1121 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) May 14 15:46:38.602011 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi [None req-f7e09a81-bfe2-409a-a6ee-7e43a1eee32f tempest-DeleteServersTestJSON-2100051872 tempest-DeleteServersTestJSON-2100051872-project] Calling method '>' {{(pid=128728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 15:46:38.604401 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.compute.api [None req-f7e09a81-bfe2-409a-a6ee-7e43a1eee32f tempest-DeleteServersTestJSON-2100051872 tempest-DeleteServersTestJSON-2100051872-project] [instance: 75ca93de-6825-44ce-af10-44cba59218a1] Fetching instance by UUID {{(pid=128728) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 15:46:38.617377 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-f7e09a81-bfe2-409a-a6ee-7e43a1eee32f tempest-DeleteServersTestJSON-2100051872 tempest-DeleteServersTestJSON-2100051872-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:46:38.618301 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-f7e09a81-bfe2-409a-a6ee-7e43a1eee32f tempest-DeleteServersTestJSON-2100051872 tempest-DeleteServersTestJSON-2100051872-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:46:38.620057 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-f7e09a81-bfe2-409a-a6ee-7e43a1eee32f tempest-DeleteServersTestJSON-2100051872 tempest-DeleteServersTestJSON-2100051872-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:46:38.621362 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-f7e09a81-bfe2-409a-a6ee-7e43a1eee32f tempest-DeleteServersTestJSON-2100051872 tempest-DeleteServersTestJSON-2100051872-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:46:38.724891 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.policy [None req-87dbf1cd-71d1-46af-bafd-2066584bfe37 tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc43895177134e9c9c030a9d87f94aaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7905689c95d44a5c9169249c70f7de57', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128729) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:46:38.734101 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: INFO nova.api.openstack.requestlog [None req-87dbf1cd-71d1-46af-bafd-2066584bfe37 tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] 10.222.0.61 "GET /compute/v2.1/servers/113f6b52-519c-45f4-9bc2-37168d644e15" status: 200 len: 1241 microversion: 2.1 time: 0.622334 May 14 15:46:38.769352 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: [pid: 128729|app: 0|req: 19/53] 10.222.0.61 () {58 vars in 1235 bytes} [Sat May 14 15:46:38 2022] GET /compute/v2.1/servers/113f6b52-519c-45f4-9bc2-37168d644e15 => generated 1241 bytes in 660 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 15:46:38.788695 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi [None req-211c241e-1e79-49ce-baf3-1999db30a62b tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Calling method '>' {{(pid=128729) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 15:46:38.790452 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.compute.api [None req-211c241e-1e79-49ce-baf3-1999db30a62b tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] [instance: 563c74e0-060d-49d5-abc5-389cee4bd9d5] Fetching instance by UUID {{(pid=128729) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 15:46:38.832698 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-211c241e-1e79-49ce-baf3-1999db30a62b tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:46:38.833165 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-211c241e-1e79-49ce-baf3-1999db30a62b tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:46:38.833980 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-211c241e-1e79-49ce-baf3-1999db30a62b tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:46:38.834460 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-211c241e-1e79-49ce-baf3-1999db30a62b tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:46:39.633994 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.policy [None req-211c241e-1e79-49ce-baf3-1999db30a62b tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b896317d96a40d6a137db0dcf5f98f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d2517d5440a4d30949f3dd36a46d813', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128729) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:46:39.648542 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: INFO nova.api.openstack.requestlog [None req-211c241e-1e79-49ce-baf3-1999db30a62b tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] 10.222.0.61 "GET /compute/v2.1/servers/563c74e0-060d-49d5-abc5-389cee4bd9d5" status: 200 len: 1279 microversion: 2.1 time: 0.877758 May 14 15:46:39.660348 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: [pid: 128729|app: 0|req: 20/54] 10.222.0.61 () {58 vars in 1235 bytes} [Sat May 14 15:46:38 2022] GET /compute/v2.1/servers/563c74e0-060d-49d5-abc5-389cee4bd9d5 => generated 1279 bytes in 890 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 15:46:39.781328 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi [None req-4219a9bd-0976-4bbb-b27e-af226f26d21a tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] Calling method '>' {{(pid=128729) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 15:46:39.783092 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.compute.api [None req-4219a9bd-0976-4bbb-b27e-af226f26d21a tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] [instance: 113f6b52-519c-45f4-9bc2-37168d644e15] Fetching instance by UUID {{(pid=128729) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 15:46:39.795548 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-4219a9bd-0976-4bbb-b27e-af226f26d21a tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:46:39.798952 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-4219a9bd-0976-4bbb-b27e-af226f26d21a tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:46:39.802706 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-4219a9bd-0976-4bbb-b27e-af226f26d21a tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:46:39.804061 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-4219a9bd-0976-4bbb-b27e-af226f26d21a tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:46:40.357966 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.policy [None req-4219a9bd-0976-4bbb-b27e-af226f26d21a tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc43895177134e9c9c030a9d87f94aaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7905689c95d44a5c9169249c70f7de57', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128729) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:46:40.375225 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: INFO nova.api.openstack.requestlog [None req-4219a9bd-0976-4bbb-b27e-af226f26d21a tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] 10.222.0.61 "GET /compute/v2.1/servers/113f6b52-519c-45f4-9bc2-37168d644e15" status: 200 len: 1293 microversion: 2.1 time: 0.598125 May 14 15:46:40.381463 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: [pid: 128729|app: 0|req: 21/55] 10.222.0.61 () {58 vars in 1235 bytes} [Sat May 14 15:46:39 2022] GET /compute/v2.1/servers/113f6b52-519c-45f4-9bc2-37168d644e15 => generated 1293 bytes in 612 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 15:46:40.538115 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.policy [None req-f7e09a81-bfe2-409a-a6ee-7e43a1eee32f tempest-DeleteServersTestJSON-2100051872 tempest-DeleteServersTestJSON-2100051872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aad828d8ff314a2d82f07fb6d84f36a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6388da70b0dc48c1952570af4332dd6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128728) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:46:40.555033 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: INFO nova.api.openstack.requestlog [None req-f7e09a81-bfe2-409a-a6ee-7e43a1eee32f tempest-DeleteServersTestJSON-2100051872 tempest-DeleteServersTestJSON-2100051872-project] 10.222.0.61 "GET /compute/v2.1/servers/75ca93de-6825-44ce-af10-44cba59218a1" status: 200 len: 1315 microversion: 2.1 time: 1.965427 May 14 15:46:40.557889 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: [pid: 128728|app: 0|req: 35/56] 10.222.0.61 () {58 vars in 1235 bytes} [Sat May 14 15:46:38 2022] GET /compute/v2.1/servers/75ca93de-6825-44ce-af10-44cba59218a1 => generated 1315 bytes in 1971 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 15:46:40.676022 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi [None req-4ba63ee0-6414-4467-9cf9-16970b44e699 tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Calling method '>' {{(pid=128729) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 15:46:40.676902 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.compute.api [None req-4ba63ee0-6414-4467-9cf9-16970b44e699 tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] [instance: 563c74e0-060d-49d5-abc5-389cee4bd9d5] Fetching instance by UUID {{(pid=128729) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 15:46:40.690221 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-4ba63ee0-6414-4467-9cf9-16970b44e699 tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:46:40.690917 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-4ba63ee0-6414-4467-9cf9-16970b44e699 tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:46:40.693433 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-4ba63ee0-6414-4467-9cf9-16970b44e699 tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:46:40.699867 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-4ba63ee0-6414-4467-9cf9-16970b44e699 tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:46:40.958858 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.policy [None req-4ba63ee0-6414-4467-9cf9-16970b44e699 tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b896317d96a40d6a137db0dcf5f98f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d2517d5440a4d30949f3dd36a46d813', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128729) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:46:40.984830 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: INFO nova.api.openstack.requestlog [None req-4ba63ee0-6414-4467-9cf9-16970b44e699 tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] 10.222.0.61 "GET /compute/v2.1/servers/563c74e0-060d-49d5-abc5-389cee4bd9d5" status: 200 len: 1279 microversion: 2.1 time: 0.306598 May 14 15:46:41.009438 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: [pid: 128729|app: 0|req: 22/57] 10.222.0.61 () {58 vars in 1235 bytes} [Sat May 14 15:46:40 2022] GET /compute/v2.1/servers/563c74e0-060d-49d5-abc5-389cee4bd9d5 => generated 1279 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 15:46:41.398178 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi [None req-462d13a4-c399-464d-86ec-10cf8e39a9a6 tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] Calling method '>' {{(pid=128728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 15:46:41.399027 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.compute.api [None req-462d13a4-c399-464d-86ec-10cf8e39a9a6 tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] [instance: 113f6b52-519c-45f4-9bc2-37168d644e15] Fetching instance by UUID {{(pid=128728) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 15:46:41.419313 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-462d13a4-c399-464d-86ec-10cf8e39a9a6 tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:46:41.423148 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-462d13a4-c399-464d-86ec-10cf8e39a9a6 tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:46:41.428482 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-462d13a4-c399-464d-86ec-10cf8e39a9a6 tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:46:41.430103 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-462d13a4-c399-464d-86ec-10cf8e39a9a6 tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:46:41.573967 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi [None req-a6dfc0b7-f45c-4be6-bc0f-57bd34b8ff2d tempest-DeleteServersTestJSON-2100051872 tempest-DeleteServersTestJSON-2100051872-project] Calling method '>' {{(pid=128729) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 15:46:41.575055 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.compute.api [None req-a6dfc0b7-f45c-4be6-bc0f-57bd34b8ff2d tempest-DeleteServersTestJSON-2100051872 tempest-DeleteServersTestJSON-2100051872-project] [instance: 75ca93de-6825-44ce-af10-44cba59218a1] Fetching instance by UUID {{(pid=128729) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 15:46:41.593609 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-a6dfc0b7-f45c-4be6-bc0f-57bd34b8ff2d tempest-DeleteServersTestJSON-2100051872 tempest-DeleteServersTestJSON-2100051872-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:46:41.594084 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-a6dfc0b7-f45c-4be6-bc0f-57bd34b8ff2d tempest-DeleteServersTestJSON-2100051872 tempest-DeleteServersTestJSON-2100051872-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:46:41.605507 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-a6dfc0b7-f45c-4be6-bc0f-57bd34b8ff2d tempest-DeleteServersTestJSON-2100051872 tempest-DeleteServersTestJSON-2100051872-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:46:41.606551 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-a6dfc0b7-f45c-4be6-bc0f-57bd34b8ff2d tempest-DeleteServersTestJSON-2100051872 tempest-DeleteServersTestJSON-2100051872-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:46:41.696436 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.policy [None req-462d13a4-c399-464d-86ec-10cf8e39a9a6 tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc43895177134e9c9c030a9d87f94aaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7905689c95d44a5c9169249c70f7de57', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128728) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:46:41.711231 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: INFO nova.api.openstack.requestlog [None req-462d13a4-c399-464d-86ec-10cf8e39a9a6 tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] 10.222.0.61 "GET /compute/v2.1/servers/113f6b52-519c-45f4-9bc2-37168d644e15" status: 200 len: 1299 microversion: 2.1 time: 0.315427 May 14 15:46:41.714019 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: [pid: 128728|app: 0|req: 36/58] 10.222.0.61 () {58 vars in 1235 bytes} [Sat May 14 15:46:41 2022] GET /compute/v2.1/servers/113f6b52-519c-45f4-9bc2-37168d644e15 => generated 1299 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 15:46:41.934665 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.policy [None req-a6dfc0b7-f45c-4be6-bc0f-57bd34b8ff2d tempest-DeleteServersTestJSON-2100051872 tempest-DeleteServersTestJSON-2100051872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aad828d8ff314a2d82f07fb6d84f36a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6388da70b0dc48c1952570af4332dd6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128729) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:46:41.943989 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: INFO nova.api.openstack.requestlog [None req-a6dfc0b7-f45c-4be6-bc0f-57bd34b8ff2d tempest-DeleteServersTestJSON-2100051872 tempest-DeleteServersTestJSON-2100051872-project] 10.222.0.61 "GET /compute/v2.1/servers/75ca93de-6825-44ce-af10-44cba59218a1" status: 200 len: 1315 microversion: 2.1 time: 0.374560 May 14 15:46:41.946642 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: [pid: 128729|app: 0|req: 23/59] 10.222.0.61 () {58 vars in 1235 bytes} [Sat May 14 15:46:41 2022] GET /compute/v2.1/servers/75ca93de-6825-44ce-af10-44cba59218a1 => generated 1315 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 15:46:42.001795 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi [None req-e869e404-bafb-45a0-be19-4435d956841e tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Calling method '>' {{(pid=128728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 15:46:42.002899 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.compute.api [None req-e869e404-bafb-45a0-be19-4435d956841e tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] [instance: 563c74e0-060d-49d5-abc5-389cee4bd9d5] Fetching instance by UUID {{(pid=128728) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 15:46:42.016626 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-e869e404-bafb-45a0-be19-4435d956841e tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:46:42.017238 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-e869e404-bafb-45a0-be19-4435d956841e tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:46:42.021650 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-e869e404-bafb-45a0-be19-4435d956841e tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:46:42.022420 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-e869e404-bafb-45a0-be19-4435d956841e tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:46:42.247796 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.policy [None req-e869e404-bafb-45a0-be19-4435d956841e tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b896317d96a40d6a137db0dcf5f98f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d2517d5440a4d30949f3dd36a46d813', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128728) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:46:42.263315 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: INFO nova.api.openstack.requestlog [None req-e869e404-bafb-45a0-be19-4435d956841e tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] 10.222.0.61 "GET /compute/v2.1/servers/563c74e0-060d-49d5-abc5-389cee4bd9d5" status: 200 len: 1279 microversion: 2.1 time: 0.262803 May 14 15:46:42.273048 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: [pid: 128728|app: 0|req: 37/60] 10.222.0.61 () {58 vars in 1235 bytes} [Sat May 14 15:46:41 2022] GET /compute/v2.1/servers/563c74e0-060d-49d5-abc5-389cee4bd9d5 => generated 1279 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 15:46:42.733704 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi [None req-612886b8-c9cf-4cd3-8a91-488d3ee757f9 tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] Calling method '>' {{(pid=128728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 15:46:42.737962 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.compute.api [None req-612886b8-c9cf-4cd3-8a91-488d3ee757f9 tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] [instance: 113f6b52-519c-45f4-9bc2-37168d644e15] Fetching instance by UUID {{(pid=128728) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 15:46:42.755661 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-612886b8-c9cf-4cd3-8a91-488d3ee757f9 tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:46:42.756139 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-612886b8-c9cf-4cd3-8a91-488d3ee757f9 tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:46:42.757002 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-612886b8-c9cf-4cd3-8a91-488d3ee757f9 tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:46:42.757436 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-612886b8-c9cf-4cd3-8a91-488d3ee757f9 tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:46:43.029646 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.policy [None req-612886b8-c9cf-4cd3-8a91-488d3ee757f9 tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc43895177134e9c9c030a9d87f94aaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7905689c95d44a5c9169249c70f7de57', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128728) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:46:43.065046 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: INFO nova.api.openstack.requestlog [None req-612886b8-c9cf-4cd3-8a91-488d3ee757f9 tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] 10.222.0.61 "GET /compute/v2.1/servers/113f6b52-519c-45f4-9bc2-37168d644e15" status: 200 len: 1299 microversion: 2.1 time: 0.333612 May 14 15:46:43.065810 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: [pid: 128728|app: 0|req: 38/61] 10.222.0.61 () {58 vars in 1235 bytes} [Sat May 14 15:46:42 2022] GET /compute/v2.1/servers/113f6b52-519c-45f4-9bc2-37168d644e15 => generated 1299 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 15:46:43.090826 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi [None req-402f4b80-0963-4a53-a3ea-9195ba237443 tempest-DeleteServersTestJSON-2100051872 tempest-DeleteServersTestJSON-2100051872-project] Calling method '>' {{(pid=128728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 15:46:43.092948 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.compute.api [None req-402f4b80-0963-4a53-a3ea-9195ba237443 tempest-DeleteServersTestJSON-2100051872 tempest-DeleteServersTestJSON-2100051872-project] [instance: 75ca93de-6825-44ce-af10-44cba59218a1] Fetching instance by UUID {{(pid=128728) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 15:46:43.110941 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-402f4b80-0963-4a53-a3ea-9195ba237443 tempest-DeleteServersTestJSON-2100051872 tempest-DeleteServersTestJSON-2100051872-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:46:43.112586 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-402f4b80-0963-4a53-a3ea-9195ba237443 tempest-DeleteServersTestJSON-2100051872 tempest-DeleteServersTestJSON-2100051872-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:46:43.114651 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-402f4b80-0963-4a53-a3ea-9195ba237443 tempest-DeleteServersTestJSON-2100051872 tempest-DeleteServersTestJSON-2100051872-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:46:43.120014 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-402f4b80-0963-4a53-a3ea-9195ba237443 tempest-DeleteServersTestJSON-2100051872 tempest-DeleteServersTestJSON-2100051872-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:46:43.185104 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi [req-b0c2521b-7193-438b-9915-f17c5bbd89c2 req-c3ede83e-96ac-4544-bdfc-4042f83fe77e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "75ca93de-6825-44ce-af10-44cba59218a1", "tag": "fb2bfc60-7355-48dd-9df7-9ffd7d99b7f6"}]} {{(pid=128729) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 15:46:43.225647 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [req-b0c2521b-7193-438b-9915-f17c5bbd89c2 req-c3ede83e-96ac-4544-bdfc-4042f83fe77e service nova] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:46:43.226112 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [req-b0c2521b-7193-438b-9915-f17c5bbd89c2 req-c3ede83e-96ac-4544-bdfc-4042f83fe77e service nova] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:46:43.304595 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: INFO nova.api.openstack.compute.server_external_events [req-b0c2521b-7193-438b-9915-f17c5bbd89c2 req-c3ede83e-96ac-4544-bdfc-4042f83fe77e service nova] Creating event network-changed:fb2bfc60-7355-48dd-9df7-9ffd7d99b7f6 for instance 75ca93de-6825-44ce-af10-44cba59218a1 on hv-cinder-83979 May 14 15:46:43.305261 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [req-b0c2521b-7193-438b-9915-f17c5bbd89c2 req-c3ede83e-96ac-4544-bdfc-4042f83fe77e service nova] Acquired lock "compute-rpcapi-router" {{(pid=128729) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} May 14 15:46:43.306429 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-d71b1ef4-0fbb-4229-a361-e7a086a77cf4 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:46:43.311155 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-d71b1ef4-0fbb-4229-a361-e7a086a77cf4 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:46:43.312034 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-d71b1ef4-0fbb-4229-a361-e7a086a77cf4 None None] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:46:43.312476 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-d71b1ef4-0fbb-4229-a361-e7a086a77cf4 None None] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:46:43.368382 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: INFO nova.compute.rpcapi [None req-d71b1ef4-0fbb-4229-a361-e7a086a77cf4 None None] Automatically selected compute RPC version 6.0 from minimum service version 61 May 14 15:46:43.369290 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-d71b1ef4-0fbb-4229-a361-e7a086a77cf4 None None] Releasing lock "compute-rpcapi-router" {{(pid=128729) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} May 14 15:46:43.435425 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: INFO nova.api.openstack.requestlog [None req-d71b1ef4-0fbb-4229-a361-e7a086a77cf4 None None] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.883496 May 14 15:46:43.436585 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: [pid: 128729|app: 0|req: 24/62] 10.222.0.61 () {64 vars in 1317 bytes} [Sat May 14 15:46:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 886 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 14 15:46:43.441884 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi [None req-96706256-80cb-4a61-9f6e-246e138b207d tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Calling method '>' {{(pid=128729) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 15:46:43.442755 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.compute.api [None req-96706256-80cb-4a61-9f6e-246e138b207d tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] [instance: 563c74e0-060d-49d5-abc5-389cee4bd9d5] Fetching instance by UUID {{(pid=128729) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 15:46:43.462033 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-96706256-80cb-4a61-9f6e-246e138b207d tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:46:43.468715 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-96706256-80cb-4a61-9f6e-246e138b207d tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:46:43.469654 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-96706256-80cb-4a61-9f6e-246e138b207d tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:46:43.470469 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-96706256-80cb-4a61-9f6e-246e138b207d tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:46:43.978715 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.policy [None req-402f4b80-0963-4a53-a3ea-9195ba237443 tempest-DeleteServersTestJSON-2100051872 tempest-DeleteServersTestJSON-2100051872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aad828d8ff314a2d82f07fb6d84f36a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6388da70b0dc48c1952570af4332dd6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128728) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:46:43.989206 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: INFO nova.api.openstack.requestlog [None req-402f4b80-0963-4a53-a3ea-9195ba237443 tempest-DeleteServersTestJSON-2100051872 tempest-DeleteServersTestJSON-2100051872-project] 10.222.0.61 "GET /compute/v2.1/servers/75ca93de-6825-44ce-af10-44cba59218a1" status: 200 len: 1315 microversion: 2.1 time: 0.922159 May 14 15:46:43.990903 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: [pid: 128728|app: 0|req: 39/63] 10.222.0.61 () {58 vars in 1235 bytes} [Sat May 14 15:46:43 2022] GET /compute/v2.1/servers/75ca93de-6825-44ce-af10-44cba59218a1 => generated 1315 bytes in 925 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 15:46:44.088438 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi [None req-9c14db2c-ca09-4d4e-8ec0-4b9bb58c27c8 tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] Calling method '>' {{(pid=128728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 15:46:44.090589 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.compute.api [None req-9c14db2c-ca09-4d4e-8ec0-4b9bb58c27c8 tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] [instance: 113f6b52-519c-45f4-9bc2-37168d644e15] Fetching instance by UUID {{(pid=128728) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 15:46:44.103601 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-9c14db2c-ca09-4d4e-8ec0-4b9bb58c27c8 tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:46:44.110078 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-9c14db2c-ca09-4d4e-8ec0-4b9bb58c27c8 tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:46:44.111903 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-9c14db2c-ca09-4d4e-8ec0-4b9bb58c27c8 tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:46:44.113058 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-9c14db2c-ca09-4d4e-8ec0-4b9bb58c27c8 tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:46:44.132778 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.policy [None req-96706256-80cb-4a61-9f6e-246e138b207d tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b896317d96a40d6a137db0dcf5f98f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d2517d5440a4d30949f3dd36a46d813', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128729) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:46:44.140804 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: INFO nova.api.openstack.requestlog [None req-96706256-80cb-4a61-9f6e-246e138b207d tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] 10.222.0.61 "GET /compute/v2.1/servers/563c74e0-060d-49d5-abc5-389cee4bd9d5" status: 200 len: 1321 microversion: 2.1 time: 0.702926 May 14 15:46:44.141710 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: [pid: 128729|app: 0|req: 25/64] 10.222.0.61 () {58 vars in 1235 bytes} [Sat May 14 15:46:43 2022] GET /compute/v2.1/servers/563c74e0-060d-49d5-abc5-389cee4bd9d5 => generated 1321 bytes in 704 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 15:46:44.291061 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.policy [None req-9c14db2c-ca09-4d4e-8ec0-4b9bb58c27c8 tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc43895177134e9c9c030a9d87f94aaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7905689c95d44a5c9169249c70f7de57', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128728) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:46:44.309480 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: INFO nova.api.openstack.requestlog [None req-9c14db2c-ca09-4d4e-8ec0-4b9bb58c27c8 tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] 10.222.0.61 "GET /compute/v2.1/servers/113f6b52-519c-45f4-9bc2-37168d644e15" status: 200 len: 1299 microversion: 2.1 time: 0.228224 May 14 15:46:44.310076 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: [pid: 128728|app: 0|req: 40/65] 10.222.0.61 () {58 vars in 1235 bytes} [Sat May 14 15:46:44 2022] GET /compute/v2.1/servers/113f6b52-519c-45f4-9bc2-37168d644e15 => generated 1299 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 15:46:45.010941 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi [None req-3604a970-1646-494f-8283-4c959c2ed8d5 tempest-DeleteServersTestJSON-2100051872 tempest-DeleteServersTestJSON-2100051872-project] Calling method '>' {{(pid=128729) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 15:46:45.012283 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.compute.api [None req-3604a970-1646-494f-8283-4c959c2ed8d5 tempest-DeleteServersTestJSON-2100051872 tempest-DeleteServersTestJSON-2100051872-project] [instance: 75ca93de-6825-44ce-af10-44cba59218a1] Fetching instance by UUID {{(pid=128729) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 15:46:45.023829 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-3604a970-1646-494f-8283-4c959c2ed8d5 tempest-DeleteServersTestJSON-2100051872 tempest-DeleteServersTestJSON-2100051872-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:46:45.033701 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-3604a970-1646-494f-8283-4c959c2ed8d5 tempest-DeleteServersTestJSON-2100051872 tempest-DeleteServersTestJSON-2100051872-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:46:45.035251 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-3604a970-1646-494f-8283-4c959c2ed8d5 tempest-DeleteServersTestJSON-2100051872 tempest-DeleteServersTestJSON-2100051872-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:46:45.035916 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-3604a970-1646-494f-8283-4c959c2ed8d5 tempest-DeleteServersTestJSON-2100051872 tempest-DeleteServersTestJSON-2100051872-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:46:45.157913 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi [None req-be92eab8-ad0f-42d4-b518-46db2baad4ff tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Calling method '>' {{(pid=128728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 15:46:45.159663 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.compute.api [None req-be92eab8-ad0f-42d4-b518-46db2baad4ff tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] [instance: 563c74e0-060d-49d5-abc5-389cee4bd9d5] Fetching instance by UUID {{(pid=128728) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 15:46:45.172105 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-be92eab8-ad0f-42d4-b518-46db2baad4ff tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:46:45.175099 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-be92eab8-ad0f-42d4-b518-46db2baad4ff tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:46:45.180549 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-be92eab8-ad0f-42d4-b518-46db2baad4ff tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:46:45.181864 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-be92eab8-ad0f-42d4-b518-46db2baad4ff tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:46:45.342524 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.policy [None req-3604a970-1646-494f-8283-4c959c2ed8d5 tempest-DeleteServersTestJSON-2100051872 tempest-DeleteServersTestJSON-2100051872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aad828d8ff314a2d82f07fb6d84f36a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6388da70b0dc48c1952570af4332dd6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128729) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:46:45.363614 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: INFO nova.api.openstack.requestlog [None req-3604a970-1646-494f-8283-4c959c2ed8d5 tempest-DeleteServersTestJSON-2100051872 tempest-DeleteServersTestJSON-2100051872-project] 10.222.0.61 "GET /compute/v2.1/servers/75ca93de-6825-44ce-af10-44cba59218a1" status: 200 len: 1315 microversion: 2.1 time: 0.359904 May 14 15:46:45.368178 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: [pid: 128729|app: 0|req: 26/66] 10.222.0.61 () {58 vars in 1235 bytes} [Sat May 14 15:46:45 2022] GET /compute/v2.1/servers/75ca93de-6825-44ce-af10-44cba59218a1 => generated 1315 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 15:46:45.384669 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi [None req-6a6fb977-dacd-44b1-8e94-09f776d4735c tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] Calling method '>' {{(pid=128729) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 15:46:45.387826 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.compute.api [None req-6a6fb977-dacd-44b1-8e94-09f776d4735c tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] [instance: 113f6b52-519c-45f4-9bc2-37168d644e15] Fetching instance by UUID {{(pid=128729) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 15:46:45.397847 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-6a6fb977-dacd-44b1-8e94-09f776d4735c tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:46:45.398322 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-6a6fb977-dacd-44b1-8e94-09f776d4735c tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:46:45.407961 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-6a6fb977-dacd-44b1-8e94-09f776d4735c tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:46:45.408434 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-6a6fb977-dacd-44b1-8e94-09f776d4735c tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:46:45.573073 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.policy [None req-be92eab8-ad0f-42d4-b518-46db2baad4ff tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b896317d96a40d6a137db0dcf5f98f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d2517d5440a4d30949f3dd36a46d813', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128728) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:46:45.590498 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.policy [None req-6a6fb977-dacd-44b1-8e94-09f776d4735c tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc43895177134e9c9c030a9d87f94aaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7905689c95d44a5c9169249c70f7de57', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128729) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:46:45.594208 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: INFO nova.api.openstack.requestlog [None req-be92eab8-ad0f-42d4-b518-46db2baad4ff tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] 10.222.0.61 "GET /compute/v2.1/servers/563c74e0-060d-49d5-abc5-389cee4bd9d5" status: 200 len: 1321 microversion: 2.1 time: 0.432597 May 14 15:46:45.600814 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: [pid: 128728|app: 0|req: 41/67] 10.222.0.61 () {58 vars in 1235 bytes} [Sat May 14 15:46:45 2022] GET /compute/v2.1/servers/563c74e0-060d-49d5-abc5-389cee4bd9d5 => generated 1321 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 15:46:45.603084 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: INFO nova.api.openstack.requestlog [None req-6a6fb977-dacd-44b1-8e94-09f776d4735c tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] 10.222.0.61 "GET /compute/v2.1/servers/113f6b52-519c-45f4-9bc2-37168d644e15" status: 200 len: 1299 microversion: 2.1 time: 0.231078 May 14 15:46:45.608915 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: [pid: 128729|app: 0|req: 27/68] 10.222.0.61 () {58 vars in 1235 bytes} [Sat May 14 15:46:45 2022] GET /compute/v2.1/servers/113f6b52-519c-45f4-9bc2-37168d644e15 => generated 1299 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 15:46:45.618811 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi [req-1e71439b-d464-4935-99be-d9c9514bf868 req-b2a18357-1d0e-4668-a1a3-24021a6ed587 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9fbb269d-11cd-49ed-81ac-570e721c15cd", "tag": "3697c0c4-258d-43cd-a608-dec915d0b3e8"}]} {{(pid=128728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 15:46:45.653864 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [req-1e71439b-d464-4935-99be-d9c9514bf868 req-b2a18357-1d0e-4668-a1a3-24021a6ed587 service nova] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:46:45.654651 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [req-1e71439b-d464-4935-99be-d9c9514bf868 req-b2a18357-1d0e-4668-a1a3-24021a6ed587 service nova] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:46:45.683490 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: INFO nova.api.openstack.compute.server_external_events [req-1e71439b-d464-4935-99be-d9c9514bf868 req-b2a18357-1d0e-4668-a1a3-24021a6ed587 service nova] Creating event network-changed:3697c0c4-258d-43cd-a608-dec915d0b3e8 for instance 9fbb269d-11cd-49ed-81ac-570e721c15cd on hv-cinder-83979 May 14 15:46:45.684397 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [req-1e71439b-d464-4935-99be-d9c9514bf868 req-b2a18357-1d0e-4668-a1a3-24021a6ed587 service nova] Acquired lock "compute-rpcapi-router" {{(pid=128728) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} May 14 15:46:45.686686 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-5cd85391-5f58-45b5-a559-69c40f94f051 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:46:45.687604 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-5cd85391-5f58-45b5-a559-69c40f94f051 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:46:45.689184 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-5cd85391-5f58-45b5-a559-69c40f94f051 None None] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:46:45.689955 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-5cd85391-5f58-45b5-a559-69c40f94f051 None None] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:46:45.702947 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: INFO nova.compute.rpcapi [None req-5cd85391-5f58-45b5-a559-69c40f94f051 None None] Automatically selected compute RPC version 6.0 from minimum service version 61 May 14 15:46:45.704109 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-5cd85391-5f58-45b5-a559-69c40f94f051 None None] Releasing lock "compute-rpcapi-router" {{(pid=128728) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} May 14 15:46:45.738244 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: INFO nova.api.openstack.requestlog [None req-5cd85391-5f58-45b5-a559-69c40f94f051 None None] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.132959 May 14 15:46:45.740561 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: [pid: 128728|app: 0|req: 42/69] 10.222.0.61 () {64 vars in 1317 bytes} [Sat May 14 15:46:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 14 15:46:45.927909 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi [req-b5c7330b-76fe-4c1c-b9ad-f147b76c291c req-ede54091-c61f-4bc9-90be-cd7eda840fed service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "563c74e0-060d-49d5-abc5-389cee4bd9d5", "tag": "e71a293a-1d12-4e53-a116-f52bc19b1aa0"}]} {{(pid=128729) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 15:46:45.947881 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [req-b5c7330b-76fe-4c1c-b9ad-f147b76c291c req-ede54091-c61f-4bc9-90be-cd7eda840fed service nova] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:46:45.948369 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [req-b5c7330b-76fe-4c1c-b9ad-f147b76c291c req-ede54091-c61f-4bc9-90be-cd7eda840fed service nova] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:46:45.980901 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: INFO nova.api.openstack.compute.server_external_events [req-b5c7330b-76fe-4c1c-b9ad-f147b76c291c req-ede54091-c61f-4bc9-90be-cd7eda840fed service nova] Creating event network-changed:e71a293a-1d12-4e53-a116-f52bc19b1aa0 for instance 563c74e0-060d-49d5-abc5-389cee4bd9d5 on hv-cinder-83979 May 14 15:46:45.996451 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: INFO nova.api.openstack.requestlog [req-b5c7330b-76fe-4c1c-b9ad-f147b76c291c req-ede54091-c61f-4bc9-90be-cd7eda840fed service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.361224 May 14 15:46:46.003421 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: [pid: 128729|app: 0|req: 28/70] 10.222.0.61 () {64 vars in 1317 bytes} [Sat May 14 15:46:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 14 15:46:46.385307 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi [None req-07f15617-d666-4389-8ce7-f87ddf5948fa tempest-DeleteServersTestJSON-2100051872 tempest-DeleteServersTestJSON-2100051872-project] Calling method '>' {{(pid=128729) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 15:46:46.389698 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi [None req-545723a4-ec68-471b-bc4a-f0c2392e32c2 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-256415257", "imageRef": "1381e3d5-fc27-4fa7-ab03-5d86278a0546", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "d4128056-aa2b-474b-a7d3-2646c1ffdbcf"}], "security_groups": [{"name": "tempest-securitygroup--900799558"}], "key_name": "tempest-keypair-1822933638", "user_data": "}} {{(pid=128728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 15:46:46.390233 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.compute.api [None req-07f15617-d666-4389-8ce7-f87ddf5948fa tempest-DeleteServersTestJSON-2100051872 tempest-DeleteServersTestJSON-2100051872-project] [instance: 75ca93de-6825-44ce-af10-44cba59218a1] Fetching instance by UUID {{(pid=128729) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 15:46:46.409339 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-07f15617-d666-4389-8ce7-f87ddf5948fa tempest-DeleteServersTestJSON-2100051872 tempest-DeleteServersTestJSON-2100051872-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:46:46.409812 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-07f15617-d666-4389-8ce7-f87ddf5948fa tempest-DeleteServersTestJSON-2100051872 tempest-DeleteServersTestJSON-2100051872-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:46:46.410624 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-07f15617-d666-4389-8ce7-f87ddf5948fa tempest-DeleteServersTestJSON-2100051872 tempest-DeleteServersTestJSON-2100051872-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:46:46.418924 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-07f15617-d666-4389-8ce7-f87ddf5948fa tempest-DeleteServersTestJSON-2100051872 tempest-DeleteServersTestJSON-2100051872-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:46:46.699981 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.network.neutron [None req-545723a4-ec68-471b-bc4a-f0c2392e32c2 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] validate_networks() for [('d4128056-aa2b-474b-a7d3-2646c1ffdbcf', None, None, None, None, None)] {{(pid=128728) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 14 15:46:46.727644 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.policy [None req-07f15617-d666-4389-8ce7-f87ddf5948fa tempest-DeleteServersTestJSON-2100051872 tempest-DeleteServersTestJSON-2100051872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aad828d8ff314a2d82f07fb6d84f36a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6388da70b0dc48c1952570af4332dd6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128729) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:46:46.756310 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: INFO nova.api.openstack.requestlog [None req-07f15617-d666-4389-8ce7-f87ddf5948fa tempest-DeleteServersTestJSON-2100051872 tempest-DeleteServersTestJSON-2100051872-project] 10.222.0.61 "GET /compute/v2.1/servers/75ca93de-6825-44ce-af10-44cba59218a1" status: 200 len: 1315 microversion: 2.1 time: 0.374808 May 14 15:46:46.758146 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: [pid: 128729|app: 0|req: 29/71] 10.222.0.61 () {58 vars in 1235 bytes} [Sat May 14 15:46:46 2022] GET /compute/v2.1/servers/75ca93de-6825-44ce-af10-44cba59218a1 => generated 1315 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 15:46:46.769359 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi [None req-5ce6eaf0-5cf9-4d97-bc22-1ce30c195e26 tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Calling method '>' {{(pid=128729) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 15:46:46.771806 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.compute.api [None req-5ce6eaf0-5cf9-4d97-bc22-1ce30c195e26 tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] [instance: 563c74e0-060d-49d5-abc5-389cee4bd9d5] Fetching instance by UUID {{(pid=128729) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 15:46:46.787239 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-5ce6eaf0-5cf9-4d97-bc22-1ce30c195e26 tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:46:46.787979 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-5ce6eaf0-5cf9-4d97-bc22-1ce30c195e26 tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:46:46.792709 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-5ce6eaf0-5cf9-4d97-bc22-1ce30c195e26 tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:46:46.793355 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-5ce6eaf0-5cf9-4d97-bc22-1ce30c195e26 tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:46:47.179827 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.policy [None req-5ce6eaf0-5cf9-4d97-bc22-1ce30c195e26 tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b896317d96a40d6a137db0dcf5f98f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d2517d5440a4d30949f3dd36a46d813', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128729) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:46:47.189970 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: INFO nova.api.openstack.requestlog [None req-5ce6eaf0-5cf9-4d97-bc22-1ce30c195e26 tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] 10.222.0.61 "GET /compute/v2.1/servers/563c74e0-060d-49d5-abc5-389cee4bd9d5" status: 200 len: 1321 microversion: 2.1 time: 0.428744 May 14 15:46:47.191864 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: [pid: 128729|app: 0|req: 30/72] 10.222.0.61 () {58 vars in 1235 bytes} [Sat May 14 15:46:46 2022] GET /compute/v2.1/servers/563c74e0-060d-49d5-abc5-389cee4bd9d5 => generated 1321 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 15:46:47.196970 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi [None req-53aa4979-0ac7-4dd1-be5a-7217bac069f6 tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] Calling method '>' {{(pid=128729) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 15:46:47.197851 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.compute.api [None req-53aa4979-0ac7-4dd1-be5a-7217bac069f6 tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] [instance: 113f6b52-519c-45f4-9bc2-37168d644e15] Fetching instance by UUID {{(pid=128729) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 15:46:47.205863 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-53aa4979-0ac7-4dd1-be5a-7217bac069f6 tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:46:47.206541 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-53aa4979-0ac7-4dd1-be5a-7217bac069f6 tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:46:47.207960 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-53aa4979-0ac7-4dd1-be5a-7217bac069f6 tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:46:47.208584 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-53aa4979-0ac7-4dd1-be5a-7217bac069f6 tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:46:47.486671 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.policy [None req-53aa4979-0ac7-4dd1-be5a-7217bac069f6 tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc43895177134e9c9c030a9d87f94aaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7905689c95d44a5c9169249c70f7de57', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128729) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:46:47.494906 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: INFO nova.api.openstack.requestlog [None req-53aa4979-0ac7-4dd1-be5a-7217bac069f6 tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] 10.222.0.61 "GET /compute/v2.1/servers/113f6b52-519c-45f4-9bc2-37168d644e15" status: 200 len: 1366 microversion: 2.1 time: 0.301775 May 14 15:46:47.505895 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: [pid: 128729|app: 0|req: 31/73] 10.222.0.61 () {58 vars in 1235 bytes} [Sat May 14 15:46:47 2022] GET /compute/v2.1/servers/113f6b52-519c-45f4-9bc2-37168d644e15 => generated 1366 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 15:46:47.729476 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.virt.hardware [None req-545723a4-ec68-471b-bc4a-f0c2392e32c2 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Flavor limits 0:0:0 {{(pid=128728) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 14 15:46:47.729981 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.virt.hardware [None req-545723a4-ec68-471b-bc4a-f0c2392e32c2 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Image limits 0:0:0 {{(pid=128728) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 14 15:46:47.731118 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.virt.hardware [None req-545723a4-ec68-471b-bc4a-f0c2392e32c2 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Flavor pref 0:0:0 {{(pid=128728) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 14 15:46:47.731712 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.virt.hardware [None req-545723a4-ec68-471b-bc4a-f0c2392e32c2 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Image pref 0:0:0 {{(pid=128728) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 14 15:46:47.732498 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.virt.hardware [None req-545723a4-ec68-471b-bc4a-f0c2392e32c2 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128728) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 14 15:46:47.748797 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-545723a4-ec68-471b-bc4a-f0c2392e32c2 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:46:47.749268 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-545723a4-ec68-471b-bc4a-f0c2392e32c2 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:46:47.750099 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-545723a4-ec68-471b-bc4a-f0c2392e32c2 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:46:47.750562 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-545723a4-ec68-471b-bc4a-f0c2392e32c2 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:46:47.774187 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.quota [None req-545723a4-ec68-471b-bc4a-f0c2392e32c2 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Getting quotas for project 0672be3fa3f7414da1c1a5b7300abbe7. Resources: {'instances', 'cores', 'ram'} {{(pid=128728) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 14 15:46:47.774649 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi [None req-02f46a8e-6db8-45ad-826a-97184b4a2063 tempest-DeleteServersTestJSON-2100051872 tempest-DeleteServersTestJSON-2100051872-project] Calling method '>' {{(pid=128729) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 15:46:47.775266 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.compute.api [None req-02f46a8e-6db8-45ad-826a-97184b4a2063 tempest-DeleteServersTestJSON-2100051872 tempest-DeleteServersTestJSON-2100051872-project] [instance: 75ca93de-6825-44ce-af10-44cba59218a1] Fetching instance by UUID {{(pid=128729) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 15:46:47.779210 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.quota [None req-545723a4-ec68-471b-bc4a-f0c2392e32c2 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Getting quotas for user 58bfb7417bc94583963401ae0fe9d39a and project 0672be3fa3f7414da1c1a5b7300abbe7. Resources: {'instances', 'cores', 'ram'} {{(pid=128728) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 14 15:46:47.781445 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-02f46a8e-6db8-45ad-826a-97184b4a2063 tempest-DeleteServersTestJSON-2100051872 tempest-DeleteServersTestJSON-2100051872-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:46:47.781896 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-02f46a8e-6db8-45ad-826a-97184b4a2063 tempest-DeleteServersTestJSON-2100051872 tempest-DeleteServersTestJSON-2100051872-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:46:47.782709 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-02f46a8e-6db8-45ad-826a-97184b4a2063 tempest-DeleteServersTestJSON-2100051872 tempest-DeleteServersTestJSON-2100051872-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:46:47.783143 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-02f46a8e-6db8-45ad-826a-97184b4a2063 tempest-DeleteServersTestJSON-2100051872 tempest-DeleteServersTestJSON-2100051872-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:46:47.792706 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.compute.api [None req-545723a4-ec68-471b-bc4a-f0c2392e32c2 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Going to run 1 instances... {{(pid=128728) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 14 15:46:47.795736 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.compute.api [None req-545723a4-ec68-471b-bc4a-f0c2392e32c2 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] [instance: e33e9970-bfb7-46f3-8d40-782dbfa3d21c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='1381e3d5-fc27-4fa7-ab03-5d86278a0546',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128728) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 14 15:46:47.883213 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: INFO nova.api.openstack.requestlog [None req-545723a4-ec68-471b-bc4a-f0c2392e32c2 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] 10.222.0.61 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.20 time: 1.506051 May 14 15:46:47.884200 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: [pid: 128728|app: 0|req: 43/74] 10.222.0.61 () {62 vars in 1187 bytes} [Sat May 14 15:46:46 2022] POST /compute/v2.1/servers => generated 401 bytes in 1508 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) May 14 15:46:47.901942 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi [None req-72616738-ee12-4a6a-bc8d-6fb7704a281a tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Calling method '>' {{(pid=128728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 15:46:47.905430 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.compute.api [None req-72616738-ee12-4a6a-bc8d-6fb7704a281a tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] [instance: e33e9970-bfb7-46f3-8d40-782dbfa3d21c] Fetching instance by UUID {{(pid=128728) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 15:46:48.026422 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.policy [None req-72616738-ee12-4a6a-bc8d-6fb7704a281a tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58bfb7417bc94583963401ae0fe9d39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0672be3fa3f7414da1c1a5b7300abbe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128728) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:46:48.048559 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.policy [None req-72616738-ee12-4a6a-bc8d-6fb7704a281a tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58bfb7417bc94583963401ae0fe9d39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0672be3fa3f7414da1c1a5b7300abbe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128728) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:46:48.050433 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.policy [None req-72616738-ee12-4a6a-bc8d-6fb7704a281a tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58bfb7417bc94583963401ae0fe9d39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0672be3fa3f7414da1c1a5b7300abbe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128728) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:46:48.051573 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: INFO nova.api.openstack.requestlog [None req-72616738-ee12-4a6a-bc8d-6fb7704a281a tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] 10.222.0.61 "GET /compute/v2.1/servers/e33e9970-bfb7-46f3-8d40-782dbfa3d21c" status: 200 len: 1281 microversion: 2.20 time: 0.159698 May 14 15:46:48.056313 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: [pid: 128728|app: 0|req: 44/75] 10.222.0.61 () {60 vars in 1276 bytes} [Sat May 14 15:46:47 2022] GET /compute/v2.1/servers/e33e9970-bfb7-46f3-8d40-782dbfa3d21c => generated 1281 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 14 15:46:48.068599 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.policy [None req-02f46a8e-6db8-45ad-826a-97184b4a2063 tempest-DeleteServersTestJSON-2100051872 tempest-DeleteServersTestJSON-2100051872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aad828d8ff314a2d82f07fb6d84f36a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6388da70b0dc48c1952570af4332dd6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128729) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:46:48.093393 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: INFO nova.api.openstack.requestlog [None req-02f46a8e-6db8-45ad-826a-97184b4a2063 tempest-DeleteServersTestJSON-2100051872 tempest-DeleteServersTestJSON-2100051872-project] 10.222.0.61 "GET /compute/v2.1/servers/75ca93de-6825-44ce-af10-44cba59218a1" status: 200 len: 1315 microversion: 2.1 time: 0.321506 May 14 15:46:48.096210 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: [pid: 128729|app: 0|req: 32/76] 10.222.0.61 () {58 vars in 1235 bytes} [Sat May 14 15:46:47 2022] GET /compute/v2.1/servers/75ca93de-6825-44ce-af10-44cba59218a1 => generated 1315 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 15:46:48.209464 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi [None req-7c4c4fb2-511e-4a60-a101-3d9220b8e3cc tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Calling method '>' {{(pid=128728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 15:46:48.210410 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.compute.api [None req-7c4c4fb2-511e-4a60-a101-3d9220b8e3cc tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] [instance: 563c74e0-060d-49d5-abc5-389cee4bd9d5] Fetching instance by UUID {{(pid=128728) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 15:46:48.234053 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-7c4c4fb2-511e-4a60-a101-3d9220b8e3cc tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:46:48.236228 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-7c4c4fb2-511e-4a60-a101-3d9220b8e3cc tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:46:48.237034 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-7c4c4fb2-511e-4a60-a101-3d9220b8e3cc tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:46:48.240833 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-7c4c4fb2-511e-4a60-a101-3d9220b8e3cc tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:46:48.513132 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.policy [None req-7c4c4fb2-511e-4a60-a101-3d9220b8e3cc tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b896317d96a40d6a137db0dcf5f98f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d2517d5440a4d30949f3dd36a46d813', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128728) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:46:48.522438 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi [None req-9fd156ad-7a12-4c0e-9a5c-32a68fc5b5ac tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] Calling method '>' {{(pid=128729) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 15:46:48.523205 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.compute.api [None req-9fd156ad-7a12-4c0e-9a5c-32a68fc5b5ac tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] [instance: 113f6b52-519c-45f4-9bc2-37168d644e15] Fetching instance by UUID {{(pid=128729) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 15:46:48.532344 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: INFO nova.api.openstack.requestlog [None req-7c4c4fb2-511e-4a60-a101-3d9220b8e3cc tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] 10.222.0.61 "GET /compute/v2.1/servers/563c74e0-060d-49d5-abc5-389cee4bd9d5" status: 200 len: 1321 microversion: 2.1 time: 0.327083 May 14 15:46:48.544797 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-9fd156ad-7a12-4c0e-9a5c-32a68fc5b5ac tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:46:48.546144 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: [pid: 128728|app: 0|req: 45/77] 10.222.0.61 () {58 vars in 1235 bytes} [Sat May 14 15:46:48 2022] GET /compute/v2.1/servers/563c74e0-060d-49d5-abc5-389cee4bd9d5 => generated 1321 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 15:46:48.555299 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-9fd156ad-7a12-4c0e-9a5c-32a68fc5b5ac tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:46:48.555959 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-9fd156ad-7a12-4c0e-9a5c-32a68fc5b5ac tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:46:48.556454 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-9fd156ad-7a12-4c0e-9a5c-32a68fc5b5ac tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:46:48.858711 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.policy [None req-9fd156ad-7a12-4c0e-9a5c-32a68fc5b5ac tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc43895177134e9c9c030a9d87f94aaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7905689c95d44a5c9169249c70f7de57', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128729) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:46:48.878146 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: INFO nova.api.openstack.requestlog [None req-9fd156ad-7a12-4c0e-9a5c-32a68fc5b5ac tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] 10.222.0.61 "GET /compute/v2.1/servers/113f6b52-519c-45f4-9bc2-37168d644e15" status: 200 len: 1366 microversion: 2.1 time: 0.355839 May 14 15:46:48.879118 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: [pid: 128729|app: 0|req: 33/78] 10.222.0.61 () {58 vars in 1235 bytes} [Sat May 14 15:46:48 2022] GET /compute/v2.1/servers/113f6b52-519c-45f4-9bc2-37168d644e15 => generated 1366 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 15:46:49.076101 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi [None req-6493f7ef-c082-45b0-b8fd-ea36bea7f65a tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Calling method '>' {{(pid=128728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 15:46:49.076101 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.compute.api [None req-6493f7ef-c082-45b0-b8fd-ea36bea7f65a tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] [instance: e33e9970-bfb7-46f3-8d40-782dbfa3d21c] Fetching instance by UUID {{(pid=128728) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 15:46:49.087425 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-6493f7ef-c082-45b0-b8fd-ea36bea7f65a tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:46:49.088219 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-6493f7ef-c082-45b0-b8fd-ea36bea7f65a tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:46:49.090689 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-6493f7ef-c082-45b0-b8fd-ea36bea7f65a tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:46:49.091498 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-6493f7ef-c082-45b0-b8fd-ea36bea7f65a tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:46:49.123154 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi [None req-f63e744b-43ec-4949-bcd9-e07d8e14b1c6 tempest-DeleteServersTestJSON-2100051872 tempest-DeleteServersTestJSON-2100051872-project] Calling method '>' {{(pid=128729) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 15:46:49.123154 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.compute.api [None req-f63e744b-43ec-4949-bcd9-e07d8e14b1c6 tempest-DeleteServersTestJSON-2100051872 tempest-DeleteServersTestJSON-2100051872-project] [instance: 75ca93de-6825-44ce-af10-44cba59218a1] Fetching instance by UUID {{(pid=128729) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 15:46:49.128935 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-f63e744b-43ec-4949-bcd9-e07d8e14b1c6 tempest-DeleteServersTestJSON-2100051872 tempest-DeleteServersTestJSON-2100051872-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:46:49.129393 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-f63e744b-43ec-4949-bcd9-e07d8e14b1c6 tempest-DeleteServersTestJSON-2100051872 tempest-DeleteServersTestJSON-2100051872-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:46:49.130286 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-f63e744b-43ec-4949-bcd9-e07d8e14b1c6 tempest-DeleteServersTestJSON-2100051872 tempest-DeleteServersTestJSON-2100051872-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:46:49.131104 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-f63e744b-43ec-4949-bcd9-e07d8e14b1c6 tempest-DeleteServersTestJSON-2100051872 tempest-DeleteServersTestJSON-2100051872-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:46:49.201545 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.policy [None req-6493f7ef-c082-45b0-b8fd-ea36bea7f65a tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58bfb7417bc94583963401ae0fe9d39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0672be3fa3f7414da1c1a5b7300abbe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128728) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:46:49.213294 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.policy [None req-6493f7ef-c082-45b0-b8fd-ea36bea7f65a tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58bfb7417bc94583963401ae0fe9d39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0672be3fa3f7414da1c1a5b7300abbe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128728) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:46:49.224124 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.policy [None req-6493f7ef-c082-45b0-b8fd-ea36bea7f65a tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58bfb7417bc94583963401ae0fe9d39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0672be3fa3f7414da1c1a5b7300abbe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128728) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:46:49.225780 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: INFO nova.api.openstack.requestlog [None req-6493f7ef-c082-45b0-b8fd-ea36bea7f65a tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] 10.222.0.61 "GET /compute/v2.1/servers/e33e9970-bfb7-46f3-8d40-782dbfa3d21c" status: 200 len: 1285 microversion: 2.20 time: 0.158466 May 14 15:46:49.229288 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: [pid: 128728|app: 0|req: 46/79] 10.222.0.61 () {60 vars in 1276 bytes} [Sat May 14 15:46:49 2022] GET /compute/v2.1/servers/e33e9970-bfb7-46f3-8d40-782dbfa3d21c => generated 1285 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 14 15:46:49.463610 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.policy [None req-f63e744b-43ec-4949-bcd9-e07d8e14b1c6 tempest-DeleteServersTestJSON-2100051872 tempest-DeleteServersTestJSON-2100051872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aad828d8ff314a2d82f07fb6d84f36a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6388da70b0dc48c1952570af4332dd6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128729) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:46:49.476199 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: INFO nova.api.openstack.requestlog [None req-f63e744b-43ec-4949-bcd9-e07d8e14b1c6 tempest-DeleteServersTestJSON-2100051872 tempest-DeleteServersTestJSON-2100051872-project] 10.222.0.61 "GET /compute/v2.1/servers/75ca93de-6825-44ce-af10-44cba59218a1" status: 200 len: 1315 microversion: 2.1 time: 0.363612 May 14 15:46:49.478664 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: [pid: 128729|app: 0|req: 34/80] 10.222.0.61 () {58 vars in 1235 bytes} [Sat May 14 15:46:49 2022] GET /compute/v2.1/servers/75ca93de-6825-44ce-af10-44cba59218a1 => generated 1315 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 15:46:49.563602 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi [None req-a836b0e5-974e-4e85-b210-d6400acaa65b tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Calling method '>' {{(pid=128728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 15:46:49.564888 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.compute.api [None req-a836b0e5-974e-4e85-b210-d6400acaa65b tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] [instance: 563c74e0-060d-49d5-abc5-389cee4bd9d5] Fetching instance by UUID {{(pid=128728) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 15:46:49.574069 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-a836b0e5-974e-4e85-b210-d6400acaa65b tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:46:49.575092 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-a836b0e5-974e-4e85-b210-d6400acaa65b tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:46:49.581347 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-a836b0e5-974e-4e85-b210-d6400acaa65b tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:46:49.581819 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-a836b0e5-974e-4e85-b210-d6400acaa65b tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:46:49.820152 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.policy [None req-a836b0e5-974e-4e85-b210-d6400acaa65b tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b896317d96a40d6a137db0dcf5f98f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d2517d5440a4d30949f3dd36a46d813', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128728) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:46:49.827791 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: INFO nova.api.openstack.requestlog [None req-a836b0e5-974e-4e85-b210-d6400acaa65b tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] 10.222.0.61 "GET /compute/v2.1/servers/563c74e0-060d-49d5-abc5-389cee4bd9d5" status: 200 len: 1321 microversion: 2.1 time: 0.269104 May 14 15:46:49.828831 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: [pid: 128728|app: 0|req: 47/81] 10.222.0.61 () {58 vars in 1235 bytes} [Sat May 14 15:46:49 2022] GET /compute/v2.1/servers/563c74e0-060d-49d5-abc5-389cee4bd9d5 => generated 1321 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 15:46:49.895141 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi [None req-5fa21fbf-7d01-4724-9573-d4d48a3f1ac4 tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] Calling method '>' {{(pid=128729) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 15:46:49.895751 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.compute.api [None req-5fa21fbf-7d01-4724-9573-d4d48a3f1ac4 tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] [instance: 113f6b52-519c-45f4-9bc2-37168d644e15] Fetching instance by UUID {{(pid=128729) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 15:46:49.902232 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-5fa21fbf-7d01-4724-9573-d4d48a3f1ac4 tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:46:49.903135 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-5fa21fbf-7d01-4724-9573-d4d48a3f1ac4 tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:46:49.903918 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-5fa21fbf-7d01-4724-9573-d4d48a3f1ac4 tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:46:49.904364 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-5fa21fbf-7d01-4724-9573-d4d48a3f1ac4 tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:46:50.057419 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.policy [None req-5fa21fbf-7d01-4724-9573-d4d48a3f1ac4 tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc43895177134e9c9c030a9d87f94aaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7905689c95d44a5c9169249c70f7de57', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128729) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:46:50.071044 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: INFO nova.api.openstack.requestlog [None req-5fa21fbf-7d01-4724-9573-d4d48a3f1ac4 tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] 10.222.0.61 "GET /compute/v2.1/servers/113f6b52-519c-45f4-9bc2-37168d644e15" status: 200 len: 1366 microversion: 2.1 time: 0.179690 May 14 15:46:50.071621 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: [pid: 128729|app: 0|req: 35/82] 10.222.0.61 () {58 vars in 1235 bytes} [Sat May 14 15:46:49 2022] GET /compute/v2.1/servers/113f6b52-519c-45f4-9bc2-37168d644e15 => generated 1366 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 15:46:50.247958 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi [None req-a62563c0-82ac-48e9-821c-f4385c2ceea8 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Calling method '>' {{(pid=128728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 15:46:50.248500 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.compute.api [None req-a62563c0-82ac-48e9-821c-f4385c2ceea8 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] [instance: e33e9970-bfb7-46f3-8d40-782dbfa3d21c] Fetching instance by UUID {{(pid=128728) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 15:46:50.254151 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-a62563c0-82ac-48e9-821c-f4385c2ceea8 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:46:50.254631 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-a62563c0-82ac-48e9-821c-f4385c2ceea8 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:46:50.255690 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-a62563c0-82ac-48e9-821c-f4385c2ceea8 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:46:50.256195 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-a62563c0-82ac-48e9-821c-f4385c2ceea8 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:46:50.321564 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.policy [None req-a62563c0-82ac-48e9-821c-f4385c2ceea8 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58bfb7417bc94583963401ae0fe9d39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0672be3fa3f7414da1c1a5b7300abbe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128728) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:46:50.330425 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.policy [None req-a62563c0-82ac-48e9-821c-f4385c2ceea8 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58bfb7417bc94583963401ae0fe9d39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0672be3fa3f7414da1c1a5b7300abbe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128728) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:46:50.332391 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.policy [None req-a62563c0-82ac-48e9-821c-f4385c2ceea8 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58bfb7417bc94583963401ae0fe9d39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0672be3fa3f7414da1c1a5b7300abbe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128728) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:46:50.333799 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: INFO nova.api.openstack.requestlog [None req-a62563c0-82ac-48e9-821c-f4385c2ceea8 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] 10.222.0.61 "GET /compute/v2.1/servers/e33e9970-bfb7-46f3-8d40-782dbfa3d21c" status: 200 len: 1285 microversion: 2.20 time: 0.090504 May 14 15:46:50.334598 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: [pid: 128728|app: 0|req: 48/83] 10.222.0.61 () {60 vars in 1276 bytes} [Sat May 14 15:46:50 2022] GET /compute/v2.1/servers/e33e9970-bfb7-46f3-8d40-782dbfa3d21c => generated 1285 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 14 15:46:50.497311 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi [None req-238067aa-6cce-4df6-af8c-51cf0eae99e7 tempest-DeleteServersTestJSON-2100051872 tempest-DeleteServersTestJSON-2100051872-project] Calling method '>' {{(pid=128729) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 15:46:50.498790 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.compute.api [None req-238067aa-6cce-4df6-af8c-51cf0eae99e7 tempest-DeleteServersTestJSON-2100051872 tempest-DeleteServersTestJSON-2100051872-project] [instance: 75ca93de-6825-44ce-af10-44cba59218a1] Fetching instance by UUID {{(pid=128729) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 15:46:50.508119 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-238067aa-6cce-4df6-af8c-51cf0eae99e7 tempest-DeleteServersTestJSON-2100051872 tempest-DeleteServersTestJSON-2100051872-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:46:50.508916 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-238067aa-6cce-4df6-af8c-51cf0eae99e7 tempest-DeleteServersTestJSON-2100051872 tempest-DeleteServersTestJSON-2100051872-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:46:50.509904 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-238067aa-6cce-4df6-af8c-51cf0eae99e7 tempest-DeleteServersTestJSON-2100051872 tempest-DeleteServersTestJSON-2100051872-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:46:50.510626 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-238067aa-6cce-4df6-af8c-51cf0eae99e7 tempest-DeleteServersTestJSON-2100051872 tempest-DeleteServersTestJSON-2100051872-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:46:50.696711 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.policy [None req-238067aa-6cce-4df6-af8c-51cf0eae99e7 tempest-DeleteServersTestJSON-2100051872 tempest-DeleteServersTestJSON-2100051872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aad828d8ff314a2d82f07fb6d84f36a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6388da70b0dc48c1952570af4332dd6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128729) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:46:50.705500 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: INFO nova.api.openstack.requestlog [None req-238067aa-6cce-4df6-af8c-51cf0eae99e7 tempest-DeleteServersTestJSON-2100051872 tempest-DeleteServersTestJSON-2100051872-project] 10.222.0.61 "GET /compute/v2.1/servers/75ca93de-6825-44ce-af10-44cba59218a1" status: 200 len: 1315 microversion: 2.1 time: 0.213697 May 14 15:46:50.706211 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: [pid: 128729|app: 0|req: 36/84] 10.222.0.61 () {58 vars in 1235 bytes} [Sat May 14 15:46:50 2022] GET /compute/v2.1/servers/75ca93de-6825-44ce-af10-44cba59218a1 => generated 1315 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 15:46:50.847116 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi [None req-3b24ae3d-c2b1-42e4-a3c2-167172bd563c tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Calling method '>' {{(pid=128728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 15:46:50.847721 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.compute.api [None req-3b24ae3d-c2b1-42e4-a3c2-167172bd563c tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] [instance: 563c74e0-060d-49d5-abc5-389cee4bd9d5] Fetching instance by UUID {{(pid=128728) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 15:46:50.853500 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-3b24ae3d-c2b1-42e4-a3c2-167172bd563c tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:46:50.853955 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-3b24ae3d-c2b1-42e4-a3c2-167172bd563c tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:46:50.854792 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-3b24ae3d-c2b1-42e4-a3c2-167172bd563c tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:46:50.855236 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-3b24ae3d-c2b1-42e4-a3c2-167172bd563c tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:46:50.988317 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.policy [None req-3b24ae3d-c2b1-42e4-a3c2-167172bd563c tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b896317d96a40d6a137db0dcf5f98f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d2517d5440a4d30949f3dd36a46d813', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128728) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:46:50.995709 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: INFO nova.api.openstack.requestlog [None req-3b24ae3d-c2b1-42e4-a3c2-167172bd563c tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] 10.222.0.61 "GET /compute/v2.1/servers/563c74e0-060d-49d5-abc5-389cee4bd9d5" status: 200 len: 1321 microversion: 2.1 time: 0.154595 May 14 15:46:50.996463 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: [pid: 128728|app: 0|req: 49/85] 10.222.0.61 () {58 vars in 1235 bytes} [Sat May 14 15:46:50 2022] GET /compute/v2.1/servers/563c74e0-060d-49d5-abc5-389cee4bd9d5 => generated 1321 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 15:46:51.088340 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi [None req-316db7e6-60a0-4123-8779-a1668b714ce2 tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] Calling method '>' {{(pid=128729) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 15:46:51.088952 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.compute.api [None req-316db7e6-60a0-4123-8779-a1668b714ce2 tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] [instance: 113f6b52-519c-45f4-9bc2-37168d644e15] Fetching instance by UUID {{(pid=128729) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 15:46:51.095204 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-316db7e6-60a0-4123-8779-a1668b714ce2 tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:46:51.095686 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-316db7e6-60a0-4123-8779-a1668b714ce2 tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:46:51.096447 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-316db7e6-60a0-4123-8779-a1668b714ce2 tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:46:51.096881 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-316db7e6-60a0-4123-8779-a1668b714ce2 tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:46:51.227574 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.policy [None req-316db7e6-60a0-4123-8779-a1668b714ce2 tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc43895177134e9c9c030a9d87f94aaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7905689c95d44a5c9169249c70f7de57', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128729) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:46:51.236442 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: INFO nova.api.openstack.requestlog [None req-316db7e6-60a0-4123-8779-a1668b714ce2 tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] 10.222.0.61 "GET /compute/v2.1/servers/113f6b52-519c-45f4-9bc2-37168d644e15" status: 200 len: 1366 microversion: 2.1 time: 0.152576 May 14 15:46:51.237021 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: [pid: 128729|app: 0|req: 37/86] 10.222.0.61 () {58 vars in 1235 bytes} [Sat May 14 15:46:51 2022] GET /compute/v2.1/servers/113f6b52-519c-45f4-9bc2-37168d644e15 => generated 1366 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 15:46:51.352026 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi [None req-d7360e21-545f-45bb-b2f4-0c5ceeb8d786 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Calling method '>' {{(pid=128728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 15:46:51.352645 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.compute.api [None req-d7360e21-545f-45bb-b2f4-0c5ceeb8d786 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] [instance: e33e9970-bfb7-46f3-8d40-782dbfa3d21c] Fetching instance by UUID {{(pid=128728) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 15:46:51.359705 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-d7360e21-545f-45bb-b2f4-0c5ceeb8d786 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:46:51.360164 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-d7360e21-545f-45bb-b2f4-0c5ceeb8d786 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:46:51.361215 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-d7360e21-545f-45bb-b2f4-0c5ceeb8d786 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:46:51.361736 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-d7360e21-545f-45bb-b2f4-0c5ceeb8d786 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:46:51.421912 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.policy [None req-d7360e21-545f-45bb-b2f4-0c5ceeb8d786 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58bfb7417bc94583963401ae0fe9d39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0672be3fa3f7414da1c1a5b7300abbe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128728) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:46:51.430228 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.policy [None req-d7360e21-545f-45bb-b2f4-0c5ceeb8d786 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58bfb7417bc94583963401ae0fe9d39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0672be3fa3f7414da1c1a5b7300abbe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128728) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:46:51.431777 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.policy [None req-d7360e21-545f-45bb-b2f4-0c5ceeb8d786 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58bfb7417bc94583963401ae0fe9d39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0672be3fa3f7414da1c1a5b7300abbe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128728) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:46:51.432945 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: INFO nova.api.openstack.requestlog [None req-d7360e21-545f-45bb-b2f4-0c5ceeb8d786 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] 10.222.0.61 "GET /compute/v2.1/servers/e33e9970-bfb7-46f3-8d40-782dbfa3d21c" status: 200 len: 1285 microversion: 2.20 time: 0.085012 May 14 15:46:51.433510 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: [pid: 128728|app: 0|req: 50/87] 10.222.0.61 () {60 vars in 1276 bytes} [Sat May 14 15:46:51 2022] GET /compute/v2.1/servers/e33e9970-bfb7-46f3-8d40-782dbfa3d21c => generated 1285 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 14 15:46:51.722568 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi [None req-cfeed877-df19-419e-9ed8-ad008ef5df6d tempest-DeleteServersTestJSON-2100051872 tempest-DeleteServersTestJSON-2100051872-project] Calling method '>' {{(pid=128729) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 15:46:51.723164 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.compute.api [None req-cfeed877-df19-419e-9ed8-ad008ef5df6d tempest-DeleteServersTestJSON-2100051872 tempest-DeleteServersTestJSON-2100051872-project] [instance: 75ca93de-6825-44ce-af10-44cba59218a1] Fetching instance by UUID {{(pid=128729) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 15:46:51.729466 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-cfeed877-df19-419e-9ed8-ad008ef5df6d tempest-DeleteServersTestJSON-2100051872 tempest-DeleteServersTestJSON-2100051872-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:46:51.730631 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-cfeed877-df19-419e-9ed8-ad008ef5df6d tempest-DeleteServersTestJSON-2100051872 tempest-DeleteServersTestJSON-2100051872-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:46:51.731855 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-cfeed877-df19-419e-9ed8-ad008ef5df6d tempest-DeleteServersTestJSON-2100051872 tempest-DeleteServersTestJSON-2100051872-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:46:51.732365 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-cfeed877-df19-419e-9ed8-ad008ef5df6d tempest-DeleteServersTestJSON-2100051872 tempest-DeleteServersTestJSON-2100051872-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:46:51.864197 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.policy [None req-cfeed877-df19-419e-9ed8-ad008ef5df6d tempest-DeleteServersTestJSON-2100051872 tempest-DeleteServersTestJSON-2100051872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aad828d8ff314a2d82f07fb6d84f36a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6388da70b0dc48c1952570af4332dd6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128729) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:46:51.869908 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: INFO nova.api.openstack.requestlog [None req-cfeed877-df19-419e-9ed8-ad008ef5df6d tempest-DeleteServersTestJSON-2100051872 tempest-DeleteServersTestJSON-2100051872-project] 10.222.0.61 "GET /compute/v2.1/servers/75ca93de-6825-44ce-af10-44cba59218a1" status: 200 len: 1315 microversion: 2.1 time: 0.151045 May 14 15:46:51.871120 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: [pid: 128729|app: 0|req: 38/88] 10.222.0.61 () {58 vars in 1235 bytes} [Sat May 14 15:46:51 2022] GET /compute/v2.1/servers/75ca93de-6825-44ce-af10-44cba59218a1 => generated 1315 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 15:46:52.012247 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi [None req-352573fa-eef4-4a2d-a993-7d76cca123c1 tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Calling method '>' {{(pid=128728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 15:46:52.012851 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.compute.api [None req-352573fa-eef4-4a2d-a993-7d76cca123c1 tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] [instance: 563c74e0-060d-49d5-abc5-389cee4bd9d5] Fetching instance by UUID {{(pid=128728) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 15:46:52.018533 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-352573fa-eef4-4a2d-a993-7d76cca123c1 tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:46:52.018979 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-352573fa-eef4-4a2d-a993-7d76cca123c1 tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:46:52.019843 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-352573fa-eef4-4a2d-a993-7d76cca123c1 tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:46:52.020284 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-352573fa-eef4-4a2d-a993-7d76cca123c1 tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:46:52.155682 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.policy [None req-352573fa-eef4-4a2d-a993-7d76cca123c1 tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b896317d96a40d6a137db0dcf5f98f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d2517d5440a4d30949f3dd36a46d813', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128728) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:46:52.162898 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: INFO nova.api.openstack.requestlog [None req-352573fa-eef4-4a2d-a993-7d76cca123c1 tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] 10.222.0.61 "GET /compute/v2.1/servers/563c74e0-060d-49d5-abc5-389cee4bd9d5" status: 200 len: 1321 microversion: 2.1 time: 0.154586 May 14 15:46:52.163469 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: [pid: 128728|app: 0|req: 51/89] 10.222.0.61 () {58 vars in 1235 bytes} [Sat May 14 15:46:52 2022] GET /compute/v2.1/servers/563c74e0-060d-49d5-abc5-389cee4bd9d5 => generated 1321 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 15:46:52.254259 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi [None req-8873260b-e455-42f2-a9b3-895bcbb97851 tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] Calling method '>' {{(pid=128729) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 15:46:52.254889 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.compute.api [None req-8873260b-e455-42f2-a9b3-895bcbb97851 tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] [instance: 113f6b52-519c-45f4-9bc2-37168d644e15] Fetching instance by UUID {{(pid=128729) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 15:46:52.260528 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-8873260b-e455-42f2-a9b3-895bcbb97851 tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:46:52.261635 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-8873260b-e455-42f2-a9b3-895bcbb97851 tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:46:52.262524 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-8873260b-e455-42f2-a9b3-895bcbb97851 tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:46:52.262989 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-8873260b-e455-42f2-a9b3-895bcbb97851 tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:46:52.389678 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.policy [None req-8873260b-e455-42f2-a9b3-895bcbb97851 tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc43895177134e9c9c030a9d87f94aaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7905689c95d44a5c9169249c70f7de57', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128729) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:46:52.397702 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: INFO nova.api.openstack.requestlog [None req-8873260b-e455-42f2-a9b3-895bcbb97851 tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] 10.222.0.61 "GET /compute/v2.1/servers/113f6b52-519c-45f4-9bc2-37168d644e15" status: 200 len: 1366 microversion: 2.1 time: 0.147230 May 14 15:46:52.398603 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: [pid: 128729|app: 0|req: 39/90] 10.222.0.61 () {58 vars in 1235 bytes} [Sat May 14 15:46:52 2022] GET /compute/v2.1/servers/113f6b52-519c-45f4-9bc2-37168d644e15 => generated 1366 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 15:46:52.450010 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi [None req-e145020a-67c0-40a3-8a62-6a68d650b4b2 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Calling method '>' {{(pid=128728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 15:46:52.450646 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.compute.api [None req-e145020a-67c0-40a3-8a62-6a68d650b4b2 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] [instance: e33e9970-bfb7-46f3-8d40-782dbfa3d21c] Fetching instance by UUID {{(pid=128728) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 15:46:52.456394 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-e145020a-67c0-40a3-8a62-6a68d650b4b2 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:46:52.456848 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-e145020a-67c0-40a3-8a62-6a68d650b4b2 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:46:52.457617 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-e145020a-67c0-40a3-8a62-6a68d650b4b2 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:46:52.458058 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-e145020a-67c0-40a3-8a62-6a68d650b4b2 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:46:52.521451 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.policy [None req-e145020a-67c0-40a3-8a62-6a68d650b4b2 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58bfb7417bc94583963401ae0fe9d39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0672be3fa3f7414da1c1a5b7300abbe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128728) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:46:52.529401 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.policy [None req-e145020a-67c0-40a3-8a62-6a68d650b4b2 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58bfb7417bc94583963401ae0fe9d39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0672be3fa3f7414da1c1a5b7300abbe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128728) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:46:52.530958 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.policy [None req-e145020a-67c0-40a3-8a62-6a68d650b4b2 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58bfb7417bc94583963401ae0fe9d39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0672be3fa3f7414da1c1a5b7300abbe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128728) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:46:52.532110 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: INFO nova.api.openstack.requestlog [None req-e145020a-67c0-40a3-8a62-6a68d650b4b2 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] 10.222.0.61 "GET /compute/v2.1/servers/e33e9970-bfb7-46f3-8d40-782dbfa3d21c" status: 200 len: 1285 microversion: 2.20 time: 0.085997 May 14 15:46:52.532775 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: [pid: 128728|app: 0|req: 52/91] 10.222.0.61 () {60 vars in 1276 bytes} [Sat May 14 15:46:52 2022] GET /compute/v2.1/servers/e33e9970-bfb7-46f3-8d40-782dbfa3d21c => generated 1285 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 14 15:46:52.887684 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi [None req-9a0c0619-c405-497c-a017-d8330afc974c tempest-DeleteServersTestJSON-2100051872 tempest-DeleteServersTestJSON-2100051872-project] Calling method '>' {{(pid=128729) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 15:46:52.888289 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.compute.api [None req-9a0c0619-c405-497c-a017-d8330afc974c tempest-DeleteServersTestJSON-2100051872 tempest-DeleteServersTestJSON-2100051872-project] [instance: 75ca93de-6825-44ce-af10-44cba59218a1] Fetching instance by UUID {{(pid=128729) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 15:46:52.894155 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-9a0c0619-c405-497c-a017-d8330afc974c tempest-DeleteServersTestJSON-2100051872 tempest-DeleteServersTestJSON-2100051872-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:46:52.894697 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-9a0c0619-c405-497c-a017-d8330afc974c tempest-DeleteServersTestJSON-2100051872 tempest-DeleteServersTestJSON-2100051872-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:46:52.895456 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-9a0c0619-c405-497c-a017-d8330afc974c tempest-DeleteServersTestJSON-2100051872 tempest-DeleteServersTestJSON-2100051872-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:46:52.895889 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-9a0c0619-c405-497c-a017-d8330afc974c tempest-DeleteServersTestJSON-2100051872 tempest-DeleteServersTestJSON-2100051872-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:46:53.020972 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.policy [None req-9a0c0619-c405-497c-a017-d8330afc974c tempest-DeleteServersTestJSON-2100051872 tempest-DeleteServersTestJSON-2100051872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aad828d8ff314a2d82f07fb6d84f36a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6388da70b0dc48c1952570af4332dd6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128729) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:46:53.028747 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: INFO nova.api.openstack.requestlog [None req-9a0c0619-c405-497c-a017-d8330afc974c tempest-DeleteServersTestJSON-2100051872 tempest-DeleteServersTestJSON-2100051872-project] 10.222.0.61 "GET /compute/v2.1/servers/75ca93de-6825-44ce-af10-44cba59218a1" status: 200 len: 1315 microversion: 2.1 time: 0.145041 May 14 15:46:53.029305 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: [pid: 128729|app: 0|req: 40/92] 10.222.0.61 () {58 vars in 1235 bytes} [Sat May 14 15:46:52 2022] GET /compute/v2.1/servers/75ca93de-6825-44ce-af10-44cba59218a1 => generated 1315 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 15:46:53.180453 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi [None req-be03e364-7c73-4a33-8f20-cc9b84878da8 tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Calling method '>' {{(pid=128728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 15:46:53.180985 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.compute.api [None req-be03e364-7c73-4a33-8f20-cc9b84878da8 tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] [instance: 563c74e0-060d-49d5-abc5-389cee4bd9d5] Fetching instance by UUID {{(pid=128728) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 15:46:53.190352 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-be03e364-7c73-4a33-8f20-cc9b84878da8 tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:46:53.190807 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-be03e364-7c73-4a33-8f20-cc9b84878da8 tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:46:53.191577 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-be03e364-7c73-4a33-8f20-cc9b84878da8 tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:46:53.192041 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-be03e364-7c73-4a33-8f20-cc9b84878da8 tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:46:53.325564 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.policy [None req-be03e364-7c73-4a33-8f20-cc9b84878da8 tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b896317d96a40d6a137db0dcf5f98f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d2517d5440a4d30949f3dd36a46d813', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128728) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:46:53.332649 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: INFO nova.api.openstack.requestlog [None req-be03e364-7c73-4a33-8f20-cc9b84878da8 tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] 10.222.0.61 "GET /compute/v2.1/servers/563c74e0-060d-49d5-abc5-389cee4bd9d5" status: 200 len: 1321 microversion: 2.1 time: 0.156087 May 14 15:46:53.333212 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: [pid: 128728|app: 0|req: 53/93] 10.222.0.61 () {58 vars in 1235 bytes} [Sat May 14 15:46:53 2022] GET /compute/v2.1/servers/563c74e0-060d-49d5-abc5-389cee4bd9d5 => generated 1321 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 15:46:53.414600 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi [None req-07f397ab-7e0b-4dbd-b9dc-28dba2fe2202 tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] Calling method '>' {{(pid=128729) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 15:46:53.415240 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.compute.api [None req-07f397ab-7e0b-4dbd-b9dc-28dba2fe2202 tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] [instance: 113f6b52-519c-45f4-9bc2-37168d644e15] Fetching instance by UUID {{(pid=128729) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 15:46:53.421162 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-07f397ab-7e0b-4dbd-b9dc-28dba2fe2202 tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:46:53.421610 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-07f397ab-7e0b-4dbd-b9dc-28dba2fe2202 tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:46:53.422398 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-07f397ab-7e0b-4dbd-b9dc-28dba2fe2202 tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:46:53.422839 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-07f397ab-7e0b-4dbd-b9dc-28dba2fe2202 tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:46:53.550064 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.policy [None req-07f397ab-7e0b-4dbd-b9dc-28dba2fe2202 tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc43895177134e9c9c030a9d87f94aaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7905689c95d44a5c9169249c70f7de57', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128729) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:46:53.550544 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi [None req-5cb53e70-0bc4-4cf4-9f3b-e309debfa6d9 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Calling method '>' {{(pid=128728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 15:46:53.551150 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.compute.api [None req-5cb53e70-0bc4-4cf4-9f3b-e309debfa6d9 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] [instance: e33e9970-bfb7-46f3-8d40-782dbfa3d21c] Fetching instance by UUID {{(pid=128728) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 15:46:53.557040 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-5cb53e70-0bc4-4cf4-9f3b-e309debfa6d9 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:46:53.557242 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: INFO nova.api.openstack.requestlog [None req-07f397ab-7e0b-4dbd-b9dc-28dba2fe2202 tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] 10.222.0.61 "GET /compute/v2.1/servers/113f6b52-519c-45f4-9bc2-37168d644e15" status: 200 len: 1366 microversion: 2.1 time: 0.146522 May 14 15:46:53.557485 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-5cb53e70-0bc4-4cf4-9f3b-e309debfa6d9 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:46:53.558335 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: [pid: 128729|app: 0|req: 41/94] 10.222.0.61 () {58 vars in 1235 bytes} [Sat May 14 15:46:53 2022] GET /compute/v2.1/servers/113f6b52-519c-45f4-9bc2-37168d644e15 => generated 1366 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 15:46:53.558779 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-5cb53e70-0bc4-4cf4-9f3b-e309debfa6d9 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:46:53.559289 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-5cb53e70-0bc4-4cf4-9f3b-e309debfa6d9 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:46:53.619024 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.policy [None req-5cb53e70-0bc4-4cf4-9f3b-e309debfa6d9 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58bfb7417bc94583963401ae0fe9d39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0672be3fa3f7414da1c1a5b7300abbe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128728) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:46:53.626875 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.policy [None req-5cb53e70-0bc4-4cf4-9f3b-e309debfa6d9 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58bfb7417bc94583963401ae0fe9d39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0672be3fa3f7414da1c1a5b7300abbe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128728) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:46:53.628403 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.policy [None req-5cb53e70-0bc4-4cf4-9f3b-e309debfa6d9 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58bfb7417bc94583963401ae0fe9d39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0672be3fa3f7414da1c1a5b7300abbe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128728) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:46:53.629486 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: INFO nova.api.openstack.requestlog [None req-5cb53e70-0bc4-4cf4-9f3b-e309debfa6d9 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] 10.222.0.61 "GET /compute/v2.1/servers/e33e9970-bfb7-46f3-8d40-782dbfa3d21c" status: 200 len: 1285 microversion: 2.20 time: 0.082812 May 14 15:46:53.630035 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: [pid: 128728|app: 0|req: 54/95] 10.222.0.61 () {60 vars in 1276 bytes} [Sat May 14 15:46:53 2022] GET /compute/v2.1/servers/e33e9970-bfb7-46f3-8d40-782dbfa3d21c => generated 1285 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 14 15:46:54.045248 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi [None req-c4d3845f-54b3-420e-8086-0a8708dcefbd tempest-DeleteServersTestJSON-2100051872 tempest-DeleteServersTestJSON-2100051872-project] Calling method '>' {{(pid=128729) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 15:46:54.045809 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.compute.api [None req-c4d3845f-54b3-420e-8086-0a8708dcefbd tempest-DeleteServersTestJSON-2100051872 tempest-DeleteServersTestJSON-2100051872-project] [instance: 75ca93de-6825-44ce-af10-44cba59218a1] Fetching instance by UUID {{(pid=128729) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 15:46:54.051748 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-c4d3845f-54b3-420e-8086-0a8708dcefbd tempest-DeleteServersTestJSON-2100051872 tempest-DeleteServersTestJSON-2100051872-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:46:54.052194 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-c4d3845f-54b3-420e-8086-0a8708dcefbd tempest-DeleteServersTestJSON-2100051872 tempest-DeleteServersTestJSON-2100051872-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:46:54.052956 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-c4d3845f-54b3-420e-8086-0a8708dcefbd tempest-DeleteServersTestJSON-2100051872 tempest-DeleteServersTestJSON-2100051872-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:46:54.053390 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-c4d3845f-54b3-420e-8086-0a8708dcefbd tempest-DeleteServersTestJSON-2100051872 tempest-DeleteServersTestJSON-2100051872-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:46:54.178194 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.policy [None req-c4d3845f-54b3-420e-8086-0a8708dcefbd tempest-DeleteServersTestJSON-2100051872 tempest-DeleteServersTestJSON-2100051872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aad828d8ff314a2d82f07fb6d84f36a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6388da70b0dc48c1952570af4332dd6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128729) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:46:54.185856 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: INFO nova.api.openstack.requestlog [None req-c4d3845f-54b3-420e-8086-0a8708dcefbd tempest-DeleteServersTestJSON-2100051872 tempest-DeleteServersTestJSON-2100051872-project] 10.222.0.61 "GET /compute/v2.1/servers/75ca93de-6825-44ce-af10-44cba59218a1" status: 200 len: 1315 microversion: 2.1 time: 0.144724 May 14 15:46:54.186438 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: [pid: 128729|app: 0|req: 42/96] 10.222.0.61 () {58 vars in 1235 bytes} [Sat May 14 15:46:54 2022] GET /compute/v2.1/servers/75ca93de-6825-44ce-af10-44cba59218a1 => generated 1315 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 15:46:54.349900 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi [None req-fe4a29a1-3885-4d41-af47-9abeaa55e949 tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Calling method '>' {{(pid=128728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 15:46:54.350535 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.compute.api [None req-fe4a29a1-3885-4d41-af47-9abeaa55e949 tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] [instance: 563c74e0-060d-49d5-abc5-389cee4bd9d5] Fetching instance by UUID {{(pid=128728) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 15:46:54.357372 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-fe4a29a1-3885-4d41-af47-9abeaa55e949 tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:46:54.357835 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-fe4a29a1-3885-4d41-af47-9abeaa55e949 tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:46:54.358654 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-fe4a29a1-3885-4d41-af47-9abeaa55e949 tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:46:54.359093 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-fe4a29a1-3885-4d41-af47-9abeaa55e949 tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:46:54.551306 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.policy [None req-fe4a29a1-3885-4d41-af47-9abeaa55e949 tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b896317d96a40d6a137db0dcf5f98f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d2517d5440a4d30949f3dd36a46d813', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128728) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:46:54.559466 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: INFO nova.api.openstack.requestlog [None req-fe4a29a1-3885-4d41-af47-9abeaa55e949 tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] 10.222.0.61 "GET /compute/v2.1/servers/563c74e0-060d-49d5-abc5-389cee4bd9d5" status: 200 len: 1321 microversion: 2.1 time: 0.213216 May 14 15:46:54.560051 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: [pid: 128728|app: 0|req: 55/97] 10.222.0.61 () {58 vars in 1235 bytes} [Sat May 14 15:46:54 2022] GET /compute/v2.1/servers/563c74e0-060d-49d5-abc5-389cee4bd9d5 => generated 1321 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 15:46:54.574622 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi [None req-043ec11c-38ee-499e-9415-99c8909c0fc8 tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] Calling method '>' {{(pid=128729) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 15:46:54.575255 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.compute.api [None req-043ec11c-38ee-499e-9415-99c8909c0fc8 tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] [instance: 113f6b52-519c-45f4-9bc2-37168d644e15] Fetching instance by UUID {{(pid=128729) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 15:46:54.581327 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-043ec11c-38ee-499e-9415-99c8909c0fc8 tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:46:54.581964 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-043ec11c-38ee-499e-9415-99c8909c0fc8 tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:46:54.582752 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-043ec11c-38ee-499e-9415-99c8909c0fc8 tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:46:54.583236 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-043ec11c-38ee-499e-9415-99c8909c0fc8 tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:46:54.649244 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi [None req-b8f53dd7-8bba-4a00-9f32-d234fe4f5271 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Calling method '>' {{(pid=128728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 15:46:54.650494 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.compute.api [None req-b8f53dd7-8bba-4a00-9f32-d234fe4f5271 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] [instance: e33e9970-bfb7-46f3-8d40-782dbfa3d21c] Fetching instance by UUID {{(pid=128728) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 15:46:54.663074 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-b8f53dd7-8bba-4a00-9f32-d234fe4f5271 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:46:54.663834 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-b8f53dd7-8bba-4a00-9f32-d234fe4f5271 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:46:54.664822 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-b8f53dd7-8bba-4a00-9f32-d234fe4f5271 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:46:54.665667 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-b8f53dd7-8bba-4a00-9f32-d234fe4f5271 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:46:54.762146 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.policy [None req-b8f53dd7-8bba-4a00-9f32-d234fe4f5271 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58bfb7417bc94583963401ae0fe9d39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0672be3fa3f7414da1c1a5b7300abbe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128728) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:46:54.774101 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.policy [None req-b8f53dd7-8bba-4a00-9f32-d234fe4f5271 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58bfb7417bc94583963401ae0fe9d39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0672be3fa3f7414da1c1a5b7300abbe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128728) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:46:54.783724 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.policy [None req-b8f53dd7-8bba-4a00-9f32-d234fe4f5271 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58bfb7417bc94583963401ae0fe9d39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0672be3fa3f7414da1c1a5b7300abbe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128728) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:46:54.785057 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: INFO nova.api.openstack.requestlog [None req-b8f53dd7-8bba-4a00-9f32-d234fe4f5271 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] 10.222.0.61 "GET /compute/v2.1/servers/e33e9970-bfb7-46f3-8d40-782dbfa3d21c" status: 200 len: 1285 microversion: 2.20 time: 0.141341 May 14 15:46:54.785266 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.policy [None req-043ec11c-38ee-499e-9415-99c8909c0fc8 tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc43895177134e9c9c030a9d87f94aaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7905689c95d44a5c9169249c70f7de57', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128729) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:46:54.796568 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: [pid: 128728|app: 0|req: 56/98] 10.222.0.61 () {60 vars in 1276 bytes} [Sat May 14 15:46:54 2022] GET /compute/v2.1/servers/e33e9970-bfb7-46f3-8d40-782dbfa3d21c => generated 1285 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 14 15:46:54.797202 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: INFO nova.api.openstack.requestlog [None req-043ec11c-38ee-499e-9415-99c8909c0fc8 tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] 10.222.0.61 "GET /compute/v2.1/servers/113f6b52-519c-45f4-9bc2-37168d644e15" status: 200 len: 1366 microversion: 2.1 time: 0.224323 May 14 15:46:54.798067 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: [pid: 128729|app: 0|req: 43/99] 10.222.0.61 () {58 vars in 1235 bytes} [Sat May 14 15:46:54 2022] GET /compute/v2.1/servers/113f6b52-519c-45f4-9bc2-37168d644e15 => generated 1366 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 15:46:54.985337 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi [req-30ef5806-04c8-4e0e-a156-5c1ae198698b req-5991825a-21cc-46d3-9fcb-10cc141df6b8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "113f6b52-519c-45f4-9bc2-37168d644e15", "tag": "60f7fd3d-dbe8-4c62-af7e-c0490eeb01d3"}]} {{(pid=128728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 15:46:54.993659 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [req-30ef5806-04c8-4e0e-a156-5c1ae198698b req-5991825a-21cc-46d3-9fcb-10cc141df6b8 service nova] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:46:54.994109 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [req-30ef5806-04c8-4e0e-a156-5c1ae198698b req-5991825a-21cc-46d3-9fcb-10cc141df6b8 service nova] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:46:55.007277 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: INFO nova.api.openstack.compute.server_external_events [req-30ef5806-04c8-4e0e-a156-5c1ae198698b req-5991825a-21cc-46d3-9fcb-10cc141df6b8 service nova] Creating event network-changed:60f7fd3d-dbe8-4c62-af7e-c0490eeb01d3 for instance 113f6b52-519c-45f4-9bc2-37168d644e15 on hv-cinder-83979 May 14 15:46:55.013717 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: INFO nova.api.openstack.requestlog [req-30ef5806-04c8-4e0e-a156-5c1ae198698b req-5991825a-21cc-46d3-9fcb-10cc141df6b8 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031829 May 14 15:46:55.014563 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: [pid: 128728|app: 0|req: 57/100] 10.222.0.61 () {64 vars in 1317 bytes} [Sat May 14 15:46:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 14 15:46:55.203832 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi [None req-cf39512e-4c34-4fc2-83b7-edf104c4426c tempest-DeleteServersTestJSON-2100051872 tempest-DeleteServersTestJSON-2100051872-project] Calling method '>' {{(pid=128729) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 15:46:55.204456 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.compute.api [None req-cf39512e-4c34-4fc2-83b7-edf104c4426c tempest-DeleteServersTestJSON-2100051872 tempest-DeleteServersTestJSON-2100051872-project] [instance: 75ca93de-6825-44ce-af10-44cba59218a1] Fetching instance by UUID {{(pid=128729) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 15:46:55.210872 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-cf39512e-4c34-4fc2-83b7-edf104c4426c tempest-DeleteServersTestJSON-2100051872 tempest-DeleteServersTestJSON-2100051872-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:46:55.211428 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-cf39512e-4c34-4fc2-83b7-edf104c4426c tempest-DeleteServersTestJSON-2100051872 tempest-DeleteServersTestJSON-2100051872-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:46:55.212096 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-cf39512e-4c34-4fc2-83b7-edf104c4426c tempest-DeleteServersTestJSON-2100051872 tempest-DeleteServersTestJSON-2100051872-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:46:55.212565 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-cf39512e-4c34-4fc2-83b7-edf104c4426c tempest-DeleteServersTestJSON-2100051872 tempest-DeleteServersTestJSON-2100051872-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:46:55.476511 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.policy [None req-cf39512e-4c34-4fc2-83b7-edf104c4426c tempest-DeleteServersTestJSON-2100051872 tempest-DeleteServersTestJSON-2100051872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aad828d8ff314a2d82f07fb6d84f36a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6388da70b0dc48c1952570af4332dd6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128729) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:46:55.484602 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: INFO nova.api.openstack.requestlog [None req-cf39512e-4c34-4fc2-83b7-edf104c4426c tempest-DeleteServersTestJSON-2100051872 tempest-DeleteServersTestJSON-2100051872-project] 10.222.0.61 "GET /compute/v2.1/servers/75ca93de-6825-44ce-af10-44cba59218a1" status: 200 len: 1315 microversion: 2.1 time: 0.285132 May 14 15:46:55.485179 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: [pid: 128729|app: 0|req: 44/101] 10.222.0.61 () {58 vars in 1235 bytes} [Sat May 14 15:46:55 2022] GET /compute/v2.1/servers/75ca93de-6825-44ce-af10-44cba59218a1 => generated 1315 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 15:46:55.576868 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi [None req-c68e0def-d1cb-4c59-b25d-11b90ceafdd6 tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Calling method '>' {{(pid=128728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 15:46:55.577577 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.compute.api [None req-c68e0def-d1cb-4c59-b25d-11b90ceafdd6 tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] [instance: 563c74e0-060d-49d5-abc5-389cee4bd9d5] Fetching instance by UUID {{(pid=128728) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 15:46:55.583933 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-c68e0def-d1cb-4c59-b25d-11b90ceafdd6 tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:46:55.584380 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-c68e0def-d1cb-4c59-b25d-11b90ceafdd6 tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:46:55.585167 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-c68e0def-d1cb-4c59-b25d-11b90ceafdd6 tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:46:55.585605 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-c68e0def-d1cb-4c59-b25d-11b90ceafdd6 tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:46:55.751624 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.policy [None req-c68e0def-d1cb-4c59-b25d-11b90ceafdd6 tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b896317d96a40d6a137db0dcf5f98f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d2517d5440a4d30949f3dd36a46d813', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128728) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:46:55.764585 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: INFO nova.api.openstack.requestlog [None req-c68e0def-d1cb-4c59-b25d-11b90ceafdd6 tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] 10.222.0.61 "GET /compute/v2.1/servers/563c74e0-060d-49d5-abc5-389cee4bd9d5" status: 200 len: 1321 microversion: 2.1 time: 0.191617 May 14 15:46:55.776442 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: [pid: 128728|app: 0|req: 58/102] 10.222.0.61 () {58 vars in 1235 bytes} [Sat May 14 15:46:55 2022] GET /compute/v2.1/servers/563c74e0-060d-49d5-abc5-389cee4bd9d5 => generated 1321 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 15:46:55.803749 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi [None req-4803617b-07c3-4844-b282-2cbd56f66d4a tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Calling method '>' {{(pid=128729) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 15:46:55.804365 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.compute.api [None req-4803617b-07c3-4844-b282-2cbd56f66d4a tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] [instance: e33e9970-bfb7-46f3-8d40-782dbfa3d21c] Fetching instance by UUID {{(pid=128729) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 15:46:55.811834 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-4803617b-07c3-4844-b282-2cbd56f66d4a tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:46:55.812491 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-4803617b-07c3-4844-b282-2cbd56f66d4a tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:46:55.813580 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-4803617b-07c3-4844-b282-2cbd56f66d4a tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:46:55.814162 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-4803617b-07c3-4844-b282-2cbd56f66d4a tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:46:55.815074 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi [None req-b217e858-bfc4-4bfd-b0cb-11eb74002034 tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] Calling method '>' {{(pid=128728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 15:46:55.815754 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.compute.api [None req-b217e858-bfc4-4bfd-b0cb-11eb74002034 tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] [instance: 113f6b52-519c-45f4-9bc2-37168d644e15] Fetching instance by UUID {{(pid=128728) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 15:46:55.824488 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-b217e858-bfc4-4bfd-b0cb-11eb74002034 tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:46:55.825316 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-b217e858-bfc4-4bfd-b0cb-11eb74002034 tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:46:55.826339 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-b217e858-bfc4-4bfd-b0cb-11eb74002034 tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:46:55.826929 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-b217e858-bfc4-4bfd-b0cb-11eb74002034 tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:46:55.977685 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.policy [None req-4803617b-07c3-4844-b282-2cbd56f66d4a tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58bfb7417bc94583963401ae0fe9d39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0672be3fa3f7414da1c1a5b7300abbe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128729) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:46:55.988830 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.policy [None req-4803617b-07c3-4844-b282-2cbd56f66d4a tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58bfb7417bc94583963401ae0fe9d39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0672be3fa3f7414da1c1a5b7300abbe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128729) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:46:55.993138 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.policy [None req-4803617b-07c3-4844-b282-2cbd56f66d4a tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58bfb7417bc94583963401ae0fe9d39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0672be3fa3f7414da1c1a5b7300abbe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128729) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:46:55.996871 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: INFO nova.api.openstack.requestlog [None req-4803617b-07c3-4844-b282-2cbd56f66d4a tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] 10.222.0.61 "GET /compute/v2.1/servers/e33e9970-bfb7-46f3-8d40-782dbfa3d21c" status: 200 len: 1333 microversion: 2.20 time: 0.197099 May 14 15:46:56.007541 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: [pid: 128729|app: 0|req: 45/103] 10.222.0.61 () {60 vars in 1276 bytes} [Sat May 14 15:46:55 2022] GET /compute/v2.1/servers/e33e9970-bfb7-46f3-8d40-782dbfa3d21c => generated 1333 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 14 15:46:56.098012 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.policy [None req-b217e858-bfc4-4bfd-b0cb-11eb74002034 tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc43895177134e9c9c030a9d87f94aaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7905689c95d44a5c9169249c70f7de57', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128728) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:46:56.106588 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: INFO nova.api.openstack.requestlog [None req-b217e858-bfc4-4bfd-b0cb-11eb74002034 tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] 10.222.0.61 "GET /compute/v2.1/servers/113f6b52-519c-45f4-9bc2-37168d644e15" status: 200 len: 1366 microversion: 2.1 time: 0.295812 May 14 15:46:56.107164 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: [pid: 128728|app: 0|req: 59/104] 10.222.0.61 () {58 vars in 1235 bytes} [Sat May 14 15:46:55 2022] GET /compute/v2.1/servers/113f6b52-519c-45f4-9bc2-37168d644e15 => generated 1366 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 15:46:56.502934 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi [None req-97cc0356-4db0-4add-beb8-ca5a50ec212b tempest-DeleteServersTestJSON-2100051872 tempest-DeleteServersTestJSON-2100051872-project] Calling method '>' {{(pid=128729) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 15:46:56.503540 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.compute.api [None req-97cc0356-4db0-4add-beb8-ca5a50ec212b tempest-DeleteServersTestJSON-2100051872 tempest-DeleteServersTestJSON-2100051872-project] [instance: 75ca93de-6825-44ce-af10-44cba59218a1] Fetching instance by UUID {{(pid=128729) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 15:46:56.509804 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-97cc0356-4db0-4add-beb8-ca5a50ec212b tempest-DeleteServersTestJSON-2100051872 tempest-DeleteServersTestJSON-2100051872-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:46:56.510251 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-97cc0356-4db0-4add-beb8-ca5a50ec212b tempest-DeleteServersTestJSON-2100051872 tempest-DeleteServersTestJSON-2100051872-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:46:56.511761 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-97cc0356-4db0-4add-beb8-ca5a50ec212b tempest-DeleteServersTestJSON-2100051872 tempest-DeleteServersTestJSON-2100051872-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:46:56.512642 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-97cc0356-4db0-4add-beb8-ca5a50ec212b tempest-DeleteServersTestJSON-2100051872 tempest-DeleteServersTestJSON-2100051872-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:46:56.668776 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.policy [None req-97cc0356-4db0-4add-beb8-ca5a50ec212b tempest-DeleteServersTestJSON-2100051872 tempest-DeleteServersTestJSON-2100051872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aad828d8ff314a2d82f07fb6d84f36a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6388da70b0dc48c1952570af4332dd6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128729) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:46:56.681020 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: INFO nova.api.openstack.requestlog [None req-97cc0356-4db0-4add-beb8-ca5a50ec212b tempest-DeleteServersTestJSON-2100051872 tempest-DeleteServersTestJSON-2100051872-project] 10.222.0.61 "GET /compute/v2.1/servers/75ca93de-6825-44ce-af10-44cba59218a1" status: 200 len: 1315 microversion: 2.1 time: 0.181942 May 14 15:46:56.692433 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: [pid: 128729|app: 0|req: 46/105] 10.222.0.61 () {58 vars in 1235 bytes} [Sat May 14 15:46:56 2022] GET /compute/v2.1/servers/75ca93de-6825-44ce-af10-44cba59218a1 => generated 1315 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 15:46:56.783010 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi [None req-e275ceb8-1057-4901-b21b-79b7e3c5e0fe tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Calling method '>' {{(pid=128728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 15:46:56.783621 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.compute.api [None req-e275ceb8-1057-4901-b21b-79b7e3c5e0fe tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] [instance: 563c74e0-060d-49d5-abc5-389cee4bd9d5] Fetching instance by UUID {{(pid=128728) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 15:46:56.789701 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-e275ceb8-1057-4901-b21b-79b7e3c5e0fe tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:46:56.790152 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-e275ceb8-1057-4901-b21b-79b7e3c5e0fe tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:46:56.790961 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-e275ceb8-1057-4901-b21b-79b7e3c5e0fe tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:46:56.791410 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-e275ceb8-1057-4901-b21b-79b7e3c5e0fe tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:46:56.940732 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.policy [None req-e275ceb8-1057-4901-b21b-79b7e3c5e0fe tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b896317d96a40d6a137db0dcf5f98f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d2517d5440a4d30949f3dd36a46d813', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128728) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:46:56.947920 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: INFO nova.api.openstack.requestlog [None req-e275ceb8-1057-4901-b21b-79b7e3c5e0fe tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] 10.222.0.61 "GET /compute/v2.1/servers/563c74e0-060d-49d5-abc5-389cee4bd9d5" status: 200 len: 1321 microversion: 2.1 time: 0.168811 May 14 15:46:56.948620 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: [pid: 128728|app: 0|req: 60/106] 10.222.0.61 () {58 vars in 1235 bytes} [Sat May 14 15:46:56 2022] GET /compute/v2.1/servers/563c74e0-060d-49d5-abc5-389cee4bd9d5 => generated 1321 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 15:46:57.016291 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi [None req-599b5801-2570-43ec-ae14-a5b26177d051 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Calling method '>' {{(pid=128729) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 15:46:57.016896 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.compute.api [None req-599b5801-2570-43ec-ae14-a5b26177d051 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] [instance: e33e9970-bfb7-46f3-8d40-782dbfa3d21c] Fetching instance by UUID {{(pid=128729) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 15:46:57.023008 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-599b5801-2570-43ec-ae14-a5b26177d051 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:46:57.023496 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-599b5801-2570-43ec-ae14-a5b26177d051 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:46:57.024761 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-599b5801-2570-43ec-ae14-a5b26177d051 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:46:57.025268 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-599b5801-2570-43ec-ae14-a5b26177d051 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:46:57.093372 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.policy [None req-599b5801-2570-43ec-ae14-a5b26177d051 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58bfb7417bc94583963401ae0fe9d39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0672be3fa3f7414da1c1a5b7300abbe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128729) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:46:57.101047 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.policy [None req-599b5801-2570-43ec-ae14-a5b26177d051 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58bfb7417bc94583963401ae0fe9d39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0672be3fa3f7414da1c1a5b7300abbe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128729) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:46:57.102628 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.policy [None req-599b5801-2570-43ec-ae14-a5b26177d051 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58bfb7417bc94583963401ae0fe9d39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0672be3fa3f7414da1c1a5b7300abbe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128729) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:46:57.103731 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: INFO nova.api.openstack.requestlog [None req-599b5801-2570-43ec-ae14-a5b26177d051 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] 10.222.0.61 "GET /compute/v2.1/servers/e33e9970-bfb7-46f3-8d40-782dbfa3d21c" status: 200 len: 1341 microversion: 2.20 time: 0.091347 May 14 15:46:57.104360 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: [pid: 128729|app: 0|req: 47/107] 10.222.0.61 () {60 vars in 1276 bytes} [Sat May 14 15:46:57 2022] GET /compute/v2.1/servers/e33e9970-bfb7-46f3-8d40-782dbfa3d21c => generated 1341 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 14 15:46:57.124263 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi [None req-b5efd05a-f0f7-4150-bc7f-860c74287f91 tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] Calling method '>' {{(pid=128728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 15:46:57.124963 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.compute.api [None req-b5efd05a-f0f7-4150-bc7f-860c74287f91 tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] [instance: 113f6b52-519c-45f4-9bc2-37168d644e15] Fetching instance by UUID {{(pid=128728) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 15:46:57.130624 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-b5efd05a-f0f7-4150-bc7f-860c74287f91 tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:46:57.131071 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-b5efd05a-f0f7-4150-bc7f-860c74287f91 tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:46:57.131829 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-b5efd05a-f0f7-4150-bc7f-860c74287f91 tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:46:57.132293 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-b5efd05a-f0f7-4150-bc7f-860c74287f91 tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:46:57.263335 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.policy [None req-b5efd05a-f0f7-4150-bc7f-860c74287f91 tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc43895177134e9c9c030a9d87f94aaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7905689c95d44a5c9169249c70f7de57', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128728) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:46:57.273614 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: INFO nova.api.openstack.requestlog [None req-b5efd05a-f0f7-4150-bc7f-860c74287f91 tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] 10.222.0.61 "GET /compute/v2.1/servers/113f6b52-519c-45f4-9bc2-37168d644e15" status: 200 len: 1366 microversion: 2.1 time: 0.153740 May 14 15:46:57.282135 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: [pid: 128728|app: 0|req: 61/108] 10.222.0.61 () {58 vars in 1235 bytes} [Sat May 14 15:46:57 2022] GET /compute/v2.1/servers/113f6b52-519c-45f4-9bc2-37168d644e15 => generated 1366 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 15:46:57.699912 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi [None req-65d6f0f2-39e3-46eb-bcae-7a23666e8c95 tempest-DeleteServersTestJSON-2100051872 tempest-DeleteServersTestJSON-2100051872-project] Calling method '>' {{(pid=128729) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 15:46:57.700528 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.compute.api [None req-65d6f0f2-39e3-46eb-bcae-7a23666e8c95 tempest-DeleteServersTestJSON-2100051872 tempest-DeleteServersTestJSON-2100051872-project] [instance: 75ca93de-6825-44ce-af10-44cba59218a1] Fetching instance by UUID {{(pid=128729) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 15:46:57.706478 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-65d6f0f2-39e3-46eb-bcae-7a23666e8c95 tempest-DeleteServersTestJSON-2100051872 tempest-DeleteServersTestJSON-2100051872-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:46:57.706928 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-65d6f0f2-39e3-46eb-bcae-7a23666e8c95 tempest-DeleteServersTestJSON-2100051872 tempest-DeleteServersTestJSON-2100051872-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:46:57.707694 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-65d6f0f2-39e3-46eb-bcae-7a23666e8c95 tempest-DeleteServersTestJSON-2100051872 tempest-DeleteServersTestJSON-2100051872-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:46:57.708131 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-65d6f0f2-39e3-46eb-bcae-7a23666e8c95 tempest-DeleteServersTestJSON-2100051872 tempest-DeleteServersTestJSON-2100051872-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:46:57.834293 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.policy [None req-65d6f0f2-39e3-46eb-bcae-7a23666e8c95 tempest-DeleteServersTestJSON-2100051872 tempest-DeleteServersTestJSON-2100051872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aad828d8ff314a2d82f07fb6d84f36a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6388da70b0dc48c1952570af4332dd6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128729) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:46:57.842647 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: INFO nova.api.openstack.requestlog [None req-65d6f0f2-39e3-46eb-bcae-7a23666e8c95 tempest-DeleteServersTestJSON-2100051872 tempest-DeleteServersTestJSON-2100051872-project] 10.222.0.61 "GET /compute/v2.1/servers/75ca93de-6825-44ce-af10-44cba59218a1" status: 200 len: 1315 microversion: 2.1 time: 0.147023 May 14 15:46:57.843217 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: [pid: 128729|app: 0|req: 48/109] 10.222.0.61 () {58 vars in 1235 bytes} [Sat May 14 15:46:57 2022] GET /compute/v2.1/servers/75ca93de-6825-44ce-af10-44cba59218a1 => generated 1315 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 15:46:57.965202 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi [None req-f2ef7ace-28bb-4fd5-93ac-183694635936 tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Calling method '>' {{(pid=128728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 15:46:57.965842 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.compute.api [None req-f2ef7ace-28bb-4fd5-93ac-183694635936 tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] [instance: 563c74e0-060d-49d5-abc5-389cee4bd9d5] Fetching instance by UUID {{(pid=128728) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 15:46:57.971609 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-f2ef7ace-28bb-4fd5-93ac-183694635936 tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:46:57.972066 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-f2ef7ace-28bb-4fd5-93ac-183694635936 tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:46:57.972848 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-f2ef7ace-28bb-4fd5-93ac-183694635936 tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:46:57.973284 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-f2ef7ace-28bb-4fd5-93ac-183694635936 tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:46:58.102579 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.policy [None req-f2ef7ace-28bb-4fd5-93ac-183694635936 tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b896317d96a40d6a137db0dcf5f98f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d2517d5440a4d30949f3dd36a46d813', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128728) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:46:58.109973 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: INFO nova.api.openstack.requestlog [None req-f2ef7ace-28bb-4fd5-93ac-183694635936 tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] 10.222.0.61 "GET /compute/v2.1/servers/563c74e0-060d-49d5-abc5-389cee4bd9d5" status: 200 len: 1321 microversion: 2.1 time: 0.149266 May 14 15:46:58.110599 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: [pid: 128728|app: 0|req: 62/110] 10.222.0.61 () {58 vars in 1235 bytes} [Sat May 14 15:46:57 2022] GET /compute/v2.1/servers/563c74e0-060d-49d5-abc5-389cee4bd9d5 => generated 1321 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 15:46:58.126535 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi [None req-ae38439e-9be4-4448-9cf7-f6803ac24b20 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Calling method '>' {{(pid=128729) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 15:46:58.126535 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.compute.api [None req-ae38439e-9be4-4448-9cf7-f6803ac24b20 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] [instance: e33e9970-bfb7-46f3-8d40-782dbfa3d21c] Fetching instance by UUID {{(pid=128729) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 15:46:58.130263 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-ae38439e-9be4-4448-9cf7-f6803ac24b20 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:46:58.130742 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-ae38439e-9be4-4448-9cf7-f6803ac24b20 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:46:58.131506 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-ae38439e-9be4-4448-9cf7-f6803ac24b20 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:46:58.131942 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-ae38439e-9be4-4448-9cf7-f6803ac24b20 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:46:58.191703 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.policy [None req-ae38439e-9be4-4448-9cf7-f6803ac24b20 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58bfb7417bc94583963401ae0fe9d39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0672be3fa3f7414da1c1a5b7300abbe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128729) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:46:58.199977 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.policy [None req-ae38439e-9be4-4448-9cf7-f6803ac24b20 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58bfb7417bc94583963401ae0fe9d39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0672be3fa3f7414da1c1a5b7300abbe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128729) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:46:58.201480 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.policy [None req-ae38439e-9be4-4448-9cf7-f6803ac24b20 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58bfb7417bc94583963401ae0fe9d39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0672be3fa3f7414da1c1a5b7300abbe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128729) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:46:58.202588 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: INFO nova.api.openstack.requestlog [None req-ae38439e-9be4-4448-9cf7-f6803ac24b20 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] 10.222.0.61 "GET /compute/v2.1/servers/e33e9970-bfb7-46f3-8d40-782dbfa3d21c" status: 200 len: 1341 microversion: 2.20 time: 0.083642 May 14 15:46:58.203150 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: [pid: 128729|app: 0|req: 49/111] 10.222.0.61 () {60 vars in 1276 bytes} [Sat May 14 15:46:58 2022] GET /compute/v2.1/servers/e33e9970-bfb7-46f3-8d40-782dbfa3d21c => generated 1341 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 14 15:46:58.290069 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi [None req-94a81c34-29fb-4949-a33e-f5d4bf2d11eb tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] Calling method '>' {{(pid=128728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 15:46:58.290727 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.compute.api [None req-94a81c34-29fb-4949-a33e-f5d4bf2d11eb tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] [instance: 113f6b52-519c-45f4-9bc2-37168d644e15] Fetching instance by UUID {{(pid=128728) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 15:46:58.296877 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-94a81c34-29fb-4949-a33e-f5d4bf2d11eb tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:46:58.297522 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-94a81c34-29fb-4949-a33e-f5d4bf2d11eb tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:46:58.298357 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-94a81c34-29fb-4949-a33e-f5d4bf2d11eb tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:46:58.298798 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-94a81c34-29fb-4949-a33e-f5d4bf2d11eb tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:46:58.428748 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.policy [None req-94a81c34-29fb-4949-a33e-f5d4bf2d11eb tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc43895177134e9c9c030a9d87f94aaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7905689c95d44a5c9169249c70f7de57', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128728) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:46:58.436087 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: INFO nova.api.openstack.requestlog [None req-94a81c34-29fb-4949-a33e-f5d4bf2d11eb tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] 10.222.0.61 "GET /compute/v2.1/servers/113f6b52-519c-45f4-9bc2-37168d644e15" status: 200 len: 1366 microversion: 2.1 time: 0.149760 May 14 15:46:58.436646 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: [pid: 128728|app: 0|req: 63/112] 10.222.0.61 () {58 vars in 1235 bytes} [Sat May 14 15:46:58 2022] GET /compute/v2.1/servers/113f6b52-519c-45f4-9bc2-37168d644e15 => generated 1366 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 15:46:58.859994 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi [None req-56e9304a-c5e6-439e-bc6d-ecde061d1a38 tempest-DeleteServersTestJSON-2100051872 tempest-DeleteServersTestJSON-2100051872-project] Calling method '>' {{(pid=128729) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 15:46:58.860632 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.compute.api [None req-56e9304a-c5e6-439e-bc6d-ecde061d1a38 tempest-DeleteServersTestJSON-2100051872 tempest-DeleteServersTestJSON-2100051872-project] [instance: 75ca93de-6825-44ce-af10-44cba59218a1] Fetching instance by UUID {{(pid=128729) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 15:46:58.866789 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-56e9304a-c5e6-439e-bc6d-ecde061d1a38 tempest-DeleteServersTestJSON-2100051872 tempest-DeleteServersTestJSON-2100051872-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:46:58.867237 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-56e9304a-c5e6-439e-bc6d-ecde061d1a38 tempest-DeleteServersTestJSON-2100051872 tempest-DeleteServersTestJSON-2100051872-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:46:58.868007 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-56e9304a-c5e6-439e-bc6d-ecde061d1a38 tempest-DeleteServersTestJSON-2100051872 tempest-DeleteServersTestJSON-2100051872-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:46:58.868443 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-56e9304a-c5e6-439e-bc6d-ecde061d1a38 tempest-DeleteServersTestJSON-2100051872 tempest-DeleteServersTestJSON-2100051872-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:46:58.992102 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.policy [None req-56e9304a-c5e6-439e-bc6d-ecde061d1a38 tempest-DeleteServersTestJSON-2100051872 tempest-DeleteServersTestJSON-2100051872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aad828d8ff314a2d82f07fb6d84f36a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6388da70b0dc48c1952570af4332dd6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128729) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:46:58.999304 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: INFO nova.api.openstack.requestlog [None req-56e9304a-c5e6-439e-bc6d-ecde061d1a38 tempest-DeleteServersTestJSON-2100051872 tempest-DeleteServersTestJSON-2100051872-project] 10.222.0.61 "GET /compute/v2.1/servers/75ca93de-6825-44ce-af10-44cba59218a1" status: 200 len: 1315 microversion: 2.1 time: 0.143040 May 14 15:46:58.999873 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: [pid: 128729|app: 0|req: 50/113] 10.222.0.61 () {58 vars in 1235 bytes} [Sat May 14 15:46:58 2022] GET /compute/v2.1/servers/75ca93de-6825-44ce-af10-44cba59218a1 => generated 1315 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 15:46:59.127257 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi [None req-6134d657-7ed4-4e1a-9bff-a45c248ed852 tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Calling method '>' {{(pid=128728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 15:46:59.127892 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.compute.api [None req-6134d657-7ed4-4e1a-9bff-a45c248ed852 tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] [instance: 563c74e0-060d-49d5-abc5-389cee4bd9d5] Fetching instance by UUID {{(pid=128728) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 15:46:59.133926 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-6134d657-7ed4-4e1a-9bff-a45c248ed852 tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:46:59.134169 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-6134d657-7ed4-4e1a-9bff-a45c248ed852 tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:46:59.134921 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-6134d657-7ed4-4e1a-9bff-a45c248ed852 tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:46:59.135350 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-6134d657-7ed4-4e1a-9bff-a45c248ed852 tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:46:59.220791 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi [None req-a39a1441-1680-4531-8462-43f07fdd72de tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Calling method '>' {{(pid=128729) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 15:46:59.221512 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.compute.api [None req-a39a1441-1680-4531-8462-43f07fdd72de tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] [instance: e33e9970-bfb7-46f3-8d40-782dbfa3d21c] Fetching instance by UUID {{(pid=128729) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 15:46:59.227477 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-a39a1441-1680-4531-8462-43f07fdd72de tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:46:59.228001 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-a39a1441-1680-4531-8462-43f07fdd72de tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:46:59.228871 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-a39a1441-1680-4531-8462-43f07fdd72de tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:46:59.229589 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-a39a1441-1680-4531-8462-43f07fdd72de tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:46:59.263041 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.policy [None req-6134d657-7ed4-4e1a-9bff-a45c248ed852 tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b896317d96a40d6a137db0dcf5f98f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d2517d5440a4d30949f3dd36a46d813', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128728) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:46:59.270246 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: INFO nova.api.openstack.requestlog [None req-6134d657-7ed4-4e1a-9bff-a45c248ed852 tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] 10.222.0.61 "GET /compute/v2.1/servers/563c74e0-060d-49d5-abc5-389cee4bd9d5" status: 200 len: 1321 microversion: 2.1 time: 0.146735 May 14 15:46:59.270846 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: [pid: 128728|app: 0|req: 64/114] 10.222.0.61 () {58 vars in 1235 bytes} [Sat May 14 15:46:59 2022] GET /compute/v2.1/servers/563c74e0-060d-49d5-abc5-389cee4bd9d5 => generated 1321 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 15:46:59.291224 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.policy [None req-a39a1441-1680-4531-8462-43f07fdd72de tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58bfb7417bc94583963401ae0fe9d39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0672be3fa3f7414da1c1a5b7300abbe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128729) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:46:59.299327 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.policy [None req-a39a1441-1680-4531-8462-43f07fdd72de tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58bfb7417bc94583963401ae0fe9d39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0672be3fa3f7414da1c1a5b7300abbe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128729) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:46:59.300832 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.policy [None req-a39a1441-1680-4531-8462-43f07fdd72de tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58bfb7417bc94583963401ae0fe9d39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0672be3fa3f7414da1c1a5b7300abbe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128729) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:46:59.301924 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: INFO nova.api.openstack.requestlog [None req-a39a1441-1680-4531-8462-43f07fdd72de tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] 10.222.0.61 "GET /compute/v2.1/servers/e33e9970-bfb7-46f3-8d40-782dbfa3d21c" status: 200 len: 1341 microversion: 2.20 time: 0.085043 May 14 15:46:59.302514 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: [pid: 128729|app: 0|req: 51/115] 10.222.0.61 () {60 vars in 1276 bytes} [Sat May 14 15:46:59 2022] GET /compute/v2.1/servers/e33e9970-bfb7-46f3-8d40-782dbfa3d21c => generated 1341 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 14 15:46:59.453361 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi [None req-d3d4abc7-b730-4ed8-8931-9994146c5483 tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] Calling method '>' {{(pid=128728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 15:46:59.453972 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.compute.api [None req-d3d4abc7-b730-4ed8-8931-9994146c5483 tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] [instance: 113f6b52-519c-45f4-9bc2-37168d644e15] Fetching instance by UUID {{(pid=128728) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 15:46:59.459944 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-d3d4abc7-b730-4ed8-8931-9994146c5483 tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:46:59.460338 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-d3d4abc7-b730-4ed8-8931-9994146c5483 tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:46:59.461106 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-d3d4abc7-b730-4ed8-8931-9994146c5483 tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:46:59.461558 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-d3d4abc7-b730-4ed8-8931-9994146c5483 tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:46:59.583704 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.policy [None req-d3d4abc7-b730-4ed8-8931-9994146c5483 tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc43895177134e9c9c030a9d87f94aaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7905689c95d44a5c9169249c70f7de57', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128728) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:46:59.591057 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: INFO nova.api.openstack.requestlog [None req-d3d4abc7-b730-4ed8-8931-9994146c5483 tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] 10.222.0.61 "GET /compute/v2.1/servers/113f6b52-519c-45f4-9bc2-37168d644e15" status: 200 len: 1366 microversion: 2.1 time: 0.141532 May 14 15:46:59.591631 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: [pid: 128728|app: 0|req: 65/116] 10.222.0.61 () {58 vars in 1235 bytes} [Sat May 14 15:46:59 2022] GET /compute/v2.1/servers/113f6b52-519c-45f4-9bc2-37168d644e15 => generated 1366 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 15:47:00.016504 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi [None req-832b1889-38b7-40f4-b71a-8c0c0624a298 tempest-DeleteServersTestJSON-2100051872 tempest-DeleteServersTestJSON-2100051872-project] Calling method '>' {{(pid=128729) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 15:47:00.017112 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.compute.api [None req-832b1889-38b7-40f4-b71a-8c0c0624a298 tempest-DeleteServersTestJSON-2100051872 tempest-DeleteServersTestJSON-2100051872-project] [instance: 75ca93de-6825-44ce-af10-44cba59218a1] Fetching instance by UUID {{(pid=128729) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 15:47:00.023017 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-832b1889-38b7-40f4-b71a-8c0c0624a298 tempest-DeleteServersTestJSON-2100051872 tempest-DeleteServersTestJSON-2100051872-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:47:00.023469 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-832b1889-38b7-40f4-b71a-8c0c0624a298 tempest-DeleteServersTestJSON-2100051872 tempest-DeleteServersTestJSON-2100051872-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:47:00.024234 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-832b1889-38b7-40f4-b71a-8c0c0624a298 tempest-DeleteServersTestJSON-2100051872 tempest-DeleteServersTestJSON-2100051872-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:47:00.024673 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-832b1889-38b7-40f4-b71a-8c0c0624a298 tempest-DeleteServersTestJSON-2100051872 tempest-DeleteServersTestJSON-2100051872-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:47:00.154616 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.policy [None req-832b1889-38b7-40f4-b71a-8c0c0624a298 tempest-DeleteServersTestJSON-2100051872 tempest-DeleteServersTestJSON-2100051872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aad828d8ff314a2d82f07fb6d84f36a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6388da70b0dc48c1952570af4332dd6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128729) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:47:00.161734 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: INFO nova.api.openstack.requestlog [None req-832b1889-38b7-40f4-b71a-8c0c0624a298 tempest-DeleteServersTestJSON-2100051872 tempest-DeleteServersTestJSON-2100051872-project] 10.222.0.61 "GET /compute/v2.1/servers/75ca93de-6825-44ce-af10-44cba59218a1" status: 200 len: 1315 microversion: 2.1 time: 0.149129 May 14 15:47:00.162288 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: [pid: 128729|app: 0|req: 52/117] 10.222.0.61 () {58 vars in 1235 bytes} [Sat May 14 15:47:00 2022] GET /compute/v2.1/servers/75ca93de-6825-44ce-af10-44cba59218a1 => generated 1315 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 15:47:00.287266 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi [None req-3806d659-5bb0-42cb-94c3-4c611690a623 tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Calling method '>' {{(pid=128728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 15:47:00.287867 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.compute.api [None req-3806d659-5bb0-42cb-94c3-4c611690a623 tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] [instance: 563c74e0-060d-49d5-abc5-389cee4bd9d5] Fetching instance by UUID {{(pid=128728) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 15:47:00.294172 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-3806d659-5bb0-42cb-94c3-4c611690a623 tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:47:00.294646 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-3806d659-5bb0-42cb-94c3-4c611690a623 tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:47:00.295402 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-3806d659-5bb0-42cb-94c3-4c611690a623 tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:47:00.295833 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-3806d659-5bb0-42cb-94c3-4c611690a623 tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:47:00.320830 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi [None req-c15abe45-3280-4f95-85c4-f68cf8d84b38 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Calling method '>' {{(pid=128729) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 15:47:00.321441 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.compute.api [None req-c15abe45-3280-4f95-85c4-f68cf8d84b38 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] [instance: e33e9970-bfb7-46f3-8d40-782dbfa3d21c] Fetching instance by UUID {{(pid=128729) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 15:47:00.328596 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-c15abe45-3280-4f95-85c4-f68cf8d84b38 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:47:00.329050 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-c15abe45-3280-4f95-85c4-f68cf8d84b38 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:47:00.329836 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-c15abe45-3280-4f95-85c4-f68cf8d84b38 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:47:00.330279 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-c15abe45-3280-4f95-85c4-f68cf8d84b38 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:47:00.408432 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.policy [None req-c15abe45-3280-4f95-85c4-f68cf8d84b38 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58bfb7417bc94583963401ae0fe9d39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0672be3fa3f7414da1c1a5b7300abbe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128729) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:47:00.416971 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.policy [None req-c15abe45-3280-4f95-85c4-f68cf8d84b38 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58bfb7417bc94583963401ae0fe9d39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0672be3fa3f7414da1c1a5b7300abbe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128729) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:47:00.418588 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.policy [None req-c15abe45-3280-4f95-85c4-f68cf8d84b38 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58bfb7417bc94583963401ae0fe9d39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0672be3fa3f7414da1c1a5b7300abbe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128729) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:47:00.419683 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: INFO nova.api.openstack.requestlog [None req-c15abe45-3280-4f95-85c4-f68cf8d84b38 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] 10.222.0.61 "GET /compute/v2.1/servers/e33e9970-bfb7-46f3-8d40-782dbfa3d21c" status: 200 len: 1341 microversion: 2.20 time: 0.102729 May 14 15:47:00.420235 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: [pid: 128729|app: 0|req: 53/118] 10.222.0.61 () {60 vars in 1276 bytes} [Sat May 14 15:47:00 2022] GET /compute/v2.1/servers/e33e9970-bfb7-46f3-8d40-782dbfa3d21c => generated 1341 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 14 15:47:00.445321 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.policy [None req-3806d659-5bb0-42cb-94c3-4c611690a623 tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b896317d96a40d6a137db0dcf5f98f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d2517d5440a4d30949f3dd36a46d813', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128728) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:47:00.453298 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: INFO nova.api.openstack.requestlog [None req-3806d659-5bb0-42cb-94c3-4c611690a623 tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] 10.222.0.61 "GET /compute/v2.1/servers/563c74e0-060d-49d5-abc5-389cee4bd9d5" status: 200 len: 1321 microversion: 2.1 time: 0.169804 May 14 15:47:00.453857 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: [pid: 128728|app: 0|req: 66/119] 10.222.0.61 () {58 vars in 1235 bytes} [Sat May 14 15:47:00 2022] GET /compute/v2.1/servers/563c74e0-060d-49d5-abc5-389cee4bd9d5 => generated 1321 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 15:47:00.606894 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi [None req-d68e3ef5-2ac0-45ae-ae99-70341bc88809 tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] Calling method '>' {{(pid=128729) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 15:47:00.607456 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.compute.api [None req-d68e3ef5-2ac0-45ae-ae99-70341bc88809 tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] [instance: 113f6b52-519c-45f4-9bc2-37168d644e15] Fetching instance by UUID {{(pid=128729) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 15:47:00.613568 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-d68e3ef5-2ac0-45ae-ae99-70341bc88809 tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:47:00.614009 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-d68e3ef5-2ac0-45ae-ae99-70341bc88809 tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:47:00.614799 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-d68e3ef5-2ac0-45ae-ae99-70341bc88809 tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:47:00.615229 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-d68e3ef5-2ac0-45ae-ae99-70341bc88809 tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:47:00.740208 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.policy [None req-d68e3ef5-2ac0-45ae-ae99-70341bc88809 tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc43895177134e9c9c030a9d87f94aaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7905689c95d44a5c9169249c70f7de57', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128729) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:47:00.747356 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: INFO nova.api.openstack.requestlog [None req-d68e3ef5-2ac0-45ae-ae99-70341bc88809 tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] 10.222.0.61 "GET /compute/v2.1/servers/113f6b52-519c-45f4-9bc2-37168d644e15" status: 200 len: 1366 microversion: 2.1 time: 0.144350 May 14 15:47:00.747920 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: [pid: 128729|app: 0|req: 54/120] 10.222.0.61 () {58 vars in 1235 bytes} [Sat May 14 15:47:00 2022] GET /compute/v2.1/servers/113f6b52-519c-45f4-9bc2-37168d644e15 => generated 1366 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 15:47:01.178927 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi [None req-fdd2d278-8f59-4b9c-aa90-c317ef7be8aa tempest-DeleteServersTestJSON-2100051872 tempest-DeleteServersTestJSON-2100051872-project] Calling method '>' {{(pid=128728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 15:47:01.179533 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.compute.api [None req-fdd2d278-8f59-4b9c-aa90-c317ef7be8aa tempest-DeleteServersTestJSON-2100051872 tempest-DeleteServersTestJSON-2100051872-project] [instance: 75ca93de-6825-44ce-af10-44cba59218a1] Fetching instance by UUID {{(pid=128728) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 15:47:01.185294 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-fdd2d278-8f59-4b9c-aa90-c317ef7be8aa tempest-DeleteServersTestJSON-2100051872 tempest-DeleteServersTestJSON-2100051872-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:47:01.185740 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-fdd2d278-8f59-4b9c-aa90-c317ef7be8aa tempest-DeleteServersTestJSON-2100051872 tempest-DeleteServersTestJSON-2100051872-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:47:01.186530 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-fdd2d278-8f59-4b9c-aa90-c317ef7be8aa tempest-DeleteServersTestJSON-2100051872 tempest-DeleteServersTestJSON-2100051872-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:47:01.186965 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-fdd2d278-8f59-4b9c-aa90-c317ef7be8aa tempest-DeleteServersTestJSON-2100051872 tempest-DeleteServersTestJSON-2100051872-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:47:01.311991 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.policy [None req-fdd2d278-8f59-4b9c-aa90-c317ef7be8aa tempest-DeleteServersTestJSON-2100051872 tempest-DeleteServersTestJSON-2100051872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aad828d8ff314a2d82f07fb6d84f36a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6388da70b0dc48c1952570af4332dd6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128728) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:47:01.319095 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: INFO nova.api.openstack.requestlog [None req-fdd2d278-8f59-4b9c-aa90-c317ef7be8aa tempest-DeleteServersTestJSON-2100051872 tempest-DeleteServersTestJSON-2100051872-project] 10.222.0.61 "GET /compute/v2.1/servers/75ca93de-6825-44ce-af10-44cba59218a1" status: 200 len: 1315 microversion: 2.1 time: 0.143897 May 14 15:47:01.319656 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: [pid: 128728|app: 0|req: 67/121] 10.222.0.61 () {58 vars in 1235 bytes} [Sat May 14 15:47:01 2022] GET /compute/v2.1/servers/75ca93de-6825-44ce-af10-44cba59218a1 => generated 1315 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 15:47:01.437519 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi [None req-2d711528-27b0-4e54-9d8a-77d37f4ba8c1 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Calling method '>' {{(pid=128729) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 15:47:01.438159 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.compute.api [None req-2d711528-27b0-4e54-9d8a-77d37f4ba8c1 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] [instance: e33e9970-bfb7-46f3-8d40-782dbfa3d21c] Fetching instance by UUID {{(pid=128729) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 15:47:01.444064 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-2d711528-27b0-4e54-9d8a-77d37f4ba8c1 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:47:01.444514 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-2d711528-27b0-4e54-9d8a-77d37f4ba8c1 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:47:01.445281 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-2d711528-27b0-4e54-9d8a-77d37f4ba8c1 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:47:01.445713 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-2d711528-27b0-4e54-9d8a-77d37f4ba8c1 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:47:01.469689 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi [None req-26b6e6bd-a980-4486-9ce7-69cdd92e90ed tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Calling method '>' {{(pid=128728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 15:47:01.470565 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.compute.api [None req-26b6e6bd-a980-4486-9ce7-69cdd92e90ed tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] [instance: 563c74e0-060d-49d5-abc5-389cee4bd9d5] Fetching instance by UUID {{(pid=128728) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 15:47:01.476384 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-26b6e6bd-a980-4486-9ce7-69cdd92e90ed tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:47:01.476914 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-26b6e6bd-a980-4486-9ce7-69cdd92e90ed tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:47:01.477759 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-26b6e6bd-a980-4486-9ce7-69cdd92e90ed tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:47:01.478270 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-26b6e6bd-a980-4486-9ce7-69cdd92e90ed tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:47:01.505323 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.policy [None req-2d711528-27b0-4e54-9d8a-77d37f4ba8c1 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58bfb7417bc94583963401ae0fe9d39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0672be3fa3f7414da1c1a5b7300abbe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128729) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:47:01.513797 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.policy [None req-2d711528-27b0-4e54-9d8a-77d37f4ba8c1 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58bfb7417bc94583963401ae0fe9d39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0672be3fa3f7414da1c1a5b7300abbe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128729) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:47:01.515334 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.policy [None req-2d711528-27b0-4e54-9d8a-77d37f4ba8c1 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58bfb7417bc94583963401ae0fe9d39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0672be3fa3f7414da1c1a5b7300abbe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128729) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:47:01.516430 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: INFO nova.api.openstack.requestlog [None req-2d711528-27b0-4e54-9d8a-77d37f4ba8c1 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] 10.222.0.61 "GET /compute/v2.1/servers/e33e9970-bfb7-46f3-8d40-782dbfa3d21c" status: 200 len: 1341 microversion: 2.20 time: 0.082784 May 14 15:47:01.516987 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: [pid: 128729|app: 0|req: 55/122] 10.222.0.61 () {60 vars in 1276 bytes} [Sat May 14 15:47:01 2022] GET /compute/v2.1/servers/e33e9970-bfb7-46f3-8d40-782dbfa3d21c => generated 1341 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 14 15:47:01.604669 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.policy [None req-26b6e6bd-a980-4486-9ce7-69cdd92e90ed tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b896317d96a40d6a137db0dcf5f98f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d2517d5440a4d30949f3dd36a46d813', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128728) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:47:01.612064 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: INFO nova.api.openstack.requestlog [None req-26b6e6bd-a980-4486-9ce7-69cdd92e90ed tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] 10.222.0.61 "GET /compute/v2.1/servers/563c74e0-060d-49d5-abc5-389cee4bd9d5" status: 200 len: 1321 microversion: 2.1 time: 0.146256 May 14 15:47:01.612626 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: [pid: 128728|app: 0|req: 68/123] 10.222.0.61 () {58 vars in 1235 bytes} [Sat May 14 15:47:01 2022] GET /compute/v2.1/servers/563c74e0-060d-49d5-abc5-389cee4bd9d5 => generated 1321 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 15:47:01.764375 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi [None req-bffa339e-f0dc-4405-a41d-07df99673f8e tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] Calling method '>' {{(pid=128729) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 15:47:01.764907 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.compute.api [None req-bffa339e-f0dc-4405-a41d-07df99673f8e tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] [instance: 113f6b52-519c-45f4-9bc2-37168d644e15] Fetching instance by UUID {{(pid=128729) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 15:47:01.770723 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-bffa339e-f0dc-4405-a41d-07df99673f8e tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:47:01.771173 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-bffa339e-f0dc-4405-a41d-07df99673f8e tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:47:01.771940 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-bffa339e-f0dc-4405-a41d-07df99673f8e tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:47:01.772372 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-bffa339e-f0dc-4405-a41d-07df99673f8e tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:47:01.897646 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.policy [None req-bffa339e-f0dc-4405-a41d-07df99673f8e tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc43895177134e9c9c030a9d87f94aaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7905689c95d44a5c9169249c70f7de57', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128729) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:47:01.905369 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: INFO nova.api.openstack.requestlog [None req-bffa339e-f0dc-4405-a41d-07df99673f8e tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] 10.222.0.61 "GET /compute/v2.1/servers/113f6b52-519c-45f4-9bc2-37168d644e15" status: 200 len: 1366 microversion: 2.1 time: 0.145435 May 14 15:47:01.905930 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: [pid: 128729|app: 0|req: 56/124] 10.222.0.61 () {58 vars in 1235 bytes} [Sat May 14 15:47:01 2022] GET /compute/v2.1/servers/113f6b52-519c-45f4-9bc2-37168d644e15 => generated 1366 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 15:47:02.335956 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi [None req-25a18875-1938-49dc-8bc2-b86179dea7f8 tempest-DeleteServersTestJSON-2100051872 tempest-DeleteServersTestJSON-2100051872-project] Calling method '>' {{(pid=128728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 15:47:02.336566 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.compute.api [None req-25a18875-1938-49dc-8bc2-b86179dea7f8 tempest-DeleteServersTestJSON-2100051872 tempest-DeleteServersTestJSON-2100051872-project] [instance: 75ca93de-6825-44ce-af10-44cba59218a1] Fetching instance by UUID {{(pid=128728) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 15:47:02.342584 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-25a18875-1938-49dc-8bc2-b86179dea7f8 tempest-DeleteServersTestJSON-2100051872 tempest-DeleteServersTestJSON-2100051872-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:47:02.343033 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-25a18875-1938-49dc-8bc2-b86179dea7f8 tempest-DeleteServersTestJSON-2100051872 tempest-DeleteServersTestJSON-2100051872-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:47:02.343796 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-25a18875-1938-49dc-8bc2-b86179dea7f8 tempest-DeleteServersTestJSON-2100051872 tempest-DeleteServersTestJSON-2100051872-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:47:02.344228 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-25a18875-1938-49dc-8bc2-b86179dea7f8 tempest-DeleteServersTestJSON-2100051872 tempest-DeleteServersTestJSON-2100051872-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:47:02.470256 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.policy [None req-25a18875-1938-49dc-8bc2-b86179dea7f8 tempest-DeleteServersTestJSON-2100051872 tempest-DeleteServersTestJSON-2100051872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aad828d8ff314a2d82f07fb6d84f36a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6388da70b0dc48c1952570af4332dd6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128728) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:47:02.477433 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: INFO nova.api.openstack.requestlog [None req-25a18875-1938-49dc-8bc2-b86179dea7f8 tempest-DeleteServersTestJSON-2100051872 tempest-DeleteServersTestJSON-2100051872-project] 10.222.0.61 "GET /compute/v2.1/servers/75ca93de-6825-44ce-af10-44cba59218a1" status: 200 len: 1315 microversion: 2.1 time: 0.145387 May 14 15:47:02.477995 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: [pid: 128728|app: 0|req: 69/125] 10.222.0.61 () {58 vars in 1235 bytes} [Sat May 14 15:47:02 2022] GET /compute/v2.1/servers/75ca93de-6825-44ce-af10-44cba59218a1 => generated 1315 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 15:47:02.534886 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi [None req-9789162a-f4c8-4597-bb41-fd4c866a3e40 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Calling method '>' {{(pid=128729) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 15:47:02.535491 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.compute.api [None req-9789162a-f4c8-4597-bb41-fd4c866a3e40 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] [instance: e33e9970-bfb7-46f3-8d40-782dbfa3d21c] Fetching instance by UUID {{(pid=128729) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 15:47:02.541348 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-9789162a-f4c8-4597-bb41-fd4c866a3e40 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:47:02.542428 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-9789162a-f4c8-4597-bb41-fd4c866a3e40 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:47:02.543190 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-9789162a-f4c8-4597-bb41-fd4c866a3e40 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:47:02.543632 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-9789162a-f4c8-4597-bb41-fd4c866a3e40 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:47:02.601836 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.policy [None req-9789162a-f4c8-4597-bb41-fd4c866a3e40 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58bfb7417bc94583963401ae0fe9d39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0672be3fa3f7414da1c1a5b7300abbe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128729) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:47:02.610160 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.policy [None req-9789162a-f4c8-4597-bb41-fd4c866a3e40 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58bfb7417bc94583963401ae0fe9d39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0672be3fa3f7414da1c1a5b7300abbe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128729) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:47:02.611965 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.policy [None req-9789162a-f4c8-4597-bb41-fd4c866a3e40 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58bfb7417bc94583963401ae0fe9d39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0672be3fa3f7414da1c1a5b7300abbe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128729) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:47:02.613055 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: INFO nova.api.openstack.requestlog [None req-9789162a-f4c8-4597-bb41-fd4c866a3e40 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] 10.222.0.61 "GET /compute/v2.1/servers/e33e9970-bfb7-46f3-8d40-782dbfa3d21c" status: 200 len: 1341 microversion: 2.20 time: 0.082058 May 14 15:47:02.613613 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: [pid: 128729|app: 0|req: 57/126] 10.222.0.61 () {60 vars in 1276 bytes} [Sat May 14 15:47:02 2022] GET /compute/v2.1/servers/e33e9970-bfb7-46f3-8d40-782dbfa3d21c => generated 1341 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 14 15:47:02.628637 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi [None req-e631a4ff-0ae1-4619-bc06-2fd3b82ae31d tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Calling method '>' {{(pid=128728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 15:47:02.629241 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.compute.api [None req-e631a4ff-0ae1-4619-bc06-2fd3b82ae31d tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] [instance: 563c74e0-060d-49d5-abc5-389cee4bd9d5] Fetching instance by UUID {{(pid=128728) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 15:47:02.635134 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-e631a4ff-0ae1-4619-bc06-2fd3b82ae31d tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:47:02.635612 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-e631a4ff-0ae1-4619-bc06-2fd3b82ae31d tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:47:02.636384 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-e631a4ff-0ae1-4619-bc06-2fd3b82ae31d tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:47:02.636818 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-e631a4ff-0ae1-4619-bc06-2fd3b82ae31d tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:47:02.759214 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.policy [None req-e631a4ff-0ae1-4619-bc06-2fd3b82ae31d tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b896317d96a40d6a137db0dcf5f98f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d2517d5440a4d30949f3dd36a46d813', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128728) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:47:02.766616 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: INFO nova.api.openstack.requestlog [None req-e631a4ff-0ae1-4619-bc06-2fd3b82ae31d tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] 10.222.0.61 "GET /compute/v2.1/servers/563c74e0-060d-49d5-abc5-389cee4bd9d5" status: 200 len: 1321 microversion: 2.1 time: 0.141877 May 14 15:47:02.767178 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: [pid: 128728|app: 0|req: 70/127] 10.222.0.61 () {58 vars in 1235 bytes} [Sat May 14 15:47:02 2022] GET /compute/v2.1/servers/563c74e0-060d-49d5-abc5-389cee4bd9d5 => generated 1321 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 15:47:02.922067 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi [None req-8338dfde-cee1-4e95-846b-dbb72cdb10a2 tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] Calling method '>' {{(pid=128729) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 15:47:02.923036 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.compute.api [None req-8338dfde-cee1-4e95-846b-dbb72cdb10a2 tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] [instance: 113f6b52-519c-45f4-9bc2-37168d644e15] Fetching instance by UUID {{(pid=128729) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 15:47:02.929226 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-8338dfde-cee1-4e95-846b-dbb72cdb10a2 tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:47:02.929671 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-8338dfde-cee1-4e95-846b-dbb72cdb10a2 tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:47:02.930456 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-8338dfde-cee1-4e95-846b-dbb72cdb10a2 tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:47:02.930889 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-8338dfde-cee1-4e95-846b-dbb72cdb10a2 tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:47:03.219606 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.policy [None req-8338dfde-cee1-4e95-846b-dbb72cdb10a2 tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc43895177134e9c9c030a9d87f94aaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7905689c95d44a5c9169249c70f7de57', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128729) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:47:03.226892 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: INFO nova.api.openstack.requestlog [None req-8338dfde-cee1-4e95-846b-dbb72cdb10a2 tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] 10.222.0.61 "GET /compute/v2.1/servers/113f6b52-519c-45f4-9bc2-37168d644e15" status: 200 len: 1366 microversion: 2.1 time: 0.308644 May 14 15:47:03.230878 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: [pid: 128729|app: 0|req: 58/128] 10.222.0.61 () {58 vars in 1235 bytes} [Sat May 14 15:47:02 2022] GET /compute/v2.1/servers/113f6b52-519c-45f4-9bc2-37168d644e15 => generated 1366 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 15:47:03.495356 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi [None req-b16e21f6-5038-4600-a0e7-064e9ddcf004 tempest-DeleteServersTestJSON-2100051872 tempest-DeleteServersTestJSON-2100051872-project] Calling method '>' {{(pid=128728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 15:47:03.495985 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.compute.api [None req-b16e21f6-5038-4600-a0e7-064e9ddcf004 tempest-DeleteServersTestJSON-2100051872 tempest-DeleteServersTestJSON-2100051872-project] [instance: 75ca93de-6825-44ce-af10-44cba59218a1] Fetching instance by UUID {{(pid=128728) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 15:47:03.501729 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-b16e21f6-5038-4600-a0e7-064e9ddcf004 tempest-DeleteServersTestJSON-2100051872 tempest-DeleteServersTestJSON-2100051872-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:47:03.502172 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-b16e21f6-5038-4600-a0e7-064e9ddcf004 tempest-DeleteServersTestJSON-2100051872 tempest-DeleteServersTestJSON-2100051872-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:47:03.502966 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-b16e21f6-5038-4600-a0e7-064e9ddcf004 tempest-DeleteServersTestJSON-2100051872 tempest-DeleteServersTestJSON-2100051872-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:47:03.503398 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-b16e21f6-5038-4600-a0e7-064e9ddcf004 tempest-DeleteServersTestJSON-2100051872 tempest-DeleteServersTestJSON-2100051872-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:47:03.625895 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.policy [None req-b16e21f6-5038-4600-a0e7-064e9ddcf004 tempest-DeleteServersTestJSON-2100051872 tempest-DeleteServersTestJSON-2100051872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aad828d8ff314a2d82f07fb6d84f36a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6388da70b0dc48c1952570af4332dd6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128728) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:47:03.630562 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi [None req-83c442fa-9728-40a2-9571-ed7f869c2f84 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Calling method '>' {{(pid=128729) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 15:47:03.631198 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.compute.api [None req-83c442fa-9728-40a2-9571-ed7f869c2f84 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] [instance: e33e9970-bfb7-46f3-8d40-782dbfa3d21c] Fetching instance by UUID {{(pid=128729) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 15:47:03.633120 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: INFO nova.api.openstack.requestlog [None req-b16e21f6-5038-4600-a0e7-064e9ddcf004 tempest-DeleteServersTestJSON-2100051872 tempest-DeleteServersTestJSON-2100051872-project] 10.222.0.61 "GET /compute/v2.1/servers/75ca93de-6825-44ce-af10-44cba59218a1" status: 200 len: 1315 microversion: 2.1 time: 0.141640 May 14 15:47:03.633982 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: [pid: 128728|app: 0|req: 71/129] 10.222.0.61 () {58 vars in 1235 bytes} [Sat May 14 15:47:03 2022] GET /compute/v2.1/servers/75ca93de-6825-44ce-af10-44cba59218a1 => generated 1315 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 15:47:03.638139 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-83c442fa-9728-40a2-9571-ed7f869c2f84 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:47:03.638737 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-83c442fa-9728-40a2-9571-ed7f869c2f84 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:47:03.639509 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-83c442fa-9728-40a2-9571-ed7f869c2f84 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:47:03.639944 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-83c442fa-9728-40a2-9571-ed7f869c2f84 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:47:03.701791 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.policy [None req-83c442fa-9728-40a2-9571-ed7f869c2f84 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58bfb7417bc94583963401ae0fe9d39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0672be3fa3f7414da1c1a5b7300abbe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128729) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:47:03.709435 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.policy [None req-83c442fa-9728-40a2-9571-ed7f869c2f84 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58bfb7417bc94583963401ae0fe9d39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0672be3fa3f7414da1c1a5b7300abbe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128729) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:47:03.710971 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.policy [None req-83c442fa-9728-40a2-9571-ed7f869c2f84 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58bfb7417bc94583963401ae0fe9d39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0672be3fa3f7414da1c1a5b7300abbe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128729) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:47:03.712060 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: INFO nova.api.openstack.requestlog [None req-83c442fa-9728-40a2-9571-ed7f869c2f84 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] 10.222.0.61 "GET /compute/v2.1/servers/e33e9970-bfb7-46f3-8d40-782dbfa3d21c" status: 200 len: 1341 microversion: 2.20 time: 0.085418 May 14 15:47:03.712611 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: [pid: 128729|app: 0|req: 59/130] 10.222.0.61 () {60 vars in 1276 bytes} [Sat May 14 15:47:03 2022] GET /compute/v2.1/servers/e33e9970-bfb7-46f3-8d40-782dbfa3d21c => generated 1341 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 14 15:47:03.783136 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi [None req-5e9431c9-2dac-479f-bdff-8aef717caaaf tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Calling method '>' {{(pid=128728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 15:47:03.783739 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.compute.api [None req-5e9431c9-2dac-479f-bdff-8aef717caaaf tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] [instance: 563c74e0-060d-49d5-abc5-389cee4bd9d5] Fetching instance by UUID {{(pid=128728) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 15:47:03.789932 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-5e9431c9-2dac-479f-bdff-8aef717caaaf tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:47:03.790408 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-5e9431c9-2dac-479f-bdff-8aef717caaaf tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:47:03.791167 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-5e9431c9-2dac-479f-bdff-8aef717caaaf tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:47:03.791599 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-5e9431c9-2dac-479f-bdff-8aef717caaaf tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:47:03.917844 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.policy [None req-5e9431c9-2dac-479f-bdff-8aef717caaaf tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b896317d96a40d6a137db0dcf5f98f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d2517d5440a4d30949f3dd36a46d813', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128728) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:47:03.925205 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: INFO nova.api.openstack.requestlog [None req-5e9431c9-2dac-479f-bdff-8aef717caaaf tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] 10.222.0.61 "GET /compute/v2.1/servers/563c74e0-060d-49d5-abc5-389cee4bd9d5" status: 200 len: 1321 microversion: 2.1 time: 0.145815 May 14 15:47:03.925764 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: [pid: 128728|app: 0|req: 72/131] 10.222.0.61 () {58 vars in 1235 bytes} [Sat May 14 15:47:03 2022] GET /compute/v2.1/servers/563c74e0-060d-49d5-abc5-389cee4bd9d5 => generated 1321 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 15:47:04.244248 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi [None req-b65cbb13-3154-4b42-b089-eaf3413cd439 tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] Calling method '>' {{(pid=128729) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 15:47:04.244930 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.compute.api [None req-b65cbb13-3154-4b42-b089-eaf3413cd439 tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] [instance: 113f6b52-519c-45f4-9bc2-37168d644e15] Fetching instance by UUID {{(pid=128729) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 15:47:04.251020 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-b65cbb13-3154-4b42-b089-eaf3413cd439 tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:47:04.251464 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-b65cbb13-3154-4b42-b089-eaf3413cd439 tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:47:04.252231 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-b65cbb13-3154-4b42-b089-eaf3413cd439 tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:47:04.252661 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-b65cbb13-3154-4b42-b089-eaf3413cd439 tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:47:04.381692 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.policy [None req-b65cbb13-3154-4b42-b089-eaf3413cd439 tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc43895177134e9c9c030a9d87f94aaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7905689c95d44a5c9169249c70f7de57', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128729) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:47:04.389545 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: INFO nova.api.openstack.requestlog [None req-b65cbb13-3154-4b42-b089-eaf3413cd439 tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] 10.222.0.61 "GET /compute/v2.1/servers/113f6b52-519c-45f4-9bc2-37168d644e15" status: 200 len: 1366 microversion: 2.1 time: 0.149188 May 14 15:47:04.390205 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: [pid: 128729|app: 0|req: 60/132] 10.222.0.61 () {58 vars in 1235 bytes} [Sat May 14 15:47:04 2022] GET /compute/v2.1/servers/113f6b52-519c-45f4-9bc2-37168d644e15 => generated 1366 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 15:47:04.652661 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi [None req-feb0c33a-cbe0-4642-8d65-eefa98ad8c10 tempest-DeleteServersTestJSON-2100051872 tempest-DeleteServersTestJSON-2100051872-project] Calling method '>' {{(pid=128728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 15:47:04.653262 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.compute.api [None req-feb0c33a-cbe0-4642-8d65-eefa98ad8c10 tempest-DeleteServersTestJSON-2100051872 tempest-DeleteServersTestJSON-2100051872-project] [instance: 75ca93de-6825-44ce-af10-44cba59218a1] Fetching instance by UUID {{(pid=128728) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 15:47:04.659197 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-feb0c33a-cbe0-4642-8d65-eefa98ad8c10 tempest-DeleteServersTestJSON-2100051872 tempest-DeleteServersTestJSON-2100051872-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:47:04.659644 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-feb0c33a-cbe0-4642-8d65-eefa98ad8c10 tempest-DeleteServersTestJSON-2100051872 tempest-DeleteServersTestJSON-2100051872-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:47:04.660396 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-feb0c33a-cbe0-4642-8d65-eefa98ad8c10 tempest-DeleteServersTestJSON-2100051872 tempest-DeleteServersTestJSON-2100051872-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:47:04.660826 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-feb0c33a-cbe0-4642-8d65-eefa98ad8c10 tempest-DeleteServersTestJSON-2100051872 tempest-DeleteServersTestJSON-2100051872-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:47:04.730618 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi [None req-5f2fe5d3-f484-4c29-bb0d-507d238a41a9 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Calling method '>' {{(pid=128729) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 15:47:04.731224 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.compute.api [None req-5f2fe5d3-f484-4c29-bb0d-507d238a41a9 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] [instance: e33e9970-bfb7-46f3-8d40-782dbfa3d21c] Fetching instance by UUID {{(pid=128729) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 15:47:04.737204 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-5f2fe5d3-f484-4c29-bb0d-507d238a41a9 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:47:04.737652 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-5f2fe5d3-f484-4c29-bb0d-507d238a41a9 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:47:04.738435 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-5f2fe5d3-f484-4c29-bb0d-507d238a41a9 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:47:04.739059 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-5f2fe5d3-f484-4c29-bb0d-507d238a41a9 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:47:04.805811 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.policy [None req-5f2fe5d3-f484-4c29-bb0d-507d238a41a9 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58bfb7417bc94583963401ae0fe9d39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0672be3fa3f7414da1c1a5b7300abbe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128729) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:47:04.813330 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.policy [None req-feb0c33a-cbe0-4642-8d65-eefa98ad8c10 tempest-DeleteServersTestJSON-2100051872 tempest-DeleteServersTestJSON-2100051872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aad828d8ff314a2d82f07fb6d84f36a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6388da70b0dc48c1952570af4332dd6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128728) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:47:04.814085 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.policy [None req-5f2fe5d3-f484-4c29-bb0d-507d238a41a9 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58bfb7417bc94583963401ae0fe9d39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0672be3fa3f7414da1c1a5b7300abbe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128729) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:47:04.815633 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.policy [None req-5f2fe5d3-f484-4c29-bb0d-507d238a41a9 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58bfb7417bc94583963401ae0fe9d39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0672be3fa3f7414da1c1a5b7300abbe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128729) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:47:04.816740 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: INFO nova.api.openstack.requestlog [None req-5f2fe5d3-f484-4c29-bb0d-507d238a41a9 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] 10.222.0.61 "GET /compute/v2.1/servers/e33e9970-bfb7-46f3-8d40-782dbfa3d21c" status: 200 len: 1341 microversion: 2.20 time: 0.090359 May 14 15:47:04.817365 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: [pid: 128729|app: 0|req: 61/133] 10.222.0.61 () {60 vars in 1276 bytes} [Sat May 14 15:47:04 2022] GET /compute/v2.1/servers/e33e9970-bfb7-46f3-8d40-782dbfa3d21c => generated 1341 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 14 15:47:04.820600 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: INFO nova.api.openstack.requestlog [None req-feb0c33a-cbe0-4642-8d65-eefa98ad8c10 tempest-DeleteServersTestJSON-2100051872 tempest-DeleteServersTestJSON-2100051872-project] 10.222.0.61 "GET /compute/v2.1/servers/75ca93de-6825-44ce-af10-44cba59218a1" status: 200 len: 1315 microversion: 2.1 time: 0.172322 May 14 15:47:04.821147 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: [pid: 128728|app: 0|req: 73/134] 10.222.0.61 () {58 vars in 1235 bytes} [Sat May 14 15:47:04 2022] GET /compute/v2.1/servers/75ca93de-6825-44ce-af10-44cba59218a1 => generated 1315 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 15:47:04.942223 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi [None req-060f126a-6c0b-426f-9950-b45c7e6d0ef2 tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Calling method '>' {{(pid=128729) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 15:47:04.942775 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.compute.api [None req-060f126a-6c0b-426f-9950-b45c7e6d0ef2 tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] [instance: 563c74e0-060d-49d5-abc5-389cee4bd9d5] Fetching instance by UUID {{(pid=128729) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 15:47:04.949381 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-060f126a-6c0b-426f-9950-b45c7e6d0ef2 tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:47:04.949825 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-060f126a-6c0b-426f-9950-b45c7e6d0ef2 tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:47:04.950611 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-060f126a-6c0b-426f-9950-b45c7e6d0ef2 tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:47:04.951046 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-060f126a-6c0b-426f-9950-b45c7e6d0ef2 tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:47:05.074799 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.policy [None req-060f126a-6c0b-426f-9950-b45c7e6d0ef2 tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b896317d96a40d6a137db0dcf5f98f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d2517d5440a4d30949f3dd36a46d813', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128729) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:47:05.081873 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: INFO nova.api.openstack.requestlog [None req-060f126a-6c0b-426f-9950-b45c7e6d0ef2 tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] 10.222.0.61 "GET /compute/v2.1/servers/563c74e0-060d-49d5-abc5-389cee4bd9d5" status: 200 len: 1321 microversion: 2.1 time: 0.143515 May 14 15:47:05.082462 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: [pid: 128729|app: 0|req: 62/135] 10.222.0.61 () {58 vars in 1235 bytes} [Sat May 14 15:47:04 2022] GET /compute/v2.1/servers/563c74e0-060d-49d5-abc5-389cee4bd9d5 => generated 1321 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 15:47:05.406335 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi [None req-69efadbf-6550-44eb-ba3d-966a3a31eaa5 tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] Calling method '>' {{(pid=128728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 15:47:05.406953 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.compute.api [None req-69efadbf-6550-44eb-ba3d-966a3a31eaa5 tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] [instance: 113f6b52-519c-45f4-9bc2-37168d644e15] Fetching instance by UUID {{(pid=128728) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 15:47:05.412919 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-69efadbf-6550-44eb-ba3d-966a3a31eaa5 tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:47:05.413370 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-69efadbf-6550-44eb-ba3d-966a3a31eaa5 tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:47:05.414147 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-69efadbf-6550-44eb-ba3d-966a3a31eaa5 tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:47:05.414608 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-69efadbf-6550-44eb-ba3d-966a3a31eaa5 tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:47:05.548126 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.policy [None req-69efadbf-6550-44eb-ba3d-966a3a31eaa5 tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc43895177134e9c9c030a9d87f94aaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7905689c95d44a5c9169249c70f7de57', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128728) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:47:05.555333 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: INFO nova.api.openstack.requestlog [None req-69efadbf-6550-44eb-ba3d-966a3a31eaa5 tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] 10.222.0.61 "GET /compute/v2.1/servers/113f6b52-519c-45f4-9bc2-37168d644e15" status: 200 len: 1366 microversion: 2.1 time: 0.152902 May 14 15:47:05.555893 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: [pid: 128728|app: 0|req: 74/136] 10.222.0.61 () {58 vars in 1235 bytes} [Sat May 14 15:47:05 2022] GET /compute/v2.1/servers/113f6b52-519c-45f4-9bc2-37168d644e15 => generated 1366 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 15:47:05.836082 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi [None req-1da26e19-b763-4cfe-a028-b4f2325cdc91 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Calling method '>' {{(pid=128729) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 15:47:05.836883 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.compute.api [None req-1da26e19-b763-4cfe-a028-b4f2325cdc91 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] [instance: e33e9970-bfb7-46f3-8d40-782dbfa3d21c] Fetching instance by UUID {{(pid=128729) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 15:47:05.837612 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi [None req-7f849648-6add-4be3-82f1-ff5e353c86a9 tempest-DeleteServersTestJSON-2100051872 tempest-DeleteServersTestJSON-2100051872-project] Calling method '>' {{(pid=128728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 15:47:05.838352 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.compute.api [None req-7f849648-6add-4be3-82f1-ff5e353c86a9 tempest-DeleteServersTestJSON-2100051872 tempest-DeleteServersTestJSON-2100051872-project] [instance: 75ca93de-6825-44ce-af10-44cba59218a1] Fetching instance by UUID {{(pid=128728) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 15:47:05.844642 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-1da26e19-b763-4cfe-a028-b4f2325cdc91 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:47:05.845095 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-1da26e19-b763-4cfe-a028-b4f2325cdc91 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:47:05.845837 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-7f849648-6add-4be3-82f1-ff5e353c86a9 tempest-DeleteServersTestJSON-2100051872 tempest-DeleteServersTestJSON-2100051872-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:47:05.845945 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-1da26e19-b763-4cfe-a028-b4f2325cdc91 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:47:05.846278 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-1da26e19-b763-4cfe-a028-b4f2325cdc91 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:47:05.846517 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-7f849648-6add-4be3-82f1-ff5e353c86a9 tempest-DeleteServersTestJSON-2100051872 tempest-DeleteServersTestJSON-2100051872-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:47:05.847370 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-7f849648-6add-4be3-82f1-ff5e353c86a9 tempest-DeleteServersTestJSON-2100051872 tempest-DeleteServersTestJSON-2100051872-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:47:05.847870 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-7f849648-6add-4be3-82f1-ff5e353c86a9 tempest-DeleteServersTestJSON-2100051872 tempest-DeleteServersTestJSON-2100051872-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:47:05.925721 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.policy [None req-1da26e19-b763-4cfe-a028-b4f2325cdc91 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58bfb7417bc94583963401ae0fe9d39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0672be3fa3f7414da1c1a5b7300abbe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128729) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:47:05.934774 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.policy [None req-1da26e19-b763-4cfe-a028-b4f2325cdc91 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58bfb7417bc94583963401ae0fe9d39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0672be3fa3f7414da1c1a5b7300abbe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128729) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:47:05.936284 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.policy [None req-1da26e19-b763-4cfe-a028-b4f2325cdc91 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58bfb7417bc94583963401ae0fe9d39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0672be3fa3f7414da1c1a5b7300abbe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128729) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:47:05.937400 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: INFO nova.api.openstack.requestlog [None req-1da26e19-b763-4cfe-a028-b4f2325cdc91 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] 10.222.0.61 "GET /compute/v2.1/servers/e33e9970-bfb7-46f3-8d40-782dbfa3d21c" status: 200 len: 1341 microversion: 2.20 time: 0.105538 May 14 15:47:05.937959 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: [pid: 128729|app: 0|req: 63/137] 10.222.0.61 () {60 vars in 1276 bytes} [Sat May 14 15:47:05 2022] GET /compute/v2.1/servers/e33e9970-bfb7-46f3-8d40-782dbfa3d21c => generated 1341 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 14 15:47:06.010681 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.policy [None req-7f849648-6add-4be3-82f1-ff5e353c86a9 tempest-DeleteServersTestJSON-2100051872 tempest-DeleteServersTestJSON-2100051872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aad828d8ff314a2d82f07fb6d84f36a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6388da70b0dc48c1952570af4332dd6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128728) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:47:06.018417 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: INFO nova.api.openstack.requestlog [None req-7f849648-6add-4be3-82f1-ff5e353c86a9 tempest-DeleteServersTestJSON-2100051872 tempest-DeleteServersTestJSON-2100051872-project] 10.222.0.61 "GET /compute/v2.1/servers/75ca93de-6825-44ce-af10-44cba59218a1" status: 200 len: 1315 microversion: 2.1 time: 0.184633 May 14 15:47:06.018989 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: [pid: 128728|app: 0|req: 75/138] 10.222.0.61 () {58 vars in 1235 bytes} [Sat May 14 15:47:05 2022] GET /compute/v2.1/servers/75ca93de-6825-44ce-af10-44cba59218a1 => generated 1315 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 15:47:06.097937 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi [None req-4b6b5979-da62-41d0-b04f-41f44aa82b63 tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Calling method '>' {{(pid=128729) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 15:47:06.098589 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.compute.api [None req-4b6b5979-da62-41d0-b04f-41f44aa82b63 tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] [instance: 563c74e0-060d-49d5-abc5-389cee4bd9d5] Fetching instance by UUID {{(pid=128729) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 15:47:06.105524 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-4b6b5979-da62-41d0-b04f-41f44aa82b63 tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:47:06.105989 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-4b6b5979-da62-41d0-b04f-41f44aa82b63 tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:47:06.106967 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-4b6b5979-da62-41d0-b04f-41f44aa82b63 tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:47:06.107411 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-4b6b5979-da62-41d0-b04f-41f44aa82b63 tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:47:06.245303 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.policy [None req-4b6b5979-da62-41d0-b04f-41f44aa82b63 tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b896317d96a40d6a137db0dcf5f98f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d2517d5440a4d30949f3dd36a46d813', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128729) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:47:06.252622 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: INFO nova.api.openstack.requestlog [None req-4b6b5979-da62-41d0-b04f-41f44aa82b63 tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] 10.222.0.61 "GET /compute/v2.1/servers/563c74e0-060d-49d5-abc5-389cee4bd9d5" status: 200 len: 1321 microversion: 2.1 time: 0.158573 May 14 15:47:06.253192 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: [pid: 128729|app: 0|req: 64/139] 10.222.0.61 () {58 vars in 1235 bytes} [Sat May 14 15:47:06 2022] GET /compute/v2.1/servers/563c74e0-060d-49d5-abc5-389cee4bd9d5 => generated 1321 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 15:47:06.571699 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi [None req-11a6c198-ea1a-4480-a7c0-86ddd4e0d467 tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] Calling method '>' {{(pid=128728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 15:47:06.572418 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.compute.api [None req-11a6c198-ea1a-4480-a7c0-86ddd4e0d467 tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] [instance: 113f6b52-519c-45f4-9bc2-37168d644e15] Fetching instance by UUID {{(pid=128728) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 15:47:06.579217 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-11a6c198-ea1a-4480-a7c0-86ddd4e0d467 tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:47:06.579668 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-11a6c198-ea1a-4480-a7c0-86ddd4e0d467 tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:47:06.580425 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-11a6c198-ea1a-4480-a7c0-86ddd4e0d467 tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:47:06.580854 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-11a6c198-ea1a-4480-a7c0-86ddd4e0d467 tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:47:06.739010 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.policy [None req-11a6c198-ea1a-4480-a7c0-86ddd4e0d467 tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc43895177134e9c9c030a9d87f94aaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7905689c95d44a5c9169249c70f7de57', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128728) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:47:06.755238 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: INFO nova.api.openstack.requestlog [None req-11a6c198-ea1a-4480-a7c0-86ddd4e0d467 tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] 10.222.0.61 "GET /compute/v2.1/servers/113f6b52-519c-45f4-9bc2-37168d644e15" status: 200 len: 1366 microversion: 2.1 time: 0.187250 May 14 15:47:06.755839 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: [pid: 128728|app: 0|req: 76/140] 10.222.0.61 () {58 vars in 1235 bytes} [Sat May 14 15:47:06 2022] GET /compute/v2.1/servers/113f6b52-519c-45f4-9bc2-37168d644e15 => generated 1366 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 15:47:06.955951 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi [None req-e034485c-272d-4273-bd54-701096266e1b tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Calling method '>' {{(pid=128729) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 15:47:06.956571 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.compute.api [None req-e034485c-272d-4273-bd54-701096266e1b tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] [instance: e33e9970-bfb7-46f3-8d40-782dbfa3d21c] Fetching instance by UUID {{(pid=128729) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 15:47:06.963264 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-e034485c-272d-4273-bd54-701096266e1b tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:47:06.963720 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-e034485c-272d-4273-bd54-701096266e1b tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:47:06.964510 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-e034485c-272d-4273-bd54-701096266e1b tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:47:06.965134 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-e034485c-272d-4273-bd54-701096266e1b tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:47:07.036518 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi [None req-1a43000b-5840-4b3e-be10-0131d1aeffee tempest-DeleteServersTestJSON-2100051872 tempest-DeleteServersTestJSON-2100051872-project] Calling method '>' {{(pid=128728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 15:47:07.037289 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.compute.api [None req-1a43000b-5840-4b3e-be10-0131d1aeffee tempest-DeleteServersTestJSON-2100051872 tempest-DeleteServersTestJSON-2100051872-project] [instance: 75ca93de-6825-44ce-af10-44cba59218a1] Fetching instance by UUID {{(pid=128728) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 15:47:07.041789 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.policy [None req-e034485c-272d-4273-bd54-701096266e1b tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58bfb7417bc94583963401ae0fe9d39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0672be3fa3f7414da1c1a5b7300abbe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128729) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:47:07.044159 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-1a43000b-5840-4b3e-be10-0131d1aeffee tempest-DeleteServersTestJSON-2100051872 tempest-DeleteServersTestJSON-2100051872-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:47:07.044696 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-1a43000b-5840-4b3e-be10-0131d1aeffee tempest-DeleteServersTestJSON-2100051872 tempest-DeleteServersTestJSON-2100051872-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:47:07.045553 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-1a43000b-5840-4b3e-be10-0131d1aeffee tempest-DeleteServersTestJSON-2100051872 tempest-DeleteServersTestJSON-2100051872-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:47:07.046173 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-1a43000b-5840-4b3e-be10-0131d1aeffee tempest-DeleteServersTestJSON-2100051872 tempest-DeleteServersTestJSON-2100051872-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:47:07.050184 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.policy [None req-e034485c-272d-4273-bd54-701096266e1b tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58bfb7417bc94583963401ae0fe9d39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0672be3fa3f7414da1c1a5b7300abbe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128729) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:47:07.051736 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.policy [None req-e034485c-272d-4273-bd54-701096266e1b tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58bfb7417bc94583963401ae0fe9d39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0672be3fa3f7414da1c1a5b7300abbe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128729) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:47:07.052856 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: INFO nova.api.openstack.requestlog [None req-e034485c-272d-4273-bd54-701096266e1b tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] 10.222.0.61 "GET /compute/v2.1/servers/e33e9970-bfb7-46f3-8d40-782dbfa3d21c" status: 200 len: 1339 microversion: 2.20 time: 0.101534 May 14 15:47:07.053414 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: [pid: 128729|app: 0|req: 65/141] 10.222.0.61 () {60 vars in 1276 bytes} [Sat May 14 15:47:06 2022] GET /compute/v2.1/servers/e33e9970-bfb7-46f3-8d40-782dbfa3d21c => generated 1339 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 14 15:47:07.189287 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.policy [None req-1a43000b-5840-4b3e-be10-0131d1aeffee tempest-DeleteServersTestJSON-2100051872 tempest-DeleteServersTestJSON-2100051872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aad828d8ff314a2d82f07fb6d84f36a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6388da70b0dc48c1952570af4332dd6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128728) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:47:07.196445 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: INFO nova.api.openstack.requestlog [None req-1a43000b-5840-4b3e-be10-0131d1aeffee tempest-DeleteServersTestJSON-2100051872 tempest-DeleteServersTestJSON-2100051872-project] 10.222.0.61 "GET /compute/v2.1/servers/75ca93de-6825-44ce-af10-44cba59218a1" status: 200 len: 1315 microversion: 2.1 time: 0.163993 May 14 15:47:07.197014 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: [pid: 128728|app: 0|req: 77/142] 10.222.0.61 () {58 vars in 1235 bytes} [Sat May 14 15:47:07 2022] GET /compute/v2.1/servers/75ca93de-6825-44ce-af10-44cba59218a1 => generated 1315 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 15:47:07.269750 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi [None req-51069a62-6647-4dec-aa01-8eee57e4b194 tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Calling method '>' {{(pid=128729) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 15:47:07.270274 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.compute.api [None req-51069a62-6647-4dec-aa01-8eee57e4b194 tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] [instance: 563c74e0-060d-49d5-abc5-389cee4bd9d5] Fetching instance by UUID {{(pid=128729) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 15:47:07.276824 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-51069a62-6647-4dec-aa01-8eee57e4b194 tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:47:07.277279 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-51069a62-6647-4dec-aa01-8eee57e4b194 tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:47:07.278041 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-51069a62-6647-4dec-aa01-8eee57e4b194 tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:47:07.278554 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-51069a62-6647-4dec-aa01-8eee57e4b194 tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:47:07.405007 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.policy [None req-51069a62-6647-4dec-aa01-8eee57e4b194 tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b896317d96a40d6a137db0dcf5f98f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d2517d5440a4d30949f3dd36a46d813', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128729) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:47:07.412259 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: INFO nova.api.openstack.requestlog [None req-51069a62-6647-4dec-aa01-8eee57e4b194 tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] 10.222.0.61 "GET /compute/v2.1/servers/563c74e0-060d-49d5-abc5-389cee4bd9d5" status: 200 len: 1321 microversion: 2.1 time: 0.146360 May 14 15:47:07.412962 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: [pid: 128729|app: 0|req: 66/143] 10.222.0.61 () {58 vars in 1235 bytes} [Sat May 14 15:47:07 2022] GET /compute/v2.1/servers/563c74e0-060d-49d5-abc5-389cee4bd9d5 => generated 1321 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 15:47:07.771768 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi [None req-45cf91ff-ba8d-4752-93c3-6d0c502067cc tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] Calling method '>' {{(pid=128728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 15:47:07.772420 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.compute.api [None req-45cf91ff-ba8d-4752-93c3-6d0c502067cc tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] [instance: 113f6b52-519c-45f4-9bc2-37168d644e15] Fetching instance by UUID {{(pid=128728) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 15:47:07.778735 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-45cf91ff-ba8d-4752-93c3-6d0c502067cc tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:47:07.779186 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-45cf91ff-ba8d-4752-93c3-6d0c502067cc tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:47:07.779947 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-45cf91ff-ba8d-4752-93c3-6d0c502067cc tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:47:07.780517 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-45cf91ff-ba8d-4752-93c3-6d0c502067cc tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:47:07.925657 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.policy [None req-45cf91ff-ba8d-4752-93c3-6d0c502067cc tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc43895177134e9c9c030a9d87f94aaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7905689c95d44a5c9169249c70f7de57', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128728) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:47:07.935576 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: INFO nova.api.openstack.requestlog [None req-45cf91ff-ba8d-4752-93c3-6d0c502067cc tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] 10.222.0.61 "GET /compute/v2.1/servers/113f6b52-519c-45f4-9bc2-37168d644e15" status: 200 len: 1366 microversion: 2.1 time: 0.167497 May 14 15:47:07.936373 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: [pid: 128728|app: 0|req: 78/144] 10.222.0.61 () {58 vars in 1235 bytes} [Sat May 14 15:47:07 2022] GET /compute/v2.1/servers/113f6b52-519c-45f4-9bc2-37168d644e15 => generated 1366 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 15:47:08.075523 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi [None req-7edec197-b1fe-416d-a224-1bb5202c24e9 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Calling method '>' {{(pid=128729) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 15:47:08.076148 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.compute.api [None req-7edec197-b1fe-416d-a224-1bb5202c24e9 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] [instance: e33e9970-bfb7-46f3-8d40-782dbfa3d21c] Fetching instance by UUID {{(pid=128729) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 15:47:08.082811 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-7edec197-b1fe-416d-a224-1bb5202c24e9 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:47:08.084867 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-7edec197-b1fe-416d-a224-1bb5202c24e9 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:47:08.084867 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-7edec197-b1fe-416d-a224-1bb5202c24e9 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:47:08.084867 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-7edec197-b1fe-416d-a224-1bb5202c24e9 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:47:08.158388 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.policy [None req-7edec197-b1fe-416d-a224-1bb5202c24e9 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58bfb7417bc94583963401ae0fe9d39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0672be3fa3f7414da1c1a5b7300abbe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128729) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:47:08.169469 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.policy [None req-7edec197-b1fe-416d-a224-1bb5202c24e9 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58bfb7417bc94583963401ae0fe9d39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0672be3fa3f7414da1c1a5b7300abbe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128729) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:47:08.171055 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.policy [None req-7edec197-b1fe-416d-a224-1bb5202c24e9 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58bfb7417bc94583963401ae0fe9d39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0672be3fa3f7414da1c1a5b7300abbe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128729) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:47:08.172190 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: INFO nova.api.openstack.requestlog [None req-7edec197-b1fe-416d-a224-1bb5202c24e9 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] 10.222.0.61 "GET /compute/v2.1/servers/e33e9970-bfb7-46f3-8d40-782dbfa3d21c" status: 200 len: 1339 microversion: 2.20 time: 0.101916 May 14 15:47:08.172896 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: [pid: 128729|app: 0|req: 67/145] 10.222.0.61 () {60 vars in 1276 bytes} [Sat May 14 15:47:08 2022] GET /compute/v2.1/servers/e33e9970-bfb7-46f3-8d40-782dbfa3d21c => generated 1339 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 14 15:47:08.214754 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi [None req-0fd7681e-7cb5-4935-af72-ae0a575d8cce tempest-DeleteServersTestJSON-2100051872 tempest-DeleteServersTestJSON-2100051872-project] Calling method '>' {{(pid=128728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 15:47:08.215624 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.compute.api [None req-0fd7681e-7cb5-4935-af72-ae0a575d8cce tempest-DeleteServersTestJSON-2100051872 tempest-DeleteServersTestJSON-2100051872-project] [instance: 75ca93de-6825-44ce-af10-44cba59218a1] Fetching instance by UUID {{(pid=128728) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 15:47:08.222373 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-0fd7681e-7cb5-4935-af72-ae0a575d8cce tempest-DeleteServersTestJSON-2100051872 tempest-DeleteServersTestJSON-2100051872-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:47:08.222823 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-0fd7681e-7cb5-4935-af72-ae0a575d8cce tempest-DeleteServersTestJSON-2100051872 tempest-DeleteServersTestJSON-2100051872-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:47:08.223740 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-0fd7681e-7cb5-4935-af72-ae0a575d8cce tempest-DeleteServersTestJSON-2100051872 tempest-DeleteServersTestJSON-2100051872-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:47:08.224182 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-0fd7681e-7cb5-4935-af72-ae0a575d8cce tempest-DeleteServersTestJSON-2100051872 tempest-DeleteServersTestJSON-2100051872-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:47:08.381191 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.policy [None req-0fd7681e-7cb5-4935-af72-ae0a575d8cce tempest-DeleteServersTestJSON-2100051872 tempest-DeleteServersTestJSON-2100051872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aad828d8ff314a2d82f07fb6d84f36a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6388da70b0dc48c1952570af4332dd6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128728) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:47:08.388957 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: INFO nova.api.openstack.requestlog [None req-0fd7681e-7cb5-4935-af72-ae0a575d8cce tempest-DeleteServersTestJSON-2100051872 tempest-DeleteServersTestJSON-2100051872-project] 10.222.0.61 "GET /compute/v2.1/servers/75ca93de-6825-44ce-af10-44cba59218a1" status: 200 len: 1315 microversion: 2.1 time: 0.179370 May 14 15:47:08.390066 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: [pid: 128728|app: 0|req: 79/146] 10.222.0.61 () {58 vars in 1235 bytes} [Sat May 14 15:47:08 2022] GET /compute/v2.1/servers/75ca93de-6825-44ce-af10-44cba59218a1 => generated 1315 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 15:47:08.429734 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi [None req-e5342afb-d224-4ec6-b61a-488a5f10caab tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Calling method '>' {{(pid=128729) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 15:47:08.430443 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.compute.api [None req-e5342afb-d224-4ec6-b61a-488a5f10caab tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] [instance: 563c74e0-060d-49d5-abc5-389cee4bd9d5] Fetching instance by UUID {{(pid=128729) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 15:47:08.437440 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-e5342afb-d224-4ec6-b61a-488a5f10caab tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:47:08.437976 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-e5342afb-d224-4ec6-b61a-488a5f10caab tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:47:08.438963 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-e5342afb-d224-4ec6-b61a-488a5f10caab tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:47:08.439477 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-e5342afb-d224-4ec6-b61a-488a5f10caab tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:47:08.577393 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.policy [None req-e5342afb-d224-4ec6-b61a-488a5f10caab tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b896317d96a40d6a137db0dcf5f98f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d2517d5440a4d30949f3dd36a46d813', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128729) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:47:08.586031 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: INFO nova.api.openstack.requestlog [None req-e5342afb-d224-4ec6-b61a-488a5f10caab tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] 10.222.0.61 "GET /compute/v2.1/servers/563c74e0-060d-49d5-abc5-389cee4bd9d5" status: 200 len: 1321 microversion: 2.1 time: 0.160636 May 14 15:47:08.586917 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: [pid: 128729|app: 0|req: 68/147] 10.222.0.61 () {58 vars in 1235 bytes} [Sat May 14 15:47:08 2022] GET /compute/v2.1/servers/563c74e0-060d-49d5-abc5-389cee4bd9d5 => generated 1321 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 15:47:08.954195 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi [None req-611d5fac-34fd-4f14-935a-66718d213014 tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] Calling method '>' {{(pid=128728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 15:47:08.954717 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.compute.api [None req-611d5fac-34fd-4f14-935a-66718d213014 tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] [instance: 113f6b52-519c-45f4-9bc2-37168d644e15] Fetching instance by UUID {{(pid=128728) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 15:47:08.966479 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-611d5fac-34fd-4f14-935a-66718d213014 tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:47:08.967017 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-611d5fac-34fd-4f14-935a-66718d213014 tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:47:08.967949 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-611d5fac-34fd-4f14-935a-66718d213014 tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:47:08.968533 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-611d5fac-34fd-4f14-935a-66718d213014 tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:47:09.246592 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.policy [None req-611d5fac-34fd-4f14-935a-66718d213014 tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc43895177134e9c9c030a9d87f94aaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7905689c95d44a5c9169249c70f7de57', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128728) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:47:09.257198 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: INFO nova.api.openstack.requestlog [None req-611d5fac-34fd-4f14-935a-66718d213014 tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] 10.222.0.61 "GET /compute/v2.1/servers/113f6b52-519c-45f4-9bc2-37168d644e15" status: 200 len: 1366 microversion: 2.1 time: 0.307935 May 14 15:47:09.267470 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: [pid: 128728|app: 0|req: 80/148] 10.222.0.61 () {58 vars in 1235 bytes} [Sat May 14 15:47:08 2022] GET /compute/v2.1/servers/113f6b52-519c-45f4-9bc2-37168d644e15 => generated 1366 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 15:47:09.267470 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi [None req-7fea8091-3b8d-4dae-a52b-798a3163e58a tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Calling method '>' {{(pid=128728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 15:47:09.267470 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.compute.api [None req-7fea8091-3b8d-4dae-a52b-798a3163e58a tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] [instance: e33e9970-bfb7-46f3-8d40-782dbfa3d21c] Fetching instance by UUID {{(pid=128728) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 15:47:09.275403 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-7fea8091-3b8d-4dae-a52b-798a3163e58a tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:47:09.275887 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-7fea8091-3b8d-4dae-a52b-798a3163e58a tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:47:09.277197 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-7fea8091-3b8d-4dae-a52b-798a3163e58a tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:47:09.277676 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-7fea8091-3b8d-4dae-a52b-798a3163e58a tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:47:09.437118 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.policy [None req-7fea8091-3b8d-4dae-a52b-798a3163e58a tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58bfb7417bc94583963401ae0fe9d39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0672be3fa3f7414da1c1a5b7300abbe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128728) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:47:09.444845 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.policy [None req-7fea8091-3b8d-4dae-a52b-798a3163e58a tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58bfb7417bc94583963401ae0fe9d39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0672be3fa3f7414da1c1a5b7300abbe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128728) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:47:09.446769 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.policy [None req-7fea8091-3b8d-4dae-a52b-798a3163e58a tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58bfb7417bc94583963401ae0fe9d39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0672be3fa3f7414da1c1a5b7300abbe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128728) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:47:09.447494 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: INFO nova.api.openstack.requestlog [None req-7fea8091-3b8d-4dae-a52b-798a3163e58a tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] 10.222.0.61 "GET /compute/v2.1/servers/e33e9970-bfb7-46f3-8d40-782dbfa3d21c" status: 200 len: 1339 microversion: 2.20 time: 0.187567 May 14 15:47:09.448145 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: [pid: 128728|app: 0|req: 81/149] 10.222.0.61 () {60 vars in 1276 bytes} [Sat May 14 15:47:09 2022] GET /compute/v2.1/servers/e33e9970-bfb7-46f3-8d40-782dbfa3d21c => generated 1339 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 14 15:47:09.456849 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi [None req-73730b4b-9c47-4d3e-9529-f2a7008fa679 tempest-DeleteServersTestJSON-2100051872 tempest-DeleteServersTestJSON-2100051872-project] Calling method '>' {{(pid=128728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 15:47:09.457468 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.compute.api [None req-73730b4b-9c47-4d3e-9529-f2a7008fa679 tempest-DeleteServersTestJSON-2100051872 tempest-DeleteServersTestJSON-2100051872-project] [instance: 75ca93de-6825-44ce-af10-44cba59218a1] Fetching instance by UUID {{(pid=128728) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 15:47:09.474267 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-73730b4b-9c47-4d3e-9529-f2a7008fa679 tempest-DeleteServersTestJSON-2100051872 tempest-DeleteServersTestJSON-2100051872-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:47:09.474766 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-73730b4b-9c47-4d3e-9529-f2a7008fa679 tempest-DeleteServersTestJSON-2100051872 tempest-DeleteServersTestJSON-2100051872-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:47:09.475603 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-73730b4b-9c47-4d3e-9529-f2a7008fa679 tempest-DeleteServersTestJSON-2100051872 tempest-DeleteServersTestJSON-2100051872-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:47:09.476048 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-73730b4b-9c47-4d3e-9529-f2a7008fa679 tempest-DeleteServersTestJSON-2100051872 tempest-DeleteServersTestJSON-2100051872-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:47:09.567520 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi [req-9f4bf881-9388-49e8-b6b6-0198b2e0044e req-b546bd4b-6b99-4f8f-a4a8-ea814dc5ad50 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "75ca93de-6825-44ce-af10-44cba59218a1", "name": "network-vif-plugged", "status": "completed", "tag": "fb2bfc60-7355-48dd-9df7-9ffd7d99b7f6"}]} {{(pid=128729) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 15:47:09.577471 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [req-9f4bf881-9388-49e8-b6b6-0198b2e0044e req-b546bd4b-6b99-4f8f-a4a8-ea814dc5ad50 service nova] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:47:09.578235 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [req-9f4bf881-9388-49e8-b6b6-0198b2e0044e req-b546bd4b-6b99-4f8f-a4a8-ea814dc5ad50 service nova] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:47:09.591098 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: INFO nova.api.openstack.compute.server_external_events [req-9f4bf881-9388-49e8-b6b6-0198b2e0044e req-b546bd4b-6b99-4f8f-a4a8-ea814dc5ad50 service nova] Creating event network-vif-plugged:fb2bfc60-7355-48dd-9df7-9ffd7d99b7f6 for instance 75ca93de-6825-44ce-af10-44cba59218a1 on hv-cinder-83979 May 14 15:47:09.597055 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: INFO nova.api.openstack.requestlog [req-9f4bf881-9388-49e8-b6b6-0198b2e0044e req-b546bd4b-6b99-4f8f-a4a8-ea814dc5ad50 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.437923 May 14 15:47:09.602488 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: [pid: 128729|app: 0|req: 69/150] 10.222.0.61 () {64 vars in 1317 bytes} [Sat May 14 15:47:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 14 15:47:09.608097 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi [None req-3b1970e6-a285-4695-8b03-071207398a7f tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Calling method '>' {{(pid=128729) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 15:47:09.608976 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.compute.api [None req-3b1970e6-a285-4695-8b03-071207398a7f tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] [instance: 563c74e0-060d-49d5-abc5-389cee4bd9d5] Fetching instance by UUID {{(pid=128729) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 15:47:09.616546 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-3b1970e6-a285-4695-8b03-071207398a7f tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:47:09.617165 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-3b1970e6-a285-4695-8b03-071207398a7f tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:47:09.618364 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-3b1970e6-a285-4695-8b03-071207398a7f tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:47:09.618978 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-3b1970e6-a285-4695-8b03-071207398a7f tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:47:09.828343 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.policy [None req-73730b4b-9c47-4d3e-9529-f2a7008fa679 tempest-DeleteServersTestJSON-2100051872 tempest-DeleteServersTestJSON-2100051872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aad828d8ff314a2d82f07fb6d84f36a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6388da70b0dc48c1952570af4332dd6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128728) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:47:09.836986 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: INFO nova.api.openstack.requestlog [None req-73730b4b-9c47-4d3e-9529-f2a7008fa679 tempest-DeleteServersTestJSON-2100051872 tempest-DeleteServersTestJSON-2100051872-project] 10.222.0.61 "GET /compute/v2.1/servers/75ca93de-6825-44ce-af10-44cba59218a1" status: 200 len: 1315 microversion: 2.1 time: 0.387789 May 14 15:47:09.838181 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: [pid: 128728|app: 0|req: 82/151] 10.222.0.61 () {58 vars in 1235 bytes} [Sat May 14 15:47:09 2022] GET /compute/v2.1/servers/75ca93de-6825-44ce-af10-44cba59218a1 => generated 1315 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 15:47:09.901249 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.policy [None req-3b1970e6-a285-4695-8b03-071207398a7f tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b896317d96a40d6a137db0dcf5f98f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d2517d5440a4d30949f3dd36a46d813', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128729) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:47:09.908667 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: INFO nova.api.openstack.requestlog [None req-3b1970e6-a285-4695-8b03-071207398a7f tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] 10.222.0.61 "GET /compute/v2.1/servers/563c74e0-060d-49d5-abc5-389cee4bd9d5" status: 200 len: 1321 microversion: 2.1 time: 0.304725 May 14 15:47:09.909446 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: [pid: 128729|app: 0|req: 70/152] 10.222.0.61 () {58 vars in 1235 bytes} [Sat May 14 15:47:09 2022] GET /compute/v2.1/servers/563c74e0-060d-49d5-abc5-389cee4bd9d5 => generated 1321 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 15:47:10.276856 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi [None req-99da2d62-212c-40a9-846a-a08b0a7e729e tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] Calling method '>' {{(pid=128728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 15:47:10.277591 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.compute.api [None req-99da2d62-212c-40a9-846a-a08b0a7e729e tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] [instance: 113f6b52-519c-45f4-9bc2-37168d644e15] Fetching instance by UUID {{(pid=128728) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 15:47:10.283542 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-99da2d62-212c-40a9-846a-a08b0a7e729e tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:47:10.283985 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-99da2d62-212c-40a9-846a-a08b0a7e729e tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:47:10.285023 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-99da2d62-212c-40a9-846a-a08b0a7e729e tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:47:10.285520 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-99da2d62-212c-40a9-846a-a08b0a7e729e tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:47:10.466804 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi [None req-a8f99623-8896-4306-8890-204ae780de4b tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Calling method '>' {{(pid=128729) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 15:47:10.470883 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.compute.api [None req-a8f99623-8896-4306-8890-204ae780de4b tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] [instance: e33e9970-bfb7-46f3-8d40-782dbfa3d21c] Fetching instance by UUID {{(pid=128729) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 15:47:10.473971 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-a8f99623-8896-4306-8890-204ae780de4b tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:47:10.474716 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-a8f99623-8896-4306-8890-204ae780de4b tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:47:10.475494 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-a8f99623-8896-4306-8890-204ae780de4b tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:47:10.475926 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-a8f99623-8896-4306-8890-204ae780de4b tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:47:10.499011 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.policy [None req-99da2d62-212c-40a9-846a-a08b0a7e729e tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc43895177134e9c9c030a9d87f94aaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7905689c95d44a5c9169249c70f7de57', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128728) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:47:10.506402 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: INFO nova.api.openstack.requestlog [None req-99da2d62-212c-40a9-846a-a08b0a7e729e tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] 10.222.0.61 "GET /compute/v2.1/servers/113f6b52-519c-45f4-9bc2-37168d644e15" status: 200 len: 1366 microversion: 2.1 time: 0.234782 May 14 15:47:10.507089 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: [pid: 128728|app: 0|req: 83/153] 10.222.0.61 () {58 vars in 1235 bytes} [Sat May 14 15:47:10 2022] GET /compute/v2.1/servers/113f6b52-519c-45f4-9bc2-37168d644e15 => generated 1366 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 15:47:10.564138 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.policy [None req-a8f99623-8896-4306-8890-204ae780de4b tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58bfb7417bc94583963401ae0fe9d39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0672be3fa3f7414da1c1a5b7300abbe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128729) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:47:10.572620 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.policy [None req-a8f99623-8896-4306-8890-204ae780de4b tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58bfb7417bc94583963401ae0fe9d39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0672be3fa3f7414da1c1a5b7300abbe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128729) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:47:10.575290 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.policy [None req-a8f99623-8896-4306-8890-204ae780de4b tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58bfb7417bc94583963401ae0fe9d39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0672be3fa3f7414da1c1a5b7300abbe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128729) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:47:10.576549 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: INFO nova.api.openstack.requestlog [None req-a8f99623-8896-4306-8890-204ae780de4b tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] 10.222.0.61 "GET /compute/v2.1/servers/e33e9970-bfb7-46f3-8d40-782dbfa3d21c" status: 200 len: 1339 microversion: 2.20 time: 0.114250 May 14 15:47:10.577107 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: [pid: 128729|app: 0|req: 71/154] 10.222.0.61 () {60 vars in 1276 bytes} [Sat May 14 15:47:10 2022] GET /compute/v2.1/servers/e33e9970-bfb7-46f3-8d40-782dbfa3d21c => generated 1339 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 14 15:47:10.853931 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi [None req-48f5110e-916e-49a5-882f-d9900b9bd7c3 tempest-DeleteServersTestJSON-2100051872 tempest-DeleteServersTestJSON-2100051872-project] Calling method '>' {{(pid=128728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 15:47:10.854591 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.compute.api [None req-48f5110e-916e-49a5-882f-d9900b9bd7c3 tempest-DeleteServersTestJSON-2100051872 tempest-DeleteServersTestJSON-2100051872-project] [instance: 75ca93de-6825-44ce-af10-44cba59218a1] Fetching instance by UUID {{(pid=128728) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 15:47:10.895522 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-48f5110e-916e-49a5-882f-d9900b9bd7c3 tempest-DeleteServersTestJSON-2100051872 tempest-DeleteServersTestJSON-2100051872-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:47:10.896051 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-48f5110e-916e-49a5-882f-d9900b9bd7c3 tempest-DeleteServersTestJSON-2100051872 tempest-DeleteServersTestJSON-2100051872-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:47:10.896880 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-48f5110e-916e-49a5-882f-d9900b9bd7c3 tempest-DeleteServersTestJSON-2100051872 tempest-DeleteServersTestJSON-2100051872-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:47:10.897484 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-48f5110e-916e-49a5-882f-d9900b9bd7c3 tempest-DeleteServersTestJSON-2100051872 tempest-DeleteServersTestJSON-2100051872-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:47:10.927479 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi [None req-b00ef434-da98-4af4-ae39-d02c25563b0f tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Calling method '>' {{(pid=128729) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 15:47:10.929257 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.compute.api [None req-b00ef434-da98-4af4-ae39-d02c25563b0f tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] [instance: 563c74e0-060d-49d5-abc5-389cee4bd9d5] Fetching instance by UUID {{(pid=128729) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 15:47:10.954928 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-b00ef434-da98-4af4-ae39-d02c25563b0f tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:47:10.955437 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-b00ef434-da98-4af4-ae39-d02c25563b0f tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:47:10.956567 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-b00ef434-da98-4af4-ae39-d02c25563b0f tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:47:10.957250 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-b00ef434-da98-4af4-ae39-d02c25563b0f tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:47:11.248434 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.policy [None req-48f5110e-916e-49a5-882f-d9900b9bd7c3 tempest-DeleteServersTestJSON-2100051872 tempest-DeleteServersTestJSON-2100051872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aad828d8ff314a2d82f07fb6d84f36a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6388da70b0dc48c1952570af4332dd6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128728) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:47:11.255769 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: INFO nova.api.openstack.requestlog [None req-48f5110e-916e-49a5-882f-d9900b9bd7c3 tempest-DeleteServersTestJSON-2100051872 tempest-DeleteServersTestJSON-2100051872-project] 10.222.0.61 "GET /compute/v2.1/servers/75ca93de-6825-44ce-af10-44cba59218a1" status: 200 len: 1315 microversion: 2.1 time: 0.405785 May 14 15:47:11.256350 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: [pid: 128728|app: 0|req: 84/155] 10.222.0.61 () {58 vars in 1235 bytes} [Sat May 14 15:47:10 2022] GET /compute/v2.1/servers/75ca93de-6825-44ce-af10-44cba59218a1 => generated 1315 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 15:47:11.282890 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.policy [None req-b00ef434-da98-4af4-ae39-d02c25563b0f tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b896317d96a40d6a137db0dcf5f98f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d2517d5440a4d30949f3dd36a46d813', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128729) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:47:11.290235 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: INFO nova.api.openstack.requestlog [None req-b00ef434-da98-4af4-ae39-d02c25563b0f tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] 10.222.0.61 "GET /compute/v2.1/servers/563c74e0-060d-49d5-abc5-389cee4bd9d5" status: 200 len: 1321 microversion: 2.1 time: 0.367803 May 14 15:47:11.293637 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: [pid: 128729|app: 0|req: 72/156] 10.222.0.61 () {58 vars in 1235 bytes} [Sat May 14 15:47:10 2022] GET /compute/v2.1/servers/563c74e0-060d-49d5-abc5-389cee4bd9d5 => generated 1321 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 15:47:11.524692 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi [None req-cdbf6aec-80c1-48a6-aa5d-1c502ba5bd18 tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] Calling method '>' {{(pid=128728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 15:47:11.525302 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.compute.api [None req-cdbf6aec-80c1-48a6-aa5d-1c502ba5bd18 tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] [instance: 113f6b52-519c-45f4-9bc2-37168d644e15] Fetching instance by UUID {{(pid=128728) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 15:47:11.531684 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-cdbf6aec-80c1-48a6-aa5d-1c502ba5bd18 tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:47:11.532133 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-cdbf6aec-80c1-48a6-aa5d-1c502ba5bd18 tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:47:11.532913 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-cdbf6aec-80c1-48a6-aa5d-1c502ba5bd18 tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:47:11.533371 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-cdbf6aec-80c1-48a6-aa5d-1c502ba5bd18 tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:47:11.594170 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi [None req-a8d68037-e773-4c44-a817-15f4ffb7c771 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Calling method '>' {{(pid=128729) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 15:47:11.594828 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.compute.api [None req-a8d68037-e773-4c44-a817-15f4ffb7c771 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] [instance: e33e9970-bfb7-46f3-8d40-782dbfa3d21c] Fetching instance by UUID {{(pid=128729) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 15:47:11.601170 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-a8d68037-e773-4c44-a817-15f4ffb7c771 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:47:11.601623 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-a8d68037-e773-4c44-a817-15f4ffb7c771 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:47:11.602428 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-a8d68037-e773-4c44-a817-15f4ffb7c771 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:47:11.603029 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-a8d68037-e773-4c44-a817-15f4ffb7c771 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:47:11.770199 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.policy [None req-cdbf6aec-80c1-48a6-aa5d-1c502ba5bd18 tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc43895177134e9c9c030a9d87f94aaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7905689c95d44a5c9169249c70f7de57', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128728) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:47:11.783039 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: INFO nova.api.openstack.requestlog [None req-cdbf6aec-80c1-48a6-aa5d-1c502ba5bd18 tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] 10.222.0.61 "GET /compute/v2.1/servers/113f6b52-519c-45f4-9bc2-37168d644e15" status: 200 len: 1366 microversion: 2.1 time: 0.262075 May 14 15:47:11.783629 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: [pid: 128728|app: 0|req: 85/157] 10.222.0.61 () {58 vars in 1235 bytes} [Sat May 14 15:47:11 2022] GET /compute/v2.1/servers/113f6b52-519c-45f4-9bc2-37168d644e15 => generated 1366 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 15:47:11.815001 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.policy [None req-a8d68037-e773-4c44-a817-15f4ffb7c771 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58bfb7417bc94583963401ae0fe9d39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0672be3fa3f7414da1c1a5b7300abbe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128729) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:47:11.824264 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.policy [None req-a8d68037-e773-4c44-a817-15f4ffb7c771 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58bfb7417bc94583963401ae0fe9d39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0672be3fa3f7414da1c1a5b7300abbe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128729) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:47:11.825904 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.policy [None req-a8d68037-e773-4c44-a817-15f4ffb7c771 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58bfb7417bc94583963401ae0fe9d39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0672be3fa3f7414da1c1a5b7300abbe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128729) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:47:11.827319 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: INFO nova.api.openstack.requestlog [None req-a8d68037-e773-4c44-a817-15f4ffb7c771 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] 10.222.0.61 "GET /compute/v2.1/servers/e33e9970-bfb7-46f3-8d40-782dbfa3d21c" status: 200 len: 1406 microversion: 2.20 time: 0.237109 May 14 15:47:11.828090 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: [pid: 128729|app: 0|req: 73/158] 10.222.0.61 () {60 vars in 1276 bytes} [Sat May 14 15:47:11 2022] GET /compute/v2.1/servers/e33e9970-bfb7-46f3-8d40-782dbfa3d21c => generated 1406 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 14 15:47:12.272868 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi [None req-6562c5b7-c629-410e-b1ad-6f80ce8d8d9f tempest-DeleteServersTestJSON-2100051872 tempest-DeleteServersTestJSON-2100051872-project] Calling method '>' {{(pid=128728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 15:47:12.273468 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.compute.api [None req-6562c5b7-c629-410e-b1ad-6f80ce8d8d9f tempest-DeleteServersTestJSON-2100051872 tempest-DeleteServersTestJSON-2100051872-project] [instance: 75ca93de-6825-44ce-af10-44cba59218a1] Fetching instance by UUID {{(pid=128728) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 15:47:12.279680 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-6562c5b7-c629-410e-b1ad-6f80ce8d8d9f tempest-DeleteServersTestJSON-2100051872 tempest-DeleteServersTestJSON-2100051872-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:47:12.280128 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-6562c5b7-c629-410e-b1ad-6f80ce8d8d9f tempest-DeleteServersTestJSON-2100051872 tempest-DeleteServersTestJSON-2100051872-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:47:12.280913 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-6562c5b7-c629-410e-b1ad-6f80ce8d8d9f tempest-DeleteServersTestJSON-2100051872 tempest-DeleteServersTestJSON-2100051872-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:47:12.281435 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-6562c5b7-c629-410e-b1ad-6f80ce8d8d9f tempest-DeleteServersTestJSON-2100051872 tempest-DeleteServersTestJSON-2100051872-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:47:12.309437 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi [None req-ff820390-d329-4094-bcf4-2defa4429e53 tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Calling method '>' {{(pid=128729) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 15:47:12.310290 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.compute.api [None req-ff820390-d329-4094-bcf4-2defa4429e53 tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] [instance: 563c74e0-060d-49d5-abc5-389cee4bd9d5] Fetching instance by UUID {{(pid=128729) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 15:47:12.318773 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-ff820390-d329-4094-bcf4-2defa4429e53 tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:47:12.324856 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-ff820390-d329-4094-bcf4-2defa4429e53 tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:47:12.326011 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-ff820390-d329-4094-bcf4-2defa4429e53 tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:47:12.326642 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-ff820390-d329-4094-bcf4-2defa4429e53 tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:47:12.533778 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.policy [None req-6562c5b7-c629-410e-b1ad-6f80ce8d8d9f tempest-DeleteServersTestJSON-2100051872 tempest-DeleteServersTestJSON-2100051872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aad828d8ff314a2d82f07fb6d84f36a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6388da70b0dc48c1952570af4332dd6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128728) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:47:12.541019 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: INFO nova.api.openstack.requestlog [None req-6562c5b7-c629-410e-b1ad-6f80ce8d8d9f tempest-DeleteServersTestJSON-2100051872 tempest-DeleteServersTestJSON-2100051872-project] 10.222.0.61 "GET /compute/v2.1/servers/75ca93de-6825-44ce-af10-44cba59218a1" status: 200 len: 1315 microversion: 2.1 time: 0.271836 May 14 15:47:12.547993 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: [pid: 128728|app: 0|req: 86/159] 10.222.0.61 () {58 vars in 1235 bytes} [Sat May 14 15:47:12 2022] GET /compute/v2.1/servers/75ca93de-6825-44ce-af10-44cba59218a1 => generated 1315 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 15:47:12.550408 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.policy [None req-ff820390-d329-4094-bcf4-2defa4429e53 tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b896317d96a40d6a137db0dcf5f98f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d2517d5440a4d30949f3dd36a46d813', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128729) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:47:12.558644 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: INFO nova.api.openstack.requestlog [None req-ff820390-d329-4094-bcf4-2defa4429e53 tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] 10.222.0.61 "GET /compute/v2.1/servers/563c74e0-060d-49d5-abc5-389cee4bd9d5" status: 200 len: 1321 microversion: 2.1 time: 0.253546 May 14 15:47:12.559887 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: [pid: 128729|app: 0|req: 74/160] 10.222.0.61 () {58 vars in 1235 bytes} [Sat May 14 15:47:12 2022] GET /compute/v2.1/servers/563c74e0-060d-49d5-abc5-389cee4bd9d5 => generated 1321 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 15:47:12.799994 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi [None req-85986197-841f-4abe-a663-9ea0a63397c3 tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] Calling method '>' {{(pid=128728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 15:47:12.800749 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.compute.api [None req-85986197-841f-4abe-a663-9ea0a63397c3 tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] [instance: 113f6b52-519c-45f4-9bc2-37168d644e15] Fetching instance by UUID {{(pid=128728) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 15:47:12.808342 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-85986197-841f-4abe-a663-9ea0a63397c3 tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:47:12.808795 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-85986197-841f-4abe-a663-9ea0a63397c3 tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:47:12.809576 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-85986197-841f-4abe-a663-9ea0a63397c3 tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:47:12.810233 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-85986197-841f-4abe-a663-9ea0a63397c3 tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:47:12.845094 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi [None req-4ae9944a-bab4-4e66-9d4a-87ef05cfd2ce tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Calling method '>' {{(pid=128729) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 15:47:12.845683 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.compute.api [None req-4ae9944a-bab4-4e66-9d4a-87ef05cfd2ce tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] [instance: e33e9970-bfb7-46f3-8d40-782dbfa3d21c] Fetching instance by UUID {{(pid=128729) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 15:47:12.854533 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-4ae9944a-bab4-4e66-9d4a-87ef05cfd2ce tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:47:12.855657 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-4ae9944a-bab4-4e66-9d4a-87ef05cfd2ce tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:47:12.859212 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-4ae9944a-bab4-4e66-9d4a-87ef05cfd2ce tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:47:12.859212 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-4ae9944a-bab4-4e66-9d4a-87ef05cfd2ce tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:47:13.058286 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.policy [None req-85986197-841f-4abe-a663-9ea0a63397c3 tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc43895177134e9c9c030a9d87f94aaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7905689c95d44a5c9169249c70f7de57', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128728) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:47:13.067852 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: INFO nova.api.openstack.requestlog [None req-85986197-841f-4abe-a663-9ea0a63397c3 tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] 10.222.0.61 "GET /compute/v2.1/servers/113f6b52-519c-45f4-9bc2-37168d644e15" status: 200 len: 1366 microversion: 2.1 time: 0.271621 May 14 15:47:13.068721 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: [pid: 128728|app: 0|req: 87/161] 10.222.0.61 () {58 vars in 1235 bytes} [Sat May 14 15:47:12 2022] GET /compute/v2.1/servers/113f6b52-519c-45f4-9bc2-37168d644e15 => generated 1366 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 15:47:13.093630 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.policy [None req-4ae9944a-bab4-4e66-9d4a-87ef05cfd2ce tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58bfb7417bc94583963401ae0fe9d39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0672be3fa3f7414da1c1a5b7300abbe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128729) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:47:13.103418 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.policy [None req-4ae9944a-bab4-4e66-9d4a-87ef05cfd2ce tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58bfb7417bc94583963401ae0fe9d39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0672be3fa3f7414da1c1a5b7300abbe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128729) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:47:13.106233 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.policy [None req-4ae9944a-bab4-4e66-9d4a-87ef05cfd2ce tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58bfb7417bc94583963401ae0fe9d39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0672be3fa3f7414da1c1a5b7300abbe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128729) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:47:13.107406 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: INFO nova.api.openstack.requestlog [None req-4ae9944a-bab4-4e66-9d4a-87ef05cfd2ce tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] 10.222.0.61 "GET /compute/v2.1/servers/e33e9970-bfb7-46f3-8d40-782dbfa3d21c" status: 200 len: 1406 microversion: 2.20 time: 0.266253 May 14 15:47:13.107956 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: [pid: 128729|app: 0|req: 75/162] 10.222.0.61 () {60 vars in 1276 bytes} [Sat May 14 15:47:12 2022] GET /compute/v2.1/servers/e33e9970-bfb7-46f3-8d40-782dbfa3d21c => generated 1406 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 14 15:47:13.560858 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi [None req-8cf047a0-1baa-478b-bd95-d09c8180de9a tempest-DeleteServersTestJSON-2100051872 tempest-DeleteServersTestJSON-2100051872-project] Calling method '>' {{(pid=128728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 15:47:13.563291 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.compute.api [None req-8cf047a0-1baa-478b-bd95-d09c8180de9a tempest-DeleteServersTestJSON-2100051872 tempest-DeleteServersTestJSON-2100051872-project] [instance: 75ca93de-6825-44ce-af10-44cba59218a1] Fetching instance by UUID {{(pid=128728) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 15:47:13.580595 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi [None req-d4fd94b7-4bc6-4224-8f7b-267c79be521a tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Calling method '>' {{(pid=128729) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 15:47:13.581731 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.compute.api [None req-d4fd94b7-4bc6-4224-8f7b-267c79be521a tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] [instance: 563c74e0-060d-49d5-abc5-389cee4bd9d5] Fetching instance by UUID {{(pid=128729) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 15:47:13.585667 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-8cf047a0-1baa-478b-bd95-d09c8180de9a tempest-DeleteServersTestJSON-2100051872 tempest-DeleteServersTestJSON-2100051872-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:47:13.587393 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-8cf047a0-1baa-478b-bd95-d09c8180de9a tempest-DeleteServersTestJSON-2100051872 tempest-DeleteServersTestJSON-2100051872-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:47:13.591766 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-d4fd94b7-4bc6-4224-8f7b-267c79be521a tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:47:13.593050 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-8cf047a0-1baa-478b-bd95-d09c8180de9a tempest-DeleteServersTestJSON-2100051872 tempest-DeleteServersTestJSON-2100051872-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:47:13.593662 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-8cf047a0-1baa-478b-bd95-d09c8180de9a tempest-DeleteServersTestJSON-2100051872 tempest-DeleteServersTestJSON-2100051872-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:47:13.597621 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-d4fd94b7-4bc6-4224-8f7b-267c79be521a tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:47:13.603102 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-d4fd94b7-4bc6-4224-8f7b-267c79be521a tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:47:13.605196 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-d4fd94b7-4bc6-4224-8f7b-267c79be521a tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:47:13.967299 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.policy [None req-8cf047a0-1baa-478b-bd95-d09c8180de9a tempest-DeleteServersTestJSON-2100051872 tempest-DeleteServersTestJSON-2100051872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aad828d8ff314a2d82f07fb6d84f36a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6388da70b0dc48c1952570af4332dd6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128728) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:47:13.974745 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: INFO nova.api.openstack.requestlog [None req-8cf047a0-1baa-478b-bd95-d09c8180de9a tempest-DeleteServersTestJSON-2100051872 tempest-DeleteServersTestJSON-2100051872-project] 10.222.0.61 "GET /compute/v2.1/servers/75ca93de-6825-44ce-af10-44cba59218a1" status: 200 len: 1315 microversion: 2.1 time: 0.419074 May 14 15:47:13.975567 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: [pid: 128728|app: 0|req: 88/163] 10.222.0.61 () {58 vars in 1235 bytes} [Sat May 14 15:47:13 2022] GET /compute/v2.1/servers/75ca93de-6825-44ce-af10-44cba59218a1 => generated 1315 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 15:47:14.049455 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.policy [None req-d4fd94b7-4bc6-4224-8f7b-267c79be521a tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b896317d96a40d6a137db0dcf5f98f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d2517d5440a4d30949f3dd36a46d813', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128729) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:47:14.068856 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: INFO nova.api.openstack.requestlog [None req-d4fd94b7-4bc6-4224-8f7b-267c79be521a tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] 10.222.0.61 "GET /compute/v2.1/servers/563c74e0-060d-49d5-abc5-389cee4bd9d5" status: 200 len: 1321 microversion: 2.1 time: 0.494874 May 14 15:47:14.070667 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: [pid: 128729|app: 0|req: 76/164] 10.222.0.61 () {58 vars in 1235 bytes} [Sat May 14 15:47:13 2022] GET /compute/v2.1/servers/563c74e0-060d-49d5-abc5-389cee4bd9d5 => generated 1321 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 15:47:14.085545 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi [None req-4ddc0d1b-55e0-4dfb-8318-be4d60cccb37 tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] Calling method '>' {{(pid=128728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 15:47:14.086068 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.compute.api [None req-4ddc0d1b-55e0-4dfb-8318-be4d60cccb37 tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] [instance: 113f6b52-519c-45f4-9bc2-37168d644e15] Fetching instance by UUID {{(pid=128728) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 15:47:14.092440 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-4ddc0d1b-55e0-4dfb-8318-be4d60cccb37 tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:47:14.092988 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-4ddc0d1b-55e0-4dfb-8318-be4d60cccb37 tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:47:14.093889 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-4ddc0d1b-55e0-4dfb-8318-be4d60cccb37 tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:47:14.094625 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-4ddc0d1b-55e0-4dfb-8318-be4d60cccb37 tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:47:14.125553 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi [None req-0d380833-34da-4356-90d0-8b433f41b4ea tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Calling method '>' {{(pid=128729) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 15:47:14.126367 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.compute.api [None req-0d380833-34da-4356-90d0-8b433f41b4ea tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] [instance: e33e9970-bfb7-46f3-8d40-782dbfa3d21c] Fetching instance by UUID {{(pid=128729) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 15:47:14.136200 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-0d380833-34da-4356-90d0-8b433f41b4ea tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:47:14.138759 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-0d380833-34da-4356-90d0-8b433f41b4ea tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:47:14.139671 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-0d380833-34da-4356-90d0-8b433f41b4ea tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:47:14.141272 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-0d380833-34da-4356-90d0-8b433f41b4ea tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:47:14.678299 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.policy [None req-4ddc0d1b-55e0-4dfb-8318-be4d60cccb37 tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc43895177134e9c9c030a9d87f94aaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7905689c95d44a5c9169249c70f7de57', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128728) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:47:14.688651 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: INFO nova.api.openstack.requestlog [None req-4ddc0d1b-55e0-4dfb-8318-be4d60cccb37 tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] 10.222.0.61 "GET /compute/v2.1/servers/113f6b52-519c-45f4-9bc2-37168d644e15" status: 200 len: 1366 microversion: 2.1 time: 0.607114 May 14 15:47:14.689227 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: [pid: 128728|app: 0|req: 89/165] 10.222.0.61 () {58 vars in 1235 bytes} [Sat May 14 15:47:14 2022] GET /compute/v2.1/servers/113f6b52-519c-45f4-9bc2-37168d644e15 => generated 1366 bytes in 608 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 15:47:14.693376 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.policy [None req-0d380833-34da-4356-90d0-8b433f41b4ea tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58bfb7417bc94583963401ae0fe9d39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0672be3fa3f7414da1c1a5b7300abbe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128729) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:47:14.702773 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.policy [None req-0d380833-34da-4356-90d0-8b433f41b4ea tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58bfb7417bc94583963401ae0fe9d39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0672be3fa3f7414da1c1a5b7300abbe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128729) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:47:14.704280 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.policy [None req-0d380833-34da-4356-90d0-8b433f41b4ea tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58bfb7417bc94583963401ae0fe9d39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0672be3fa3f7414da1c1a5b7300abbe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128729) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:47:14.705555 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: INFO nova.api.openstack.requestlog [None req-0d380833-34da-4356-90d0-8b433f41b4ea tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] 10.222.0.61 "GET /compute/v2.1/servers/e33e9970-bfb7-46f3-8d40-782dbfa3d21c" status: 200 len: 1406 microversion: 2.20 time: 0.584322 May 14 15:47:14.706113 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: [pid: 128729|app: 0|req: 77/166] 10.222.0.61 () {60 vars in 1276 bytes} [Sat May 14 15:47:14 2022] GET /compute/v2.1/servers/e33e9970-bfb7-46f3-8d40-782dbfa3d21c => generated 1406 bytes in 585 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 14 15:47:14.992508 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi [None req-0211cb91-b36b-476d-b4c5-a94c922f547c tempest-DeleteServersTestJSON-2100051872 tempest-DeleteServersTestJSON-2100051872-project] Calling method '>' {{(pid=128728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 15:47:14.993355 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.compute.api [None req-0211cb91-b36b-476d-b4c5-a94c922f547c tempest-DeleteServersTestJSON-2100051872 tempest-DeleteServersTestJSON-2100051872-project] [instance: 75ca93de-6825-44ce-af10-44cba59218a1] Fetching instance by UUID {{(pid=128728) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 15:47:15.000560 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-0211cb91-b36b-476d-b4c5-a94c922f547c tempest-DeleteServersTestJSON-2100051872 tempest-DeleteServersTestJSON-2100051872-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:47:15.001032 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-0211cb91-b36b-476d-b4c5-a94c922f547c tempest-DeleteServersTestJSON-2100051872 tempest-DeleteServersTestJSON-2100051872-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:47:15.002068 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-0211cb91-b36b-476d-b4c5-a94c922f547c tempest-DeleteServersTestJSON-2100051872 tempest-DeleteServersTestJSON-2100051872-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:47:15.002758 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-0211cb91-b36b-476d-b4c5-a94c922f547c tempest-DeleteServersTestJSON-2100051872 tempest-DeleteServersTestJSON-2100051872-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:47:15.086965 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi [None req-48ffeef9-f91b-412d-992b-78f1d175270a tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Calling method '>' {{(pid=128729) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 15:47:15.088365 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.compute.api [None req-48ffeef9-f91b-412d-992b-78f1d175270a tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] [instance: 563c74e0-060d-49d5-abc5-389cee4bd9d5] Fetching instance by UUID {{(pid=128729) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 15:47:15.095442 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-48ffeef9-f91b-412d-992b-78f1d175270a tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:47:15.096396 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-48ffeef9-f91b-412d-992b-78f1d175270a tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:47:15.103075 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-48ffeef9-f91b-412d-992b-78f1d175270a tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:47:15.103853 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-48ffeef9-f91b-412d-992b-78f1d175270a tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:47:15.190431 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.policy [None req-0211cb91-b36b-476d-b4c5-a94c922f547c tempest-DeleteServersTestJSON-2100051872 tempest-DeleteServersTestJSON-2100051872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aad828d8ff314a2d82f07fb6d84f36a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6388da70b0dc48c1952570af4332dd6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128728) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:47:15.200145 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: INFO nova.api.openstack.requestlog [None req-0211cb91-b36b-476d-b4c5-a94c922f547c tempest-DeleteServersTestJSON-2100051872 tempest-DeleteServersTestJSON-2100051872-project] 10.222.0.61 "GET /compute/v2.1/servers/75ca93de-6825-44ce-af10-44cba59218a1" status: 200 len: 1315 microversion: 2.1 time: 0.209588 May 14 15:47:15.209603 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: [pid: 128728|app: 0|req: 90/167] 10.222.0.61 () {58 vars in 1235 bytes} [Sat May 14 15:47:14 2022] GET /compute/v2.1/servers/75ca93de-6825-44ce-af10-44cba59218a1 => generated 1315 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 15:47:15.215277 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi [req-8f2f4fc0-8985-4220-9e91-29f1fae85ca4 req-b27ec1e2-5ced-4cd8-838f-3c6c43d4f459 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e33e9970-bfb7-46f3-8d40-782dbfa3d21c", "tag": "759be0ca-daaf-4eba-97b6-a252b70cbb3b"}]} {{(pid=128728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 15:47:15.228727 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [req-8f2f4fc0-8985-4220-9e91-29f1fae85ca4 req-b27ec1e2-5ced-4cd8-838f-3c6c43d4f459 service nova] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:47:15.229480 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [req-8f2f4fc0-8985-4220-9e91-29f1fae85ca4 req-b27ec1e2-5ced-4cd8-838f-3c6c43d4f459 service nova] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:47:15.246381 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: INFO nova.api.openstack.compute.server_external_events [req-8f2f4fc0-8985-4220-9e91-29f1fae85ca4 req-b27ec1e2-5ced-4cd8-838f-3c6c43d4f459 service nova] Creating event network-changed:759be0ca-daaf-4eba-97b6-a252b70cbb3b for instance e33e9970-bfb7-46f3-8d40-782dbfa3d21c on hv-cinder-83979 May 14 15:47:15.252230 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: INFO nova.api.openstack.requestlog [req-8f2f4fc0-8985-4220-9e91-29f1fae85ca4 req-b27ec1e2-5ced-4cd8-838f-3c6c43d4f459 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040378 May 14 15:47:15.253366 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: [pid: 128728|app: 0|req: 91/168] 10.222.0.61 () {64 vars in 1317 bytes} [Sat May 14 15:47:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 14 15:47:15.267948 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.policy [None req-48ffeef9-f91b-412d-992b-78f1d175270a tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b896317d96a40d6a137db0dcf5f98f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d2517d5440a4d30949f3dd36a46d813', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128729) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:47:15.275759 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: INFO nova.api.openstack.requestlog [None req-48ffeef9-f91b-412d-992b-78f1d175270a tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] 10.222.0.61 "GET /compute/v2.1/servers/563c74e0-060d-49d5-abc5-389cee4bd9d5" status: 200 len: 1321 microversion: 2.1 time: 0.192547 May 14 15:47:15.276382 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: [pid: 128729|app: 0|req: 78/169] 10.222.0.61 () {58 vars in 1235 bytes} [Sat May 14 15:47:15 2022] GET /compute/v2.1/servers/563c74e0-060d-49d5-abc5-389cee4bd9d5 => generated 1321 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 15:47:15.705964 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi [None req-39acc9f5-7242-42c0-a880-958a9877cddb tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] Calling method '>' {{(pid=128728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 15:47:15.706895 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.compute.api [None req-39acc9f5-7242-42c0-a880-958a9877cddb tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] [instance: 113f6b52-519c-45f4-9bc2-37168d644e15] Fetching instance by UUID {{(pid=128728) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 15:47:15.713346 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-39acc9f5-7242-42c0-a880-958a9877cddb tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:47:15.713802 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-39acc9f5-7242-42c0-a880-958a9877cddb tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:47:15.714601 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-39acc9f5-7242-42c0-a880-958a9877cddb tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:47:15.715035 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-39acc9f5-7242-42c0-a880-958a9877cddb tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:47:15.732543 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi [None req-d669f2f4-037b-4316-8c0e-6aba841bae17 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Calling method '>' {{(pid=128729) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 15:47:15.733284 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.compute.api [None req-d669f2f4-037b-4316-8c0e-6aba841bae17 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] [instance: e33e9970-bfb7-46f3-8d40-782dbfa3d21c] Fetching instance by UUID {{(pid=128729) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 15:47:15.739391 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-d669f2f4-037b-4316-8c0e-6aba841bae17 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:47:15.739835 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-d669f2f4-037b-4316-8c0e-6aba841bae17 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:47:15.740659 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-d669f2f4-037b-4316-8c0e-6aba841bae17 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:47:15.741087 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-d669f2f4-037b-4316-8c0e-6aba841bae17 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:47:15.909805 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.policy [None req-39acc9f5-7242-42c0-a880-958a9877cddb tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc43895177134e9c9c030a9d87f94aaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7905689c95d44a5c9169249c70f7de57', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128728) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:47:15.917522 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: INFO nova.api.openstack.requestlog [None req-39acc9f5-7242-42c0-a880-958a9877cddb tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] 10.222.0.61 "GET /compute/v2.1/servers/113f6b52-519c-45f4-9bc2-37168d644e15" status: 200 len: 1366 microversion: 2.1 time: 0.216041 May 14 15:47:15.918212 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: [pid: 128728|app: 0|req: 92/170] 10.222.0.61 () {58 vars in 1235 bytes} [Sat May 14 15:47:15 2022] GET /compute/v2.1/servers/113f6b52-519c-45f4-9bc2-37168d644e15 => generated 1366 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 15:47:15.921556 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.policy [None req-d669f2f4-037b-4316-8c0e-6aba841bae17 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58bfb7417bc94583963401ae0fe9d39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0672be3fa3f7414da1c1a5b7300abbe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128729) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:47:15.929611 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.policy [None req-d669f2f4-037b-4316-8c0e-6aba841bae17 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58bfb7417bc94583963401ae0fe9d39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0672be3fa3f7414da1c1a5b7300abbe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128729) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:47:15.931264 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.policy [None req-d669f2f4-037b-4316-8c0e-6aba841bae17 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58bfb7417bc94583963401ae0fe9d39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0672be3fa3f7414da1c1a5b7300abbe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128729) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:47:15.933111 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: INFO nova.api.openstack.requestlog [None req-d669f2f4-037b-4316-8c0e-6aba841bae17 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] 10.222.0.61 "GET /compute/v2.1/servers/e33e9970-bfb7-46f3-8d40-782dbfa3d21c" status: 200 len: 1406 microversion: 2.20 time: 0.208281 May 14 15:47:15.933665 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: [pid: 128729|app: 0|req: 79/171] 10.222.0.61 () {60 vars in 1276 bytes} [Sat May 14 15:47:15 2022] GET /compute/v2.1/servers/e33e9970-bfb7-46f3-8d40-782dbfa3d21c => generated 1406 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 14 15:47:16.163888 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi [req-20be9fa9-6a3c-4d65-9714-d665c60fd69a req-cbbbe438-0307-479b-a03c-7f0d110e4e28 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9fbb269d-11cd-49ed-81ac-570e721c15cd", "name": "network-vif-plugged", "status": "completed", "tag": "3697c0c4-258d-43cd-a608-dec915d0b3e8"}]} {{(pid=128728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 15:47:16.175152 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [req-20be9fa9-6a3c-4d65-9714-d665c60fd69a req-cbbbe438-0307-479b-a03c-7f0d110e4e28 service nova] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:47:16.175934 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [req-20be9fa9-6a3c-4d65-9714-d665c60fd69a req-cbbbe438-0307-479b-a03c-7f0d110e4e28 service nova] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:47:16.187489 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: INFO nova.api.openstack.compute.server_external_events [req-20be9fa9-6a3c-4d65-9714-d665c60fd69a req-cbbbe438-0307-479b-a03c-7f0d110e4e28 service nova] Creating event network-vif-plugged:3697c0c4-258d-43cd-a608-dec915d0b3e8 for instance 9fbb269d-11cd-49ed-81ac-570e721c15cd on hv-cinder-83979 May 14 15:47:16.201120 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: INFO nova.api.openstack.requestlog [req-20be9fa9-6a3c-4d65-9714-d665c60fd69a req-cbbbe438-0307-479b-a03c-7f0d110e4e28 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043161 May 14 15:47:16.201725 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: [pid: 128728|app: 0|req: 93/172] 10.222.0.61 () {64 vars in 1317 bytes} [Sat May 14 15:47:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 14 15:47:16.217967 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi [None req-01bedfd1-5683-44db-9a3f-2f5421be78ea tempest-DeleteServersTestJSON-2100051872 tempest-DeleteServersTestJSON-2100051872-project] Calling method '>' {{(pid=128729) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 15:47:16.218671 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.compute.api [None req-01bedfd1-5683-44db-9a3f-2f5421be78ea tempest-DeleteServersTestJSON-2100051872 tempest-DeleteServersTestJSON-2100051872-project] [instance: 75ca93de-6825-44ce-af10-44cba59218a1] Fetching instance by UUID {{(pid=128729) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 15:47:16.227550 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-01bedfd1-5683-44db-9a3f-2f5421be78ea tempest-DeleteServersTestJSON-2100051872 tempest-DeleteServersTestJSON-2100051872-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:47:16.227550 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-01bedfd1-5683-44db-9a3f-2f5421be78ea tempest-DeleteServersTestJSON-2100051872 tempest-DeleteServersTestJSON-2100051872-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:47:16.228229 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-01bedfd1-5683-44db-9a3f-2f5421be78ea tempest-DeleteServersTestJSON-2100051872 tempest-DeleteServersTestJSON-2100051872-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:47:16.228829 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-01bedfd1-5683-44db-9a3f-2f5421be78ea tempest-DeleteServersTestJSON-2100051872 tempest-DeleteServersTestJSON-2100051872-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:47:16.295777 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi [None req-5eac9016-8913-43b8-9df7-b8db66f2d24c tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Calling method '>' {{(pid=128728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 15:47:16.296868 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.compute.api [None req-5eac9016-8913-43b8-9df7-b8db66f2d24c tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] [instance: 563c74e0-060d-49d5-abc5-389cee4bd9d5] Fetching instance by UUID {{(pid=128728) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 15:47:16.304774 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-5eac9016-8913-43b8-9df7-b8db66f2d24c tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:47:16.305385 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-5eac9016-8913-43b8-9df7-b8db66f2d24c tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:47:16.306328 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-5eac9016-8913-43b8-9df7-b8db66f2d24c tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:47:16.307206 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-5eac9016-8913-43b8-9df7-b8db66f2d24c tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:47:16.433203 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.policy [None req-01bedfd1-5683-44db-9a3f-2f5421be78ea tempest-DeleteServersTestJSON-2100051872 tempest-DeleteServersTestJSON-2100051872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aad828d8ff314a2d82f07fb6d84f36a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6388da70b0dc48c1952570af4332dd6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128729) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:47:16.440641 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: INFO nova.api.openstack.requestlog [None req-01bedfd1-5683-44db-9a3f-2f5421be78ea tempest-DeleteServersTestJSON-2100051872 tempest-DeleteServersTestJSON-2100051872-project] 10.222.0.61 "GET /compute/v2.1/servers/75ca93de-6825-44ce-af10-44cba59218a1" status: 200 len: 1315 microversion: 2.1 time: 0.227404 May 14 15:47:16.441580 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: [pid: 128729|app: 0|req: 80/173] 10.222.0.61 () {58 vars in 1235 bytes} [Sat May 14 15:47:16 2022] GET /compute/v2.1/servers/75ca93de-6825-44ce-af10-44cba59218a1 => generated 1315 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 15:47:16.482216 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.policy [None req-5eac9016-8913-43b8-9df7-b8db66f2d24c tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b896317d96a40d6a137db0dcf5f98f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d2517d5440a4d30949f3dd36a46d813', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128728) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:47:16.489876 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: INFO nova.api.openstack.requestlog [None req-5eac9016-8913-43b8-9df7-b8db66f2d24c tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] 10.222.0.61 "GET /compute/v2.1/servers/563c74e0-060d-49d5-abc5-389cee4bd9d5" status: 200 len: 1321 microversion: 2.1 time: 0.200284 May 14 15:47:16.490503 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: [pid: 128728|app: 0|req: 94/174] 10.222.0.61 () {58 vars in 1235 bytes} [Sat May 14 15:47:16 2022] GET /compute/v2.1/servers/563c74e0-060d-49d5-abc5-389cee4bd9d5 => generated 1321 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 15:47:16.935992 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi [None req-ce6e0894-a577-44bb-96f9-0d3f85c32e30 tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] Calling method '>' {{(pid=128729) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 15:47:16.936882 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.compute.api [None req-ce6e0894-a577-44bb-96f9-0d3f85c32e30 tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] [instance: 113f6b52-519c-45f4-9bc2-37168d644e15] Fetching instance by UUID {{(pid=128729) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 15:47:16.944118 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-ce6e0894-a577-44bb-96f9-0d3f85c32e30 tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:47:16.944565 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-ce6e0894-a577-44bb-96f9-0d3f85c32e30 tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:47:16.951606 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-ce6e0894-a577-44bb-96f9-0d3f85c32e30 tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:47:16.951606 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-ce6e0894-a577-44bb-96f9-0d3f85c32e30 tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:47:16.951799 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi [None req-616e0561-670d-497d-a988-c4d7be659142 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Calling method '>' {{(pid=128728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 15:47:16.952336 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.compute.api [None req-616e0561-670d-497d-a988-c4d7be659142 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] [instance: e33e9970-bfb7-46f3-8d40-782dbfa3d21c] Fetching instance by UUID {{(pid=128728) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 15:47:16.958187 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-616e0561-670d-497d-a988-c4d7be659142 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:47:16.958659 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-616e0561-670d-497d-a988-c4d7be659142 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:47:16.959944 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-616e0561-670d-497d-a988-c4d7be659142 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:47:16.960379 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-616e0561-670d-497d-a988-c4d7be659142 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:47:17.161510 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.policy [None req-616e0561-670d-497d-a988-c4d7be659142 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58bfb7417bc94583963401ae0fe9d39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0672be3fa3f7414da1c1a5b7300abbe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128728) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:47:17.163444 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.policy [None req-ce6e0894-a577-44bb-96f9-0d3f85c32e30 tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc43895177134e9c9c030a9d87f94aaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7905689c95d44a5c9169249c70f7de57', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128729) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:47:17.172439 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: INFO nova.api.openstack.requestlog [None req-ce6e0894-a577-44bb-96f9-0d3f85c32e30 tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] 10.222.0.61 "GET /compute/v2.1/servers/113f6b52-519c-45f4-9bc2-37168d644e15" status: 200 len: 1366 microversion: 2.1 time: 0.241637 May 14 15:47:17.173450 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.policy [None req-616e0561-670d-497d-a988-c4d7be659142 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58bfb7417bc94583963401ae0fe9d39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0672be3fa3f7414da1c1a5b7300abbe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128728) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:47:17.176186 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.policy [None req-616e0561-670d-497d-a988-c4d7be659142 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58bfb7417bc94583963401ae0fe9d39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0672be3fa3f7414da1c1a5b7300abbe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128728) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:47:17.178250 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: INFO nova.api.openstack.requestlog [None req-616e0561-670d-497d-a988-c4d7be659142 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] 10.222.0.61 "GET /compute/v2.1/servers/e33e9970-bfb7-46f3-8d40-782dbfa3d21c" status: 200 len: 1406 microversion: 2.20 time: 0.231556 May 14 15:47:17.179107 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: [pid: 128728|app: 0|req: 95/175] 10.222.0.61 () {60 vars in 1276 bytes} [Sat May 14 15:47:16 2022] GET /compute/v2.1/servers/e33e9970-bfb7-46f3-8d40-782dbfa3d21c => generated 1406 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 14 15:47:17.183257 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: [pid: 128729|app: 0|req: 81/176] 10.222.0.61 () {58 vars in 1235 bytes} [Sat May 14 15:47:16 2022] GET /compute/v2.1/servers/113f6b52-519c-45f4-9bc2-37168d644e15 => generated 1366 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 15:47:17.459645 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi [None req-c263e8cb-a335-4d06-904b-32d68de99aac tempest-DeleteServersTestJSON-2100051872 tempest-DeleteServersTestJSON-2100051872-project] Calling method '>' {{(pid=128728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 15:47:17.460287 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.compute.api [None req-c263e8cb-a335-4d06-904b-32d68de99aac tempest-DeleteServersTestJSON-2100051872 tempest-DeleteServersTestJSON-2100051872-project] [instance: 75ca93de-6825-44ce-af10-44cba59218a1] Fetching instance by UUID {{(pid=128728) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 15:47:17.466774 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-c263e8cb-a335-4d06-904b-32d68de99aac tempest-DeleteServersTestJSON-2100051872 tempest-DeleteServersTestJSON-2100051872-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:47:17.467223 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-c263e8cb-a335-4d06-904b-32d68de99aac tempest-DeleteServersTestJSON-2100051872 tempest-DeleteServersTestJSON-2100051872-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:47:17.467987 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-c263e8cb-a335-4d06-904b-32d68de99aac tempest-DeleteServersTestJSON-2100051872 tempest-DeleteServersTestJSON-2100051872-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:47:17.468517 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-c263e8cb-a335-4d06-904b-32d68de99aac tempest-DeleteServersTestJSON-2100051872 tempest-DeleteServersTestJSON-2100051872-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:47:17.507304 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi [None req-3ddb4fb5-f563-4ae4-aa2e-032ade25886a tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Calling method '>' {{(pid=128729) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 15:47:17.507943 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.compute.api [None req-3ddb4fb5-f563-4ae4-aa2e-032ade25886a tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] [instance: 563c74e0-060d-49d5-abc5-389cee4bd9d5] Fetching instance by UUID {{(pid=128729) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 15:47:17.514093 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-3ddb4fb5-f563-4ae4-aa2e-032ade25886a tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:47:17.514580 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-3ddb4fb5-f563-4ae4-aa2e-032ade25886a tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:47:17.515370 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-3ddb4fb5-f563-4ae4-aa2e-032ade25886a tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:47:17.515813 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-3ddb4fb5-f563-4ae4-aa2e-032ade25886a tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:47:17.678997 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.policy [None req-c263e8cb-a335-4d06-904b-32d68de99aac tempest-DeleteServersTestJSON-2100051872 tempest-DeleteServersTestJSON-2100051872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aad828d8ff314a2d82f07fb6d84f36a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6388da70b0dc48c1952570af4332dd6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128728) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:47:17.688322 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: INFO nova.api.openstack.requestlog [None req-c263e8cb-a335-4d06-904b-32d68de99aac tempest-DeleteServersTestJSON-2100051872 tempest-DeleteServersTestJSON-2100051872-project] 10.222.0.61 "GET /compute/v2.1/servers/75ca93de-6825-44ce-af10-44cba59218a1" status: 200 len: 1315 microversion: 2.1 time: 0.232814 May 14 15:47:17.688897 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: [pid: 128728|app: 0|req: 96/177] 10.222.0.61 () {58 vars in 1235 bytes} [Sat May 14 15:47:17 2022] GET /compute/v2.1/servers/75ca93de-6825-44ce-af10-44cba59218a1 => generated 1315 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 15:47:17.724565 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.policy [None req-3ddb4fb5-f563-4ae4-aa2e-032ade25886a tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b896317d96a40d6a137db0dcf5f98f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d2517d5440a4d30949f3dd36a46d813', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128729) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:47:17.733026 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: INFO nova.api.openstack.requestlog [None req-3ddb4fb5-f563-4ae4-aa2e-032ade25886a tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] 10.222.0.61 "GET /compute/v2.1/servers/563c74e0-060d-49d5-abc5-389cee4bd9d5" status: 200 len: 1321 microversion: 2.1 time: 0.229615 May 14 15:47:17.733545 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: [pid: 128729|app: 0|req: 82/178] 10.222.0.61 () {58 vars in 1235 bytes} [Sat May 14 15:47:17 2022] GET /compute/v2.1/servers/563c74e0-060d-49d5-abc5-389cee4bd9d5 => generated 1321 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 15:47:18.189203 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi [None req-b8ebcfbb-6457-427a-a59a-9bc725ca2880 tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] Calling method '>' {{(pid=128728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 15:47:18.189814 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.compute.api [None req-b8ebcfbb-6457-427a-a59a-9bc725ca2880 tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] [instance: 113f6b52-519c-45f4-9bc2-37168d644e15] Fetching instance by UUID {{(pid=128728) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 15:47:18.196446 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-b8ebcfbb-6457-427a-a59a-9bc725ca2880 tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:47:18.196919 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-b8ebcfbb-6457-427a-a59a-9bc725ca2880 tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:47:18.198365 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-b8ebcfbb-6457-427a-a59a-9bc725ca2880 tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:47:18.199091 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-b8ebcfbb-6457-427a-a59a-9bc725ca2880 tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:47:18.203544 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi [None req-b096acdb-16aa-4440-8eba-5bad756ac450 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Calling method '>' {{(pid=128729) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 15:47:18.204155 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.compute.api [None req-b096acdb-16aa-4440-8eba-5bad756ac450 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] [instance: e33e9970-bfb7-46f3-8d40-782dbfa3d21c] Fetching instance by UUID {{(pid=128729) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 15:47:18.210138 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-b096acdb-16aa-4440-8eba-5bad756ac450 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:47:18.210608 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-b096acdb-16aa-4440-8eba-5bad756ac450 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:47:18.211407 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-b096acdb-16aa-4440-8eba-5bad756ac450 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:47:18.211841 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-b096acdb-16aa-4440-8eba-5bad756ac450 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:47:18.417209 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.policy [None req-b8ebcfbb-6457-427a-a59a-9bc725ca2880 tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc43895177134e9c9c030a9d87f94aaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7905689c95d44a5c9169249c70f7de57', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128728) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:47:18.421233 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.policy [None req-b096acdb-16aa-4440-8eba-5bad756ac450 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58bfb7417bc94583963401ae0fe9d39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0672be3fa3f7414da1c1a5b7300abbe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128729) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:47:18.424743 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: INFO nova.api.openstack.requestlog [None req-b8ebcfbb-6457-427a-a59a-9bc725ca2880 tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] 10.222.0.61 "GET /compute/v2.1/servers/113f6b52-519c-45f4-9bc2-37168d644e15" status: 200 len: 1366 microversion: 2.1 time: 0.239511 May 14 15:47:18.425545 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: [pid: 128728|app: 0|req: 97/179] 10.222.0.61 () {58 vars in 1235 bytes} [Sat May 14 15:47:18 2022] GET /compute/v2.1/servers/113f6b52-519c-45f4-9bc2-37168d644e15 => generated 1366 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 15:47:18.429313 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.policy [None req-b096acdb-16aa-4440-8eba-5bad756ac450 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58bfb7417bc94583963401ae0fe9d39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0672be3fa3f7414da1c1a5b7300abbe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128729) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:47:18.430854 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.policy [None req-b096acdb-16aa-4440-8eba-5bad756ac450 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58bfb7417bc94583963401ae0fe9d39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0672be3fa3f7414da1c1a5b7300abbe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128729) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:47:18.432480 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: INFO nova.api.openstack.requestlog [None req-b096acdb-16aa-4440-8eba-5bad756ac450 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] 10.222.0.61 "GET /compute/v2.1/servers/e33e9970-bfb7-46f3-8d40-782dbfa3d21c" status: 200 len: 1406 microversion: 2.20 time: 0.232665 May 14 15:47:18.438513 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: [pid: 128729|app: 0|req: 83/180] 10.222.0.61 () {60 vars in 1276 bytes} [Sat May 14 15:47:18 2022] GET /compute/v2.1/servers/e33e9970-bfb7-46f3-8d40-782dbfa3d21c => generated 1406 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 14 15:47:18.705030 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi [None req-00704829-cc4b-43c5-8f8a-f1b5ae86eca0 tempest-DeleteServersTestJSON-2100051872 tempest-DeleteServersTestJSON-2100051872-project] Calling method '>' {{(pid=128728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 15:47:18.705572 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.compute.api [None req-00704829-cc4b-43c5-8f8a-f1b5ae86eca0 tempest-DeleteServersTestJSON-2100051872 tempest-DeleteServersTestJSON-2100051872-project] [instance: 75ca93de-6825-44ce-af10-44cba59218a1] Fetching instance by UUID {{(pid=128728) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 15:47:18.711713 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-00704829-cc4b-43c5-8f8a-f1b5ae86eca0 tempest-DeleteServersTestJSON-2100051872 tempest-DeleteServersTestJSON-2100051872-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:47:18.712171 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-00704829-cc4b-43c5-8f8a-f1b5ae86eca0 tempest-DeleteServersTestJSON-2100051872 tempest-DeleteServersTestJSON-2100051872-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:47:18.712971 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-00704829-cc4b-43c5-8f8a-f1b5ae86eca0 tempest-DeleteServersTestJSON-2100051872 tempest-DeleteServersTestJSON-2100051872-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:47:18.713442 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-00704829-cc4b-43c5-8f8a-f1b5ae86eca0 tempest-DeleteServersTestJSON-2100051872 tempest-DeleteServersTestJSON-2100051872-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:47:18.755966 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi [None req-e7bc27fe-d83f-4672-8437-97d9f89bef78 tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Calling method '>' {{(pid=128729) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 15:47:18.755966 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.compute.api [None req-e7bc27fe-d83f-4672-8437-97d9f89bef78 tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] [instance: 563c74e0-060d-49d5-abc5-389cee4bd9d5] Fetching instance by UUID {{(pid=128729) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 15:47:18.762087 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-e7bc27fe-d83f-4672-8437-97d9f89bef78 tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:47:18.762695 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-e7bc27fe-d83f-4672-8437-97d9f89bef78 tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:47:18.763687 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-e7bc27fe-d83f-4672-8437-97d9f89bef78 tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:47:18.766550 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-e7bc27fe-d83f-4672-8437-97d9f89bef78 tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:47:18.914069 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.policy [None req-00704829-cc4b-43c5-8f8a-f1b5ae86eca0 tempest-DeleteServersTestJSON-2100051872 tempest-DeleteServersTestJSON-2100051872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aad828d8ff314a2d82f07fb6d84f36a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6388da70b0dc48c1952570af4332dd6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128728) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:47:18.922560 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: INFO nova.api.openstack.requestlog [None req-00704829-cc4b-43c5-8f8a-f1b5ae86eca0 tempest-DeleteServersTestJSON-2100051872 tempest-DeleteServersTestJSON-2100051872-project] 10.222.0.61 "GET /compute/v2.1/servers/75ca93de-6825-44ce-af10-44cba59218a1" status: 200 len: 1315 microversion: 2.1 time: 0.221383 May 14 15:47:18.923224 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: [pid: 128728|app: 0|req: 98/181] 10.222.0.61 () {58 vars in 1235 bytes} [Sat May 14 15:47:18 2022] GET /compute/v2.1/servers/75ca93de-6825-44ce-af10-44cba59218a1 => generated 1315 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 15:47:18.948414 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.policy [None req-e7bc27fe-d83f-4672-8437-97d9f89bef78 tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b896317d96a40d6a137db0dcf5f98f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d2517d5440a4d30949f3dd36a46d813', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128729) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:47:18.955783 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: INFO nova.api.openstack.requestlog [None req-e7bc27fe-d83f-4672-8437-97d9f89bef78 tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] 10.222.0.61 "GET /compute/v2.1/servers/563c74e0-060d-49d5-abc5-389cee4bd9d5" status: 200 len: 1321 microversion: 2.1 time: 0.208622 May 14 15:47:18.956288 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: [pid: 128729|app: 0|req: 84/182] 10.222.0.61 () {58 vars in 1235 bytes} [Sat May 14 15:47:18 2022] GET /compute/v2.1/servers/563c74e0-060d-49d5-abc5-389cee4bd9d5 => generated 1321 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 15:47:19.442224 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi [None req-68e765f6-e21a-4f8c-9eb0-79a45ccab42c tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] Calling method '>' {{(pid=128728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 15:47:19.442875 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.compute.api [None req-68e765f6-e21a-4f8c-9eb0-79a45ccab42c tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] [instance: 113f6b52-519c-45f4-9bc2-37168d644e15] Fetching instance by UUID {{(pid=128728) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 15:47:19.449735 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-68e765f6-e21a-4f8c-9eb0-79a45ccab42c tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:47:19.450192 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-68e765f6-e21a-4f8c-9eb0-79a45ccab42c tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:47:19.451025 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-68e765f6-e21a-4f8c-9eb0-79a45ccab42c tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:47:19.451468 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-68e765f6-e21a-4f8c-9eb0-79a45ccab42c tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:47:19.451581 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi [None req-9d3ca593-d2ec-4e57-8e39-2d951652eb1a tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Calling method '>' {{(pid=128729) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 15:47:19.452142 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.compute.api [None req-9d3ca593-d2ec-4e57-8e39-2d951652eb1a tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] [instance: e33e9970-bfb7-46f3-8d40-782dbfa3d21c] Fetching instance by UUID {{(pid=128729) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 15:47:19.459195 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-9d3ca593-d2ec-4e57-8e39-2d951652eb1a tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:47:19.460030 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-9d3ca593-d2ec-4e57-8e39-2d951652eb1a tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:47:19.460914 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-9d3ca593-d2ec-4e57-8e39-2d951652eb1a tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:47:19.461305 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-9d3ca593-d2ec-4e57-8e39-2d951652eb1a tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:47:19.667224 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.policy [None req-9d3ca593-d2ec-4e57-8e39-2d951652eb1a tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58bfb7417bc94583963401ae0fe9d39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0672be3fa3f7414da1c1a5b7300abbe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128729) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:47:19.674212 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.policy [None req-68e765f6-e21a-4f8c-9eb0-79a45ccab42c tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc43895177134e9c9c030a9d87f94aaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7905689c95d44a5c9169249c70f7de57', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128728) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:47:19.675817 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.policy [None req-9d3ca593-d2ec-4e57-8e39-2d951652eb1a tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58bfb7417bc94583963401ae0fe9d39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0672be3fa3f7414da1c1a5b7300abbe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128729) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:47:19.677422 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.policy [None req-9d3ca593-d2ec-4e57-8e39-2d951652eb1a tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58bfb7417bc94583963401ae0fe9d39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0672be3fa3f7414da1c1a5b7300abbe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128729) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:47:19.678658 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: INFO nova.api.openstack.requestlog [None req-9d3ca593-d2ec-4e57-8e39-2d951652eb1a tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] 10.222.0.61 "GET /compute/v2.1/servers/e33e9970-bfb7-46f3-8d40-782dbfa3d21c" status: 200 len: 1406 microversion: 2.20 time: 0.231637 May 14 15:47:19.679340 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: [pid: 128729|app: 0|req: 85/183] 10.222.0.61 () {60 vars in 1276 bytes} [Sat May 14 15:47:19 2022] GET /compute/v2.1/servers/e33e9970-bfb7-46f3-8d40-782dbfa3d21c => generated 1406 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 14 15:47:19.690065 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: INFO nova.api.openstack.requestlog [None req-68e765f6-e21a-4f8c-9eb0-79a45ccab42c tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] 10.222.0.61 "GET /compute/v2.1/servers/113f6b52-519c-45f4-9bc2-37168d644e15" status: 200 len: 1366 microversion: 2.1 time: 0.243409 May 14 15:47:19.690065 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: [pid: 128728|app: 0|req: 99/184] 10.222.0.61 () {58 vars in 1235 bytes} [Sat May 14 15:47:19 2022] GET /compute/v2.1/servers/113f6b52-519c-45f4-9bc2-37168d644e15 => generated 1366 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 15:47:19.939661 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi [None req-d3c7981f-e2eb-4443-b621-fbc8ef3ff795 tempest-DeleteServersTestJSON-2100051872 tempest-DeleteServersTestJSON-2100051872-project] Calling method '>' {{(pid=128728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 15:47:19.940271 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.compute.api [None req-d3c7981f-e2eb-4443-b621-fbc8ef3ff795 tempest-DeleteServersTestJSON-2100051872 tempest-DeleteServersTestJSON-2100051872-project] [instance: 75ca93de-6825-44ce-af10-44cba59218a1] Fetching instance by UUID {{(pid=128728) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 15:47:19.946052 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-d3c7981f-e2eb-4443-b621-fbc8ef3ff795 tempest-DeleteServersTestJSON-2100051872 tempest-DeleteServersTestJSON-2100051872-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:47:19.946536 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-d3c7981f-e2eb-4443-b621-fbc8ef3ff795 tempest-DeleteServersTestJSON-2100051872 tempest-DeleteServersTestJSON-2100051872-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:47:19.947339 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-d3c7981f-e2eb-4443-b621-fbc8ef3ff795 tempest-DeleteServersTestJSON-2100051872 tempest-DeleteServersTestJSON-2100051872-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:47:19.948413 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-d3c7981f-e2eb-4443-b621-fbc8ef3ff795 tempest-DeleteServersTestJSON-2100051872 tempest-DeleteServersTestJSON-2100051872-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:47:19.973872 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi [None req-ae3a1c27-fac0-4bf4-a811-d07f862d9867 tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Calling method '>' {{(pid=128729) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 15:47:19.974628 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.compute.api [None req-ae3a1c27-fac0-4bf4-a811-d07f862d9867 tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] [instance: 563c74e0-060d-49d5-abc5-389cee4bd9d5] Fetching instance by UUID {{(pid=128729) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 15:47:19.982289 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-ae3a1c27-fac0-4bf4-a811-d07f862d9867 tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:47:19.983047 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-ae3a1c27-fac0-4bf4-a811-d07f862d9867 tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:47:19.984032 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-ae3a1c27-fac0-4bf4-a811-d07f862d9867 tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:47:19.984545 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-ae3a1c27-fac0-4bf4-a811-d07f862d9867 tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:47:20.164172 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.policy [None req-d3c7981f-e2eb-4443-b621-fbc8ef3ff795 tempest-DeleteServersTestJSON-2100051872 tempest-DeleteServersTestJSON-2100051872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aad828d8ff314a2d82f07fb6d84f36a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6388da70b0dc48c1952570af4332dd6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128728) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:47:20.173640 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: INFO nova.api.openstack.requestlog [None req-d3c7981f-e2eb-4443-b621-fbc8ef3ff795 tempest-DeleteServersTestJSON-2100051872 tempest-DeleteServersTestJSON-2100051872-project] 10.222.0.61 "GET /compute/v2.1/servers/75ca93de-6825-44ce-af10-44cba59218a1" status: 200 len: 1315 microversion: 2.1 time: 0.237670 May 14 15:47:20.176933 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.policy [None req-ae3a1c27-fac0-4bf4-a811-d07f862d9867 tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b896317d96a40d6a137db0dcf5f98f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d2517d5440a4d30949f3dd36a46d813', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128729) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:47:20.184159 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: [pid: 128728|app: 0|req: 100/185] 10.222.0.61 () {58 vars in 1235 bytes} [Sat May 14 15:47:19 2022] GET /compute/v2.1/servers/75ca93de-6825-44ce-af10-44cba59218a1 => generated 1315 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 15:47:20.184779 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: INFO nova.api.openstack.requestlog [None req-ae3a1c27-fac0-4bf4-a811-d07f862d9867 tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] 10.222.0.61 "GET /compute/v2.1/servers/563c74e0-060d-49d5-abc5-389cee4bd9d5" status: 200 len: 1321 microversion: 2.1 time: 0.215391 May 14 15:47:20.185494 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: [pid: 128729|app: 0|req: 86/186] 10.222.0.61 () {58 vars in 1235 bytes} [Sat May 14 15:47:19 2022] GET /compute/v2.1/servers/563c74e0-060d-49d5-abc5-389cee4bd9d5 => generated 1321 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 15:47:20.696815 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi [None req-5954dc62-da5b-4315-8005-1cbc48ab580a tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Calling method '>' {{(pid=128728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 15:47:20.697811 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.compute.api [None req-5954dc62-da5b-4315-8005-1cbc48ab580a tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] [instance: e33e9970-bfb7-46f3-8d40-782dbfa3d21c] Fetching instance by UUID {{(pid=128728) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 15:47:20.699204 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi [None req-791ee6c2-1811-4e84-b84a-c39686ee1cee tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] Calling method '>' {{(pid=128729) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 15:47:20.699872 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.compute.api [None req-791ee6c2-1811-4e84-b84a-c39686ee1cee tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] [instance: 113f6b52-519c-45f4-9bc2-37168d644e15] Fetching instance by UUID {{(pid=128729) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 15:47:20.707082 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-5954dc62-da5b-4315-8005-1cbc48ab580a tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:47:20.707705 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-5954dc62-da5b-4315-8005-1cbc48ab580a tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:47:20.707983 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-791ee6c2-1811-4e84-b84a-c39686ee1cee tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:47:20.708435 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-791ee6c2-1811-4e84-b84a-c39686ee1cee tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:47:20.708686 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-5954dc62-da5b-4315-8005-1cbc48ab580a tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:47:20.709186 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-5954dc62-da5b-4315-8005-1cbc48ab580a tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:47:20.709284 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-791ee6c2-1811-4e84-b84a-c39686ee1cee tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:47:20.709631 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-791ee6c2-1811-4e84-b84a-c39686ee1cee tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:47:20.916170 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.policy [None req-5954dc62-da5b-4315-8005-1cbc48ab580a tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58bfb7417bc94583963401ae0fe9d39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0672be3fa3f7414da1c1a5b7300abbe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128728) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:47:20.919245 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.policy [None req-791ee6c2-1811-4e84-b84a-c39686ee1cee tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc43895177134e9c9c030a9d87f94aaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7905689c95d44a5c9169249c70f7de57', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128729) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:47:20.925428 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.policy [None req-5954dc62-da5b-4315-8005-1cbc48ab580a tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58bfb7417bc94583963401ae0fe9d39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0672be3fa3f7414da1c1a5b7300abbe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128728) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:47:20.927130 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.policy [None req-5954dc62-da5b-4315-8005-1cbc48ab580a tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58bfb7417bc94583963401ae0fe9d39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0672be3fa3f7414da1c1a5b7300abbe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128728) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:47:20.928049 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: INFO nova.api.openstack.requestlog [None req-791ee6c2-1811-4e84-b84a-c39686ee1cee tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] 10.222.0.61 "GET /compute/v2.1/servers/113f6b52-519c-45f4-9bc2-37168d644e15" status: 200 len: 1366 microversion: 2.1 time: 0.232833 May 14 15:47:20.928419 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: INFO nova.api.openstack.requestlog [None req-5954dc62-da5b-4315-8005-1cbc48ab580a tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] 10.222.0.61 "GET /compute/v2.1/servers/e33e9970-bfb7-46f3-8d40-782dbfa3d21c" status: 200 len: 1406 microversion: 2.20 time: 0.235530 May 14 15:47:20.928687 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: [pid: 128729|app: 0|req: 87/187] 10.222.0.61 () {58 vars in 1235 bytes} [Sat May 14 15:47:20 2022] GET /compute/v2.1/servers/113f6b52-519c-45f4-9bc2-37168d644e15 => generated 1366 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 15:47:20.929291 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: [pid: 128728|app: 0|req: 101/188] 10.222.0.61 () {60 vars in 1276 bytes} [Sat May 14 15:47:20 2022] GET /compute/v2.1/servers/e33e9970-bfb7-46f3-8d40-782dbfa3d21c => generated 1406 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 14 15:47:21.192643 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi [None req-c1e56055-877f-4b05-9047-36783cb89397 tempest-DeleteServersTestJSON-2100051872 tempest-DeleteServersTestJSON-2100051872-project] Calling method '>' {{(pid=128729) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 15:47:21.193944 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.compute.api [None req-c1e56055-877f-4b05-9047-36783cb89397 tempest-DeleteServersTestJSON-2100051872 tempest-DeleteServersTestJSON-2100051872-project] [instance: 75ca93de-6825-44ce-af10-44cba59218a1] Fetching instance by UUID {{(pid=128729) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 15:47:21.201855 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi [None req-9e787989-0bdf-44d3-baa5-05f1f7d7e21a tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Calling method '>' {{(pid=128728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 15:47:21.202050 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-c1e56055-877f-4b05-9047-36783cb89397 tempest-DeleteServersTestJSON-2100051872 tempest-DeleteServersTestJSON-2100051872-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:47:21.202368 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-c1e56055-877f-4b05-9047-36783cb89397 tempest-DeleteServersTestJSON-2100051872 tempest-DeleteServersTestJSON-2100051872-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:47:21.202841 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.compute.api [None req-9e787989-0bdf-44d3-baa5-05f1f7d7e21a tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] [instance: 563c74e0-060d-49d5-abc5-389cee4bd9d5] Fetching instance by UUID {{(pid=128728) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 15:47:21.203137 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-c1e56055-877f-4b05-9047-36783cb89397 tempest-DeleteServersTestJSON-2100051872 tempest-DeleteServersTestJSON-2100051872-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:47:21.203571 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-c1e56055-877f-4b05-9047-36783cb89397 tempest-DeleteServersTestJSON-2100051872 tempest-DeleteServersTestJSON-2100051872-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:47:21.209152 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-9e787989-0bdf-44d3-baa5-05f1f7d7e21a tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:47:21.209862 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-9e787989-0bdf-44d3-baa5-05f1f7d7e21a tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:47:21.210897 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-9e787989-0bdf-44d3-baa5-05f1f7d7e21a tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:47:21.211335 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-9e787989-0bdf-44d3-baa5-05f1f7d7e21a tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:47:21.421404 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.policy [None req-c1e56055-877f-4b05-9047-36783cb89397 tempest-DeleteServersTestJSON-2100051872 tempest-DeleteServersTestJSON-2100051872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aad828d8ff314a2d82f07fb6d84f36a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6388da70b0dc48c1952570af4332dd6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128729) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:47:21.428801 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: INFO nova.api.openstack.requestlog [None req-c1e56055-877f-4b05-9047-36783cb89397 tempest-DeleteServersTestJSON-2100051872 tempest-DeleteServersTestJSON-2100051872-project] 10.222.0.61 "GET /compute/v2.1/servers/75ca93de-6825-44ce-af10-44cba59218a1" status: 200 len: 1315 microversion: 2.1 time: 0.241613 May 14 15:47:21.429672 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: [pid: 128729|app: 0|req: 88/189] 10.222.0.61 () {58 vars in 1235 bytes} [Sat May 14 15:47:21 2022] GET /compute/v2.1/servers/75ca93de-6825-44ce-af10-44cba59218a1 => generated 1315 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 15:47:21.442235 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.policy [None req-9e787989-0bdf-44d3-baa5-05f1f7d7e21a tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b896317d96a40d6a137db0dcf5f98f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d2517d5440a4d30949f3dd36a46d813', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128728) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:47:21.452801 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: INFO nova.api.openstack.requestlog [None req-9e787989-0bdf-44d3-baa5-05f1f7d7e21a tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] 10.222.0.61 "GET /compute/v2.1/servers/563c74e0-060d-49d5-abc5-389cee4bd9d5" status: 200 len: 1321 microversion: 2.1 time: 0.255296 May 14 15:47:21.453379 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: [pid: 128728|app: 0|req: 102/190] 10.222.0.61 () {58 vars in 1235 bytes} [Sat May 14 15:47:21 2022] GET /compute/v2.1/servers/563c74e0-060d-49d5-abc5-389cee4bd9d5 => generated 1321 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 15:47:21.945048 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi [None req-96f8d6bd-d517-4dbb-825a-5ce130046b82 tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] Calling method '>' {{(pid=128729) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 15:47:21.945663 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.compute.api [None req-96f8d6bd-d517-4dbb-825a-5ce130046b82 tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] [instance: 113f6b52-519c-45f4-9bc2-37168d644e15] Fetching instance by UUID {{(pid=128729) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 15:47:21.946649 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi [None req-45914378-e836-4633-80c5-7c164a8aec59 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Calling method '>' {{(pid=128728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 15:47:21.947278 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.compute.api [None req-45914378-e836-4633-80c5-7c164a8aec59 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] [instance: e33e9970-bfb7-46f3-8d40-782dbfa3d21c] Fetching instance by UUID {{(pid=128728) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 15:47:21.952698 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-96f8d6bd-d517-4dbb-825a-5ce130046b82 tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:47:21.953229 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-96f8d6bd-d517-4dbb-825a-5ce130046b82 tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:47:21.953844 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-45914378-e836-4633-80c5-7c164a8aec59 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:47:21.954183 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-96f8d6bd-d517-4dbb-825a-5ce130046b82 tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:47:21.954279 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-45914378-e836-4633-80c5-7c164a8aec59 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:47:21.954856 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-96f8d6bd-d517-4dbb-825a-5ce130046b82 tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:47:21.955789 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-45914378-e836-4633-80c5-7c164a8aec59 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:47:21.956226 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-45914378-e836-4633-80c5-7c164a8aec59 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:47:22.156433 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.policy [None req-45914378-e836-4633-80c5-7c164a8aec59 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58bfb7417bc94583963401ae0fe9d39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0672be3fa3f7414da1c1a5b7300abbe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128728) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:47:22.161780 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.policy [None req-96f8d6bd-d517-4dbb-825a-5ce130046b82 tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc43895177134e9c9c030a9d87f94aaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7905689c95d44a5c9169249c70f7de57', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128729) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:47:22.164944 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.policy [None req-45914378-e836-4633-80c5-7c164a8aec59 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58bfb7417bc94583963401ae0fe9d39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0672be3fa3f7414da1c1a5b7300abbe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128728) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:47:22.167944 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.policy [None req-45914378-e836-4633-80c5-7c164a8aec59 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58bfb7417bc94583963401ae0fe9d39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0672be3fa3f7414da1c1a5b7300abbe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128728) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:47:22.169311 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: INFO nova.api.openstack.requestlog [None req-96f8d6bd-d517-4dbb-825a-5ce130046b82 tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] 10.222.0.61 "GET /compute/v2.1/servers/113f6b52-519c-45f4-9bc2-37168d644e15" status: 200 len: 1366 microversion: 2.1 time: 0.228307 May 14 15:47:22.169931 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: [pid: 128729|app: 0|req: 89/191] 10.222.0.61 () {58 vars in 1235 bytes} [Sat May 14 15:47:21 2022] GET /compute/v2.1/servers/113f6b52-519c-45f4-9bc2-37168d644e15 => generated 1366 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 15:47:22.170087 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: INFO nova.api.openstack.requestlog [None req-45914378-e836-4633-80c5-7c164a8aec59 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] 10.222.0.61 "GET /compute/v2.1/servers/e33e9970-bfb7-46f3-8d40-782dbfa3d21c" status: 200 len: 1406 microversion: 2.20 time: 0.227059 May 14 15:47:22.171110 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: [pid: 128728|app: 0|req: 103/192] 10.222.0.61 () {60 vars in 1276 bytes} [Sat May 14 15:47:21 2022] GET /compute/v2.1/servers/e33e9970-bfb7-46f3-8d40-782dbfa3d21c => generated 1406 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 14 15:47:22.446454 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi [None req-0b405297-7903-4de9-a695-1022b2665213 tempest-DeleteServersTestJSON-2100051872 tempest-DeleteServersTestJSON-2100051872-project] Calling method '>' {{(pid=128729) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 15:47:22.447827 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.compute.api [None req-0b405297-7903-4de9-a695-1022b2665213 tempest-DeleteServersTestJSON-2100051872 tempest-DeleteServersTestJSON-2100051872-project] [instance: 75ca93de-6825-44ce-af10-44cba59218a1] Fetching instance by UUID {{(pid=128729) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 15:47:22.453947 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-0b405297-7903-4de9-a695-1022b2665213 tempest-DeleteServersTestJSON-2100051872 tempest-DeleteServersTestJSON-2100051872-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:47:22.454421 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-0b405297-7903-4de9-a695-1022b2665213 tempest-DeleteServersTestJSON-2100051872 tempest-DeleteServersTestJSON-2100051872-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:47:22.455384 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-0b405297-7903-4de9-a695-1022b2665213 tempest-DeleteServersTestJSON-2100051872 tempest-DeleteServersTestJSON-2100051872-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:47:22.455859 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-0b405297-7903-4de9-a695-1022b2665213 tempest-DeleteServersTestJSON-2100051872 tempest-DeleteServersTestJSON-2100051872-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:47:22.471011 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi [None req-6e272c39-2df6-46da-8a0a-9cfa00552ab9 tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Calling method '>' {{(pid=128728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 15:47:22.472264 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.compute.api [None req-6e272c39-2df6-46da-8a0a-9cfa00552ab9 tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] [instance: 563c74e0-060d-49d5-abc5-389cee4bd9d5] Fetching instance by UUID {{(pid=128728) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 15:47:22.478504 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-6e272c39-2df6-46da-8a0a-9cfa00552ab9 tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:47:22.480257 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-6e272c39-2df6-46da-8a0a-9cfa00552ab9 tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:47:22.481050 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-6e272c39-2df6-46da-8a0a-9cfa00552ab9 tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:47:22.481511 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-6e272c39-2df6-46da-8a0a-9cfa00552ab9 tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:47:22.647346 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.policy [None req-0b405297-7903-4de9-a695-1022b2665213 tempest-DeleteServersTestJSON-2100051872 tempest-DeleteServersTestJSON-2100051872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aad828d8ff314a2d82f07fb6d84f36a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6388da70b0dc48c1952570af4332dd6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128729) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:47:22.656596 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: INFO nova.api.openstack.requestlog [None req-0b405297-7903-4de9-a695-1022b2665213 tempest-DeleteServersTestJSON-2100051872 tempest-DeleteServersTestJSON-2100051872-project] 10.222.0.61 "GET /compute/v2.1/servers/75ca93de-6825-44ce-af10-44cba59218a1" status: 200 len: 1315 microversion: 2.1 time: 0.213870 May 14 15:47:22.658228 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: [pid: 128729|app: 0|req: 90/193] 10.222.0.61 () {58 vars in 1235 bytes} [Sat May 14 15:47:22 2022] GET /compute/v2.1/servers/75ca93de-6825-44ce-af10-44cba59218a1 => generated 1315 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 15:47:22.687217 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.policy [None req-6e272c39-2df6-46da-8a0a-9cfa00552ab9 tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b896317d96a40d6a137db0dcf5f98f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d2517d5440a4d30949f3dd36a46d813', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128728) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:47:22.697032 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: INFO nova.api.openstack.requestlog [None req-6e272c39-2df6-46da-8a0a-9cfa00552ab9 tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] 10.222.0.61 "GET /compute/v2.1/servers/563c74e0-060d-49d5-abc5-389cee4bd9d5" status: 200 len: 1321 microversion: 2.1 time: 0.231896 May 14 15:47:22.706228 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: [pid: 128728|app: 0|req: 104/194] 10.222.0.61 () {58 vars in 1235 bytes} [Sat May 14 15:47:22 2022] GET /compute/v2.1/servers/563c74e0-060d-49d5-abc5-389cee4bd9d5 => generated 1321 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 15:47:23.186570 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi [None req-5e15e415-f525-4fb3-af7e-3f226c1a2f6f tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] Calling method '>' {{(pid=128729) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 15:47:23.187311 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.compute.api [None req-5e15e415-f525-4fb3-af7e-3f226c1a2f6f tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] [instance: 113f6b52-519c-45f4-9bc2-37168d644e15] Fetching instance by UUID {{(pid=128729) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 15:47:23.188487 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi [None req-01db7f8c-660f-49ce-b034-288244ea2381 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Calling method '>' {{(pid=128728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 15:47:23.189612 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.compute.api [None req-01db7f8c-660f-49ce-b034-288244ea2381 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] [instance: e33e9970-bfb7-46f3-8d40-782dbfa3d21c] Fetching instance by UUID {{(pid=128728) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 15:47:23.193389 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-5e15e415-f525-4fb3-af7e-3f226c1a2f6f tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:47:23.193928 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-5e15e415-f525-4fb3-af7e-3f226c1a2f6f tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:47:23.194804 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-5e15e415-f525-4fb3-af7e-3f226c1a2f6f tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:47:23.195316 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-5e15e415-f525-4fb3-af7e-3f226c1a2f6f tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:47:23.195548 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-01db7f8c-660f-49ce-b034-288244ea2381 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:47:23.195990 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-01db7f8c-660f-49ce-b034-288244ea2381 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:47:23.196913 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-01db7f8c-660f-49ce-b034-288244ea2381 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:47:23.197528 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-01db7f8c-660f-49ce-b034-288244ea2381 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:47:23.389541 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.policy [None req-5e15e415-f525-4fb3-af7e-3f226c1a2f6f tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc43895177134e9c9c030a9d87f94aaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7905689c95d44a5c9169249c70f7de57', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128729) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:47:23.399029 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: INFO nova.api.openstack.requestlog [None req-5e15e415-f525-4fb3-af7e-3f226c1a2f6f tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] 10.222.0.61 "GET /compute/v2.1/servers/113f6b52-519c-45f4-9bc2-37168d644e15" status: 200 len: 1366 microversion: 2.1 time: 0.216205 May 14 15:47:23.399925 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: [pid: 128729|app: 0|req: 91/195] 10.222.0.61 () {58 vars in 1235 bytes} [Sat May 14 15:47:23 2022] GET /compute/v2.1/servers/113f6b52-519c-45f4-9bc2-37168d644e15 => generated 1366 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 15:47:23.401486 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.policy [None req-01db7f8c-660f-49ce-b034-288244ea2381 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58bfb7417bc94583963401ae0fe9d39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0672be3fa3f7414da1c1a5b7300abbe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128728) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:47:23.409548 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.policy [None req-01db7f8c-660f-49ce-b034-288244ea2381 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58bfb7417bc94583963401ae0fe9d39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0672be3fa3f7414da1c1a5b7300abbe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128728) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:47:23.411218 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.policy [None req-01db7f8c-660f-49ce-b034-288244ea2381 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58bfb7417bc94583963401ae0fe9d39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0672be3fa3f7414da1c1a5b7300abbe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128728) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:47:23.412266 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: INFO nova.api.openstack.requestlog [None req-01db7f8c-660f-49ce-b034-288244ea2381 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] 10.222.0.61 "GET /compute/v2.1/servers/e33e9970-bfb7-46f3-8d40-782dbfa3d21c" status: 200 len: 1406 microversion: 2.20 time: 0.227622 May 14 15:47:23.412847 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: [pid: 128728|app: 0|req: 105/196] 10.222.0.61 () {60 vars in 1276 bytes} [Sat May 14 15:47:23 2022] GET /compute/v2.1/servers/e33e9970-bfb7-46f3-8d40-782dbfa3d21c => generated 1406 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 14 15:47:23.673537 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi [None req-43ede3b2-9459-4f2a-8e60-a8f97a6c394a tempest-DeleteServersTestJSON-2100051872 tempest-DeleteServersTestJSON-2100051872-project] Calling method '>' {{(pid=128729) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 15:47:23.674250 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.compute.api [None req-43ede3b2-9459-4f2a-8e60-a8f97a6c394a tempest-DeleteServersTestJSON-2100051872 tempest-DeleteServersTestJSON-2100051872-project] [instance: 75ca93de-6825-44ce-af10-44cba59218a1] Fetching instance by UUID {{(pid=128729) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 15:47:23.680515 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-43ede3b2-9459-4f2a-8e60-a8f97a6c394a tempest-DeleteServersTestJSON-2100051872 tempest-DeleteServersTestJSON-2100051872-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:47:23.680959 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-43ede3b2-9459-4f2a-8e60-a8f97a6c394a tempest-DeleteServersTestJSON-2100051872 tempest-DeleteServersTestJSON-2100051872-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:47:23.681717 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-43ede3b2-9459-4f2a-8e60-a8f97a6c394a tempest-DeleteServersTestJSON-2100051872 tempest-DeleteServersTestJSON-2100051872-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:47:23.682226 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-43ede3b2-9459-4f2a-8e60-a8f97a6c394a tempest-DeleteServersTestJSON-2100051872 tempest-DeleteServersTestJSON-2100051872-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:47:23.717198 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi [None req-8346f6e1-68fe-4e95-b6c3-6b5a11806af4 tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Calling method '>' {{(pid=128728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 15:47:23.718126 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.compute.api [None req-8346f6e1-68fe-4e95-b6c3-6b5a11806af4 tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] [instance: 563c74e0-060d-49d5-abc5-389cee4bd9d5] Fetching instance by UUID {{(pid=128728) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 15:47:23.725168 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-8346f6e1-68fe-4e95-b6c3-6b5a11806af4 tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:47:23.726642 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-8346f6e1-68fe-4e95-b6c3-6b5a11806af4 tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:47:23.727632 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-8346f6e1-68fe-4e95-b6c3-6b5a11806af4 tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:47:23.728231 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-8346f6e1-68fe-4e95-b6c3-6b5a11806af4 tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:47:23.895169 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.policy [None req-43ede3b2-9459-4f2a-8e60-a8f97a6c394a tempest-DeleteServersTestJSON-2100051872 tempest-DeleteServersTestJSON-2100051872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aad828d8ff314a2d82f07fb6d84f36a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6388da70b0dc48c1952570af4332dd6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128729) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:47:23.903070 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: INFO nova.api.openstack.requestlog [None req-43ede3b2-9459-4f2a-8e60-a8f97a6c394a tempest-DeleteServersTestJSON-2100051872 tempest-DeleteServersTestJSON-2100051872-project] 10.222.0.61 "GET /compute/v2.1/servers/75ca93de-6825-44ce-af10-44cba59218a1" status: 200 len: 1502 microversion: 2.1 time: 0.233339 May 14 15:47:23.903637 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: [pid: 128729|app: 0|req: 92/197] 10.222.0.61 () {58 vars in 1235 bytes} [Sat May 14 15:47:23 2022] GET /compute/v2.1/servers/75ca93de-6825-44ce-af10-44cba59218a1 => generated 1502 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 15:47:23.923213 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.policy [None req-8346f6e1-68fe-4e95-b6c3-6b5a11806af4 tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b896317d96a40d6a137db0dcf5f98f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d2517d5440a4d30949f3dd36a46d813', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128728) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:47:23.931212 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: INFO nova.api.openstack.requestlog [None req-8346f6e1-68fe-4e95-b6c3-6b5a11806af4 tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] 10.222.0.61 "GET /compute/v2.1/servers/563c74e0-060d-49d5-abc5-389cee4bd9d5" status: 200 len: 1321 microversion: 2.1 time: 0.219877 May 14 15:47:23.932622 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: [pid: 128728|app: 0|req: 106/198] 10.222.0.61 () {58 vars in 1235 bytes} [Sat May 14 15:47:23 2022] GET /compute/v2.1/servers/563c74e0-060d-49d5-abc5-389cee4bd9d5 => generated 1321 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 15:47:24.415822 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi [None req-bdf15d8b-343a-4a15-bff2-3b8a894a1c0b tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] Calling method '>' {{(pid=128729) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 15:47:24.416441 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.compute.api [None req-bdf15d8b-343a-4a15-bff2-3b8a894a1c0b tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] [instance: 113f6b52-519c-45f4-9bc2-37168d644e15] Fetching instance by UUID {{(pid=128729) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 15:47:24.424663 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-bdf15d8b-343a-4a15-bff2-3b8a894a1c0b tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:47:24.424663 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-bdf15d8b-343a-4a15-bff2-3b8a894a1c0b tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:47:24.424663 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-bdf15d8b-343a-4a15-bff2-3b8a894a1c0b tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:47:24.424663 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-bdf15d8b-343a-4a15-bff2-3b8a894a1c0b tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:47:24.435243 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi [None req-f64cbd5c-6845-465b-881e-ab6045753c89 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Calling method '>' {{(pid=128728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 15:47:24.435953 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.compute.api [None req-f64cbd5c-6845-465b-881e-ab6045753c89 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] [instance: e33e9970-bfb7-46f3-8d40-782dbfa3d21c] Fetching instance by UUID {{(pid=128728) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 15:47:24.443849 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-f64cbd5c-6845-465b-881e-ab6045753c89 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:47:24.444304 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-f64cbd5c-6845-465b-881e-ab6045753c89 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:47:24.445681 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-f64cbd5c-6845-465b-881e-ab6045753c89 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:47:24.446118 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-f64cbd5c-6845-465b-881e-ab6045753c89 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:47:24.618147 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.policy [None req-bdf15d8b-343a-4a15-bff2-3b8a894a1c0b tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc43895177134e9c9c030a9d87f94aaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7905689c95d44a5c9169249c70f7de57', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128729) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:47:24.626597 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: INFO nova.api.openstack.requestlog [None req-bdf15d8b-343a-4a15-bff2-3b8a894a1c0b tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] 10.222.0.61 "GET /compute/v2.1/servers/113f6b52-519c-45f4-9bc2-37168d644e15" status: 200 len: 1366 microversion: 2.1 time: 0.214544 May 14 15:47:24.627417 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: [pid: 128729|app: 0|req: 93/199] 10.222.0.61 () {58 vars in 1235 bytes} [Sat May 14 15:47:24 2022] GET /compute/v2.1/servers/113f6b52-519c-45f4-9bc2-37168d644e15 => generated 1366 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 15:47:24.652973 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.policy [None req-f64cbd5c-6845-465b-881e-ab6045753c89 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58bfb7417bc94583963401ae0fe9d39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0672be3fa3f7414da1c1a5b7300abbe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128728) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:47:24.660777 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.policy [None req-f64cbd5c-6845-465b-881e-ab6045753c89 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58bfb7417bc94583963401ae0fe9d39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0672be3fa3f7414da1c1a5b7300abbe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128728) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:47:24.665178 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.policy [None req-f64cbd5c-6845-465b-881e-ab6045753c89 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58bfb7417bc94583963401ae0fe9d39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0672be3fa3f7414da1c1a5b7300abbe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128728) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:47:24.665178 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: INFO nova.api.openstack.requestlog [None req-f64cbd5c-6845-465b-881e-ab6045753c89 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] 10.222.0.61 "GET /compute/v2.1/servers/e33e9970-bfb7-46f3-8d40-782dbfa3d21c" status: 200 len: 1406 microversion: 2.20 time: 0.235128 May 14 15:47:24.665178 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: [pid: 128728|app: 0|req: 107/200] 10.222.0.61 () {60 vars in 1276 bytes} [Sat May 14 15:47:24 2022] GET /compute/v2.1/servers/e33e9970-bfb7-46f3-8d40-782dbfa3d21c => generated 1406 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 14 15:47:24.949251 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi [None req-43f372e2-8c50-4532-a8b4-75df786a8db5 tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Calling method '>' {{(pid=128729) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 15:47:24.949777 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.compute.api [None req-43f372e2-8c50-4532-a8b4-75df786a8db5 tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] [instance: 563c74e0-060d-49d5-abc5-389cee4bd9d5] Fetching instance by UUID {{(pid=128729) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 15:47:24.955666 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-43f372e2-8c50-4532-a8b4-75df786a8db5 tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:47:24.956767 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-43f372e2-8c50-4532-a8b4-75df786a8db5 tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:47:24.957746 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-43f372e2-8c50-4532-a8b4-75df786a8db5 tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:47:24.958431 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-43f372e2-8c50-4532-a8b4-75df786a8db5 tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:47:25.136095 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.policy [None req-43f372e2-8c50-4532-a8b4-75df786a8db5 tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b896317d96a40d6a137db0dcf5f98f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d2517d5440a4d30949f3dd36a46d813', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128729) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:47:25.143371 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: INFO nova.api.openstack.requestlog [None req-43f372e2-8c50-4532-a8b4-75df786a8db5 tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] 10.222.0.61 "GET /compute/v2.1/servers/563c74e0-060d-49d5-abc5-389cee4bd9d5" status: 200 len: 1321 microversion: 2.1 time: 0.198635 May 14 15:47:25.143925 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: [pid: 128729|app: 0|req: 94/201] 10.222.0.61 () {58 vars in 1235 bytes} [Sat May 14 15:47:24 2022] GET /compute/v2.1/servers/563c74e0-060d-49d5-abc5-389cee4bd9d5 => generated 1321 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 15:47:25.642451 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi [None req-d912b060-30d9-4319-b014-4b5e4fd9f202 tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] Calling method '>' {{(pid=128728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 15:47:25.643056 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.compute.api [None req-d912b060-30d9-4319-b014-4b5e4fd9f202 tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] [instance: 113f6b52-519c-45f4-9bc2-37168d644e15] Fetching instance by UUID {{(pid=128728) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 15:47:25.649492 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-d912b060-30d9-4319-b014-4b5e4fd9f202 tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:47:25.649684 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-d912b060-30d9-4319-b014-4b5e4fd9f202 tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:47:25.651301 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-d912b060-30d9-4319-b014-4b5e4fd9f202 tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:47:25.651652 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-d912b060-30d9-4319-b014-4b5e4fd9f202 tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:47:25.686843 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi [None req-c53f7327-4f33-4393-adbb-841de612fabc tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Calling method '>' {{(pid=128729) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 15:47:25.687563 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.compute.api [None req-c53f7327-4f33-4393-adbb-841de612fabc tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] [instance: e33e9970-bfb7-46f3-8d40-782dbfa3d21c] Fetching instance by UUID {{(pid=128729) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 15:47:25.693585 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-c53f7327-4f33-4393-adbb-841de612fabc tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:47:25.694328 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-c53f7327-4f33-4393-adbb-841de612fabc tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:47:25.695113 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-c53f7327-4f33-4393-adbb-841de612fabc tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:47:25.695615 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-c53f7327-4f33-4393-adbb-841de612fabc tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:47:25.840904 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.policy [None req-d912b060-30d9-4319-b014-4b5e4fd9f202 tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc43895177134e9c9c030a9d87f94aaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7905689c95d44a5c9169249c70f7de57', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128728) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:47:25.849827 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: INFO nova.api.openstack.requestlog [None req-d912b060-30d9-4319-b014-4b5e4fd9f202 tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] 10.222.0.61 "GET /compute/v2.1/servers/113f6b52-519c-45f4-9bc2-37168d644e15" status: 200 len: 1366 microversion: 2.1 time: 0.210512 May 14 15:47:25.856708 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: [pid: 128728|app: 0|req: 108/202] 10.222.0.61 () {58 vars in 1235 bytes} [Sat May 14 15:47:25 2022] GET /compute/v2.1/servers/113f6b52-519c-45f4-9bc2-37168d644e15 => generated 1366 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 15:47:25.868565 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.policy [None req-c53f7327-4f33-4393-adbb-841de612fabc tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58bfb7417bc94583963401ae0fe9d39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0672be3fa3f7414da1c1a5b7300abbe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128729) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:47:25.878303 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.policy [None req-c53f7327-4f33-4393-adbb-841de612fabc tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58bfb7417bc94583963401ae0fe9d39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0672be3fa3f7414da1c1a5b7300abbe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128729) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:47:25.879923 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.policy [None req-c53f7327-4f33-4393-adbb-841de612fabc tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58bfb7417bc94583963401ae0fe9d39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0672be3fa3f7414da1c1a5b7300abbe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128729) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:47:25.881140 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: INFO nova.api.openstack.requestlog [None req-c53f7327-4f33-4393-adbb-841de612fabc tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] 10.222.0.61 "GET /compute/v2.1/servers/e33e9970-bfb7-46f3-8d40-782dbfa3d21c" status: 200 len: 1406 microversion: 2.20 time: 0.202447 May 14 15:47:25.881773 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: [pid: 128729|app: 0|req: 95/203] 10.222.0.61 () {60 vars in 1276 bytes} [Sat May 14 15:47:25 2022] GET /compute/v2.1/servers/e33e9970-bfb7-46f3-8d40-782dbfa3d21c => generated 1406 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 14 15:47:26.161262 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi [None req-f11c8e56-1ec9-4775-8333-6351d528574b tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Calling method '>' {{(pid=128728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 15:47:26.161967 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.compute.api [None req-f11c8e56-1ec9-4775-8333-6351d528574b tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] [instance: 563c74e0-060d-49d5-abc5-389cee4bd9d5] Fetching instance by UUID {{(pid=128728) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 15:47:26.169150 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-f11c8e56-1ec9-4775-8333-6351d528574b tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:47:26.169596 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-f11c8e56-1ec9-4775-8333-6351d528574b tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:47:26.170390 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-f11c8e56-1ec9-4775-8333-6351d528574b tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:47:26.170996 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-f11c8e56-1ec9-4775-8333-6351d528574b tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:47:26.330013 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.policy [None req-f11c8e56-1ec9-4775-8333-6351d528574b tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b896317d96a40d6a137db0dcf5f98f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d2517d5440a4d30949f3dd36a46d813', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128728) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:47:26.338944 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: INFO nova.api.openstack.requestlog [None req-f11c8e56-1ec9-4775-8333-6351d528574b tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] 10.222.0.61 "GET /compute/v2.1/servers/563c74e0-060d-49d5-abc5-389cee4bd9d5" status: 200 len: 1321 microversion: 2.1 time: 0.181283 May 14 15:47:26.339117 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: [pid: 128728|app: 0|req: 109/204] 10.222.0.61 () {58 vars in 1235 bytes} [Sat May 14 15:47:26 2022] GET /compute/v2.1/servers/563c74e0-060d-49d5-abc5-389cee4bd9d5 => generated 1321 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 15:47:26.867882 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi [None req-2c88354b-57f0-4857-9bf7-9c5fc9068fa4 tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] Calling method '>' {{(pid=128729) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 15:47:26.868484 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.compute.api [None req-2c88354b-57f0-4857-9bf7-9c5fc9068fa4 tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] [instance: 113f6b52-519c-45f4-9bc2-37168d644e15] Fetching instance by UUID {{(pid=128729) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 15:47:26.874957 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-2c88354b-57f0-4857-9bf7-9c5fc9068fa4 tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:47:26.875408 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-2c88354b-57f0-4857-9bf7-9c5fc9068fa4 tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:47:26.876174 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-2c88354b-57f0-4857-9bf7-9c5fc9068fa4 tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:47:26.876608 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-2c88354b-57f0-4857-9bf7-9c5fc9068fa4 tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:47:26.900215 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi [None req-3a5d5b69-91c1-4e22-bef4-eee79a40faf9 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Calling method '>' {{(pid=128728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 15:47:26.901469 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.compute.api [None req-3a5d5b69-91c1-4e22-bef4-eee79a40faf9 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] [instance: e33e9970-bfb7-46f3-8d40-782dbfa3d21c] Fetching instance by UUID {{(pid=128728) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 15:47:26.907363 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-3a5d5b69-91c1-4e22-bef4-eee79a40faf9 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:47:26.907807 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-3a5d5b69-91c1-4e22-bef4-eee79a40faf9 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:47:26.908577 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-3a5d5b69-91c1-4e22-bef4-eee79a40faf9 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:47:26.909012 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-3a5d5b69-91c1-4e22-bef4-eee79a40faf9 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:47:27.077295 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.policy [None req-2c88354b-57f0-4857-9bf7-9c5fc9068fa4 tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc43895177134e9c9c030a9d87f94aaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7905689c95d44a5c9169249c70f7de57', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128729) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:47:27.084678 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.policy [None req-3a5d5b69-91c1-4e22-bef4-eee79a40faf9 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58bfb7417bc94583963401ae0fe9d39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0672be3fa3f7414da1c1a5b7300abbe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128728) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:47:27.086127 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: INFO nova.api.openstack.requestlog [None req-2c88354b-57f0-4857-9bf7-9c5fc9068fa4 tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] 10.222.0.61 "GET /compute/v2.1/servers/113f6b52-519c-45f4-9bc2-37168d644e15" status: 200 len: 1366 microversion: 2.1 time: 0.222057 May 14 15:47:27.087074 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: [pid: 128729|app: 0|req: 96/205] 10.222.0.61 () {58 vars in 1235 bytes} [Sat May 14 15:47:26 2022] GET /compute/v2.1/servers/113f6b52-519c-45f4-9bc2-37168d644e15 => generated 1366 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 15:47:27.093645 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.policy [None req-3a5d5b69-91c1-4e22-bef4-eee79a40faf9 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58bfb7417bc94583963401ae0fe9d39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0672be3fa3f7414da1c1a5b7300abbe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128728) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:47:27.095209 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.policy [None req-3a5d5b69-91c1-4e22-bef4-eee79a40faf9 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58bfb7417bc94583963401ae0fe9d39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0672be3fa3f7414da1c1a5b7300abbe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128728) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:47:27.096309 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: INFO nova.api.openstack.requestlog [None req-3a5d5b69-91c1-4e22-bef4-eee79a40faf9 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] 10.222.0.61 "GET /compute/v2.1/servers/e33e9970-bfb7-46f3-8d40-782dbfa3d21c" status: 200 len: 1406 microversion: 2.20 time: 0.200120 May 14 15:47:27.097045 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: [pid: 128728|app: 0|req: 110/206] 10.222.0.61 () {60 vars in 1276 bytes} [Sat May 14 15:47:26 2022] GET /compute/v2.1/servers/e33e9970-bfb7-46f3-8d40-782dbfa3d21c => generated 1406 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 14 15:47:27.354997 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi [None req-5b3577a5-ba6f-41f2-9aea-60bbeb199923 tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Calling method '>' {{(pid=128729) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 15:47:27.355681 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.compute.api [None req-5b3577a5-ba6f-41f2-9aea-60bbeb199923 tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] [instance: 563c74e0-060d-49d5-abc5-389cee4bd9d5] Fetching instance by UUID {{(pid=128729) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 15:47:27.361926 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-5b3577a5-ba6f-41f2-9aea-60bbeb199923 tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:47:27.362610 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-5b3577a5-ba6f-41f2-9aea-60bbeb199923 tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:47:27.363377 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-5b3577a5-ba6f-41f2-9aea-60bbeb199923 tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:47:27.364002 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-5b3577a5-ba6f-41f2-9aea-60bbeb199923 tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:47:27.503912 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.policy [None req-5b3577a5-ba6f-41f2-9aea-60bbeb199923 tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b896317d96a40d6a137db0dcf5f98f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d2517d5440a4d30949f3dd36a46d813', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128729) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:47:27.511967 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: INFO nova.api.openstack.requestlog [None req-5b3577a5-ba6f-41f2-9aea-60bbeb199923 tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] 10.222.0.61 "GET /compute/v2.1/servers/563c74e0-060d-49d5-abc5-389cee4bd9d5" status: 200 len: 1321 microversion: 2.1 time: 0.160862 May 14 15:47:27.512544 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: [pid: 128729|app: 0|req: 97/207] 10.222.0.61 () {58 vars in 1235 bytes} [Sat May 14 15:47:27 2022] GET /compute/v2.1/servers/563c74e0-060d-49d5-abc5-389cee4bd9d5 => generated 1321 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 15:47:28.105227 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi [None req-8026c62b-4bd0-4729-bcdb-e2486afc3c19 tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] Calling method '>' {{(pid=128728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 15:47:28.105784 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.compute.api [None req-8026c62b-4bd0-4729-bcdb-e2486afc3c19 tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] [instance: 113f6b52-519c-45f4-9bc2-37168d644e15] Fetching instance by UUID {{(pid=128728) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 15:47:28.111945 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-8026c62b-4bd0-4729-bcdb-e2486afc3c19 tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:47:28.112397 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-8026c62b-4bd0-4729-bcdb-e2486afc3c19 tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:47:28.113250 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-8026c62b-4bd0-4729-bcdb-e2486afc3c19 tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:47:28.113697 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-8026c62b-4bd0-4729-bcdb-e2486afc3c19 tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:47:28.118069 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi [None req-243a487a-abc4-48ed-836c-4d2183590536 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Calling method '>' {{(pid=128729) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 15:47:28.118728 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.compute.api [None req-243a487a-abc4-48ed-836c-4d2183590536 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] [instance: e33e9970-bfb7-46f3-8d40-782dbfa3d21c] Fetching instance by UUID {{(pid=128729) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 15:47:28.124452 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-243a487a-abc4-48ed-836c-4d2183590536 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:47:28.124893 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-243a487a-abc4-48ed-836c-4d2183590536 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:47:28.125657 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-243a487a-abc4-48ed-836c-4d2183590536 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:47:28.126091 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-243a487a-abc4-48ed-836c-4d2183590536 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:47:28.302690 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.policy [None req-8026c62b-4bd0-4729-bcdb-e2486afc3c19 tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc43895177134e9c9c030a9d87f94aaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7905689c95d44a5c9169249c70f7de57', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128728) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:47:28.310502 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: INFO nova.api.openstack.requestlog [None req-8026c62b-4bd0-4729-bcdb-e2486afc3c19 tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] 10.222.0.61 "GET /compute/v2.1/servers/113f6b52-519c-45f4-9bc2-37168d644e15" status: 200 len: 1366 microversion: 2.1 time: 0.209753 May 14 15:47:28.311091 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: [pid: 128728|app: 0|req: 111/208] 10.222.0.61 () {58 vars in 1235 bytes} [Sat May 14 15:47:28 2022] GET /compute/v2.1/servers/113f6b52-519c-45f4-9bc2-37168d644e15 => generated 1366 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 15:47:28.311344 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.policy [None req-243a487a-abc4-48ed-836c-4d2183590536 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58bfb7417bc94583963401ae0fe9d39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0672be3fa3f7414da1c1a5b7300abbe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128729) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:47:28.319743 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.policy [None req-243a487a-abc4-48ed-836c-4d2183590536 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58bfb7417bc94583963401ae0fe9d39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0672be3fa3f7414da1c1a5b7300abbe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128729) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:47:28.321434 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.policy [None req-243a487a-abc4-48ed-836c-4d2183590536 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58bfb7417bc94583963401ae0fe9d39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0672be3fa3f7414da1c1a5b7300abbe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128729) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:47:28.323099 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: INFO nova.api.openstack.requestlog [None req-243a487a-abc4-48ed-836c-4d2183590536 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] 10.222.0.61 "GET /compute/v2.1/servers/e33e9970-bfb7-46f3-8d40-782dbfa3d21c" status: 200 len: 1406 microversion: 2.20 time: 0.208269 May 14 15:47:28.324006 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: [pid: 128729|app: 0|req: 98/209] 10.222.0.61 () {60 vars in 1276 bytes} [Sat May 14 15:47:28 2022] GET /compute/v2.1/servers/e33e9970-bfb7-46f3-8d40-782dbfa3d21c => generated 1406 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 14 15:47:28.528593 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi [None req-1adfa13d-669d-450d-ba32-cb7700e4d75f tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Calling method '>' {{(pid=128728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 15:47:28.529233 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.compute.api [None req-1adfa13d-669d-450d-ba32-cb7700e4d75f tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] [instance: 563c74e0-060d-49d5-abc5-389cee4bd9d5] Fetching instance by UUID {{(pid=128728) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 15:47:28.535055 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-1adfa13d-669d-450d-ba32-cb7700e4d75f tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:47:28.535500 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-1adfa13d-669d-450d-ba32-cb7700e4d75f tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:47:28.536263 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-1adfa13d-669d-450d-ba32-cb7700e4d75f tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:47:28.536700 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-1adfa13d-669d-450d-ba32-cb7700e4d75f tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:47:28.664652 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.policy [None req-1adfa13d-669d-450d-ba32-cb7700e4d75f tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b896317d96a40d6a137db0dcf5f98f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d2517d5440a4d30949f3dd36a46d813', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128728) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:47:28.671769 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: INFO nova.api.openstack.requestlog [None req-1adfa13d-669d-450d-ba32-cb7700e4d75f tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] 10.222.0.61 "GET /compute/v2.1/servers/563c74e0-060d-49d5-abc5-389cee4bd9d5" status: 200 len: 1321 microversion: 2.1 time: 0.147666 May 14 15:47:28.672336 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: [pid: 128728|app: 0|req: 112/210] 10.222.0.61 () {58 vars in 1235 bytes} [Sat May 14 15:47:28 2022] GET /compute/v2.1/servers/563c74e0-060d-49d5-abc5-389cee4bd9d5 => generated 1321 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 15:47:29.327508 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi [None req-366ec3ed-633c-47ef-b32b-36037429ae41 tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] Calling method '>' {{(pid=128729) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 15:47:29.328135 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.compute.api [None req-366ec3ed-633c-47ef-b32b-36037429ae41 tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] [instance: 113f6b52-519c-45f4-9bc2-37168d644e15] Fetching instance by UUID {{(pid=128729) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 15:47:29.334073 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-366ec3ed-633c-47ef-b32b-36037429ae41 tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:47:29.334527 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-366ec3ed-633c-47ef-b32b-36037429ae41 tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:47:29.335303 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-366ec3ed-633c-47ef-b32b-36037429ae41 tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:47:29.335773 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-366ec3ed-633c-47ef-b32b-36037429ae41 tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:47:29.340798 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi [None req-c9a24a4c-2bee-4789-96cc-6e74a381b539 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Calling method '>' {{(pid=128728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 15:47:29.341394 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.compute.api [None req-c9a24a4c-2bee-4789-96cc-6e74a381b539 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] [instance: e33e9970-bfb7-46f3-8d40-782dbfa3d21c] Fetching instance by UUID {{(pid=128728) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 15:47:29.347069 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-c9a24a4c-2bee-4789-96cc-6e74a381b539 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:47:29.347510 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-c9a24a4c-2bee-4789-96cc-6e74a381b539 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:47:29.348265 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-c9a24a4c-2bee-4789-96cc-6e74a381b539 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:47:29.348693 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-c9a24a4c-2bee-4789-96cc-6e74a381b539 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:47:29.521426 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.policy [None req-366ec3ed-633c-47ef-b32b-36037429ae41 tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc43895177134e9c9c030a9d87f94aaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7905689c95d44a5c9169249c70f7de57', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128729) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:47:29.529224 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: INFO nova.api.openstack.requestlog [None req-366ec3ed-633c-47ef-b32b-36037429ae41 tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] 10.222.0.61 "GET /compute/v2.1/servers/113f6b52-519c-45f4-9bc2-37168d644e15" status: 200 len: 1366 microversion: 2.1 time: 0.205569 May 14 15:47:29.529792 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: [pid: 128729|app: 0|req: 99/211] 10.222.0.61 () {58 vars in 1235 bytes} [Sat May 14 15:47:29 2022] GET /compute/v2.1/servers/113f6b52-519c-45f4-9bc2-37168d644e15 => generated 1366 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 15:47:29.543017 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.policy [None req-c9a24a4c-2bee-4789-96cc-6e74a381b539 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58bfb7417bc94583963401ae0fe9d39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0672be3fa3f7414da1c1a5b7300abbe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128728) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:47:29.550591 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.policy [None req-c9a24a4c-2bee-4789-96cc-6e74a381b539 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58bfb7417bc94583963401ae0fe9d39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0672be3fa3f7414da1c1a5b7300abbe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128728) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:47:29.552087 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.policy [None req-c9a24a4c-2bee-4789-96cc-6e74a381b539 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58bfb7417bc94583963401ae0fe9d39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0672be3fa3f7414da1c1a5b7300abbe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128728) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:47:29.553170 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: INFO nova.api.openstack.requestlog [None req-c9a24a4c-2bee-4789-96cc-6e74a381b539 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] 10.222.0.61 "GET /compute/v2.1/servers/e33e9970-bfb7-46f3-8d40-782dbfa3d21c" status: 200 len: 1406 microversion: 2.20 time: 0.216248 May 14 15:47:29.553722 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: [pid: 128728|app: 0|req: 113/212] 10.222.0.61 () {60 vars in 1276 bytes} [Sat May 14 15:47:29 2022] GET /compute/v2.1/servers/e33e9970-bfb7-46f3-8d40-782dbfa3d21c => generated 1406 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 14 15:47:29.688342 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi [None req-b3f92753-7045-4106-8126-a869a3825df9 tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Calling method '>' {{(pid=128729) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 15:47:29.688866 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.compute.api [None req-b3f92753-7045-4106-8126-a869a3825df9 tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] [instance: 563c74e0-060d-49d5-abc5-389cee4bd9d5] Fetching instance by UUID {{(pid=128729) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 15:47:29.694728 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-b3f92753-7045-4106-8126-a869a3825df9 tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:47:29.695173 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-b3f92753-7045-4106-8126-a869a3825df9 tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:47:29.695922 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-b3f92753-7045-4106-8126-a869a3825df9 tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:47:29.696351 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-b3f92753-7045-4106-8126-a869a3825df9 tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:47:29.820275 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.policy [None req-b3f92753-7045-4106-8126-a869a3825df9 tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b896317d96a40d6a137db0dcf5f98f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d2517d5440a4d30949f3dd36a46d813', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128729) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:47:29.828099 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: INFO nova.api.openstack.requestlog [None req-b3f92753-7045-4106-8126-a869a3825df9 tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] 10.222.0.61 "GET /compute/v2.1/servers/563c74e0-060d-49d5-abc5-389cee4bd9d5" status: 200 len: 1321 microversion: 2.1 time: 0.143604 May 14 15:47:29.828656 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: [pid: 128729|app: 0|req: 100/213] 10.222.0.61 () {58 vars in 1235 bytes} [Sat May 14 15:47:29 2022] GET /compute/v2.1/servers/563c74e0-060d-49d5-abc5-389cee4bd9d5 => generated 1321 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 15:47:30.544798 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi [None req-eab941a5-fb9b-41e8-bcbf-de3c37bf7a6b tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] Calling method '>' {{(pid=128728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 15:47:30.545404 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.compute.api [None req-eab941a5-fb9b-41e8-bcbf-de3c37bf7a6b tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] [instance: 113f6b52-519c-45f4-9bc2-37168d644e15] Fetching instance by UUID {{(pid=128728) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 15:47:30.554183 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-eab941a5-fb9b-41e8-bcbf-de3c37bf7a6b tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:47:30.554663 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-eab941a5-fb9b-41e8-bcbf-de3c37bf7a6b tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:47:30.555478 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-eab941a5-fb9b-41e8-bcbf-de3c37bf7a6b tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:47:30.555913 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-eab941a5-fb9b-41e8-bcbf-de3c37bf7a6b tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:47:30.570770 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi [None req-9c067381-a8fb-4d30-9d3c-15a989196762 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Calling method '>' {{(pid=128729) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 15:47:30.571472 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.compute.api [None req-9c067381-a8fb-4d30-9d3c-15a989196762 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] [instance: e33e9970-bfb7-46f3-8d40-782dbfa3d21c] Fetching instance by UUID {{(pid=128729) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 15:47:30.578653 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-9c067381-a8fb-4d30-9d3c-15a989196762 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:47:30.579108 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-9c067381-a8fb-4d30-9d3c-15a989196762 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:47:30.579883 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-9c067381-a8fb-4d30-9d3c-15a989196762 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:47:30.580323 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-9c067381-a8fb-4d30-9d3c-15a989196762 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:47:30.748558 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.policy [None req-eab941a5-fb9b-41e8-bcbf-de3c37bf7a6b tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc43895177134e9c9c030a9d87f94aaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7905689c95d44a5c9169249c70f7de57', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128728) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:47:30.755931 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: INFO nova.api.openstack.requestlog [None req-eab941a5-fb9b-41e8-bcbf-de3c37bf7a6b tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] 10.222.0.61 "GET /compute/v2.1/servers/113f6b52-519c-45f4-9bc2-37168d644e15" status: 200 len: 1366 microversion: 2.1 time: 0.214869 May 14 15:47:30.756499 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: [pid: 128728|app: 0|req: 114/214] 10.222.0.61 () {58 vars in 1235 bytes} [Sat May 14 15:47:30 2022] GET /compute/v2.1/servers/113f6b52-519c-45f4-9bc2-37168d644e15 => generated 1366 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 15:47:30.762237 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.policy [None req-9c067381-a8fb-4d30-9d3c-15a989196762 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58bfb7417bc94583963401ae0fe9d39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0672be3fa3f7414da1c1a5b7300abbe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128729) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:47:30.769876 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.policy [None req-9c067381-a8fb-4d30-9d3c-15a989196762 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58bfb7417bc94583963401ae0fe9d39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0672be3fa3f7414da1c1a5b7300abbe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128729) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:47:30.771409 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.policy [None req-9c067381-a8fb-4d30-9d3c-15a989196762 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58bfb7417bc94583963401ae0fe9d39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0672be3fa3f7414da1c1a5b7300abbe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128729) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:47:30.772488 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: INFO nova.api.openstack.requestlog [None req-9c067381-a8fb-4d30-9d3c-15a989196762 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] 10.222.0.61 "GET /compute/v2.1/servers/e33e9970-bfb7-46f3-8d40-782dbfa3d21c" status: 200 len: 1406 microversion: 2.20 time: 0.205645 May 14 15:47:30.773020 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: [pid: 128729|app: 0|req: 101/215] 10.222.0.61 () {60 vars in 1276 bytes} [Sat May 14 15:47:30 2022] GET /compute/v2.1/servers/e33e9970-bfb7-46f3-8d40-782dbfa3d21c => generated 1406 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 14 15:47:30.844722 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi [None req-556dd685-e508-4ca9-8746-43e5cd367c4e tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Calling method '>' {{(pid=128728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 15:47:30.845325 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.compute.api [None req-556dd685-e508-4ca9-8746-43e5cd367c4e tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] [instance: 563c74e0-060d-49d5-abc5-389cee4bd9d5] Fetching instance by UUID {{(pid=128728) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 15:47:30.851182 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-556dd685-e508-4ca9-8746-43e5cd367c4e tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:47:30.851625 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-556dd685-e508-4ca9-8746-43e5cd367c4e tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:47:30.852375 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-556dd685-e508-4ca9-8746-43e5cd367c4e tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:47:30.852805 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-556dd685-e508-4ca9-8746-43e5cd367c4e tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:47:30.977810 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.policy [None req-556dd685-e508-4ca9-8746-43e5cd367c4e tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b896317d96a40d6a137db0dcf5f98f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d2517d5440a4d30949f3dd36a46d813', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128728) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:47:30.985702 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: INFO nova.api.openstack.requestlog [None req-556dd685-e508-4ca9-8746-43e5cd367c4e tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] 10.222.0.61 "GET /compute/v2.1/servers/563c74e0-060d-49d5-abc5-389cee4bd9d5" status: 200 len: 1321 microversion: 2.1 time: 0.144825 May 14 15:47:30.986543 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: [pid: 128728|app: 0|req: 115/216] 10.222.0.61 () {58 vars in 1235 bytes} [Sat May 14 15:47:30 2022] GET /compute/v2.1/servers/563c74e0-060d-49d5-abc5-389cee4bd9d5 => generated 1321 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 15:47:31.772752 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi [None req-7a2b9b95-d669-46b1-8a20-fa66d17d9c9a tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] Calling method '>' {{(pid=128729) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 15:47:31.773384 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.compute.api [None req-7a2b9b95-d669-46b1-8a20-fa66d17d9c9a tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] [instance: 113f6b52-519c-45f4-9bc2-37168d644e15] Fetching instance by UUID {{(pid=128729) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 15:47:31.779811 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-7a2b9b95-d669-46b1-8a20-fa66d17d9c9a tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:47:31.780197 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-7a2b9b95-d669-46b1-8a20-fa66d17d9c9a tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:47:31.780958 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-7a2b9b95-d669-46b1-8a20-fa66d17d9c9a tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:47:31.781390 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-7a2b9b95-d669-46b1-8a20-fa66d17d9c9a tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:47:31.789832 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi [None req-9b90bff1-6cc1-4183-8bef-edd0617231ea tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Calling method '>' {{(pid=128728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 15:47:31.790470 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.compute.api [None req-9b90bff1-6cc1-4183-8bef-edd0617231ea tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] [instance: e33e9970-bfb7-46f3-8d40-782dbfa3d21c] Fetching instance by UUID {{(pid=128728) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 15:47:31.796949 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-9b90bff1-6cc1-4183-8bef-edd0617231ea tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:47:31.797402 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-9b90bff1-6cc1-4183-8bef-edd0617231ea tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:47:31.798239 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-9b90bff1-6cc1-4183-8bef-edd0617231ea tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:47:31.798706 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-9b90bff1-6cc1-4183-8bef-edd0617231ea tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:47:32.136840 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.policy [None req-7a2b9b95-d669-46b1-8a20-fa66d17d9c9a tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc43895177134e9c9c030a9d87f94aaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7905689c95d44a5c9169249c70f7de57', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128729) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:47:32.144731 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: INFO nova.api.openstack.requestlog [None req-7a2b9b95-d669-46b1-8a20-fa66d17d9c9a tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] 10.222.0.61 "GET /compute/v2.1/servers/113f6b52-519c-45f4-9bc2-37168d644e15" status: 200 len: 1366 microversion: 2.1 time: 0.375740 May 14 15:47:32.145314 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: [pid: 128729|app: 0|req: 102/217] 10.222.0.61 () {58 vars in 1235 bytes} [Sat May 14 15:47:31 2022] GET /compute/v2.1/servers/113f6b52-519c-45f4-9bc2-37168d644e15 => generated 1366 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 15:47:32.148689 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.policy [None req-9b90bff1-6cc1-4183-8bef-edd0617231ea tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58bfb7417bc94583963401ae0fe9d39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0672be3fa3f7414da1c1a5b7300abbe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128728) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:47:32.149799 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi [None req-35f4176b-c5d1-45b1-9939-cdface12195d tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Calling method '>' {{(pid=128729) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 15:47:32.150463 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.compute.api [None req-35f4176b-c5d1-45b1-9939-cdface12195d tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] [instance: 563c74e0-060d-49d5-abc5-389cee4bd9d5] Fetching instance by UUID {{(pid=128729) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 15:47:32.156369 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-35f4176b-c5d1-45b1-9939-cdface12195d tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:47:32.156833 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-35f4176b-c5d1-45b1-9939-cdface12195d tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:47:32.157280 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.policy [None req-9b90bff1-6cc1-4183-8bef-edd0617231ea tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58bfb7417bc94583963401ae0fe9d39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0672be3fa3f7414da1c1a5b7300abbe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128728) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:47:32.157594 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-35f4176b-c5d1-45b1-9939-cdface12195d tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:47:32.158028 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-35f4176b-c5d1-45b1-9939-cdface12195d tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:47:32.158805 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.policy [None req-9b90bff1-6cc1-4183-8bef-edd0617231ea tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58bfb7417bc94583963401ae0fe9d39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0672be3fa3f7414da1c1a5b7300abbe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128728) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:47:32.159894 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: INFO nova.api.openstack.requestlog [None req-9b90bff1-6cc1-4183-8bef-edd0617231ea tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] 10.222.0.61 "GET /compute/v2.1/servers/e33e9970-bfb7-46f3-8d40-782dbfa3d21c" status: 200 len: 1406 microversion: 2.20 time: 0.373989 May 14 15:47:32.160591 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: [pid: 128728|app: 0|req: 116/218] 10.222.0.61 () {60 vars in 1276 bytes} [Sat May 14 15:47:31 2022] GET /compute/v2.1/servers/e33e9970-bfb7-46f3-8d40-782dbfa3d21c => generated 1406 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 14 15:47:32.294106 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.policy [None req-35f4176b-c5d1-45b1-9939-cdface12195d tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b896317d96a40d6a137db0dcf5f98f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d2517d5440a4d30949f3dd36a46d813', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128729) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:47:32.301304 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: INFO nova.api.openstack.requestlog [None req-35f4176b-c5d1-45b1-9939-cdface12195d tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] 10.222.0.61 "GET /compute/v2.1/servers/563c74e0-060d-49d5-abc5-389cee4bd9d5" status: 200 len: 1321 microversion: 2.1 time: 0.155055 May 14 15:47:32.301872 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: [pid: 128729|app: 0|req: 103/219] 10.222.0.61 () {58 vars in 1235 bytes} [Sat May 14 15:47:32 2022] GET /compute/v2.1/servers/563c74e0-060d-49d5-abc5-389cee4bd9d5 => generated 1321 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 15:47:32.915151 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi [req-37ecfcbd-0781-4ee6-adb7-4947ea326321 req-765931af-3e30-4037-a37a-dc652267e124 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "563c74e0-060d-49d5-abc5-389cee4bd9d5", "name": "network-vif-plugged", "status": "completed", "tag": "e71a293a-1d12-4e53-a116-f52bc19b1aa0"}]} {{(pid=128728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 15:47:32.923794 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [req-37ecfcbd-0781-4ee6-adb7-4947ea326321 req-765931af-3e30-4037-a37a-dc652267e124 service nova] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:47:32.924089 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [req-37ecfcbd-0781-4ee6-adb7-4947ea326321 req-765931af-3e30-4037-a37a-dc652267e124 service nova] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:47:32.936052 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: INFO nova.api.openstack.compute.server_external_events [req-37ecfcbd-0781-4ee6-adb7-4947ea326321 req-765931af-3e30-4037-a37a-dc652267e124 service nova] Creating event network-vif-plugged:e71a293a-1d12-4e53-a116-f52bc19b1aa0 for instance 563c74e0-060d-49d5-abc5-389cee4bd9d5 on hv-cinder-83979 May 14 15:47:32.940889 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: INFO nova.api.openstack.requestlog [req-37ecfcbd-0781-4ee6-adb7-4947ea326321 req-765931af-3e30-4037-a37a-dc652267e124 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029450 May 14 15:47:32.941473 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: [pid: 128728|app: 0|req: 117/220] 10.222.0.61 () {64 vars in 1317 bytes} [Sat May 14 15:47:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 14 15:47:33.162793 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi [None req-7e0889d1-d6ea-4a1c-9176-07db1e63e9d1 tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] Calling method '>' {{(pid=128729) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 15:47:33.163422 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.compute.api [None req-7e0889d1-d6ea-4a1c-9176-07db1e63e9d1 tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] [instance: 113f6b52-519c-45f4-9bc2-37168d644e15] Fetching instance by UUID {{(pid=128729) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 15:47:33.169468 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-7e0889d1-d6ea-4a1c-9176-07db1e63e9d1 tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:47:33.169912 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-7e0889d1-d6ea-4a1c-9176-07db1e63e9d1 tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:47:33.170714 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-7e0889d1-d6ea-4a1c-9176-07db1e63e9d1 tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:47:33.171259 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-7e0889d1-d6ea-4a1c-9176-07db1e63e9d1 tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:47:33.179019 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi [None req-230d99ba-8a78-479c-b49e-3c323b0a8b5c tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Calling method '>' {{(pid=128728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 15:47:33.179713 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.compute.api [None req-230d99ba-8a78-479c-b49e-3c323b0a8b5c tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] [instance: e33e9970-bfb7-46f3-8d40-782dbfa3d21c] Fetching instance by UUID {{(pid=128728) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 15:47:33.186416 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-230d99ba-8a78-479c-b49e-3c323b0a8b5c tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:47:33.186866 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-230d99ba-8a78-479c-b49e-3c323b0a8b5c tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:47:33.187637 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-230d99ba-8a78-479c-b49e-3c323b0a8b5c tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:47:33.188073 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-230d99ba-8a78-479c-b49e-3c323b0a8b5c tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:47:33.388996 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.policy [None req-7e0889d1-d6ea-4a1c-9176-07db1e63e9d1 tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc43895177134e9c9c030a9d87f94aaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7905689c95d44a5c9169249c70f7de57', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128729) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:47:33.393805 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.policy [None req-230d99ba-8a78-479c-b49e-3c323b0a8b5c tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58bfb7417bc94583963401ae0fe9d39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0672be3fa3f7414da1c1a5b7300abbe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128728) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:47:33.398978 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: INFO nova.api.openstack.requestlog [None req-7e0889d1-d6ea-4a1c-9176-07db1e63e9d1 tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] 10.222.0.61 "GET /compute/v2.1/servers/113f6b52-519c-45f4-9bc2-37168d644e15" status: 200 len: 1366 microversion: 2.1 time: 0.239352 May 14 15:47:33.403456 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.policy [None req-230d99ba-8a78-479c-b49e-3c323b0a8b5c tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58bfb7417bc94583963401ae0fe9d39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0672be3fa3f7414da1c1a5b7300abbe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128728) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:47:33.405426 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.policy [None req-230d99ba-8a78-479c-b49e-3c323b0a8b5c tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58bfb7417bc94583963401ae0fe9d39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0672be3fa3f7414da1c1a5b7300abbe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128728) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:47:33.406631 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: INFO nova.api.openstack.requestlog [None req-230d99ba-8a78-479c-b49e-3c323b0a8b5c tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] 10.222.0.61 "GET /compute/v2.1/servers/e33e9970-bfb7-46f3-8d40-782dbfa3d21c" status: 200 len: 1406 microversion: 2.20 time: 0.231986 May 14 15:47:33.407184 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: [pid: 128728|app: 0|req: 118/221] 10.222.0.61 () {60 vars in 1276 bytes} [Sat May 14 15:47:33 2022] GET /compute/v2.1/servers/e33e9970-bfb7-46f3-8d40-782dbfa3d21c => generated 1406 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 14 15:47:33.410409 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: [pid: 128729|app: 0|req: 104/222] 10.222.0.61 () {58 vars in 1235 bytes} [Sat May 14 15:47:33 2022] GET /compute/v2.1/servers/113f6b52-519c-45f4-9bc2-37168d644e15 => generated 1366 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 15:47:33.412302 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi [None req-326aa612-848f-4d33-be2f-82fb75a45e5c tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Calling method '>' {{(pid=128728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 15:47:33.412961 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.compute.api [None req-326aa612-848f-4d33-be2f-82fb75a45e5c tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] [instance: 563c74e0-060d-49d5-abc5-389cee4bd9d5] Fetching instance by UUID {{(pid=128728) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 15:47:33.420565 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-326aa612-848f-4d33-be2f-82fb75a45e5c tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:47:33.421011 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-326aa612-848f-4d33-be2f-82fb75a45e5c tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:47:33.421896 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-326aa612-848f-4d33-be2f-82fb75a45e5c tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:47:33.422488 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-326aa612-848f-4d33-be2f-82fb75a45e5c tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:47:33.550613 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.policy [None req-326aa612-848f-4d33-be2f-82fb75a45e5c tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b896317d96a40d6a137db0dcf5f98f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d2517d5440a4d30949f3dd36a46d813', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128728) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:47:33.558137 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: INFO nova.api.openstack.requestlog [None req-326aa612-848f-4d33-be2f-82fb75a45e5c tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] 10.222.0.61 "GET /compute/v2.1/servers/563c74e0-060d-49d5-abc5-389cee4bd9d5" status: 200 len: 1321 microversion: 2.1 time: 0.149944 May 14 15:47:33.558717 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: [pid: 128728|app: 0|req: 119/223] 10.222.0.61 () {58 vars in 1235 bytes} [Sat May 14 15:47:33 2022] GET /compute/v2.1/servers/563c74e0-060d-49d5-abc5-389cee4bd9d5 => generated 1321 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 15:47:33.715056 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi [None req-2590b2fa-8238-4253-9fc6-a568e070e5cc tempest-DeleteServersTestJSON-2100051872 tempest-DeleteServersTestJSON-2100051872-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "2a40fb9a-7c1f-49d5-87d9-0ebc0bfdbb1b"}} {{(pid=128729) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 15:47:33.716153 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.compute.api [None req-2590b2fa-8238-4253-9fc6-a568e070e5cc tempest-DeleteServersTestJSON-2100051872 tempest-DeleteServersTestJSON-2100051872-project] [instance: 75ca93de-6825-44ce-af10-44cba59218a1] Fetching instance by UUID {{(pid=128729) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 15:47:33.722067 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-2590b2fa-8238-4253-9fc6-a568e070e5cc tempest-DeleteServersTestJSON-2100051872 tempest-DeleteServersTestJSON-2100051872-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:47:33.722567 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-2590b2fa-8238-4253-9fc6-a568e070e5cc tempest-DeleteServersTestJSON-2100051872 tempest-DeleteServersTestJSON-2100051872-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:47:33.723326 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-2590b2fa-8238-4253-9fc6-a568e070e5cc tempest-DeleteServersTestJSON-2100051872 tempest-DeleteServersTestJSON-2100051872-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:47:33.723757 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-2590b2fa-8238-4253-9fc6-a568e070e5cc tempest-DeleteServersTestJSON-2100051872 tempest-DeleteServersTestJSON-2100051872-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:47:34.416954 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi [None req-727f8970-02c8-4320-9345-63162b0bb5db tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] Calling method '>' {{(pid=128728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 15:47:34.417675 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.compute.api [None req-727f8970-02c8-4320-9345-63162b0bb5db tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] [instance: 113f6b52-519c-45f4-9bc2-37168d644e15] Fetching instance by UUID {{(pid=128728) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 15:47:34.424663 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-727f8970-02c8-4320-9345-63162b0bb5db tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:47:34.425188 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-727f8970-02c8-4320-9345-63162b0bb5db tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:47:34.426142 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-727f8970-02c8-4320-9345-63162b0bb5db tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:47:34.426611 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-727f8970-02c8-4320-9345-63162b0bb5db tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:47:34.600724 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.policy [None req-727f8970-02c8-4320-9345-63162b0bb5db tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc43895177134e9c9c030a9d87f94aaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7905689c95d44a5c9169249c70f7de57', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128728) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:47:34.609075 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: INFO nova.api.openstack.requestlog [None req-727f8970-02c8-4320-9345-63162b0bb5db tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] 10.222.0.61 "GET /compute/v2.1/servers/113f6b52-519c-45f4-9bc2-37168d644e15" status: 200 len: 1366 microversion: 2.1 time: 0.195994 May 14 15:47:34.609651 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: [pid: 128728|app: 0|req: 120/224] 10.222.0.61 () {58 vars in 1235 bytes} [Sat May 14 15:47:34 2022] GET /compute/v2.1/servers/113f6b52-519c-45f4-9bc2-37168d644e15 => generated 1366 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 15:47:34.618789 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi [None req-c48d3a2e-18f1-4ee2-b132-173fb5555a10 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Calling method '>' {{(pid=128728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 15:47:34.620347 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.compute.api [None req-c48d3a2e-18f1-4ee2-b132-173fb5555a10 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] [instance: e33e9970-bfb7-46f3-8d40-782dbfa3d21c] Fetching instance by UUID {{(pid=128728) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 15:47:34.627168 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-c48d3a2e-18f1-4ee2-b132-173fb5555a10 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:47:34.627615 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-c48d3a2e-18f1-4ee2-b132-173fb5555a10 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:47:34.628380 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-c48d3a2e-18f1-4ee2-b132-173fb5555a10 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:47:34.628865 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-c48d3a2e-18f1-4ee2-b132-173fb5555a10 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:47:34.767572 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.policy [None req-c48d3a2e-18f1-4ee2-b132-173fb5555a10 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58bfb7417bc94583963401ae0fe9d39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0672be3fa3f7414da1c1a5b7300abbe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128728) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:47:34.789788 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.policy [None req-c48d3a2e-18f1-4ee2-b132-173fb5555a10 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58bfb7417bc94583963401ae0fe9d39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0672be3fa3f7414da1c1a5b7300abbe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128728) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:47:34.791392 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.policy [None req-c48d3a2e-18f1-4ee2-b132-173fb5555a10 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58bfb7417bc94583963401ae0fe9d39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0672be3fa3f7414da1c1a5b7300abbe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128728) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:47:34.792789 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: INFO nova.api.openstack.requestlog [None req-c48d3a2e-18f1-4ee2-b132-173fb5555a10 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] 10.222.0.61 "GET /compute/v2.1/servers/e33e9970-bfb7-46f3-8d40-782dbfa3d21c" status: 200 len: 1406 microversion: 2.20 time: 0.178976 May 14 15:47:34.793353 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: [pid: 128728|app: 0|req: 121/225] 10.222.0.61 () {60 vars in 1276 bytes} [Sat May 14 15:47:34 2022] GET /compute/v2.1/servers/e33e9970-bfb7-46f3-8d40-782dbfa3d21c => generated 1406 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 14 15:47:34.797946 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi [None req-8ad08020-d269-45ad-b171-34560d2da54d tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Calling method '>' {{(pid=128728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 15:47:34.798574 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.compute.api [None req-8ad08020-d269-45ad-b171-34560d2da54d tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] [instance: 563c74e0-060d-49d5-abc5-389cee4bd9d5] Fetching instance by UUID {{(pid=128728) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 15:47:34.805980 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-8ad08020-d269-45ad-b171-34560d2da54d tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:47:34.806368 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-8ad08020-d269-45ad-b171-34560d2da54d tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:47:34.808064 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-8ad08020-d269-45ad-b171-34560d2da54d tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:47:34.808505 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-8ad08020-d269-45ad-b171-34560d2da54d tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:47:35.021403 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.policy [None req-8ad08020-d269-45ad-b171-34560d2da54d tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b896317d96a40d6a137db0dcf5f98f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d2517d5440a4d30949f3dd36a46d813', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128728) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:47:35.034692 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: INFO nova.api.openstack.requestlog [None req-8ad08020-d269-45ad-b171-34560d2da54d tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] 10.222.0.61 "GET /compute/v2.1/servers/563c74e0-060d-49d5-abc5-389cee4bd9d5" status: 200 len: 1321 microversion: 2.1 time: 0.240155 May 14 15:47:35.036921 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: [pid: 128728|app: 0|req: 122/226] 10.222.0.61 () {58 vars in 1235 bytes} [Sat May 14 15:47:34 2022] GET /compute/v2.1/servers/563c74e0-060d-49d5-abc5-389cee4bd9d5 => generated 1321 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 15:47:35.428771 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: INFO nova.api.openstack.requestlog [None req-2590b2fa-8238-4253-9fc6-a568e070e5cc tempest-DeleteServersTestJSON-2100051872 tempest-DeleteServersTestJSON-2100051872-project] 10.222.0.61 "POST /compute/v2.1/servers/75ca93de-6825-44ce-af10-44cba59218a1/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.718100 May 14 15:47:35.434232 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: [pid: 128729|app: 0|req: 105/227] 10.222.0.61 () {60 vars in 1322 bytes} [Sat May 14 15:47:33 2022] POST /compute/v2.1/servers/75ca93de-6825-44ce-af10-44cba59218a1/os-volume_attachments => generated 194 bytes in 1720 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 14 15:47:35.626605 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi [None req-b7aa381f-3fe3-4ba9-a8ef-bc394a8cbb33 tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] Calling method '>' {{(pid=128728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 15:47:35.627753 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.compute.api [None req-b7aa381f-3fe3-4ba9-a8ef-bc394a8cbb33 tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] [instance: 113f6b52-519c-45f4-9bc2-37168d644e15] Fetching instance by UUID {{(pid=128728) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 15:47:35.637271 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-b7aa381f-3fe3-4ba9-a8ef-bc394a8cbb33 tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:47:35.637732 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-b7aa381f-3fe3-4ba9-a8ef-bc394a8cbb33 tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:47:35.638592 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-b7aa381f-3fe3-4ba9-a8ef-bc394a8cbb33 tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:47:35.639067 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-b7aa381f-3fe3-4ba9-a8ef-bc394a8cbb33 tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:47:35.784101 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.policy [None req-b7aa381f-3fe3-4ba9-a8ef-bc394a8cbb33 tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc43895177134e9c9c030a9d87f94aaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7905689c95d44a5c9169249c70f7de57', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128728) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:47:35.801670 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: INFO nova.api.openstack.requestlog [None req-b7aa381f-3fe3-4ba9-a8ef-bc394a8cbb33 tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] 10.222.0.61 "GET /compute/v2.1/servers/113f6b52-519c-45f4-9bc2-37168d644e15" status: 200 len: 1366 microversion: 2.1 time: 0.179025 May 14 15:47:35.803247 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: [pid: 128728|app: 0|req: 123/228] 10.222.0.61 () {58 vars in 1235 bytes} [Sat May 14 15:47:35 2022] GET /compute/v2.1/servers/113f6b52-519c-45f4-9bc2-37168d644e15 => generated 1366 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 15:47:35.816275 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi [None req-625ec7a5-5a2a-4a9f-a003-3ee69eec95f9 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Calling method '>' {{(pid=128729) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 15:47:35.817068 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.compute.api [None req-625ec7a5-5a2a-4a9f-a003-3ee69eec95f9 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] [instance: e33e9970-bfb7-46f3-8d40-782dbfa3d21c] Fetching instance by UUID {{(pid=128729) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 15:47:35.849473 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-625ec7a5-5a2a-4a9f-a003-3ee69eec95f9 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:47:35.850086 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-625ec7a5-5a2a-4a9f-a003-3ee69eec95f9 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:47:35.857325 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-625ec7a5-5a2a-4a9f-a003-3ee69eec95f9 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:47:35.858367 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-625ec7a5-5a2a-4a9f-a003-3ee69eec95f9 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:47:36.053456 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi [None req-5cee2b62-89b9-4a2d-9145-3606bafa3f22 tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Calling method '>' {{(pid=128728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 15:47:36.054475 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.compute.api [None req-5cee2b62-89b9-4a2d-9145-3606bafa3f22 tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] [instance: 563c74e0-060d-49d5-abc5-389cee4bd9d5] Fetching instance by UUID {{(pid=128728) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 15:47:36.061257 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-5cee2b62-89b9-4a2d-9145-3606bafa3f22 tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:47:36.062172 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-5cee2b62-89b9-4a2d-9145-3606bafa3f22 tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:47:36.063567 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-5cee2b62-89b9-4a2d-9145-3606bafa3f22 tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:47:36.064183 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-5cee2b62-89b9-4a2d-9145-3606bafa3f22 tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:47:36.069911 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.policy [None req-625ec7a5-5a2a-4a9f-a003-3ee69eec95f9 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58bfb7417bc94583963401ae0fe9d39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0672be3fa3f7414da1c1a5b7300abbe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128729) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:47:36.082076 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.policy [None req-625ec7a5-5a2a-4a9f-a003-3ee69eec95f9 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58bfb7417bc94583963401ae0fe9d39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0672be3fa3f7414da1c1a5b7300abbe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128729) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:47:36.084268 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.policy [None req-625ec7a5-5a2a-4a9f-a003-3ee69eec95f9 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58bfb7417bc94583963401ae0fe9d39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0672be3fa3f7414da1c1a5b7300abbe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128729) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:47:36.085966 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: INFO nova.api.openstack.requestlog [None req-625ec7a5-5a2a-4a9f-a003-3ee69eec95f9 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] 10.222.0.61 "GET /compute/v2.1/servers/e33e9970-bfb7-46f3-8d40-782dbfa3d21c" status: 200 len: 1406 microversion: 2.20 time: 0.275651 May 14 15:47:36.087637 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: [pid: 128729|app: 0|req: 106/229] 10.222.0.61 () {60 vars in 1276 bytes} [Sat May 14 15:47:35 2022] GET /compute/v2.1/servers/e33e9970-bfb7-46f3-8d40-782dbfa3d21c => generated 1406 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 14 15:47:36.204444 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.policy [None req-5cee2b62-89b9-4a2d-9145-3606bafa3f22 tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b896317d96a40d6a137db0dcf5f98f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d2517d5440a4d30949f3dd36a46d813', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128728) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:47:36.215226 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: INFO nova.api.openstack.requestlog [None req-5cee2b62-89b9-4a2d-9145-3606bafa3f22 tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] 10.222.0.61 "GET /compute/v2.1/servers/563c74e0-060d-49d5-abc5-389cee4bd9d5" status: 200 len: 1321 microversion: 2.1 time: 0.165989 May 14 15:47:36.215868 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: [pid: 128728|app: 0|req: 124/230] 10.222.0.61 () {58 vars in 1235 bytes} [Sat May 14 15:47:36 2022] GET /compute/v2.1/servers/563c74e0-060d-49d5-abc5-389cee4bd9d5 => generated 1321 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 15:47:36.819777 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi [None req-9066cf46-c639-4a74-a5aa-559faa4d2024 tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] Calling method '>' {{(pid=128729) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 15:47:36.820666 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.compute.api [None req-9066cf46-c639-4a74-a5aa-559faa4d2024 tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] [instance: 113f6b52-519c-45f4-9bc2-37168d644e15] Fetching instance by UUID {{(pid=128729) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 15:47:36.828217 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-9066cf46-c639-4a74-a5aa-559faa4d2024 tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:47:36.828787 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-9066cf46-c639-4a74-a5aa-559faa4d2024 tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:47:36.829670 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-9066cf46-c639-4a74-a5aa-559faa4d2024 tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:47:36.830772 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-9066cf46-c639-4a74-a5aa-559faa4d2024 tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:47:36.930913 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi [req-1047dd3d-648a-4c0b-a52e-07ce0edea740 req-4406c3f1-d1f1-4aeb-9ae1-e9ef88239dc2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "113f6b52-519c-45f4-9bc2-37168d644e15", "name": "network-vif-plugged", "status": "completed", "tag": "60f7fd3d-dbe8-4c62-af7e-c0490eeb01d3"}]} {{(pid=128728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 15:47:36.940370 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [req-1047dd3d-648a-4c0b-a52e-07ce0edea740 req-4406c3f1-d1f1-4aeb-9ae1-e9ef88239dc2 service nova] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:47:36.941101 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [req-1047dd3d-648a-4c0b-a52e-07ce0edea740 req-4406c3f1-d1f1-4aeb-9ae1-e9ef88239dc2 service nova] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:47:36.954495 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: INFO nova.api.openstack.compute.server_external_events [req-1047dd3d-648a-4c0b-a52e-07ce0edea740 req-4406c3f1-d1f1-4aeb-9ae1-e9ef88239dc2 service nova] Creating event network-vif-plugged:60f7fd3d-dbe8-4c62-af7e-c0490eeb01d3 for instance 113f6b52-519c-45f4-9bc2-37168d644e15 on hv-cinder-83979 May 14 15:47:36.961621 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: INFO nova.api.openstack.requestlog [req-1047dd3d-648a-4c0b-a52e-07ce0edea740 req-4406c3f1-d1f1-4aeb-9ae1-e9ef88239dc2 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033585 May 14 15:47:36.962440 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: [pid: 128728|app: 0|req: 125/231] 10.222.0.61 () {64 vars in 1317 bytes} [Sat May 14 15:47:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 14 15:47:36.989474 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.policy [None req-9066cf46-c639-4a74-a5aa-559faa4d2024 tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc43895177134e9c9c030a9d87f94aaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7905689c95d44a5c9169249c70f7de57', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128729) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:47:37.002345 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: INFO nova.api.openstack.requestlog [None req-9066cf46-c639-4a74-a5aa-559faa4d2024 tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] 10.222.0.61 "GET /compute/v2.1/servers/113f6b52-519c-45f4-9bc2-37168d644e15" status: 200 len: 1366 microversion: 2.1 time: 0.185957 May 14 15:47:37.003161 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: [pid: 128729|app: 0|req: 107/232] 10.222.0.61 () {58 vars in 1235 bytes} [Sat May 14 15:47:36 2022] GET /compute/v2.1/servers/113f6b52-519c-45f4-9bc2-37168d644e15 => generated 1366 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 15:47:37.105279 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi [None req-f777e4b8-79be-4ed5-be1d-de98919afbbc tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Calling method '>' {{(pid=128728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 15:47:37.106072 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.compute.api [None req-f777e4b8-79be-4ed5-be1d-de98919afbbc tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] [instance: e33e9970-bfb7-46f3-8d40-782dbfa3d21c] Fetching instance by UUID {{(pid=128728) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 15:47:37.112908 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-f777e4b8-79be-4ed5-be1d-de98919afbbc tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:47:37.113528 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-f777e4b8-79be-4ed5-be1d-de98919afbbc tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:47:37.114516 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-f777e4b8-79be-4ed5-be1d-de98919afbbc tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:47:37.115091 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-f777e4b8-79be-4ed5-be1d-de98919afbbc tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:47:37.232108 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi [None req-f292f9e4-7aa6-40b6-b616-46eff40877a0 tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Calling method '>' {{(pid=128729) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 15:47:37.232978 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.compute.api [None req-f292f9e4-7aa6-40b6-b616-46eff40877a0 tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] [instance: 563c74e0-060d-49d5-abc5-389cee4bd9d5] Fetching instance by UUID {{(pid=128729) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 15:47:37.239315 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-f292f9e4-7aa6-40b6-b616-46eff40877a0 tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:47:37.239796 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-f292f9e4-7aa6-40b6-b616-46eff40877a0 tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:47:37.240577 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-f292f9e4-7aa6-40b6-b616-46eff40877a0 tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:47:37.241018 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-f292f9e4-7aa6-40b6-b616-46eff40877a0 tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:47:37.281232 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.policy [None req-f777e4b8-79be-4ed5-be1d-de98919afbbc tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58bfb7417bc94583963401ae0fe9d39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0672be3fa3f7414da1c1a5b7300abbe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128728) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:47:37.291114 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.policy [None req-f777e4b8-79be-4ed5-be1d-de98919afbbc tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58bfb7417bc94583963401ae0fe9d39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0672be3fa3f7414da1c1a5b7300abbe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128728) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:47:37.293216 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.policy [None req-f777e4b8-79be-4ed5-be1d-de98919afbbc tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58bfb7417bc94583963401ae0fe9d39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0672be3fa3f7414da1c1a5b7300abbe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128728) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:47:37.294578 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: INFO nova.api.openstack.requestlog [None req-f777e4b8-79be-4ed5-be1d-de98919afbbc tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] 10.222.0.61 "GET /compute/v2.1/servers/e33e9970-bfb7-46f3-8d40-782dbfa3d21c" status: 200 len: 1406 microversion: 2.20 time: 0.194268 May 14 15:47:37.295194 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: [pid: 128728|app: 0|req: 126/233] 10.222.0.61 () {60 vars in 1276 bytes} [Sat May 14 15:47:37 2022] GET /compute/v2.1/servers/e33e9970-bfb7-46f3-8d40-782dbfa3d21c => generated 1406 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 14 15:47:37.391485 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.policy [None req-f292f9e4-7aa6-40b6-b616-46eff40877a0 tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b896317d96a40d6a137db0dcf5f98f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d2517d5440a4d30949f3dd36a46d813', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128729) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:47:37.401822 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: INFO nova.api.openstack.requestlog [None req-f292f9e4-7aa6-40b6-b616-46eff40877a0 tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] 10.222.0.61 "GET /compute/v2.1/servers/563c74e0-060d-49d5-abc5-389cee4bd9d5" status: 200 len: 1321 microversion: 2.1 time: 0.172139 May 14 15:47:37.401822 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: [pid: 128729|app: 0|req: 108/234] 10.222.0.61 () {58 vars in 1235 bytes} [Sat May 14 15:47:37 2022] GET /compute/v2.1/servers/563c74e0-060d-49d5-abc5-389cee4bd9d5 => generated 1321 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 15:47:38.020816 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi [None req-4cd67b3c-2a48-4c14-9ee8-0d79f4b9ee1f tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] Calling method '>' {{(pid=128728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 15:47:38.021770 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.compute.api [None req-4cd67b3c-2a48-4c14-9ee8-0d79f4b9ee1f tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] [instance: 113f6b52-519c-45f4-9bc2-37168d644e15] Fetching instance by UUID {{(pid=128728) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 15:47:38.034745 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-4cd67b3c-2a48-4c14-9ee8-0d79f4b9ee1f tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:47:38.035012 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-4cd67b3c-2a48-4c14-9ee8-0d79f4b9ee1f tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:47:38.036067 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-4cd67b3c-2a48-4c14-9ee8-0d79f4b9ee1f tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:47:38.036430 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-4cd67b3c-2a48-4c14-9ee8-0d79f4b9ee1f tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:47:38.257360 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.policy [None req-4cd67b3c-2a48-4c14-9ee8-0d79f4b9ee1f tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc43895177134e9c9c030a9d87f94aaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7905689c95d44a5c9169249c70f7de57', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128728) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:47:38.269591 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: INFO nova.api.openstack.requestlog [None req-4cd67b3c-2a48-4c14-9ee8-0d79f4b9ee1f tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] 10.222.0.61 "GET /compute/v2.1/servers/113f6b52-519c-45f4-9bc2-37168d644e15" status: 200 len: 1366 microversion: 2.1 time: 0.253667 May 14 15:47:38.270346 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: [pid: 128728|app: 0|req: 127/235] 10.222.0.61 () {58 vars in 1235 bytes} [Sat May 14 15:47:38 2022] GET /compute/v2.1/servers/113f6b52-519c-45f4-9bc2-37168d644e15 => generated 1366 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 15:47:38.313216 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi [None req-f0bb01ea-c554-4234-8c79-c5fc485b3489 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Calling method '>' {{(pid=128729) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 15:47:38.314597 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.compute.api [None req-f0bb01ea-c554-4234-8c79-c5fc485b3489 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] [instance: e33e9970-bfb7-46f3-8d40-782dbfa3d21c] Fetching instance by UUID {{(pid=128729) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 15:47:38.324377 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-f0bb01ea-c554-4234-8c79-c5fc485b3489 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:47:38.324974 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-f0bb01ea-c554-4234-8c79-c5fc485b3489 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:47:38.325986 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-f0bb01ea-c554-4234-8c79-c5fc485b3489 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:47:38.326482 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-f0bb01ea-c554-4234-8c79-c5fc485b3489 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:47:38.423703 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi [None req-4186b15e-5c58-4c79-963b-b4b39f5cc8f0 tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Calling method '>' {{(pid=128728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 15:47:38.424488 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.compute.api [None req-4186b15e-5c58-4c79-963b-b4b39f5cc8f0 tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] [instance: 563c74e0-060d-49d5-abc5-389cee4bd9d5] Fetching instance by UUID {{(pid=128728) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 15:47:38.446756 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-4186b15e-5c58-4c79-963b-b4b39f5cc8f0 tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:47:38.447464 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-4186b15e-5c58-4c79-963b-b4b39f5cc8f0 tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:47:38.449019 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-4186b15e-5c58-4c79-963b-b4b39f5cc8f0 tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:47:38.449736 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-4186b15e-5c58-4c79-963b-b4b39f5cc8f0 tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:47:38.560469 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.policy [None req-f0bb01ea-c554-4234-8c79-c5fc485b3489 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58bfb7417bc94583963401ae0fe9d39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0672be3fa3f7414da1c1a5b7300abbe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128729) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:47:38.570886 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.policy [None req-f0bb01ea-c554-4234-8c79-c5fc485b3489 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58bfb7417bc94583963401ae0fe9d39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0672be3fa3f7414da1c1a5b7300abbe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128729) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:47:38.573899 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.policy [None req-f0bb01ea-c554-4234-8c79-c5fc485b3489 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58bfb7417bc94583963401ae0fe9d39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0672be3fa3f7414da1c1a5b7300abbe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128729) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:47:38.575970 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: INFO nova.api.openstack.requestlog [None req-f0bb01ea-c554-4234-8c79-c5fc485b3489 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] 10.222.0.61 "GET /compute/v2.1/servers/e33e9970-bfb7-46f3-8d40-782dbfa3d21c" status: 200 len: 1406 microversion: 2.20 time: 0.267068 May 14 15:47:38.576609 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: [pid: 128729|app: 0|req: 109/236] 10.222.0.61 () {60 vars in 1276 bytes} [Sat May 14 15:47:38 2022] GET /compute/v2.1/servers/e33e9970-bfb7-46f3-8d40-782dbfa3d21c => generated 1406 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 14 15:47:38.637636 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.policy [None req-4186b15e-5c58-4c79-963b-b4b39f5cc8f0 tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b896317d96a40d6a137db0dcf5f98f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d2517d5440a4d30949f3dd36a46d813', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128728) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:47:38.648185 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: INFO nova.api.openstack.requestlog [None req-4186b15e-5c58-4c79-963b-b4b39f5cc8f0 tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] 10.222.0.61 "GET /compute/v2.1/servers/563c74e0-060d-49d5-abc5-389cee4bd9d5" status: 200 len: 1321 microversion: 2.1 time: 0.232119 May 14 15:47:38.660286 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: [pid: 128728|app: 0|req: 128/237] 10.222.0.61 () {58 vars in 1235 bytes} [Sat May 14 15:47:38 2022] GET /compute/v2.1/servers/563c74e0-060d-49d5-abc5-389cee4bd9d5 => generated 1321 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 15:47:39.288725 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi [None req-115e1d83-e629-496e-ba80-dea8155a5237 tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] Calling method '>' {{(pid=128729) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 15:47:39.289569 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.compute.api [None req-115e1d83-e629-496e-ba80-dea8155a5237 tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] [instance: 113f6b52-519c-45f4-9bc2-37168d644e15] Fetching instance by UUID {{(pid=128729) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 15:47:39.297366 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-115e1d83-e629-496e-ba80-dea8155a5237 tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:47:39.297816 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-115e1d83-e629-496e-ba80-dea8155a5237 tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:47:39.298626 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-115e1d83-e629-496e-ba80-dea8155a5237 tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:47:39.299068 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-115e1d83-e629-496e-ba80-dea8155a5237 tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:47:39.447088 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.policy [None req-115e1d83-e629-496e-ba80-dea8155a5237 tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc43895177134e9c9c030a9d87f94aaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7905689c95d44a5c9169249c70f7de57', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128729) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:47:39.455896 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: INFO nova.api.openstack.requestlog [None req-115e1d83-e629-496e-ba80-dea8155a5237 tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] 10.222.0.61 "GET /compute/v2.1/servers/113f6b52-519c-45f4-9bc2-37168d644e15" status: 200 len: 1366 microversion: 2.1 time: 0.171468 May 14 15:47:39.456476 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: [pid: 128729|app: 0|req: 110/238] 10.222.0.61 () {58 vars in 1235 bytes} [Sat May 14 15:47:39 2022] GET /compute/v2.1/servers/113f6b52-519c-45f4-9bc2-37168d644e15 => generated 1366 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 15:47:39.594531 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi [None req-96c5a5c8-d391-4f92-8904-caef2d2f6188 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Calling method '>' {{(pid=128728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 15:47:39.595134 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.compute.api [None req-96c5a5c8-d391-4f92-8904-caef2d2f6188 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] [instance: e33e9970-bfb7-46f3-8d40-782dbfa3d21c] Fetching instance by UUID {{(pid=128728) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 15:47:39.604874 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-96c5a5c8-d391-4f92-8904-caef2d2f6188 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:47:39.605392 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-96c5a5c8-d391-4f92-8904-caef2d2f6188 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:47:39.606237 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-96c5a5c8-d391-4f92-8904-caef2d2f6188 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:47:39.606764 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-96c5a5c8-d391-4f92-8904-caef2d2f6188 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:47:39.670786 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi [None req-c97ff1b5-e0e8-4ff9-a42a-8ddceeb76e61 tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Calling method '>' {{(pid=128729) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 15:47:39.672325 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.compute.api [None req-c97ff1b5-e0e8-4ff9-a42a-8ddceeb76e61 tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] [instance: 563c74e0-060d-49d5-abc5-389cee4bd9d5] Fetching instance by UUID {{(pid=128729) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 15:47:39.679250 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-c97ff1b5-e0e8-4ff9-a42a-8ddceeb76e61 tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:47:39.679976 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-c97ff1b5-e0e8-4ff9-a42a-8ddceeb76e61 tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:47:39.681026 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-c97ff1b5-e0e8-4ff9-a42a-8ddceeb76e61 tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:47:39.681795 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-c97ff1b5-e0e8-4ff9-a42a-8ddceeb76e61 tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:47:39.815395 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.policy [None req-96c5a5c8-d391-4f92-8904-caef2d2f6188 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58bfb7417bc94583963401ae0fe9d39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0672be3fa3f7414da1c1a5b7300abbe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128728) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:47:39.823144 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.policy [None req-96c5a5c8-d391-4f92-8904-caef2d2f6188 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58bfb7417bc94583963401ae0fe9d39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0672be3fa3f7414da1c1a5b7300abbe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128728) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:47:39.828154 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.policy [None req-96c5a5c8-d391-4f92-8904-caef2d2f6188 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58bfb7417bc94583963401ae0fe9d39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0672be3fa3f7414da1c1a5b7300abbe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128728) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:47:39.829296 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: INFO nova.api.openstack.requestlog [None req-96c5a5c8-d391-4f92-8904-caef2d2f6188 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] 10.222.0.61 "GET /compute/v2.1/servers/e33e9970-bfb7-46f3-8d40-782dbfa3d21c" status: 200 len: 1406 microversion: 2.20 time: 0.238895 May 14 15:47:39.840332 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: [pid: 128728|app: 0|req: 129/239] 10.222.0.61 () {60 vars in 1276 bytes} [Sat May 14 15:47:39 2022] GET /compute/v2.1/servers/e33e9970-bfb7-46f3-8d40-782dbfa3d21c => generated 1406 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 14 15:47:39.881203 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.policy [None req-c97ff1b5-e0e8-4ff9-a42a-8ddceeb76e61 tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b896317d96a40d6a137db0dcf5f98f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d2517d5440a4d30949f3dd36a46d813', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128729) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:47:39.888962 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: INFO nova.api.openstack.requestlog [None req-c97ff1b5-e0e8-4ff9-a42a-8ddceeb76e61 tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] 10.222.0.61 "GET /compute/v2.1/servers/563c74e0-060d-49d5-abc5-389cee4bd9d5" status: 200 len: 1321 microversion: 2.1 time: 0.226137 May 14 15:47:39.889529 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: [pid: 128729|app: 0|req: 111/240] 10.222.0.61 () {58 vars in 1235 bytes} [Sat May 14 15:47:39 2022] GET /compute/v2.1/servers/563c74e0-060d-49d5-abc5-389cee4bd9d5 => generated 1321 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 15:47:40.473192 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi [None req-7eaf03a5-4117-4666-8924-2a7a0cc3367a tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] Calling method '>' {{(pid=128728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 15:47:40.473823 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.compute.api [None req-7eaf03a5-4117-4666-8924-2a7a0cc3367a tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] [instance: 113f6b52-519c-45f4-9bc2-37168d644e15] Fetching instance by UUID {{(pid=128728) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 15:47:40.479879 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-7eaf03a5-4117-4666-8924-2a7a0cc3367a tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:47:40.480321 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-7eaf03a5-4117-4666-8924-2a7a0cc3367a tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:47:40.481081 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-7eaf03a5-4117-4666-8924-2a7a0cc3367a tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:47:40.481511 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-7eaf03a5-4117-4666-8924-2a7a0cc3367a tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:47:40.611519 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.policy [None req-7eaf03a5-4117-4666-8924-2a7a0cc3367a tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc43895177134e9c9c030a9d87f94aaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7905689c95d44a5c9169249c70f7de57', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128728) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:47:40.618756 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: INFO nova.api.openstack.requestlog [None req-7eaf03a5-4117-4666-8924-2a7a0cc3367a tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] 10.222.0.61 "GET /compute/v2.1/servers/113f6b52-519c-45f4-9bc2-37168d644e15" status: 200 len: 1366 microversion: 2.1 time: 0.149312 May 14 15:47:40.619326 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: [pid: 128728|app: 0|req: 130/241] 10.222.0.61 () {58 vars in 1235 bytes} [Sat May 14 15:47:40 2022] GET /compute/v2.1/servers/113f6b52-519c-45f4-9bc2-37168d644e15 => generated 1366 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 15:47:40.847165 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi [None req-241ee0aa-016d-4b44-bdb5-f2039aa2402a tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Calling method '>' {{(pid=128729) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 15:47:40.847803 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.compute.api [None req-241ee0aa-016d-4b44-bdb5-f2039aa2402a tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] [instance: e33e9970-bfb7-46f3-8d40-782dbfa3d21c] Fetching instance by UUID {{(pid=128729) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 15:47:40.857634 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-241ee0aa-016d-4b44-bdb5-f2039aa2402a tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:47:40.858111 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-241ee0aa-016d-4b44-bdb5-f2039aa2402a tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:47:40.858952 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-241ee0aa-016d-4b44-bdb5-f2039aa2402a tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:47:40.859395 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-241ee0aa-016d-4b44-bdb5-f2039aa2402a tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:47:40.905845 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi [None req-bd8938d5-f9bb-4c82-95f6-29ad77f2e4a1 tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Calling method '>' {{(pid=128728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 15:47:40.906486 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.compute.api [None req-bd8938d5-f9bb-4c82-95f6-29ad77f2e4a1 tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] [instance: 563c74e0-060d-49d5-abc5-389cee4bd9d5] Fetching instance by UUID {{(pid=128728) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 15:47:40.912196 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-bd8938d5-f9bb-4c82-95f6-29ad77f2e4a1 tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:47:40.912650 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-bd8938d5-f9bb-4c82-95f6-29ad77f2e4a1 tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:47:40.913425 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-bd8938d5-f9bb-4c82-95f6-29ad77f2e4a1 tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:47:40.913865 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-bd8938d5-f9bb-4c82-95f6-29ad77f2e4a1 tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:47:41.034012 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.policy [None req-241ee0aa-016d-4b44-bdb5-f2039aa2402a tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58bfb7417bc94583963401ae0fe9d39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0672be3fa3f7414da1c1a5b7300abbe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128729) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:47:41.042118 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.policy [None req-241ee0aa-016d-4b44-bdb5-f2039aa2402a tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58bfb7417bc94583963401ae0fe9d39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0672be3fa3f7414da1c1a5b7300abbe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128729) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:47:41.043799 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.policy [None req-241ee0aa-016d-4b44-bdb5-f2039aa2402a tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58bfb7417bc94583963401ae0fe9d39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0672be3fa3f7414da1c1a5b7300abbe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128729) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:47:41.044913 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: INFO nova.api.openstack.requestlog [None req-241ee0aa-016d-4b44-bdb5-f2039aa2402a tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] 10.222.0.61 "GET /compute/v2.1/servers/e33e9970-bfb7-46f3-8d40-782dbfa3d21c" status: 200 len: 1406 microversion: 2.20 time: 0.202191 May 14 15:47:41.045495 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: [pid: 128729|app: 0|req: 112/242] 10.222.0.61 () {60 vars in 1276 bytes} [Sat May 14 15:47:40 2022] GET /compute/v2.1/servers/e33e9970-bfb7-46f3-8d40-782dbfa3d21c => generated 1406 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 14 15:47:41.067764 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.policy [None req-bd8938d5-f9bb-4c82-95f6-29ad77f2e4a1 tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b896317d96a40d6a137db0dcf5f98f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d2517d5440a4d30949f3dd36a46d813', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128728) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:47:41.075668 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: INFO nova.api.openstack.requestlog [None req-bd8938d5-f9bb-4c82-95f6-29ad77f2e4a1 tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] 10.222.0.61 "GET /compute/v2.1/servers/563c74e0-060d-49d5-abc5-389cee4bd9d5" status: 200 len: 1321 microversion: 2.1 time: 0.173684 May 14 15:47:41.076238 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: [pid: 128728|app: 0|req: 131/243] 10.222.0.61 () {58 vars in 1235 bytes} [Sat May 14 15:47:40 2022] GET /compute/v2.1/servers/563c74e0-060d-49d5-abc5-389cee4bd9d5 => generated 1321 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 15:47:41.635520 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi [None req-96654e70-1b17-4aff-b1e2-2aa04c7d8417 tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] Calling method '>' {{(pid=128729) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 15:47:41.636128 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.compute.api [None req-96654e70-1b17-4aff-b1e2-2aa04c7d8417 tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] [instance: 113f6b52-519c-45f4-9bc2-37168d644e15] Fetching instance by UUID {{(pid=128729) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 15:47:41.641943 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-96654e70-1b17-4aff-b1e2-2aa04c7d8417 tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:47:41.642425 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-96654e70-1b17-4aff-b1e2-2aa04c7d8417 tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:47:41.643189 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-96654e70-1b17-4aff-b1e2-2aa04c7d8417 tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:47:41.643625 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-96654e70-1b17-4aff-b1e2-2aa04c7d8417 tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:47:41.770001 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.policy [None req-96654e70-1b17-4aff-b1e2-2aa04c7d8417 tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc43895177134e9c9c030a9d87f94aaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7905689c95d44a5c9169249c70f7de57', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128729) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:47:41.777628 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: INFO nova.api.openstack.requestlog [None req-96654e70-1b17-4aff-b1e2-2aa04c7d8417 tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] 10.222.0.61 "GET /compute/v2.1/servers/113f6b52-519c-45f4-9bc2-37168d644e15" status: 200 len: 1366 microversion: 2.1 time: 0.146086 May 14 15:47:41.778210 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: [pid: 128729|app: 0|req: 113/244] 10.222.0.61 () {58 vars in 1235 bytes} [Sat May 14 15:47:41 2022] GET /compute/v2.1/servers/113f6b52-519c-45f4-9bc2-37168d644e15 => generated 1366 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 15:47:42.063059 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi [None req-7085ff8e-4b34-40d8-a2d6-f4db42402e76 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Calling method '>' {{(pid=128728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 15:47:42.063713 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.compute.api [None req-7085ff8e-4b34-40d8-a2d6-f4db42402e76 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] [instance: e33e9970-bfb7-46f3-8d40-782dbfa3d21c] Fetching instance by UUID {{(pid=128728) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 15:47:42.069446 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-7085ff8e-4b34-40d8-a2d6-f4db42402e76 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:47:42.069894 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-7085ff8e-4b34-40d8-a2d6-f4db42402e76 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:47:42.070679 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-7085ff8e-4b34-40d8-a2d6-f4db42402e76 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:47:42.071105 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-7085ff8e-4b34-40d8-a2d6-f4db42402e76 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:47:42.092701 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi [None req-21cbdfc2-6c92-4547-a00b-9f7b9b00661a tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Calling method '>' {{(pid=128729) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 15:47:42.093388 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.compute.api [None req-21cbdfc2-6c92-4547-a00b-9f7b9b00661a tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] [instance: 563c74e0-060d-49d5-abc5-389cee4bd9d5] Fetching instance by UUID {{(pid=128729) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 15:47:42.099748 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-21cbdfc2-6c92-4547-a00b-9f7b9b00661a tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:47:42.100292 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-21cbdfc2-6c92-4547-a00b-9f7b9b00661a tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:47:42.101170 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-21cbdfc2-6c92-4547-a00b-9f7b9b00661a tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:47:42.101704 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-21cbdfc2-6c92-4547-a00b-9f7b9b00661a tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:47:42.250030 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.policy [None req-7085ff8e-4b34-40d8-a2d6-f4db42402e76 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58bfb7417bc94583963401ae0fe9d39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0672be3fa3f7414da1c1a5b7300abbe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128728) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:47:42.258369 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.policy [None req-7085ff8e-4b34-40d8-a2d6-f4db42402e76 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58bfb7417bc94583963401ae0fe9d39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0672be3fa3f7414da1c1a5b7300abbe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128728) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:47:42.260461 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.policy [None req-7085ff8e-4b34-40d8-a2d6-f4db42402e76 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58bfb7417bc94583963401ae0fe9d39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0672be3fa3f7414da1c1a5b7300abbe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128728) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:47:42.261660 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: INFO nova.api.openstack.requestlog [None req-7085ff8e-4b34-40d8-a2d6-f4db42402e76 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] 10.222.0.61 "GET /compute/v2.1/servers/e33e9970-bfb7-46f3-8d40-782dbfa3d21c" status: 200 len: 1406 microversion: 2.20 time: 0.202461 May 14 15:47:42.262223 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: [pid: 128728|app: 0|req: 132/245] 10.222.0.61 () {60 vars in 1276 bytes} [Sat May 14 15:47:42 2022] GET /compute/v2.1/servers/e33e9970-bfb7-46f3-8d40-782dbfa3d21c => generated 1406 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 14 15:47:42.275014 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.policy [None req-21cbdfc2-6c92-4547-a00b-9f7b9b00661a tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b896317d96a40d6a137db0dcf5f98f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d2517d5440a4d30949f3dd36a46d813', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128729) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:47:42.282628 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: INFO nova.api.openstack.requestlog [None req-21cbdfc2-6c92-4547-a00b-9f7b9b00661a tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] 10.222.0.61 "GET /compute/v2.1/servers/563c74e0-060d-49d5-abc5-389cee4bd9d5" status: 200 len: 1321 microversion: 2.1 time: 0.193693 May 14 15:47:42.283193 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: [pid: 128729|app: 0|req: 114/246] 10.222.0.61 () {58 vars in 1235 bytes} [Sat May 14 15:47:42 2022] GET /compute/v2.1/servers/563c74e0-060d-49d5-abc5-389cee4bd9d5 => generated 1321 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 15:47:42.795051 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi [None req-8ad7b996-7679-46ab-999a-102f3cbd8293 tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] Calling method '>' {{(pid=128728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 15:47:42.795660 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.compute.api [None req-8ad7b996-7679-46ab-999a-102f3cbd8293 tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] [instance: 113f6b52-519c-45f4-9bc2-37168d644e15] Fetching instance by UUID {{(pid=128728) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 15:47:42.801536 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-8ad7b996-7679-46ab-999a-102f3cbd8293 tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:47:42.801984 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-8ad7b996-7679-46ab-999a-102f3cbd8293 tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:47:42.802773 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-8ad7b996-7679-46ab-999a-102f3cbd8293 tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:47:42.803217 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-8ad7b996-7679-46ab-999a-102f3cbd8293 tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:47:42.930536 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.policy [None req-8ad7b996-7679-46ab-999a-102f3cbd8293 tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc43895177134e9c9c030a9d87f94aaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7905689c95d44a5c9169249c70f7de57', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128728) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:47:42.938758 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: INFO nova.api.openstack.requestlog [None req-8ad7b996-7679-46ab-999a-102f3cbd8293 tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] 10.222.0.61 "GET /compute/v2.1/servers/113f6b52-519c-45f4-9bc2-37168d644e15" status: 200 len: 1366 microversion: 2.1 time: 0.148356 May 14 15:47:42.939338 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: [pid: 128728|app: 0|req: 133/247] 10.222.0.61 () {58 vars in 1235 bytes} [Sat May 14 15:47:42 2022] GET /compute/v2.1/servers/113f6b52-519c-45f4-9bc2-37168d644e15 => generated 1366 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 15:47:43.280111 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi [None req-8bc3190a-5ec0-44c4-971d-68e772e66f12 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Calling method '>' {{(pid=128729) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 15:47:43.280899 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.compute.api [None req-8bc3190a-5ec0-44c4-971d-68e772e66f12 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] [instance: e33e9970-bfb7-46f3-8d40-782dbfa3d21c] Fetching instance by UUID {{(pid=128729) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 15:47:43.288287 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-8bc3190a-5ec0-44c4-971d-68e772e66f12 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:47:43.289024 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-8bc3190a-5ec0-44c4-971d-68e772e66f12 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:47:43.289933 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-8bc3190a-5ec0-44c4-971d-68e772e66f12 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:47:43.290388 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-8bc3190a-5ec0-44c4-971d-68e772e66f12 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:47:43.299548 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi [None req-152625a2-25fd-4063-b26f-5a3955b2c88d tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Calling method '>' {{(pid=128728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 15:47:43.300360 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.compute.api [None req-152625a2-25fd-4063-b26f-5a3955b2c88d tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] [instance: 563c74e0-060d-49d5-abc5-389cee4bd9d5] Fetching instance by UUID {{(pid=128728) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 15:47:43.306277 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-152625a2-25fd-4063-b26f-5a3955b2c88d tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:47:43.307050 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-152625a2-25fd-4063-b26f-5a3955b2c88d tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:47:43.308108 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-152625a2-25fd-4063-b26f-5a3955b2c88d tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:47:43.309494 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-152625a2-25fd-4063-b26f-5a3955b2c88d tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:47:43.498582 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.policy [None req-8bc3190a-5ec0-44c4-971d-68e772e66f12 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58bfb7417bc94583963401ae0fe9d39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0672be3fa3f7414da1c1a5b7300abbe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128729) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:47:43.502829 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.policy [None req-152625a2-25fd-4063-b26f-5a3955b2c88d tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b896317d96a40d6a137db0dcf5f98f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d2517d5440a4d30949f3dd36a46d813', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128728) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:47:43.511147 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: INFO nova.api.openstack.requestlog [None req-152625a2-25fd-4063-b26f-5a3955b2c88d tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] 10.222.0.61 "GET /compute/v2.1/servers/563c74e0-060d-49d5-abc5-389cee4bd9d5" status: 200 len: 1516 microversion: 2.1 time: 0.215525 May 14 15:47:43.511718 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: [pid: 128728|app: 0|req: 134/248] 10.222.0.61 () {58 vars in 1235 bytes} [Sat May 14 15:47:43 2022] GET /compute/v2.1/servers/563c74e0-060d-49d5-abc5-389cee4bd9d5 => generated 1516 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 15:47:43.514233 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.policy [None req-8bc3190a-5ec0-44c4-971d-68e772e66f12 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58bfb7417bc94583963401ae0fe9d39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0672be3fa3f7414da1c1a5b7300abbe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128729) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:47:43.515842 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.policy [None req-8bc3190a-5ec0-44c4-971d-68e772e66f12 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58bfb7417bc94583963401ae0fe9d39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0672be3fa3f7414da1c1a5b7300abbe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128729) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:47:43.517018 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: INFO nova.api.openstack.requestlog [None req-8bc3190a-5ec0-44c4-971d-68e772e66f12 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] 10.222.0.61 "GET /compute/v2.1/servers/e33e9970-bfb7-46f3-8d40-782dbfa3d21c" status: 200 len: 1406 microversion: 2.20 time: 0.240782 May 14 15:47:43.517601 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: [pid: 128729|app: 0|req: 115/249] 10.222.0.61 () {60 vars in 1276 bytes} [Sat May 14 15:47:43 2022] GET /compute/v2.1/servers/e33e9970-bfb7-46f3-8d40-782dbfa3d21c => generated 1406 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 14 15:47:43.528050 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi [None req-bc291235-1a68-4bd4-9e75-d075100c6e4b tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=128728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 15:47:43.529052 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.compute.api [None req-bc291235-1a68-4bd4-9e75-d075100c6e4b tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] [instance: 563c74e0-060d-49d5-abc5-389cee4bd9d5] Fetching instance by UUID {{(pid=128728) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 15:47:43.534677 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-bc291235-1a68-4bd4-9e75-d075100c6e4b tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:47:43.535122 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-bc291235-1a68-4bd4-9e75-d075100c6e4b tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:47:43.535877 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-bc291235-1a68-4bd4-9e75-d075100c6e4b tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:47:43.536306 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-bc291235-1a68-4bd4-9e75-d075100c6e4b tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:47:43.596914 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.objects.instance [None req-bc291235-1a68-4bd4-9e75-d075100c6e4b tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Lazy-loading 'flavor' on Instance uuid 563c74e0-060d-49d5-abc5-389cee4bd9d5 {{(pid=128728) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 14 15:47:43.708579 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: INFO nova.api.openstack.requestlog [None req-bc291235-1a68-4bd4-9e75-d075100c6e4b tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] 10.222.0.61 "POST /compute/v2.1/servers/563c74e0-060d-49d5-abc5-389cee4bd9d5/action" status: 200 len: 32 microversion: 2.1 time: 0.184828 May 14 15:47:43.709208 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: [pid: 128728|app: 0|req: 135/250] 10.222.0.61 () {60 vars in 1277 bytes} [Sat May 14 15:47:43 2022] POST /compute/v2.1/servers/563c74e0-060d-49d5-abc5-389cee4bd9d5/action => generated 32 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 14 15:47:43.718793 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi [None req-cc908b20-d2d1-460b-8327-8ad4e6515c43 tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Calling method '>' {{(pid=128729) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 15:47:43.719574 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.compute.api [None req-cc908b20-d2d1-460b-8327-8ad4e6515c43 tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] [instance: 563c74e0-060d-49d5-abc5-389cee4bd9d5] Fetching instance by UUID {{(pid=128729) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 15:47:43.725859 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-cc908b20-d2d1-460b-8327-8ad4e6515c43 tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:47:43.726334 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-cc908b20-d2d1-460b-8327-8ad4e6515c43 tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:47:43.727106 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-cc908b20-d2d1-460b-8327-8ad4e6515c43 tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:47:43.727572 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-cc908b20-d2d1-460b-8327-8ad4e6515c43 tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:47:43.863021 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.policy [None req-cc908b20-d2d1-460b-8327-8ad4e6515c43 tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b896317d96a40d6a137db0dcf5f98f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d2517d5440a4d30949f3dd36a46d813', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128729) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:47:43.870167 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: INFO nova.api.openstack.requestlog [None req-cc908b20-d2d1-460b-8327-8ad4e6515c43 tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] 10.222.0.61 "GET /compute/v2.1/servers/563c74e0-060d-49d5-abc5-389cee4bd9d5" status: 200 len: 1522 microversion: 2.1 time: 0.155268 May 14 15:47:43.870754 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: [pid: 128729|app: 0|req: 116/251] 10.222.0.61 () {58 vars in 1235 bytes} [Sat May 14 15:47:43 2022] GET /compute/v2.1/servers/563c74e0-060d-49d5-abc5-389cee4bd9d5 => generated 1522 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 15:47:43.956290 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi [None req-2c8934c0-d52c-492d-a07a-5c2fed4a22f3 tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] Calling method '>' {{(pid=128728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 15:47:43.956984 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.compute.api [None req-2c8934c0-d52c-492d-a07a-5c2fed4a22f3 tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] [instance: 113f6b52-519c-45f4-9bc2-37168d644e15] Fetching instance by UUID {{(pid=128728) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 15:47:43.963619 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-2c8934c0-d52c-492d-a07a-5c2fed4a22f3 tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:47:43.964063 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-2c8934c0-d52c-492d-a07a-5c2fed4a22f3 tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:47:43.964834 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-2c8934c0-d52c-492d-a07a-5c2fed4a22f3 tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:47:43.965276 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-2c8934c0-d52c-492d-a07a-5c2fed4a22f3 tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:47:44.094150 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.policy [None req-2c8934c0-d52c-492d-a07a-5c2fed4a22f3 tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc43895177134e9c9c030a9d87f94aaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7905689c95d44a5c9169249c70f7de57', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128728) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:47:44.101619 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: INFO nova.api.openstack.requestlog [None req-2c8934c0-d52c-492d-a07a-5c2fed4a22f3 tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] 10.222.0.61 "GET /compute/v2.1/servers/113f6b52-519c-45f4-9bc2-37168d644e15" status: 200 len: 1366 microversion: 2.1 time: 0.149508 May 14 15:47:44.102253 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: [pid: 128728|app: 0|req: 136/252] 10.222.0.61 () {58 vars in 1235 bytes} [Sat May 14 15:47:43 2022] GET /compute/v2.1/servers/113f6b52-519c-45f4-9bc2-37168d644e15 => generated 1366 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 15:47:44.535599 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi [None req-f741c541-1bcf-4c99-bca9-df5867581eaf tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Calling method '>' {{(pid=128729) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 15:47:44.536207 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.compute.api [None req-f741c541-1bcf-4c99-bca9-df5867581eaf tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] [instance: e33e9970-bfb7-46f3-8d40-782dbfa3d21c] Fetching instance by UUID {{(pid=128729) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 15:47:44.542777 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-f741c541-1bcf-4c99-bca9-df5867581eaf tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:47:44.543227 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-f741c541-1bcf-4c99-bca9-df5867581eaf tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:47:44.543997 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-f741c541-1bcf-4c99-bca9-df5867581eaf tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:47:44.544434 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-f741c541-1bcf-4c99-bca9-df5867581eaf tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:47:44.679703 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.policy [None req-f741c541-1bcf-4c99-bca9-df5867581eaf tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58bfb7417bc94583963401ae0fe9d39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0672be3fa3f7414da1c1a5b7300abbe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128729) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:47:44.688227 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.policy [None req-f741c541-1bcf-4c99-bca9-df5867581eaf tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58bfb7417bc94583963401ae0fe9d39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0672be3fa3f7414da1c1a5b7300abbe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128729) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:47:44.689781 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.policy [None req-f741c541-1bcf-4c99-bca9-df5867581eaf tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58bfb7417bc94583963401ae0fe9d39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0672be3fa3f7414da1c1a5b7300abbe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128729) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:47:44.690859 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: INFO nova.api.openstack.requestlog [None req-f741c541-1bcf-4c99-bca9-df5867581eaf tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] 10.222.0.61 "GET /compute/v2.1/servers/e33e9970-bfb7-46f3-8d40-782dbfa3d21c" status: 200 len: 1406 microversion: 2.20 time: 0.159124 May 14 15:47:44.691702 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: [pid: 128729|app: 0|req: 117/253] 10.222.0.61 () {60 vars in 1276 bytes} [Sat May 14 15:47:44 2022] GET /compute/v2.1/servers/e33e9970-bfb7-46f3-8d40-782dbfa3d21c => generated 1406 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 14 15:47:44.887211 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi [None req-5b9bcc9b-9316-497e-9357-3758a07a115e tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Calling method '>' {{(pid=128728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 15:47:44.887868 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.compute.api [None req-5b9bcc9b-9316-497e-9357-3758a07a115e tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] [instance: 563c74e0-060d-49d5-abc5-389cee4bd9d5] Fetching instance by UUID {{(pid=128728) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 15:47:44.893880 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-5b9bcc9b-9316-497e-9357-3758a07a115e tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:47:44.894345 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-5b9bcc9b-9316-497e-9357-3758a07a115e tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:47:44.895132 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-5b9bcc9b-9316-497e-9357-3758a07a115e tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:47:44.895561 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-5b9bcc9b-9316-497e-9357-3758a07a115e tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:47:45.021563 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.policy [None req-5b9bcc9b-9316-497e-9357-3758a07a115e tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b896317d96a40d6a137db0dcf5f98f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d2517d5440a4d30949f3dd36a46d813', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128728) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:47:45.028915 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: INFO nova.api.openstack.requestlog [None req-5b9bcc9b-9316-497e-9357-3758a07a115e tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] 10.222.0.61 "GET /compute/v2.1/servers/563c74e0-060d-49d5-abc5-389cee4bd9d5" status: 200 len: 1522 microversion: 2.1 time: 0.145543 May 14 15:47:45.029478 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: [pid: 128728|app: 0|req: 137/254] 10.222.0.61 () {58 vars in 1235 bytes} [Sat May 14 15:47:44 2022] GET /compute/v2.1/servers/563c74e0-060d-49d5-abc5-389cee4bd9d5 => generated 1522 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 15:47:45.118498 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi [None req-37894bf0-ceec-4c33-8867-336088668e5e tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] Calling method '>' {{(pid=128729) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 15:47:45.119204 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.compute.api [None req-37894bf0-ceec-4c33-8867-336088668e5e tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] [instance: 113f6b52-519c-45f4-9bc2-37168d644e15] Fetching instance by UUID {{(pid=128729) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 15:47:45.125168 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-37894bf0-ceec-4c33-8867-336088668e5e tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:47:45.125620 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-37894bf0-ceec-4c33-8867-336088668e5e tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:47:45.126418 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-37894bf0-ceec-4c33-8867-336088668e5e tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:47:45.126859 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-37894bf0-ceec-4c33-8867-336088668e5e tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:47:45.253342 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.policy [None req-37894bf0-ceec-4c33-8867-336088668e5e tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc43895177134e9c9c030a9d87f94aaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7905689c95d44a5c9169249c70f7de57', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128729) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:47:45.261271 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: INFO nova.api.openstack.requestlog [None req-37894bf0-ceec-4c33-8867-336088668e5e tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] 10.222.0.61 "GET /compute/v2.1/servers/113f6b52-519c-45f4-9bc2-37168d644e15" status: 200 len: 1366 microversion: 2.1 time: 0.146851 May 14 15:47:45.261841 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: [pid: 128729|app: 0|req: 118/255] 10.222.0.61 () {58 vars in 1235 bytes} [Sat May 14 15:47:45 2022] GET /compute/v2.1/servers/113f6b52-519c-45f4-9bc2-37168d644e15 => generated 1366 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 15:47:45.709128 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi [None req-38624cd9-8114-426f-807a-2aa8e96db113 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Calling method '>' {{(pid=128728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 15:47:45.709719 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.compute.api [None req-38624cd9-8114-426f-807a-2aa8e96db113 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] [instance: e33e9970-bfb7-46f3-8d40-782dbfa3d21c] Fetching instance by UUID {{(pid=128728) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 15:47:45.715490 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-38624cd9-8114-426f-807a-2aa8e96db113 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:47:45.715926 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-38624cd9-8114-426f-807a-2aa8e96db113 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:47:45.716682 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-38624cd9-8114-426f-807a-2aa8e96db113 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:47:45.717110 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-38624cd9-8114-426f-807a-2aa8e96db113 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:47:45.845376 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.policy [None req-38624cd9-8114-426f-807a-2aa8e96db113 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58bfb7417bc94583963401ae0fe9d39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0672be3fa3f7414da1c1a5b7300abbe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128728) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:47:45.853872 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.policy [None req-38624cd9-8114-426f-807a-2aa8e96db113 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58bfb7417bc94583963401ae0fe9d39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0672be3fa3f7414da1c1a5b7300abbe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128728) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:47:45.855412 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.policy [None req-38624cd9-8114-426f-807a-2aa8e96db113 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58bfb7417bc94583963401ae0fe9d39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0672be3fa3f7414da1c1a5b7300abbe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128728) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:47:45.856507 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: INFO nova.api.openstack.requestlog [None req-38624cd9-8114-426f-807a-2aa8e96db113 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] 10.222.0.61 "GET /compute/v2.1/servers/e33e9970-bfb7-46f3-8d40-782dbfa3d21c" status: 200 len: 1406 microversion: 2.20 time: 0.151204 May 14 15:47:45.857054 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: [pid: 128728|app: 0|req: 138/256] 10.222.0.61 () {60 vars in 1276 bytes} [Sat May 14 15:47:45 2022] GET /compute/v2.1/servers/e33e9970-bfb7-46f3-8d40-782dbfa3d21c => generated 1406 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 14 15:47:46.045424 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi [None req-bad00c17-85a7-4b1c-975d-0c515088751f tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Calling method '>' {{(pid=128729) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 15:47:46.046053 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.compute.api [None req-bad00c17-85a7-4b1c-975d-0c515088751f tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] [instance: 563c74e0-060d-49d5-abc5-389cee4bd9d5] Fetching instance by UUID {{(pid=128729) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 15:47:46.052311 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-bad00c17-85a7-4b1c-975d-0c515088751f tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:47:46.052751 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-bad00c17-85a7-4b1c-975d-0c515088751f tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:47:46.053511 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-bad00c17-85a7-4b1c-975d-0c515088751f tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:47:46.053946 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-bad00c17-85a7-4b1c-975d-0c515088751f tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:47:46.179229 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.policy [None req-bad00c17-85a7-4b1c-975d-0c515088751f tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b896317d96a40d6a137db0dcf5f98f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d2517d5440a4d30949f3dd36a46d813', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128729) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:47:46.186486 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: INFO nova.api.openstack.requestlog [None req-bad00c17-85a7-4b1c-975d-0c515088751f tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] 10.222.0.61 "GET /compute/v2.1/servers/563c74e0-060d-49d5-abc5-389cee4bd9d5" status: 200 len: 1522 microversion: 2.1 time: 0.145524 May 14 15:47:46.187068 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: [pid: 128729|app: 0|req: 119/257] 10.222.0.61 () {58 vars in 1235 bytes} [Sat May 14 15:47:46 2022] GET /compute/v2.1/servers/563c74e0-060d-49d5-abc5-389cee4bd9d5 => generated 1522 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 15:47:46.277648 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi [None req-528c208d-6696-4737-a639-45d1f919063a tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] Calling method '>' {{(pid=128728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 15:47:46.278406 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.compute.api [None req-528c208d-6696-4737-a639-45d1f919063a tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] [instance: 113f6b52-519c-45f4-9bc2-37168d644e15] Fetching instance by UUID {{(pid=128728) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 15:47:46.284535 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-528c208d-6696-4737-a639-45d1f919063a tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:47:46.284968 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-528c208d-6696-4737-a639-45d1f919063a tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:47:46.285726 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-528c208d-6696-4737-a639-45d1f919063a tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:47:46.286161 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-528c208d-6696-4737-a639-45d1f919063a tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:47:46.561402 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.policy [None req-528c208d-6696-4737-a639-45d1f919063a tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc43895177134e9c9c030a9d87f94aaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7905689c95d44a5c9169249c70f7de57', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128728) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:47:46.568611 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: INFO nova.api.openstack.requestlog [None req-528c208d-6696-4737-a639-45d1f919063a tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] 10.222.0.61 "GET /compute/v2.1/servers/113f6b52-519c-45f4-9bc2-37168d644e15" status: 200 len: 1366 microversion: 2.1 time: 0.295556 May 14 15:47:46.569179 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: [pid: 128728|app: 0|req: 139/258] 10.222.0.61 () {58 vars in 1235 bytes} [Sat May 14 15:47:46 2022] GET /compute/v2.1/servers/113f6b52-519c-45f4-9bc2-37168d644e15 => generated 1366 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 15:47:46.875068 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi [None req-64c4acb9-ff0f-4d10-8db2-e033f3de7410 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Calling method '>' {{(pid=128729) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 15:47:46.875859 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.compute.api [None req-64c4acb9-ff0f-4d10-8db2-e033f3de7410 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] [instance: e33e9970-bfb7-46f3-8d40-782dbfa3d21c] Fetching instance by UUID {{(pid=128729) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 15:47:46.881982 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-64c4acb9-ff0f-4d10-8db2-e033f3de7410 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:47:46.882517 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-64c4acb9-ff0f-4d10-8db2-e033f3de7410 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:47:46.883280 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-64c4acb9-ff0f-4d10-8db2-e033f3de7410 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:47:46.883713 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-64c4acb9-ff0f-4d10-8db2-e033f3de7410 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:47:47.007965 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.policy [None req-64c4acb9-ff0f-4d10-8db2-e033f3de7410 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58bfb7417bc94583963401ae0fe9d39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0672be3fa3f7414da1c1a5b7300abbe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128729) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:47:47.016694 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.policy [None req-64c4acb9-ff0f-4d10-8db2-e033f3de7410 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58bfb7417bc94583963401ae0fe9d39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0672be3fa3f7414da1c1a5b7300abbe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128729) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:47:47.018185 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.policy [None req-64c4acb9-ff0f-4d10-8db2-e033f3de7410 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58bfb7417bc94583963401ae0fe9d39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0672be3fa3f7414da1c1a5b7300abbe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128729) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:47:47.019554 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: INFO nova.api.openstack.requestlog [None req-64c4acb9-ff0f-4d10-8db2-e033f3de7410 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] 10.222.0.61 "GET /compute/v2.1/servers/e33e9970-bfb7-46f3-8d40-782dbfa3d21c" status: 200 len: 1406 microversion: 2.20 time: 0.148566 May 14 15:47:47.020108 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: [pid: 128729|app: 0|req: 120/259] 10.222.0.61 () {60 vars in 1276 bytes} [Sat May 14 15:47:46 2022] GET /compute/v2.1/servers/e33e9970-bfb7-46f3-8d40-782dbfa3d21c => generated 1406 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 14 15:47:47.202939 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi [None req-f7223b3b-9df0-4358-97ae-f456793ca5fa tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Calling method '>' {{(pid=128728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 15:47:47.203542 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.compute.api [None req-f7223b3b-9df0-4358-97ae-f456793ca5fa tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] [instance: 563c74e0-060d-49d5-abc5-389cee4bd9d5] Fetching instance by UUID {{(pid=128728) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 15:47:47.209277 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-f7223b3b-9df0-4358-97ae-f456793ca5fa tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:47:47.209719 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-f7223b3b-9df0-4358-97ae-f456793ca5fa tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:47:47.210500 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-f7223b3b-9df0-4358-97ae-f456793ca5fa tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:47:47.210934 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-f7223b3b-9df0-4358-97ae-f456793ca5fa tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:47:47.340497 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.policy [None req-f7223b3b-9df0-4358-97ae-f456793ca5fa tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b896317d96a40d6a137db0dcf5f98f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d2517d5440a4d30949f3dd36a46d813', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128728) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:47:47.347709 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: INFO nova.api.openstack.requestlog [None req-f7223b3b-9df0-4358-97ae-f456793ca5fa tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] 10.222.0.61 "GET /compute/v2.1/servers/563c74e0-060d-49d5-abc5-389cee4bd9d5" status: 200 len: 1522 microversion: 2.1 time: 0.148508 May 14 15:47:47.348255 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: [pid: 128728|app: 0|req: 140/260] 10.222.0.61 () {58 vars in 1235 bytes} [Sat May 14 15:47:47 2022] GET /compute/v2.1/servers/563c74e0-060d-49d5-abc5-389cee4bd9d5 => generated 1522 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 15:47:47.586072 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi [None req-05355912-7d96-4302-af01-36070637c0ae tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] Calling method '>' {{(pid=128729) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 15:47:47.586630 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.compute.api [None req-05355912-7d96-4302-af01-36070637c0ae tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] [instance: 113f6b52-519c-45f4-9bc2-37168d644e15] Fetching instance by UUID {{(pid=128729) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 15:47:47.593524 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-05355912-7d96-4302-af01-36070637c0ae tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:47:47.593981 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-05355912-7d96-4302-af01-36070637c0ae tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:47:47.594785 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-05355912-7d96-4302-af01-36070637c0ae tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:47:47.595224 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-05355912-7d96-4302-af01-36070637c0ae tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:47:47.720229 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.policy [None req-05355912-7d96-4302-af01-36070637c0ae tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc43895177134e9c9c030a9d87f94aaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7905689c95d44a5c9169249c70f7de57', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128729) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:47:47.727510 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: INFO nova.api.openstack.requestlog [None req-05355912-7d96-4302-af01-36070637c0ae tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] 10.222.0.61 "GET /compute/v2.1/servers/113f6b52-519c-45f4-9bc2-37168d644e15" status: 200 len: 1366 microversion: 2.1 time: 0.145334 May 14 15:47:47.728699 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: [pid: 128729|app: 0|req: 121/261] 10.222.0.61 () {58 vars in 1235 bytes} [Sat May 14 15:47:47 2022] GET /compute/v2.1/servers/113f6b52-519c-45f4-9bc2-37168d644e15 => generated 1366 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 15:47:48.037212 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi [None req-ce4fc041-1ea4-44d6-bdf6-9d4639f65351 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Calling method '>' {{(pid=128728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 15:47:48.037812 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.compute.api [None req-ce4fc041-1ea4-44d6-bdf6-9d4639f65351 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] [instance: e33e9970-bfb7-46f3-8d40-782dbfa3d21c] Fetching instance by UUID {{(pid=128728) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 15:47:48.043678 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-ce4fc041-1ea4-44d6-bdf6-9d4639f65351 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:47:48.044124 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-ce4fc041-1ea4-44d6-bdf6-9d4639f65351 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:47:48.044890 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-ce4fc041-1ea4-44d6-bdf6-9d4639f65351 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:47:48.045323 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-ce4fc041-1ea4-44d6-bdf6-9d4639f65351 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:47:48.173474 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.policy [None req-ce4fc041-1ea4-44d6-bdf6-9d4639f65351 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58bfb7417bc94583963401ae0fe9d39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0672be3fa3f7414da1c1a5b7300abbe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128728) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:47:48.181725 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.policy [None req-ce4fc041-1ea4-44d6-bdf6-9d4639f65351 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58bfb7417bc94583963401ae0fe9d39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0672be3fa3f7414da1c1a5b7300abbe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128728) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:47:48.183261 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.policy [None req-ce4fc041-1ea4-44d6-bdf6-9d4639f65351 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58bfb7417bc94583963401ae0fe9d39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0672be3fa3f7414da1c1a5b7300abbe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128728) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:47:48.184392 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: INFO nova.api.openstack.requestlog [None req-ce4fc041-1ea4-44d6-bdf6-9d4639f65351 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] 10.222.0.61 "GET /compute/v2.1/servers/e33e9970-bfb7-46f3-8d40-782dbfa3d21c" status: 200 len: 1406 microversion: 2.20 time: 0.151073 May 14 15:47:48.184940 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: [pid: 128728|app: 0|req: 141/262] 10.222.0.61 () {60 vars in 1276 bytes} [Sat May 14 15:47:48 2022] GET /compute/v2.1/servers/e33e9970-bfb7-46f3-8d40-782dbfa3d21c => generated 1406 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 14 15:47:48.364990 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi [None req-f90ddd20-09dc-43c3-b421-5d138dc1591d tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Calling method '>' {{(pid=128729) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 15:47:48.365597 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.compute.api [None req-f90ddd20-09dc-43c3-b421-5d138dc1591d tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] [instance: 563c74e0-060d-49d5-abc5-389cee4bd9d5] Fetching instance by UUID {{(pid=128729) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 15:47:48.372120 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-f90ddd20-09dc-43c3-b421-5d138dc1591d tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:47:48.372507 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-f90ddd20-09dc-43c3-b421-5d138dc1591d tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:47:48.373274 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-f90ddd20-09dc-43c3-b421-5d138dc1591d tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:47:48.373714 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-f90ddd20-09dc-43c3-b421-5d138dc1591d tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:47:48.676900 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.policy [None req-f90ddd20-09dc-43c3-b421-5d138dc1591d tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b896317d96a40d6a137db0dcf5f98f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d2517d5440a4d30949f3dd36a46d813', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128729) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:47:48.685034 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: INFO nova.api.openstack.requestlog [None req-f90ddd20-09dc-43c3-b421-5d138dc1591d tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] 10.222.0.61 "GET /compute/v2.1/servers/563c74e0-060d-49d5-abc5-389cee4bd9d5" status: 200 len: 1522 microversion: 2.1 time: 0.324035 May 14 15:47:48.685611 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: [pid: 128729|app: 0|req: 122/263] 10.222.0.61 () {58 vars in 1235 bytes} [Sat May 14 15:47:48 2022] GET /compute/v2.1/servers/563c74e0-060d-49d5-abc5-389cee4bd9d5 => generated 1522 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 15:47:48.747556 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi [None req-301dd697-3f91-47e8-adbe-671cf0a12677 tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] Calling method '>' {{(pid=128728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 15:47:48.748173 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.compute.api [None req-301dd697-3f91-47e8-adbe-671cf0a12677 tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] [instance: 113f6b52-519c-45f4-9bc2-37168d644e15] Fetching instance by UUID {{(pid=128728) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 15:47:48.754243 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-301dd697-3f91-47e8-adbe-671cf0a12677 tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:47:48.754725 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-301dd697-3f91-47e8-adbe-671cf0a12677 tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:47:48.755497 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-301dd697-3f91-47e8-adbe-671cf0a12677 tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:47:48.755938 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-301dd697-3f91-47e8-adbe-671cf0a12677 tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:47:48.883124 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.policy [None req-301dd697-3f91-47e8-adbe-671cf0a12677 tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc43895177134e9c9c030a9d87f94aaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7905689c95d44a5c9169249c70f7de57', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128728) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:47:48.890812 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: INFO nova.api.openstack.requestlog [None req-301dd697-3f91-47e8-adbe-671cf0a12677 tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] 10.222.0.61 "GET /compute/v2.1/servers/113f6b52-519c-45f4-9bc2-37168d644e15" status: 200 len: 1366 microversion: 2.1 time: 0.147576 May 14 15:47:48.891404 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: [pid: 128728|app: 0|req: 142/264] 10.222.0.61 () {58 vars in 1235 bytes} [Sat May 14 15:47:48 2022] GET /compute/v2.1/servers/113f6b52-519c-45f4-9bc2-37168d644e15 => generated 1366 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 15:47:49.202537 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi [None req-981264ab-e9d6-4ef9-adef-6baa9473b545 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Calling method '>' {{(pid=128729) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 15:47:49.203173 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.compute.api [None req-981264ab-e9d6-4ef9-adef-6baa9473b545 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] [instance: e33e9970-bfb7-46f3-8d40-782dbfa3d21c] Fetching instance by UUID {{(pid=128729) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 15:47:49.208859 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-981264ab-e9d6-4ef9-adef-6baa9473b545 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:47:49.209306 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-981264ab-e9d6-4ef9-adef-6baa9473b545 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:47:49.210058 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-981264ab-e9d6-4ef9-adef-6baa9473b545 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:47:49.210521 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-981264ab-e9d6-4ef9-adef-6baa9473b545 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:47:49.336211 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.policy [None req-981264ab-e9d6-4ef9-adef-6baa9473b545 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58bfb7417bc94583963401ae0fe9d39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0672be3fa3f7414da1c1a5b7300abbe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128729) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:47:49.344822 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.policy [None req-981264ab-e9d6-4ef9-adef-6baa9473b545 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58bfb7417bc94583963401ae0fe9d39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0672be3fa3f7414da1c1a5b7300abbe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128729) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:47:49.346339 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.policy [None req-981264ab-e9d6-4ef9-adef-6baa9473b545 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58bfb7417bc94583963401ae0fe9d39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0672be3fa3f7414da1c1a5b7300abbe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128729) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:47:49.347424 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: INFO nova.api.openstack.requestlog [None req-981264ab-e9d6-4ef9-adef-6baa9473b545 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] 10.222.0.61 "GET /compute/v2.1/servers/e33e9970-bfb7-46f3-8d40-782dbfa3d21c" status: 200 len: 1406 microversion: 2.20 time: 0.148896 May 14 15:47:49.347980 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: [pid: 128729|app: 0|req: 123/265] 10.222.0.61 () {60 vars in 1276 bytes} [Sat May 14 15:47:49 2022] GET /compute/v2.1/servers/e33e9970-bfb7-46f3-8d40-782dbfa3d21c => generated 1406 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 14 15:47:49.701833 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi [None req-9275023a-1b4a-4f9d-953c-9957efbd2aa0 tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Calling method '>' {{(pid=128728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 15:47:49.702818 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.compute.api [None req-9275023a-1b4a-4f9d-953c-9957efbd2aa0 tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] [instance: 563c74e0-060d-49d5-abc5-389cee4bd9d5] Fetching instance by UUID {{(pid=128728) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 15:47:49.709672 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-9275023a-1b4a-4f9d-953c-9957efbd2aa0 tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:47:49.710146 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-9275023a-1b4a-4f9d-953c-9957efbd2aa0 tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:47:49.711047 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-9275023a-1b4a-4f9d-953c-9957efbd2aa0 tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:47:49.711578 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-9275023a-1b4a-4f9d-953c-9957efbd2aa0 tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:47:49.851593 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.policy [None req-9275023a-1b4a-4f9d-953c-9957efbd2aa0 tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b896317d96a40d6a137db0dcf5f98f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d2517d5440a4d30949f3dd36a46d813', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128728) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:47:49.859197 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: INFO nova.api.openstack.requestlog [None req-9275023a-1b4a-4f9d-953c-9957efbd2aa0 tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] 10.222.0.61 "GET /compute/v2.1/servers/563c74e0-060d-49d5-abc5-389cee4bd9d5" status: 200 len: 1522 microversion: 2.1 time: 0.161287 May 14 15:47:49.859767 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: [pid: 128728|app: 0|req: 143/266] 10.222.0.61 () {58 vars in 1235 bytes} [Sat May 14 15:47:49 2022] GET /compute/v2.1/servers/563c74e0-060d-49d5-abc5-389cee4bd9d5 => generated 1522 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 15:47:49.908063 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi [None req-aaa854b8-f603-4a2e-85b6-f2271486d085 tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] Calling method '>' {{(pid=128729) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 15:47:49.908669 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.compute.api [None req-aaa854b8-f603-4a2e-85b6-f2271486d085 tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] [instance: 113f6b52-519c-45f4-9bc2-37168d644e15] Fetching instance by UUID {{(pid=128729) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 15:47:49.914919 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-aaa854b8-f603-4a2e-85b6-f2271486d085 tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:47:49.915368 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-aaa854b8-f603-4a2e-85b6-f2271486d085 tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:47:49.916218 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-aaa854b8-f603-4a2e-85b6-f2271486d085 tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:47:49.916656 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-aaa854b8-f603-4a2e-85b6-f2271486d085 tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:47:50.055634 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.policy [None req-aaa854b8-f603-4a2e-85b6-f2271486d085 tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc43895177134e9c9c030a9d87f94aaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7905689c95d44a5c9169249c70f7de57', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128729) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:47:50.068141 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: INFO nova.api.openstack.requestlog [None req-aaa854b8-f603-4a2e-85b6-f2271486d085 tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] 10.222.0.61 "GET /compute/v2.1/servers/113f6b52-519c-45f4-9bc2-37168d644e15" status: 200 len: 1366 microversion: 2.1 time: 0.164051 May 14 15:47:50.070928 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: [pid: 128729|app: 0|req: 124/267] 10.222.0.61 () {58 vars in 1235 bytes} [Sat May 14 15:47:49 2022] GET /compute/v2.1/servers/113f6b52-519c-45f4-9bc2-37168d644e15 => generated 1366 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 15:47:50.365716 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi [None req-706ac655-d3e9-4e5e-98fa-e51d503ea365 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Calling method '>' {{(pid=128728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 15:47:50.366528 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.compute.api [None req-706ac655-d3e9-4e5e-98fa-e51d503ea365 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] [instance: e33e9970-bfb7-46f3-8d40-782dbfa3d21c] Fetching instance by UUID {{(pid=128728) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 15:47:50.373357 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-706ac655-d3e9-4e5e-98fa-e51d503ea365 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:47:50.373945 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-706ac655-d3e9-4e5e-98fa-e51d503ea365 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:47:50.374847 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-706ac655-d3e9-4e5e-98fa-e51d503ea365 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:47:50.375360 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-706ac655-d3e9-4e5e-98fa-e51d503ea365 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:47:50.509804 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.policy [None req-706ac655-d3e9-4e5e-98fa-e51d503ea365 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58bfb7417bc94583963401ae0fe9d39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0672be3fa3f7414da1c1a5b7300abbe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128728) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:47:50.517948 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.policy [None req-706ac655-d3e9-4e5e-98fa-e51d503ea365 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58bfb7417bc94583963401ae0fe9d39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0672be3fa3f7414da1c1a5b7300abbe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128728) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:47:50.519578 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.policy [None req-706ac655-d3e9-4e5e-98fa-e51d503ea365 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58bfb7417bc94583963401ae0fe9d39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0672be3fa3f7414da1c1a5b7300abbe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128728) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:47:50.520733 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: INFO nova.api.openstack.requestlog [None req-706ac655-d3e9-4e5e-98fa-e51d503ea365 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] 10.222.0.61 "GET /compute/v2.1/servers/e33e9970-bfb7-46f3-8d40-782dbfa3d21c" status: 200 len: 1406 microversion: 2.20 time: 0.159338 May 14 15:47:50.521315 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: [pid: 128728|app: 0|req: 144/268] 10.222.0.61 () {60 vars in 1276 bytes} [Sat May 14 15:47:50 2022] GET /compute/v2.1/servers/e33e9970-bfb7-46f3-8d40-782dbfa3d21c => generated 1406 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 14 15:47:50.877148 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi [None req-cb9b1ea2-09b1-4fa3-bcf1-2f9c8d600a54 tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Calling method '>' {{(pid=128729) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 15:47:50.877752 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.compute.api [None req-cb9b1ea2-09b1-4fa3-bcf1-2f9c8d600a54 tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] [instance: 563c74e0-060d-49d5-abc5-389cee4bd9d5] Fetching instance by UUID {{(pid=128729) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 15:47:50.887969 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-cb9b1ea2-09b1-4fa3-bcf1-2f9c8d600a54 tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:47:50.888876 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-cb9b1ea2-09b1-4fa3-bcf1-2f9c8d600a54 tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:47:50.889682 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-cb9b1ea2-09b1-4fa3-bcf1-2f9c8d600a54 tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:47:50.890118 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-cb9b1ea2-09b1-4fa3-bcf1-2f9c8d600a54 tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:47:51.044010 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.policy [None req-cb9b1ea2-09b1-4fa3-bcf1-2f9c8d600a54 tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b896317d96a40d6a137db0dcf5f98f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d2517d5440a4d30949f3dd36a46d813', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128729) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:47:51.052033 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: INFO nova.api.openstack.requestlog [None req-cb9b1ea2-09b1-4fa3-bcf1-2f9c8d600a54 tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] 10.222.0.61 "GET /compute/v2.1/servers/563c74e0-060d-49d5-abc5-389cee4bd9d5" status: 200 len: 1522 microversion: 2.1 time: 0.178757 May 14 15:47:51.052606 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: [pid: 128729|app: 0|req: 125/269] 10.222.0.61 () {58 vars in 1235 bytes} [Sat May 14 15:47:50 2022] GET /compute/v2.1/servers/563c74e0-060d-49d5-abc5-389cee4bd9d5 => generated 1522 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 15:47:51.087523 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi [None req-e856d2d6-aa31-4e89-89e9-cc97d7399dda tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] Calling method '>' {{(pid=128728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 15:47:51.088308 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.compute.api [None req-e856d2d6-aa31-4e89-89e9-cc97d7399dda tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] [instance: 113f6b52-519c-45f4-9bc2-37168d644e15] Fetching instance by UUID {{(pid=128728) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 15:47:51.094740 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-e856d2d6-aa31-4e89-89e9-cc97d7399dda tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:47:51.095302 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-e856d2d6-aa31-4e89-89e9-cc97d7399dda tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:47:51.096133 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-e856d2d6-aa31-4e89-89e9-cc97d7399dda tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:47:51.096917 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-e856d2d6-aa31-4e89-89e9-cc97d7399dda tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:47:51.251631 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.policy [None req-e856d2d6-aa31-4e89-89e9-cc97d7399dda tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc43895177134e9c9c030a9d87f94aaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7905689c95d44a5c9169249c70f7de57', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128728) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:47:51.265114 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: INFO nova.api.openstack.requestlog [None req-e856d2d6-aa31-4e89-89e9-cc97d7399dda tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] 10.222.0.61 "GET /compute/v2.1/servers/113f6b52-519c-45f4-9bc2-37168d644e15" status: 200 len: 1366 microversion: 2.1 time: 0.181122 May 14 15:47:51.277343 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: [pid: 128728|app: 0|req: 145/270] 10.222.0.61 () {58 vars in 1235 bytes} [Sat May 14 15:47:51 2022] GET /compute/v2.1/servers/113f6b52-519c-45f4-9bc2-37168d644e15 => generated 1366 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 15:47:51.539255 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi [None req-551ee297-b459-4cd6-a56e-d203b6391201 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Calling method '>' {{(pid=128729) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 15:47:51.540100 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.compute.api [None req-551ee297-b459-4cd6-a56e-d203b6391201 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] [instance: e33e9970-bfb7-46f3-8d40-782dbfa3d21c] Fetching instance by UUID {{(pid=128729) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 15:47:51.546639 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-551ee297-b459-4cd6-a56e-d203b6391201 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:47:51.547087 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-551ee297-b459-4cd6-a56e-d203b6391201 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:47:51.547858 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-551ee297-b459-4cd6-a56e-d203b6391201 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:47:51.548453 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-551ee297-b459-4cd6-a56e-d203b6391201 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:47:51.847080 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.policy [None req-551ee297-b459-4cd6-a56e-d203b6391201 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58bfb7417bc94583963401ae0fe9d39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0672be3fa3f7414da1c1a5b7300abbe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128729) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:47:51.857970 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.policy [None req-551ee297-b459-4cd6-a56e-d203b6391201 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58bfb7417bc94583963401ae0fe9d39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0672be3fa3f7414da1c1a5b7300abbe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128729) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:47:51.859759 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.policy [None req-551ee297-b459-4cd6-a56e-d203b6391201 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58bfb7417bc94583963401ae0fe9d39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0672be3fa3f7414da1c1a5b7300abbe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128729) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:47:51.860975 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: INFO nova.api.openstack.requestlog [None req-551ee297-b459-4cd6-a56e-d203b6391201 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] 10.222.0.61 "GET /compute/v2.1/servers/e33e9970-bfb7-46f3-8d40-782dbfa3d21c" status: 200 len: 1406 microversion: 2.20 time: 0.325515 May 14 15:47:51.861803 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: [pid: 128729|app: 0|req: 126/271] 10.222.0.61 () {60 vars in 1276 bytes} [Sat May 14 15:47:51 2022] GET /compute/v2.1/servers/e33e9970-bfb7-46f3-8d40-782dbfa3d21c => generated 1406 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 14 15:47:52.070733 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi [None req-4ba3dd3b-6775-4a67-a236-7b38ba621fa9 tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Calling method '>' {{(pid=128728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 15:47:52.072765 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.compute.api [None req-4ba3dd3b-6775-4a67-a236-7b38ba621fa9 tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] [instance: 563c74e0-060d-49d5-abc5-389cee4bd9d5] Fetching instance by UUID {{(pid=128728) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 15:47:52.080017 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-4ba3dd3b-6775-4a67-a236-7b38ba621fa9 tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:47:52.081019 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-4ba3dd3b-6775-4a67-a236-7b38ba621fa9 tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:47:52.082647 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-4ba3dd3b-6775-4a67-a236-7b38ba621fa9 tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:47:52.083297 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-4ba3dd3b-6775-4a67-a236-7b38ba621fa9 tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:47:52.238374 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.policy [None req-4ba3dd3b-6775-4a67-a236-7b38ba621fa9 tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b896317d96a40d6a137db0dcf5f98f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d2517d5440a4d30949f3dd36a46d813', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128728) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:47:52.248500 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: INFO nova.api.openstack.requestlog [None req-4ba3dd3b-6775-4a67-a236-7b38ba621fa9 tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] 10.222.0.61 "GET /compute/v2.1/servers/563c74e0-060d-49d5-abc5-389cee4bd9d5" status: 200 len: 1522 microversion: 2.1 time: 0.182740 May 14 15:47:52.257903 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: [pid: 128728|app: 0|req: 146/272] 10.222.0.61 () {58 vars in 1235 bytes} [Sat May 14 15:47:52 2022] GET /compute/v2.1/servers/563c74e0-060d-49d5-abc5-389cee4bd9d5 => generated 1522 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 15:47:52.281510 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi [None req-178ce807-aba1-4d0d-b25c-a4ce71f454ff tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] Calling method '>' {{(pid=128729) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 15:47:52.282188 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.compute.api [None req-178ce807-aba1-4d0d-b25c-a4ce71f454ff tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] [instance: 113f6b52-519c-45f4-9bc2-37168d644e15] Fetching instance by UUID {{(pid=128729) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 15:47:52.289068 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-178ce807-aba1-4d0d-b25c-a4ce71f454ff tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:47:52.289595 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-178ce807-aba1-4d0d-b25c-a4ce71f454ff tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:47:52.290571 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-178ce807-aba1-4d0d-b25c-a4ce71f454ff tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:47:52.291086 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-178ce807-aba1-4d0d-b25c-a4ce71f454ff tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:47:52.490166 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.policy [None req-178ce807-aba1-4d0d-b25c-a4ce71f454ff tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc43895177134e9c9c030a9d87f94aaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7905689c95d44a5c9169249c70f7de57', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128729) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:47:52.505211 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: INFO nova.api.openstack.requestlog [None req-178ce807-aba1-4d0d-b25c-a4ce71f454ff tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] 10.222.0.61 "GET /compute/v2.1/servers/113f6b52-519c-45f4-9bc2-37168d644e15" status: 200 len: 1366 microversion: 2.1 time: 0.227644 May 14 15:47:52.505974 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: [pid: 128729|app: 0|req: 127/273] 10.222.0.61 () {58 vars in 1235 bytes} [Sat May 14 15:47:52 2022] GET /compute/v2.1/servers/113f6b52-519c-45f4-9bc2-37168d644e15 => generated 1366 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 15:47:52.879554 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi [None req-deafe77a-cdfb-4a6c-a7aa-9c921a1925de tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Calling method '>' {{(pid=128728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 15:47:52.880528 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.compute.api [None req-deafe77a-cdfb-4a6c-a7aa-9c921a1925de tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] [instance: e33e9970-bfb7-46f3-8d40-782dbfa3d21c] Fetching instance by UUID {{(pid=128728) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 15:47:52.892722 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-deafe77a-cdfb-4a6c-a7aa-9c921a1925de tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:47:52.893420 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-deafe77a-cdfb-4a6c-a7aa-9c921a1925de tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:47:52.894467 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-deafe77a-cdfb-4a6c-a7aa-9c921a1925de tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:47:52.897342 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-deafe77a-cdfb-4a6c-a7aa-9c921a1925de tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:47:53.265564 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi [None req-4ba2f79b-b73e-4233-a8ce-5da46bc4a4fe tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Calling method '>' {{(pid=128729) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 15:47:53.266174 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.compute.api [None req-4ba2f79b-b73e-4233-a8ce-5da46bc4a4fe tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] [instance: 563c74e0-060d-49d5-abc5-389cee4bd9d5] Fetching instance by UUID {{(pid=128729) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 15:47:53.272504 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-4ba2f79b-b73e-4233-a8ce-5da46bc4a4fe tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:47:53.273003 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-4ba2f79b-b73e-4233-a8ce-5da46bc4a4fe tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:47:53.273926 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-4ba2f79b-b73e-4233-a8ce-5da46bc4a4fe tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:47:53.274361 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-4ba2f79b-b73e-4233-a8ce-5da46bc4a4fe tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:47:53.296283 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.policy [None req-deafe77a-cdfb-4a6c-a7aa-9c921a1925de tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58bfb7417bc94583963401ae0fe9d39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0672be3fa3f7414da1c1a5b7300abbe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128728) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:47:53.308880 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.policy [None req-deafe77a-cdfb-4a6c-a7aa-9c921a1925de tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58bfb7417bc94583963401ae0fe9d39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0672be3fa3f7414da1c1a5b7300abbe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128728) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:47:53.313419 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.policy [None req-deafe77a-cdfb-4a6c-a7aa-9c921a1925de tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58bfb7417bc94583963401ae0fe9d39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0672be3fa3f7414da1c1a5b7300abbe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128728) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:47:53.317546 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: INFO nova.api.openstack.requestlog [None req-deafe77a-cdfb-4a6c-a7aa-9c921a1925de tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] 10.222.0.61 "GET /compute/v2.1/servers/e33e9970-bfb7-46f3-8d40-782dbfa3d21c" status: 200 len: 1406 microversion: 2.20 time: 0.440683 May 14 15:47:53.318582 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: [pid: 128728|app: 0|req: 147/274] 10.222.0.61 () {60 vars in 1276 bytes} [Sat May 14 15:47:52 2022] GET /compute/v2.1/servers/e33e9970-bfb7-46f3-8d40-782dbfa3d21c => generated 1406 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 14 15:47:53.498528 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.policy [None req-4ba2f79b-b73e-4233-a8ce-5da46bc4a4fe tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b896317d96a40d6a137db0dcf5f98f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d2517d5440a4d30949f3dd36a46d813', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128729) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:47:53.519956 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: INFO nova.api.openstack.requestlog [None req-4ba2f79b-b73e-4233-a8ce-5da46bc4a4fe tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] 10.222.0.61 "GET /compute/v2.1/servers/563c74e0-060d-49d5-abc5-389cee4bd9d5" status: 200 len: 1522 microversion: 2.1 time: 0.258218 May 14 15:47:53.522765 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi [None req-343a19eb-6ebe-41f9-92b5-518e47bd8d0a tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] Calling method '>' {{(pid=128728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 15:47:53.523567 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.compute.api [None req-343a19eb-6ebe-41f9-92b5-518e47bd8d0a tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] [instance: 113f6b52-519c-45f4-9bc2-37168d644e15] Fetching instance by UUID {{(pid=128728) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 15:47:53.523976 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: [pid: 128729|app: 0|req: 128/275] 10.222.0.61 () {58 vars in 1235 bytes} [Sat May 14 15:47:53 2022] GET /compute/v2.1/servers/563c74e0-060d-49d5-abc5-389cee4bd9d5 => generated 1522 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 15:47:53.534093 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-343a19eb-6ebe-41f9-92b5-518e47bd8d0a tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:47:53.534924 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-343a19eb-6ebe-41f9-92b5-518e47bd8d0a tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:47:53.535940 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-343a19eb-6ebe-41f9-92b5-518e47bd8d0a tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:47:53.536617 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-343a19eb-6ebe-41f9-92b5-518e47bd8d0a tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:47:53.740502 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.policy [None req-343a19eb-6ebe-41f9-92b5-518e47bd8d0a tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc43895177134e9c9c030a9d87f94aaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7905689c95d44a5c9169249c70f7de57', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128728) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:47:53.751583 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: INFO nova.api.openstack.requestlog [None req-343a19eb-6ebe-41f9-92b5-518e47bd8d0a tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] 10.222.0.61 "GET /compute/v2.1/servers/113f6b52-519c-45f4-9bc2-37168d644e15" status: 200 len: 1556 microversion: 2.1 time: 0.232545 May 14 15:47:53.755363 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: [pid: 128728|app: 0|req: 148/276] 10.222.0.61 () {58 vars in 1235 bytes} [Sat May 14 15:47:53 2022] GET /compute/v2.1/servers/113f6b52-519c-45f4-9bc2-37168d644e15 => generated 1556 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 15:47:53.769593 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi [None req-3f98dec0-9be4-4009-beaf-a99b844d20c2 tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] Calling method '>' {{(pid=128729) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 15:47:53.770093 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.compute.api [None req-3f98dec0-9be4-4009-beaf-a99b844d20c2 tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] [instance: 113f6b52-519c-45f4-9bc2-37168d644e15] Fetching instance by UUID {{(pid=128729) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 15:47:53.782253 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-3f98dec0-9be4-4009-beaf-a99b844d20c2 tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:47:53.783071 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-3f98dec0-9be4-4009-beaf-a99b844d20c2 tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:47:53.786675 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-3f98dec0-9be4-4009-beaf-a99b844d20c2 tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:47:53.787134 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-3f98dec0-9be4-4009-beaf-a99b844d20c2 tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:47:53.907278 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: INFO nova.api.openstack.requestlog [None req-3f98dec0-9be4-4009-beaf-a99b844d20c2 tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] 10.222.0.61 "GET /compute/v2.1/servers/113f6b52-519c-45f4-9bc2-37168d644e15/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.141530 May 14 15:47:53.914713 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: [pid: 128729|app: 0|req: 129/277] 10.222.0.61 () {58 vars in 1274 bytes} [Sat May 14 15:47:53 2022] GET /compute/v2.1/servers/113f6b52-519c-45f4-9bc2-37168d644e15/os-interface => generated 285 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 14 15:47:54.338123 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi [None req-19e3c68d-a88d-42f4-a572-2b85cb743406 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Calling method '>' {{(pid=128728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 15:47:54.339403 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.compute.api [None req-19e3c68d-a88d-42f4-a572-2b85cb743406 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] [instance: e33e9970-bfb7-46f3-8d40-782dbfa3d21c] Fetching instance by UUID {{(pid=128728) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 15:47:54.346414 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-19e3c68d-a88d-42f4-a572-2b85cb743406 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:47:54.356196 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-19e3c68d-a88d-42f4-a572-2b85cb743406 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:47:54.359202 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-19e3c68d-a88d-42f4-a572-2b85cb743406 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:47:54.359882 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-19e3c68d-a88d-42f4-a572-2b85cb743406 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:47:54.542895 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi [None req-9be822a7-abb6-4bc1-a348-29c0ca57827a tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Calling method '>' {{(pid=128729) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 15:47:54.544890 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.compute.api [None req-9be822a7-abb6-4bc1-a348-29c0ca57827a tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] [instance: 563c74e0-060d-49d5-abc5-389cee4bd9d5] Fetching instance by UUID {{(pid=128729) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 15:47:54.554843 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-9be822a7-abb6-4bc1-a348-29c0ca57827a tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:47:54.555495 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-9be822a7-abb6-4bc1-a348-29c0ca57827a tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:47:54.557435 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-9be822a7-abb6-4bc1-a348-29c0ca57827a tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:47:54.558998 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-9be822a7-abb6-4bc1-a348-29c0ca57827a tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:47:54.782366 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.policy [None req-19e3c68d-a88d-42f4-a572-2b85cb743406 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58bfb7417bc94583963401ae0fe9d39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0672be3fa3f7414da1c1a5b7300abbe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128728) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:47:54.798231 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.policy [None req-19e3c68d-a88d-42f4-a572-2b85cb743406 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58bfb7417bc94583963401ae0fe9d39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0672be3fa3f7414da1c1a5b7300abbe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128728) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:47:54.800642 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.policy [None req-19e3c68d-a88d-42f4-a572-2b85cb743406 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58bfb7417bc94583963401ae0fe9d39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0672be3fa3f7414da1c1a5b7300abbe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128728) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:47:54.802364 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: INFO nova.api.openstack.requestlog [None req-19e3c68d-a88d-42f4-a572-2b85cb743406 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] 10.222.0.61 "GET /compute/v2.1/servers/e33e9970-bfb7-46f3-8d40-782dbfa3d21c" status: 200 len: 1406 microversion: 2.20 time: 0.468520 May 14 15:47:54.815258 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: [pid: 128728|app: 0|req: 149/278] 10.222.0.61 () {60 vars in 1276 bytes} [Sat May 14 15:47:54 2022] GET /compute/v2.1/servers/e33e9970-bfb7-46f3-8d40-782dbfa3d21c => generated 1406 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 14 15:47:55.048579 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi [req-de7c4850-47e8-4da0-82db-6b0be75daceb req-b4a5c3fd-4031-42d0-a167-9dd452d98c0a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e33e9970-bfb7-46f3-8d40-782dbfa3d21c", "name": "network-vif-plugged", "status": "completed", "tag": "759be0ca-daaf-4eba-97b6-a252b70cbb3b"}]} {{(pid=128728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 15:47:55.068712 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [req-de7c4850-47e8-4da0-82db-6b0be75daceb req-b4a5c3fd-4031-42d0-a167-9dd452d98c0a service nova] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:47:55.071032 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [req-de7c4850-47e8-4da0-82db-6b0be75daceb req-b4a5c3fd-4031-42d0-a167-9dd452d98c0a service nova] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:47:55.084585 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: INFO nova.api.openstack.compute.server_external_events [req-de7c4850-47e8-4da0-82db-6b0be75daceb req-b4a5c3fd-4031-42d0-a167-9dd452d98c0a service nova] Creating event network-vif-plugged:759be0ca-daaf-4eba-97b6-a252b70cbb3b for instance e33e9970-bfb7-46f3-8d40-782dbfa3d21c on hv-cinder-83979 May 14 15:47:55.090994 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: INFO nova.api.openstack.requestlog [req-de7c4850-47e8-4da0-82db-6b0be75daceb req-b4a5c3fd-4031-42d0-a167-9dd452d98c0a service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046950 May 14 15:47:55.092399 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: [pid: 128728|app: 0|req: 150/279] 10.222.0.61 () {64 vars in 1317 bytes} [Sat May 14 15:47:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 14 15:47:55.305702 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.policy [None req-9be822a7-abb6-4bc1-a348-29c0ca57827a tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b896317d96a40d6a137db0dcf5f98f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d2517d5440a4d30949f3dd36a46d813', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128729) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:47:55.318704 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: INFO nova.api.openstack.requestlog [None req-9be822a7-abb6-4bc1-a348-29c0ca57827a tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] 10.222.0.61 "GET /compute/v2.1/servers/563c74e0-060d-49d5-abc5-389cee4bd9d5" status: 200 len: 1522 microversion: 2.1 time: 0.780202 May 14 15:47:55.319424 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: [pid: 128729|app: 0|req: 130/280] 10.222.0.61 () {58 vars in 1235 bytes} [Sat May 14 15:47:54 2022] GET /compute/v2.1/servers/563c74e0-060d-49d5-abc5-389cee4bd9d5 => generated 1522 bytes in 782 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 15:47:55.836333 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi [None req-d04ae433-84c9-4e90-85b6-8551cc2704d2 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Calling method '>' {{(pid=128728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 15:47:55.839647 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.compute.api [None req-d04ae433-84c9-4e90-85b6-8551cc2704d2 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] [instance: e33e9970-bfb7-46f3-8d40-782dbfa3d21c] Fetching instance by UUID {{(pid=128728) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 15:47:55.863143 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-d04ae433-84c9-4e90-85b6-8551cc2704d2 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:47:55.863664 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-d04ae433-84c9-4e90-85b6-8551cc2704d2 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:47:55.864775 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-d04ae433-84c9-4e90-85b6-8551cc2704d2 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:47:55.865378 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-d04ae433-84c9-4e90-85b6-8551cc2704d2 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:47:55.890684 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi [req-0cebebe3-c40e-4823-9873-4e9cf616b099 req-8ac3a094-c718-4a6b-92bd-2a8295c88756 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "113f6b52-519c-45f4-9bc2-37168d644e15", "tag": "60f7fd3d-dbe8-4c62-af7e-c0490eeb01d3"}]} {{(pid=128729) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 15:47:55.903517 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [req-0cebebe3-c40e-4823-9873-4e9cf616b099 req-8ac3a094-c718-4a6b-92bd-2a8295c88756 service nova] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:47:55.904381 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [req-0cebebe3-c40e-4823-9873-4e9cf616b099 req-8ac3a094-c718-4a6b-92bd-2a8295c88756 service nova] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:47:55.922803 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: INFO nova.api.openstack.compute.server_external_events [req-0cebebe3-c40e-4823-9873-4e9cf616b099 req-8ac3a094-c718-4a6b-92bd-2a8295c88756 service nova] Creating event network-changed:60f7fd3d-dbe8-4c62-af7e-c0490eeb01d3 for instance 113f6b52-519c-45f4-9bc2-37168d644e15 on hv-cinder-83979 May 14 15:47:55.933239 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: INFO nova.api.openstack.requestlog [req-0cebebe3-c40e-4823-9873-4e9cf616b099 req-8ac3a094-c718-4a6b-92bd-2a8295c88756 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049985 May 14 15:47:55.933966 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: [pid: 128729|app: 0|req: 131/281] 10.222.0.61 () {64 vars in 1317 bytes} [Sat May 14 15:47:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 14 15:47:56.050009 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.policy [None req-d04ae433-84c9-4e90-85b6-8551cc2704d2 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58bfb7417bc94583963401ae0fe9d39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0672be3fa3f7414da1c1a5b7300abbe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128728) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:47:56.059437 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.policy [None req-d04ae433-84c9-4e90-85b6-8551cc2704d2 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58bfb7417bc94583963401ae0fe9d39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0672be3fa3f7414da1c1a5b7300abbe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128728) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:47:56.061275 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.policy [None req-d04ae433-84c9-4e90-85b6-8551cc2704d2 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58bfb7417bc94583963401ae0fe9d39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0672be3fa3f7414da1c1a5b7300abbe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128728) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:47:56.062606 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: INFO nova.api.openstack.requestlog [None req-d04ae433-84c9-4e90-85b6-8551cc2704d2 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] 10.222.0.61 "GET /compute/v2.1/servers/e33e9970-bfb7-46f3-8d40-782dbfa3d21c" status: 200 len: 1406 microversion: 2.20 time: 0.243546 May 14 15:47:56.064101 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: [pid: 128728|app: 0|req: 151/282] 10.222.0.61 () {60 vars in 1276 bytes} [Sat May 14 15:47:55 2022] GET /compute/v2.1/servers/e33e9970-bfb7-46f3-8d40-782dbfa3d21c => generated 1406 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 14 15:47:56.336982 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi [None req-01d49d0b-6071-48e1-95f6-2a340a22f9b5 tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Calling method '>' {{(pid=128729) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 15:47:56.338330 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.compute.api [None req-01d49d0b-6071-48e1-95f6-2a340a22f9b5 tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] [instance: 563c74e0-060d-49d5-abc5-389cee4bd9d5] Fetching instance by UUID {{(pid=128729) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 15:47:56.346391 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-01d49d0b-6071-48e1-95f6-2a340a22f9b5 tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:47:56.346856 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-01d49d0b-6071-48e1-95f6-2a340a22f9b5 tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:47:56.347650 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-01d49d0b-6071-48e1-95f6-2a340a22f9b5 tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:47:56.348091 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-01d49d0b-6071-48e1-95f6-2a340a22f9b5 tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:47:56.523477 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.policy [None req-01d49d0b-6071-48e1-95f6-2a340a22f9b5 tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b896317d96a40d6a137db0dcf5f98f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d2517d5440a4d30949f3dd36a46d813', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128729) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:47:56.532839 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: INFO nova.api.openstack.requestlog [None req-01d49d0b-6071-48e1-95f6-2a340a22f9b5 tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] 10.222.0.61 "GET /compute/v2.1/servers/563c74e0-060d-49d5-abc5-389cee4bd9d5" status: 200 len: 1522 microversion: 2.1 time: 0.200058 May 14 15:47:56.544316 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: [pid: 128729|app: 0|req: 132/283] 10.222.0.61 () {58 vars in 1235 bytes} [Sat May 14 15:47:56 2022] GET /compute/v2.1/servers/563c74e0-060d-49d5-abc5-389cee4bd9d5 => generated 1522 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 15:47:57.083489 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi [None req-838667c0-01fb-4f10-810a-c6ec49540102 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Calling method '>' {{(pid=128728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 15:47:57.084772 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.compute.api [None req-838667c0-01fb-4f10-810a-c6ec49540102 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] [instance: e33e9970-bfb7-46f3-8d40-782dbfa3d21c] Fetching instance by UUID {{(pid=128728) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 15:47:57.091690 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-838667c0-01fb-4f10-810a-c6ec49540102 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:47:57.092130 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-838667c0-01fb-4f10-810a-c6ec49540102 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:47:57.092927 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-838667c0-01fb-4f10-810a-c6ec49540102 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:47:57.093372 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-838667c0-01fb-4f10-810a-c6ec49540102 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:47:57.238498 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.policy [None req-838667c0-01fb-4f10-810a-c6ec49540102 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58bfb7417bc94583963401ae0fe9d39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0672be3fa3f7414da1c1a5b7300abbe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128728) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:47:57.247004 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.policy [None req-838667c0-01fb-4f10-810a-c6ec49540102 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58bfb7417bc94583963401ae0fe9d39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0672be3fa3f7414da1c1a5b7300abbe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128728) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:47:57.248446 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.policy [None req-838667c0-01fb-4f10-810a-c6ec49540102 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58bfb7417bc94583963401ae0fe9d39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0672be3fa3f7414da1c1a5b7300abbe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128728) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:47:57.249559 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: INFO nova.api.openstack.requestlog [None req-838667c0-01fb-4f10-810a-c6ec49540102 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] 10.222.0.61 "GET /compute/v2.1/servers/e33e9970-bfb7-46f3-8d40-782dbfa3d21c" status: 200 len: 1406 microversion: 2.20 time: 0.170539 May 14 15:47:57.250692 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: [pid: 128728|app: 0|req: 152/284] 10.222.0.61 () {60 vars in 1276 bytes} [Sat May 14 15:47:57 2022] GET /compute/v2.1/servers/e33e9970-bfb7-46f3-8d40-782dbfa3d21c => generated 1406 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 14 15:47:57.550484 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi [None req-d287637b-7e75-41d9-82c7-5c48254b7e60 tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Calling method '>' {{(pid=128729) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 15:47:57.551100 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.compute.api [None req-d287637b-7e75-41d9-82c7-5c48254b7e60 tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] [instance: 563c74e0-060d-49d5-abc5-389cee4bd9d5] Fetching instance by UUID {{(pid=128729) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 15:47:57.557899 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-d287637b-7e75-41d9-82c7-5c48254b7e60 tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:47:57.558507 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-d287637b-7e75-41d9-82c7-5c48254b7e60 tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:47:57.559675 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-d287637b-7e75-41d9-82c7-5c48254b7e60 tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:47:57.560214 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-d287637b-7e75-41d9-82c7-5c48254b7e60 tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:47:57.719021 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.policy [None req-d287637b-7e75-41d9-82c7-5c48254b7e60 tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b896317d96a40d6a137db0dcf5f98f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d2517d5440a4d30949f3dd36a46d813', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128729) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:47:57.726963 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: INFO nova.api.openstack.requestlog [None req-d287637b-7e75-41d9-82c7-5c48254b7e60 tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] 10.222.0.61 "GET /compute/v2.1/servers/563c74e0-060d-49d5-abc5-389cee4bd9d5" status: 200 len: 1522 microversion: 2.1 time: 0.180359 May 14 15:47:57.728117 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: [pid: 128729|app: 0|req: 133/285] 10.222.0.61 () {58 vars in 1235 bytes} [Sat May 14 15:47:57 2022] GET /compute/v2.1/servers/563c74e0-060d-49d5-abc5-389cee4bd9d5 => generated 1522 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 15:47:58.268371 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi [None req-049041f5-bddf-4999-9570-5ff4237d4cc3 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Calling method '>' {{(pid=128728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 15:47:58.269044 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.compute.api [None req-049041f5-bddf-4999-9570-5ff4237d4cc3 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] [instance: e33e9970-bfb7-46f3-8d40-782dbfa3d21c] Fetching instance by UUID {{(pid=128728) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 15:47:58.275959 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-049041f5-bddf-4999-9570-5ff4237d4cc3 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:47:58.276376 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-049041f5-bddf-4999-9570-5ff4237d4cc3 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:47:58.277157 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-049041f5-bddf-4999-9570-5ff4237d4cc3 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:47:58.277602 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-049041f5-bddf-4999-9570-5ff4237d4cc3 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:47:58.403871 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.policy [None req-049041f5-bddf-4999-9570-5ff4237d4cc3 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58bfb7417bc94583963401ae0fe9d39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0672be3fa3f7414da1c1a5b7300abbe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128728) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:47:58.411477 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.policy [None req-049041f5-bddf-4999-9570-5ff4237d4cc3 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58bfb7417bc94583963401ae0fe9d39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0672be3fa3f7414da1c1a5b7300abbe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128728) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:47:58.412971 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.policy [None req-049041f5-bddf-4999-9570-5ff4237d4cc3 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58bfb7417bc94583963401ae0fe9d39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0672be3fa3f7414da1c1a5b7300abbe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128728) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:47:58.414060 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: INFO nova.api.openstack.requestlog [None req-049041f5-bddf-4999-9570-5ff4237d4cc3 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] 10.222.0.61 "GET /compute/v2.1/servers/e33e9970-bfb7-46f3-8d40-782dbfa3d21c" status: 200 len: 1406 microversion: 2.20 time: 0.149614 May 14 15:47:58.414673 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: [pid: 128728|app: 0|req: 153/286] 10.222.0.61 () {60 vars in 1276 bytes} [Sat May 14 15:47:58 2022] GET /compute/v2.1/servers/e33e9970-bfb7-46f3-8d40-782dbfa3d21c => generated 1406 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 14 15:47:58.745229 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi [None req-ad966f27-f20c-492d-9ad2-933b4703991a tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Calling method '>' {{(pid=128729) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 15:47:58.745825 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.compute.api [None req-ad966f27-f20c-492d-9ad2-933b4703991a tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] [instance: 563c74e0-060d-49d5-abc5-389cee4bd9d5] Fetching instance by UUID {{(pid=128729) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 15:47:58.752113 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-ad966f27-f20c-492d-9ad2-933b4703991a tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:47:58.752562 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-ad966f27-f20c-492d-9ad2-933b4703991a tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:47:58.753318 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-ad966f27-f20c-492d-9ad2-933b4703991a tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:47:58.753750 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-ad966f27-f20c-492d-9ad2-933b4703991a tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:47:58.882739 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.policy [None req-ad966f27-f20c-492d-9ad2-933b4703991a tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b896317d96a40d6a137db0dcf5f98f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d2517d5440a4d30949f3dd36a46d813', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128729) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:47:58.890437 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: INFO nova.api.openstack.requestlog [None req-ad966f27-f20c-492d-9ad2-933b4703991a tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] 10.222.0.61 "GET /compute/v2.1/servers/563c74e0-060d-49d5-abc5-389cee4bd9d5" status: 200 len: 1522 microversion: 2.1 time: 0.149646 May 14 15:47:58.891005 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: [pid: 128729|app: 0|req: 134/287] 10.222.0.61 () {58 vars in 1235 bytes} [Sat May 14 15:47:58 2022] GET /compute/v2.1/servers/563c74e0-060d-49d5-abc5-389cee4bd9d5 => generated 1522 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 15:47:59.432502 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi [None req-56b3ecb0-3ee6-422f-b9d7-a0851f15952f tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Calling method '>' {{(pid=128728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 15:47:59.433106 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.compute.api [None req-56b3ecb0-3ee6-422f-b9d7-a0851f15952f tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] [instance: e33e9970-bfb7-46f3-8d40-782dbfa3d21c] Fetching instance by UUID {{(pid=128728) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 15:47:59.439003 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-56b3ecb0-3ee6-422f-b9d7-a0851f15952f tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:47:59.439478 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-56b3ecb0-3ee6-422f-b9d7-a0851f15952f tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:47:59.440243 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-56b3ecb0-3ee6-422f-b9d7-a0851f15952f tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:47:59.440706 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-56b3ecb0-3ee6-422f-b9d7-a0851f15952f tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:47:59.563640 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.policy [None req-56b3ecb0-3ee6-422f-b9d7-a0851f15952f tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58bfb7417bc94583963401ae0fe9d39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0672be3fa3f7414da1c1a5b7300abbe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128728) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:47:59.571287 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.policy [None req-56b3ecb0-3ee6-422f-b9d7-a0851f15952f tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58bfb7417bc94583963401ae0fe9d39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0672be3fa3f7414da1c1a5b7300abbe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128728) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:47:59.573433 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.policy [None req-56b3ecb0-3ee6-422f-b9d7-a0851f15952f tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58bfb7417bc94583963401ae0fe9d39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0672be3fa3f7414da1c1a5b7300abbe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128728) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:47:59.574564 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: INFO nova.api.openstack.requestlog [None req-56b3ecb0-3ee6-422f-b9d7-a0851f15952f tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] 10.222.0.61 "GET /compute/v2.1/servers/e33e9970-bfb7-46f3-8d40-782dbfa3d21c" status: 200 len: 1406 microversion: 2.20 time: 0.146418 May 14 15:47:59.575116 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: [pid: 128728|app: 0|req: 154/288] 10.222.0.61 () {60 vars in 1276 bytes} [Sat May 14 15:47:59 2022] GET /compute/v2.1/servers/e33e9970-bfb7-46f3-8d40-782dbfa3d21c => generated 1406 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 14 15:47:59.906622 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi [None req-565ea363-3cd9-4330-86a1-da16b7fbff1c tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Calling method '>' {{(pid=128729) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 15:47:59.907270 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.compute.api [None req-565ea363-3cd9-4330-86a1-da16b7fbff1c tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] [instance: 563c74e0-060d-49d5-abc5-389cee4bd9d5] Fetching instance by UUID {{(pid=128729) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 15:47:59.913529 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-565ea363-3cd9-4330-86a1-da16b7fbff1c tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:47:59.913980 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-565ea363-3cd9-4330-86a1-da16b7fbff1c tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:47:59.914781 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-565ea363-3cd9-4330-86a1-da16b7fbff1c tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:47:59.915765 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-565ea363-3cd9-4330-86a1-da16b7fbff1c tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:48:00.049816 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.policy [None req-565ea363-3cd9-4330-86a1-da16b7fbff1c tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b896317d96a40d6a137db0dcf5f98f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d2517d5440a4d30949f3dd36a46d813', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128729) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:48:00.057539 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: INFO nova.api.openstack.requestlog [None req-565ea363-3cd9-4330-86a1-da16b7fbff1c tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] 10.222.0.61 "GET /compute/v2.1/servers/563c74e0-060d-49d5-abc5-389cee4bd9d5" status: 200 len: 1522 microversion: 2.1 time: 0.154909 May 14 15:48:00.061036 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: [pid: 128729|app: 0|req: 135/289] 10.222.0.61 () {58 vars in 1235 bytes} [Sat May 14 15:47:59 2022] GET /compute/v2.1/servers/563c74e0-060d-49d5-abc5-389cee4bd9d5 => generated 1522 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 15:48:00.593511 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi [None req-0d82c299-8930-4134-9beb-ae952b801a62 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Calling method '>' {{(pid=128728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 15:48:00.594285 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.compute.api [None req-0d82c299-8930-4134-9beb-ae952b801a62 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] [instance: e33e9970-bfb7-46f3-8d40-782dbfa3d21c] Fetching instance by UUID {{(pid=128728) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 15:48:00.600771 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-0d82c299-8930-4134-9beb-ae952b801a62 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:48:00.601212 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-0d82c299-8930-4134-9beb-ae952b801a62 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:48:00.601971 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-0d82c299-8930-4134-9beb-ae952b801a62 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:48:00.602430 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-0d82c299-8930-4134-9beb-ae952b801a62 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:48:00.739885 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.policy [None req-0d82c299-8930-4134-9beb-ae952b801a62 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58bfb7417bc94583963401ae0fe9d39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0672be3fa3f7414da1c1a5b7300abbe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128728) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:48:00.750828 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.policy [None req-0d82c299-8930-4134-9beb-ae952b801a62 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58bfb7417bc94583963401ae0fe9d39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0672be3fa3f7414da1c1a5b7300abbe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128728) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:48:00.752558 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.policy [None req-0d82c299-8930-4134-9beb-ae952b801a62 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58bfb7417bc94583963401ae0fe9d39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0672be3fa3f7414da1c1a5b7300abbe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128728) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:48:00.753661 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: INFO nova.api.openstack.requestlog [None req-0d82c299-8930-4134-9beb-ae952b801a62 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] 10.222.0.61 "GET /compute/v2.1/servers/e33e9970-bfb7-46f3-8d40-782dbfa3d21c" status: 200 len: 1406 microversion: 2.20 time: 0.165000 May 14 15:48:00.754217 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: [pid: 128728|app: 0|req: 155/290] 10.222.0.61 () {60 vars in 1276 bytes} [Sat May 14 15:48:00 2022] GET /compute/v2.1/servers/e33e9970-bfb7-46f3-8d40-782dbfa3d21c => generated 1406 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 14 15:48:01.078995 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi [None req-6cb8b379-0af5-4795-b1b2-10ecd7922e0b tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Calling method '>' {{(pid=128729) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 15:48:01.079984 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.compute.api [None req-6cb8b379-0af5-4795-b1b2-10ecd7922e0b tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] [instance: 563c74e0-060d-49d5-abc5-389cee4bd9d5] Fetching instance by UUID {{(pid=128729) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 15:48:01.088726 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-6cb8b379-0af5-4795-b1b2-10ecd7922e0b tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:48:01.089179 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-6cb8b379-0af5-4795-b1b2-10ecd7922e0b tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:48:01.089953 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-6cb8b379-0af5-4795-b1b2-10ecd7922e0b tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:48:01.090427 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-6cb8b379-0af5-4795-b1b2-10ecd7922e0b tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:48:01.241979 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.policy [None req-6cb8b379-0af5-4795-b1b2-10ecd7922e0b tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b896317d96a40d6a137db0dcf5f98f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d2517d5440a4d30949f3dd36a46d813', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128729) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:48:01.254194 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: INFO nova.api.openstack.requestlog [None req-6cb8b379-0af5-4795-b1b2-10ecd7922e0b tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] 10.222.0.61 "GET /compute/v2.1/servers/563c74e0-060d-49d5-abc5-389cee4bd9d5" status: 200 len: 1522 microversion: 2.1 time: 0.178092 May 14 15:48:01.257326 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: [pid: 128729|app: 0|req: 136/291] 10.222.0.61 () {58 vars in 1235 bytes} [Sat May 14 15:48:01 2022] GET /compute/v2.1/servers/563c74e0-060d-49d5-abc5-389cee4bd9d5 => generated 1522 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 15:48:01.772436 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi [None req-e7a0d193-62d7-49b6-82e9-e56e1bb7601f tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Calling method '>' {{(pid=128728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 15:48:01.773042 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.compute.api [None req-e7a0d193-62d7-49b6-82e9-e56e1bb7601f tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] [instance: e33e9970-bfb7-46f3-8d40-782dbfa3d21c] Fetching instance by UUID {{(pid=128728) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 15:48:01.780267 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-e7a0d193-62d7-49b6-82e9-e56e1bb7601f tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:48:01.780807 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-e7a0d193-62d7-49b6-82e9-e56e1bb7601f tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:48:01.782271 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-e7a0d193-62d7-49b6-82e9-e56e1bb7601f tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:48:01.782923 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-e7a0d193-62d7-49b6-82e9-e56e1bb7601f tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:48:01.923735 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.policy [None req-e7a0d193-62d7-49b6-82e9-e56e1bb7601f tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58bfb7417bc94583963401ae0fe9d39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0672be3fa3f7414da1c1a5b7300abbe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128728) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:48:01.932946 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.policy [None req-e7a0d193-62d7-49b6-82e9-e56e1bb7601f tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58bfb7417bc94583963401ae0fe9d39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0672be3fa3f7414da1c1a5b7300abbe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128728) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:48:01.934508 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.policy [None req-e7a0d193-62d7-49b6-82e9-e56e1bb7601f tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58bfb7417bc94583963401ae0fe9d39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0672be3fa3f7414da1c1a5b7300abbe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128728) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:48:01.935623 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: INFO nova.api.openstack.requestlog [None req-e7a0d193-62d7-49b6-82e9-e56e1bb7601f tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] 10.222.0.61 "GET /compute/v2.1/servers/e33e9970-bfb7-46f3-8d40-782dbfa3d21c" status: 200 len: 1406 microversion: 2.20 time: 0.167139 May 14 15:48:01.936198 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: [pid: 128728|app: 0|req: 156/292] 10.222.0.61 () {60 vars in 1276 bytes} [Sat May 14 15:48:01 2022] GET /compute/v2.1/servers/e33e9970-bfb7-46f3-8d40-782dbfa3d21c => generated 1406 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 14 15:48:02.268563 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi [None req-e2cadce2-cd16-46a8-ae65-70ecc1155665 tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Calling method '>' {{(pid=128729) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 15:48:02.269919 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.compute.api [None req-e2cadce2-cd16-46a8-ae65-70ecc1155665 tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] [instance: 563c74e0-060d-49d5-abc5-389cee4bd9d5] Fetching instance by UUID {{(pid=128729) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 15:48:02.277958 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-e2cadce2-cd16-46a8-ae65-70ecc1155665 tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:48:02.278819 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-e2cadce2-cd16-46a8-ae65-70ecc1155665 tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:48:02.279540 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-e2cadce2-cd16-46a8-ae65-70ecc1155665 tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:48:02.280522 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-e2cadce2-cd16-46a8-ae65-70ecc1155665 tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:48:02.429892 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.policy [None req-e2cadce2-cd16-46a8-ae65-70ecc1155665 tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b896317d96a40d6a137db0dcf5f98f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d2517d5440a4d30949f3dd36a46d813', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128729) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:48:02.439878 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: INFO nova.api.openstack.requestlog [None req-e2cadce2-cd16-46a8-ae65-70ecc1155665 tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] 10.222.0.61 "GET /compute/v2.1/servers/563c74e0-060d-49d5-abc5-389cee4bd9d5" status: 200 len: 1522 microversion: 2.1 time: 0.176592 May 14 15:48:02.448031 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: [pid: 128729|app: 0|req: 137/293] 10.222.0.61 () {58 vars in 1235 bytes} [Sat May 14 15:48:02 2022] GET /compute/v2.1/servers/563c74e0-060d-49d5-abc5-389cee4bd9d5 => generated 1522 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 15:48:02.953574 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi [None req-8d4a53c1-a534-4ee2-9872-f1f63b63ca5e tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Calling method '>' {{(pid=128728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 15:48:02.954206 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.compute.api [None req-8d4a53c1-a534-4ee2-9872-f1f63b63ca5e tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] [instance: e33e9970-bfb7-46f3-8d40-782dbfa3d21c] Fetching instance by UUID {{(pid=128728) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 15:48:02.960156 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-8d4a53c1-a534-4ee2-9872-f1f63b63ca5e tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:48:02.960612 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-8d4a53c1-a534-4ee2-9872-f1f63b63ca5e tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:48:02.961394 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-8d4a53c1-a534-4ee2-9872-f1f63b63ca5e tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:48:02.961840 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-8d4a53c1-a534-4ee2-9872-f1f63b63ca5e tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:48:03.107911 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.policy [None req-8d4a53c1-a534-4ee2-9872-f1f63b63ca5e tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58bfb7417bc94583963401ae0fe9d39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0672be3fa3f7414da1c1a5b7300abbe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128728) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:48:03.116634 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.policy [None req-8d4a53c1-a534-4ee2-9872-f1f63b63ca5e tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58bfb7417bc94583963401ae0fe9d39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0672be3fa3f7414da1c1a5b7300abbe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128728) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:48:03.118253 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.policy [None req-8d4a53c1-a534-4ee2-9872-f1f63b63ca5e tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58bfb7417bc94583963401ae0fe9d39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0672be3fa3f7414da1c1a5b7300abbe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128728) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:48:03.119844 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: INFO nova.api.openstack.requestlog [None req-8d4a53c1-a534-4ee2-9872-f1f63b63ca5e tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] 10.222.0.61 "GET /compute/v2.1/servers/e33e9970-bfb7-46f3-8d40-782dbfa3d21c" status: 200 len: 1406 microversion: 2.20 time: 0.170657 May 14 15:48:03.120564 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: [pid: 128728|app: 0|req: 157/294] 10.222.0.61 () {60 vars in 1276 bytes} [Sat May 14 15:48:02 2022] GET /compute/v2.1/servers/e33e9970-bfb7-46f3-8d40-782dbfa3d21c => generated 1406 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 14 15:48:03.456973 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi [None req-261d88ce-5c92-45f9-ad84-1f53580f5e83 tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Calling method '>' {{(pid=128729) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 15:48:03.457619 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.compute.api [None req-261d88ce-5c92-45f9-ad84-1f53580f5e83 tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] [instance: 563c74e0-060d-49d5-abc5-389cee4bd9d5] Fetching instance by UUID {{(pid=128729) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 15:48:03.464243 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-261d88ce-5c92-45f9-ad84-1f53580f5e83 tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:48:03.464700 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-261d88ce-5c92-45f9-ad84-1f53580f5e83 tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:48:03.465478 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-261d88ce-5c92-45f9-ad84-1f53580f5e83 tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:48:03.465917 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-261d88ce-5c92-45f9-ad84-1f53580f5e83 tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:48:03.599489 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.policy [None req-261d88ce-5c92-45f9-ad84-1f53580f5e83 tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b896317d96a40d6a137db0dcf5f98f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d2517d5440a4d30949f3dd36a46d813', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128729) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:48:03.607928 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: INFO nova.api.openstack.requestlog [None req-261d88ce-5c92-45f9-ad84-1f53580f5e83 tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] 10.222.0.61 "GET /compute/v2.1/servers/563c74e0-060d-49d5-abc5-389cee4bd9d5" status: 200 len: 1522 microversion: 2.1 time: 0.154791 May 14 15:48:03.608686 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: [pid: 128729|app: 0|req: 138/295] 10.222.0.61 () {58 vars in 1235 bytes} [Sat May 14 15:48:03 2022] GET /compute/v2.1/servers/563c74e0-060d-49d5-abc5-389cee4bd9d5 => generated 1522 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 15:48:04.137176 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi [None req-88c58960-d964-46b9-9d1d-fd064bec6f91 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Calling method '>' {{(pid=128728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 15:48:04.137780 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.compute.api [None req-88c58960-d964-46b9-9d1d-fd064bec6f91 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] [instance: e33e9970-bfb7-46f3-8d40-782dbfa3d21c] Fetching instance by UUID {{(pid=128728) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 15:48:04.143556 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-88c58960-d964-46b9-9d1d-fd064bec6f91 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:48:04.144000 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-88c58960-d964-46b9-9d1d-fd064bec6f91 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:48:04.144758 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-88c58960-d964-46b9-9d1d-fd064bec6f91 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:48:04.145220 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-88c58960-d964-46b9-9d1d-fd064bec6f91 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:48:04.273635 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.policy [None req-88c58960-d964-46b9-9d1d-fd064bec6f91 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58bfb7417bc94583963401ae0fe9d39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0672be3fa3f7414da1c1a5b7300abbe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128728) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:48:04.283190 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.policy [None req-88c58960-d964-46b9-9d1d-fd064bec6f91 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58bfb7417bc94583963401ae0fe9d39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0672be3fa3f7414da1c1a5b7300abbe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128728) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:48:04.284721 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.policy [None req-88c58960-d964-46b9-9d1d-fd064bec6f91 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58bfb7417bc94583963401ae0fe9d39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0672be3fa3f7414da1c1a5b7300abbe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128728) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:48:04.285810 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: INFO nova.api.openstack.requestlog [None req-88c58960-d964-46b9-9d1d-fd064bec6f91 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] 10.222.0.61 "GET /compute/v2.1/servers/e33e9970-bfb7-46f3-8d40-782dbfa3d21c" status: 200 len: 1406 microversion: 2.20 time: 0.152745 May 14 15:48:04.286491 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: [pid: 128728|app: 0|req: 158/296] 10.222.0.61 () {60 vars in 1276 bytes} [Sat May 14 15:48:04 2022] GET /compute/v2.1/servers/e33e9970-bfb7-46f3-8d40-782dbfa3d21c => generated 1406 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 14 15:48:04.625267 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi [None req-723d573f-d897-49f2-a2bd-b79c17d254bc tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Calling method '>' {{(pid=128729) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 15:48:04.625883 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.compute.api [None req-723d573f-d897-49f2-a2bd-b79c17d254bc tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] [instance: 563c74e0-060d-49d5-abc5-389cee4bd9d5] Fetching instance by UUID {{(pid=128729) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 15:48:04.631648 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-723d573f-d897-49f2-a2bd-b79c17d254bc tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:48:04.632100 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-723d573f-d897-49f2-a2bd-b79c17d254bc tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:48:04.632873 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-723d573f-d897-49f2-a2bd-b79c17d254bc tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:48:04.633602 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-723d573f-d897-49f2-a2bd-b79c17d254bc tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:48:04.774738 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.policy [None req-723d573f-d897-49f2-a2bd-b79c17d254bc tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b896317d96a40d6a137db0dcf5f98f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d2517d5440a4d30949f3dd36a46d813', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128729) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:48:04.782622 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: INFO nova.api.openstack.requestlog [None req-723d573f-d897-49f2-a2bd-b79c17d254bc tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] 10.222.0.61 "GET /compute/v2.1/servers/563c74e0-060d-49d5-abc5-389cee4bd9d5" status: 200 len: 1522 microversion: 2.1 time: 0.161207 May 14 15:48:04.783044 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: [pid: 128729|app: 0|req: 139/297] 10.222.0.61 () {58 vars in 1235 bytes} [Sat May 14 15:48:04 2022] GET /compute/v2.1/servers/563c74e0-060d-49d5-abc5-389cee4bd9d5 => generated 1522 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 15:48:05.304666 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi [None req-6872aafe-05dd-48ad-8d5c-47775d28cff0 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Calling method '>' {{(pid=128728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 15:48:05.305278 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.compute.api [None req-6872aafe-05dd-48ad-8d5c-47775d28cff0 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] [instance: e33e9970-bfb7-46f3-8d40-782dbfa3d21c] Fetching instance by UUID {{(pid=128728) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 15:48:05.311916 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-6872aafe-05dd-48ad-8d5c-47775d28cff0 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:48:05.312367 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-6872aafe-05dd-48ad-8d5c-47775d28cff0 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:48:05.313149 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-6872aafe-05dd-48ad-8d5c-47775d28cff0 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:48:05.313588 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-6872aafe-05dd-48ad-8d5c-47775d28cff0 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:48:05.452005 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.policy [None req-6872aafe-05dd-48ad-8d5c-47775d28cff0 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58bfb7417bc94583963401ae0fe9d39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0672be3fa3f7414da1c1a5b7300abbe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128728) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:48:05.461047 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.policy [None req-6872aafe-05dd-48ad-8d5c-47775d28cff0 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58bfb7417bc94583963401ae0fe9d39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0672be3fa3f7414da1c1a5b7300abbe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128728) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:48:05.463289 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.policy [None req-6872aafe-05dd-48ad-8d5c-47775d28cff0 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58bfb7417bc94583963401ae0fe9d39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0672be3fa3f7414da1c1a5b7300abbe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128728) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:48:05.464552 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: INFO nova.api.openstack.requestlog [None req-6872aafe-05dd-48ad-8d5c-47775d28cff0 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] 10.222.0.61 "GET /compute/v2.1/servers/e33e9970-bfb7-46f3-8d40-782dbfa3d21c" status: 200 len: 1406 microversion: 2.20 time: 0.163933 May 14 15:48:05.465334 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: [pid: 128728|app: 0|req: 159/298] 10.222.0.61 () {60 vars in 1276 bytes} [Sat May 14 15:48:05 2022] GET /compute/v2.1/servers/e33e9970-bfb7-46f3-8d40-782dbfa3d21c => generated 1406 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 14 15:48:05.800132 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi [None req-5884305d-52a8-4919-8647-1890b1b0c31e tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Calling method '>' {{(pid=128729) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 15:48:05.800747 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.compute.api [None req-5884305d-52a8-4919-8647-1890b1b0c31e tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] [instance: 563c74e0-060d-49d5-abc5-389cee4bd9d5] Fetching instance by UUID {{(pid=128729) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 15:48:05.807866 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-5884305d-52a8-4919-8647-1890b1b0c31e tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:48:05.808314 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-5884305d-52a8-4919-8647-1890b1b0c31e tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:48:05.809269 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-5884305d-52a8-4919-8647-1890b1b0c31e tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:48:05.809559 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-5884305d-52a8-4919-8647-1890b1b0c31e tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:48:05.962760 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.policy [None req-5884305d-52a8-4919-8647-1890b1b0c31e tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b896317d96a40d6a137db0dcf5f98f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d2517d5440a4d30949f3dd36a46d813', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128729) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:48:05.970738 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: INFO nova.api.openstack.requestlog [None req-5884305d-52a8-4919-8647-1890b1b0c31e tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] 10.222.0.61 "GET /compute/v2.1/servers/563c74e0-060d-49d5-abc5-389cee4bd9d5" status: 200 len: 1522 microversion: 2.1 time: 0.174836 May 14 15:48:05.971395 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: [pid: 128729|app: 0|req: 140/299] 10.222.0.61 () {58 vars in 1235 bytes} [Sat May 14 15:48:05 2022] GET /compute/v2.1/servers/563c74e0-060d-49d5-abc5-389cee4bd9d5 => generated 1522 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 15:48:06.483033 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi [None req-88f87225-7060-436c-8859-fdf4ae913a10 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Calling method '>' {{(pid=128728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 15:48:06.483645 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.compute.api [None req-88f87225-7060-436c-8859-fdf4ae913a10 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] [instance: e33e9970-bfb7-46f3-8d40-782dbfa3d21c] Fetching instance by UUID {{(pid=128728) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 15:48:06.489855 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-88f87225-7060-436c-8859-fdf4ae913a10 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:48:06.490322 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-88f87225-7060-436c-8859-fdf4ae913a10 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:48:06.491097 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-88f87225-7060-436c-8859-fdf4ae913a10 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:48:06.491536 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-88f87225-7060-436c-8859-fdf4ae913a10 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:48:06.623171 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.policy [None req-88f87225-7060-436c-8859-fdf4ae913a10 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58bfb7417bc94583963401ae0fe9d39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0672be3fa3f7414da1c1a5b7300abbe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128728) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:48:06.632274 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.policy [None req-88f87225-7060-436c-8859-fdf4ae913a10 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58bfb7417bc94583963401ae0fe9d39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0672be3fa3f7414da1c1a5b7300abbe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128728) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:48:06.633717 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.policy [None req-88f87225-7060-436c-8859-fdf4ae913a10 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58bfb7417bc94583963401ae0fe9d39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0672be3fa3f7414da1c1a5b7300abbe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128728) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:48:06.634963 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: INFO nova.api.openstack.requestlog [None req-88f87225-7060-436c-8859-fdf4ae913a10 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] 10.222.0.61 "GET /compute/v2.1/servers/e33e9970-bfb7-46f3-8d40-782dbfa3d21c" status: 200 len: 1406 microversion: 2.20 time: 0.156392 May 14 15:48:06.635521 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: [pid: 128728|app: 0|req: 160/300] 10.222.0.61 () {60 vars in 1276 bytes} [Sat May 14 15:48:06 2022] GET /compute/v2.1/servers/e33e9970-bfb7-46f3-8d40-782dbfa3d21c => generated 1406 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 14 15:48:06.989619 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi [None req-1e262852-cbb8-4162-94ff-646d970cdb20 tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Calling method '>' {{(pid=128729) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 15:48:06.990130 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.compute.api [None req-1e262852-cbb8-4162-94ff-646d970cdb20 tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] [instance: 563c74e0-060d-49d5-abc5-389cee4bd9d5] Fetching instance by UUID {{(pid=128729) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 15:48:06.996427 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-1e262852-cbb8-4162-94ff-646d970cdb20 tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:48:06.996878 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-1e262852-cbb8-4162-94ff-646d970cdb20 tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:48:06.997647 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-1e262852-cbb8-4162-94ff-646d970cdb20 tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:48:06.998084 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-1e262852-cbb8-4162-94ff-646d970cdb20 tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:48:07.138568 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.policy [None req-1e262852-cbb8-4162-94ff-646d970cdb20 tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b896317d96a40d6a137db0dcf5f98f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d2517d5440a4d30949f3dd36a46d813', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128729) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:48:07.145803 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: INFO nova.api.openstack.requestlog [None req-1e262852-cbb8-4162-94ff-646d970cdb20 tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] 10.222.0.61 "GET /compute/v2.1/servers/563c74e0-060d-49d5-abc5-389cee4bd9d5" status: 200 len: 1522 microversion: 2.1 time: 0.160379 May 14 15:48:07.146388 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: [pid: 128729|app: 0|req: 141/301] 10.222.0.61 () {58 vars in 1235 bytes} [Sat May 14 15:48:06 2022] GET /compute/v2.1/servers/563c74e0-060d-49d5-abc5-389cee4bd9d5 => generated 1522 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 15:48:07.653537 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi [None req-43c6def9-e7a1-46fe-be35-2af9e0e93f19 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Calling method '>' {{(pid=128728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 15:48:07.654148 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.compute.api [None req-43c6def9-e7a1-46fe-be35-2af9e0e93f19 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] [instance: e33e9970-bfb7-46f3-8d40-782dbfa3d21c] Fetching instance by UUID {{(pid=128728) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 15:48:07.660066 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-43c6def9-e7a1-46fe-be35-2af9e0e93f19 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:48:07.660520 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-43c6def9-e7a1-46fe-be35-2af9e0e93f19 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:48:07.661284 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-43c6def9-e7a1-46fe-be35-2af9e0e93f19 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:48:07.661725 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-43c6def9-e7a1-46fe-be35-2af9e0e93f19 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:48:07.790457 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.policy [None req-43c6def9-e7a1-46fe-be35-2af9e0e93f19 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58bfb7417bc94583963401ae0fe9d39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0672be3fa3f7414da1c1a5b7300abbe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128728) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:48:07.798334 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.policy [None req-43c6def9-e7a1-46fe-be35-2af9e0e93f19 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58bfb7417bc94583963401ae0fe9d39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0672be3fa3f7414da1c1a5b7300abbe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128728) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:48:07.799838 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.policy [None req-43c6def9-e7a1-46fe-be35-2af9e0e93f19 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58bfb7417bc94583963401ae0fe9d39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0672be3fa3f7414da1c1a5b7300abbe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128728) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:48:07.801051 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: INFO nova.api.openstack.requestlog [None req-43c6def9-e7a1-46fe-be35-2af9e0e93f19 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] 10.222.0.61 "GET /compute/v2.1/servers/e33e9970-bfb7-46f3-8d40-782dbfa3d21c" status: 200 len: 1406 microversion: 2.20 time: 0.152068 May 14 15:48:07.801600 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: [pid: 128728|app: 0|req: 161/302] 10.222.0.61 () {60 vars in 1276 bytes} [Sat May 14 15:48:07 2022] GET /compute/v2.1/servers/e33e9970-bfb7-46f3-8d40-782dbfa3d21c => generated 1406 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 14 15:48:08.163198 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi [None req-844b29d3-0696-41af-a59d-40452ae70416 tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Calling method '>' {{(pid=128729) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 15:48:08.163807 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.compute.api [None req-844b29d3-0696-41af-a59d-40452ae70416 tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] [instance: 563c74e0-060d-49d5-abc5-389cee4bd9d5] Fetching instance by UUID {{(pid=128729) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 15:48:08.170560 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-844b29d3-0696-41af-a59d-40452ae70416 tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:48:08.171010 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-844b29d3-0696-41af-a59d-40452ae70416 tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:48:08.171773 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-844b29d3-0696-41af-a59d-40452ae70416 tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:48:08.172210 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-844b29d3-0696-41af-a59d-40452ae70416 tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:48:08.317528 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.policy [None req-844b29d3-0696-41af-a59d-40452ae70416 tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b896317d96a40d6a137db0dcf5f98f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d2517d5440a4d30949f3dd36a46d813', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128729) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:48:08.326506 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: INFO nova.api.openstack.requestlog [None req-844b29d3-0696-41af-a59d-40452ae70416 tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] 10.222.0.61 "GET /compute/v2.1/servers/563c74e0-060d-49d5-abc5-389cee4bd9d5" status: 200 len: 1522 microversion: 2.1 time: 0.166723 May 14 15:48:08.327784 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: [pid: 128729|app: 0|req: 142/303] 10.222.0.61 () {58 vars in 1235 bytes} [Sat May 14 15:48:08 2022] GET /compute/v2.1/servers/563c74e0-060d-49d5-abc5-389cee4bd9d5 => generated 1522 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 15:48:08.819873 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi [None req-64a749c9-c7ff-456c-98a6-b92b8eaf9f4f tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Calling method '>' {{(pid=128728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 15:48:08.820481 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.compute.api [None req-64a749c9-c7ff-456c-98a6-b92b8eaf9f4f tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] [instance: e33e9970-bfb7-46f3-8d40-782dbfa3d21c] Fetching instance by UUID {{(pid=128728) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 15:48:08.828900 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-64a749c9-c7ff-456c-98a6-b92b8eaf9f4f tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:48:08.829405 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-64a749c9-c7ff-456c-98a6-b92b8eaf9f4f tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:48:08.830225 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-64a749c9-c7ff-456c-98a6-b92b8eaf9f4f tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:48:08.831270 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-64a749c9-c7ff-456c-98a6-b92b8eaf9f4f tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:48:08.968001 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.policy [None req-64a749c9-c7ff-456c-98a6-b92b8eaf9f4f tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58bfb7417bc94583963401ae0fe9d39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0672be3fa3f7414da1c1a5b7300abbe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128728) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:48:08.976017 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.policy [None req-64a749c9-c7ff-456c-98a6-b92b8eaf9f4f tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58bfb7417bc94583963401ae0fe9d39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0672be3fa3f7414da1c1a5b7300abbe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128728) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:48:08.977561 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.policy [None req-64a749c9-c7ff-456c-98a6-b92b8eaf9f4f tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58bfb7417bc94583963401ae0fe9d39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0672be3fa3f7414da1c1a5b7300abbe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128728) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:48:08.979569 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: INFO nova.api.openstack.requestlog [None req-64a749c9-c7ff-456c-98a6-b92b8eaf9f4f tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] 10.222.0.61 "GET /compute/v2.1/servers/e33e9970-bfb7-46f3-8d40-782dbfa3d21c" status: 200 len: 1598 microversion: 2.20 time: 0.163320 May 14 15:48:08.980487 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: [pid: 128728|app: 0|req: 162/304] 10.222.0.61 () {60 vars in 1276 bytes} [Sat May 14 15:48:08 2022] GET /compute/v2.1/servers/e33e9970-bfb7-46f3-8d40-782dbfa3d21c => generated 1598 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 14 15:48:09.001273 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi [None req-27d588fd-aec5-456d-8b2f-0186005c5a08 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Calling method '>' {{(pid=128729) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 15:48:09.001763 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.compute.api [None req-27d588fd-aec5-456d-8b2f-0186005c5a08 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] [instance: e33e9970-bfb7-46f3-8d40-782dbfa3d21c] Fetching instance by UUID {{(pid=128729) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 15:48:09.007624 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-27d588fd-aec5-456d-8b2f-0186005c5a08 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:48:09.009472 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-27d588fd-aec5-456d-8b2f-0186005c5a08 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:48:09.010034 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-27d588fd-aec5-456d-8b2f-0186005c5a08 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:48:09.010506 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-27d588fd-aec5-456d-8b2f-0186005c5a08 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:48:09.095649 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: INFO nova.api.openstack.requestlog [None req-27d588fd-aec5-456d-8b2f-0186005c5a08 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] 10.222.0.61 "GET /compute/v2.1/servers/e33e9970-bfb7-46f3-8d40-782dbfa3d21c/os-interface" status: 200 len: 285 microversion: 2.20 time: 0.098669 May 14 15:48:09.096357 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: [pid: 128729|app: 0|req: 143/305] 10.222.0.61 () {60 vars in 1315 bytes} [Sat May 14 15:48:08 2022] GET /compute/v2.1/servers/e33e9970-bfb7-46f3-8d40-782dbfa3d21c/os-interface => generated 285 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 14 15:48:09.346135 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi [None req-ac606124-65c6-4cb3-b199-856089422793 tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Calling method '>' {{(pid=128728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 15:48:09.347377 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.compute.api [None req-ac606124-65c6-4cb3-b199-856089422793 tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] [instance: 563c74e0-060d-49d5-abc5-389cee4bd9d5] Fetching instance by UUID {{(pid=128728) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 15:48:09.355439 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-ac606124-65c6-4cb3-b199-856089422793 tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:48:09.355936 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-ac606124-65c6-4cb3-b199-856089422793 tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:48:09.357184 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-ac606124-65c6-4cb3-b199-856089422793 tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:48:09.357965 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-ac606124-65c6-4cb3-b199-856089422793 tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:48:09.659603 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.policy [None req-ac606124-65c6-4cb3-b199-856089422793 tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b896317d96a40d6a137db0dcf5f98f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d2517d5440a4d30949f3dd36a46d813', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128728) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:48:09.668595 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: INFO nova.api.openstack.requestlog [None req-ac606124-65c6-4cb3-b199-856089422793 tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] 10.222.0.61 "GET /compute/v2.1/servers/563c74e0-060d-49d5-abc5-389cee4bd9d5" status: 200 len: 1522 microversion: 2.1 time: 0.327742 May 14 15:48:09.669524 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: [pid: 128728|app: 0|req: 163/306] 10.222.0.61 () {58 vars in 1235 bytes} [Sat May 14 15:48:09 2022] GET /compute/v2.1/servers/563c74e0-060d-49d5-abc5-389cee4bd9d5 => generated 1522 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 15:48:10.431929 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi [req-85847987-0bee-4d6b-a2c4-8e80c9c72972 req-71ac46fd-426a-4ce0-8226-05d50e1efc8e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e33e9970-bfb7-46f3-8d40-782dbfa3d21c", "tag": "759be0ca-daaf-4eba-97b6-a252b70cbb3b"}]} {{(pid=128729) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 15:48:10.469300 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [req-85847987-0bee-4d6b-a2c4-8e80c9c72972 req-71ac46fd-426a-4ce0-8226-05d50e1efc8e service nova] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:48:10.469906 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [req-85847987-0bee-4d6b-a2c4-8e80c9c72972 req-71ac46fd-426a-4ce0-8226-05d50e1efc8e service nova] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:48:10.485175 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: INFO nova.api.openstack.compute.server_external_events [req-85847987-0bee-4d6b-a2c4-8e80c9c72972 req-71ac46fd-426a-4ce0-8226-05d50e1efc8e service nova] Creating event network-changed:759be0ca-daaf-4eba-97b6-a252b70cbb3b for instance e33e9970-bfb7-46f3-8d40-782dbfa3d21c on hv-cinder-83979 May 14 15:48:10.492951 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: INFO nova.api.openstack.requestlog [req-85847987-0bee-4d6b-a2c4-8e80c9c72972 req-71ac46fd-426a-4ce0-8226-05d50e1efc8e service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.064909 May 14 15:48:10.494351 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: [pid: 128729|app: 0|req: 144/307] 10.222.0.61 () {64 vars in 1317 bytes} [Sat May 14 15:48:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 14 15:48:10.685890 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi [None req-824a028a-798c-4466-a34d-f86921ee3720 tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Calling method '>' {{(pid=128728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 15:48:10.686528 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.compute.api [None req-824a028a-798c-4466-a34d-f86921ee3720 tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] [instance: 563c74e0-060d-49d5-abc5-389cee4bd9d5] Fetching instance by UUID {{(pid=128728) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 15:48:10.692270 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-824a028a-798c-4466-a34d-f86921ee3720 tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:48:10.692725 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-824a028a-798c-4466-a34d-f86921ee3720 tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:48:10.693496 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-824a028a-798c-4466-a34d-f86921ee3720 tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:48:10.693941 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-824a028a-798c-4466-a34d-f86921ee3720 tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:48:10.822376 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.policy [None req-824a028a-798c-4466-a34d-f86921ee3720 tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b896317d96a40d6a137db0dcf5f98f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d2517d5440a4d30949f3dd36a46d813', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128728) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:48:10.829828 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: INFO nova.api.openstack.requestlog [None req-824a028a-798c-4466-a34d-f86921ee3720 tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] 10.222.0.61 "GET /compute/v2.1/servers/563c74e0-060d-49d5-abc5-389cee4bd9d5" status: 200 len: 1522 microversion: 2.1 time: 0.148006 May 14 15:48:10.838075 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: [pid: 128728|app: 0|req: 164/308] 10.222.0.61 () {58 vars in 1235 bytes} [Sat May 14 15:48:10 2022] GET /compute/v2.1/servers/563c74e0-060d-49d5-abc5-389cee4bd9d5 => generated 1522 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 15:48:11.847943 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi [None req-046e9844-043d-4383-9764-457f36e4d79e tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Calling method '>' {{(pid=128729) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 15:48:11.848644 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.compute.api [None req-046e9844-043d-4383-9764-457f36e4d79e tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] [instance: 563c74e0-060d-49d5-abc5-389cee4bd9d5] Fetching instance by UUID {{(pid=128729) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 15:48:11.854870 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-046e9844-043d-4383-9764-457f36e4d79e tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:48:11.855319 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-046e9844-043d-4383-9764-457f36e4d79e tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:48:11.856088 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-046e9844-043d-4383-9764-457f36e4d79e tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:48:11.856528 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-046e9844-043d-4383-9764-457f36e4d79e tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:48:11.983861 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.policy [None req-046e9844-043d-4383-9764-457f36e4d79e tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b896317d96a40d6a137db0dcf5f98f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d2517d5440a4d30949f3dd36a46d813', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128729) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:48:11.991310 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: INFO nova.api.openstack.requestlog [None req-046e9844-043d-4383-9764-457f36e4d79e tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] 10.222.0.61 "GET /compute/v2.1/servers/563c74e0-060d-49d5-abc5-389cee4bd9d5" status: 200 len: 1522 microversion: 2.1 time: 0.148021 May 14 15:48:11.991876 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: [pid: 128729|app: 0|req: 145/309] 10.222.0.61 () {58 vars in 1235 bytes} [Sat May 14 15:48:11 2022] GET /compute/v2.1/servers/563c74e0-060d-49d5-abc5-389cee4bd9d5 => generated 1522 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 15:48:13.008231 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi [None req-d853d44a-b87e-410a-b3a8-b356620d77bb tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Calling method '>' {{(pid=128728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 15:48:13.008799 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.compute.api [None req-d853d44a-b87e-410a-b3a8-b356620d77bb tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] [instance: 563c74e0-060d-49d5-abc5-389cee4bd9d5] Fetching instance by UUID {{(pid=128728) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 15:48:13.014606 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-d853d44a-b87e-410a-b3a8-b356620d77bb tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:48:13.015053 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-d853d44a-b87e-410a-b3a8-b356620d77bb tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:48:13.015815 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-d853d44a-b87e-410a-b3a8-b356620d77bb tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:48:13.016259 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-d853d44a-b87e-410a-b3a8-b356620d77bb tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:48:13.143004 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.policy [None req-d853d44a-b87e-410a-b3a8-b356620d77bb tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b896317d96a40d6a137db0dcf5f98f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d2517d5440a4d30949f3dd36a46d813', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128728) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:48:13.151343 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: INFO nova.api.openstack.requestlog [None req-d853d44a-b87e-410a-b3a8-b356620d77bb tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] 10.222.0.61 "GET /compute/v2.1/servers/563c74e0-060d-49d5-abc5-389cee4bd9d5" status: 200 len: 1522 microversion: 2.1 time: 0.147042 May 14 15:48:13.151916 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: [pid: 128728|app: 0|req: 165/310] 10.222.0.61 () {58 vars in 1235 bytes} [Sat May 14 15:48:13 2022] GET /compute/v2.1/servers/563c74e0-060d-49d5-abc5-389cee4bd9d5 => generated 1522 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 15:48:14.169245 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi [None req-dceb9e34-678b-485b-9b0b-4b7ccb583941 tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Calling method '>' {{(pid=128729) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 15:48:14.169842 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.compute.api [None req-dceb9e34-678b-485b-9b0b-4b7ccb583941 tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] [instance: 563c74e0-060d-49d5-abc5-389cee4bd9d5] Fetching instance by UUID {{(pid=128729) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 15:48:14.176307 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-dceb9e34-678b-485b-9b0b-4b7ccb583941 tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:48:14.176755 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-dceb9e34-678b-485b-9b0b-4b7ccb583941 tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:48:14.177532 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-dceb9e34-678b-485b-9b0b-4b7ccb583941 tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:48:14.177970 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-dceb9e34-678b-485b-9b0b-4b7ccb583941 tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:48:14.315415 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.policy [None req-dceb9e34-678b-485b-9b0b-4b7ccb583941 tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b896317d96a40d6a137db0dcf5f98f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d2517d5440a4d30949f3dd36a46d813', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128729) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:48:14.323314 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: INFO nova.api.openstack.requestlog [None req-dceb9e34-678b-485b-9b0b-4b7ccb583941 tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] 10.222.0.61 "GET /compute/v2.1/servers/563c74e0-060d-49d5-abc5-389cee4bd9d5" status: 200 len: 1522 microversion: 2.1 time: 0.159744 May 14 15:48:14.324627 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: [pid: 128729|app: 0|req: 146/311] 10.222.0.61 () {58 vars in 1235 bytes} [Sat May 14 15:48:14 2022] GET /compute/v2.1/servers/563c74e0-060d-49d5-abc5-389cee4bd9d5 => generated 1522 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 15:48:14.812436 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi [None req-3681d9b4-f870-422f-8b91-0b1bc054b9c6 tempest-DeleteServersTestJSON-2100051872 tempest-DeleteServersTestJSON-2100051872-project] Calling method '>' {{(pid=128728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 15:48:14.812940 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.compute.api [None req-3681d9b4-f870-422f-8b91-0b1bc054b9c6 tempest-DeleteServersTestJSON-2100051872 tempest-DeleteServersTestJSON-2100051872-project] [instance: 75ca93de-6825-44ce-af10-44cba59218a1] Fetching instance by UUID {{(pid=128728) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 15:48:14.819035 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-3681d9b4-f870-422f-8b91-0b1bc054b9c6 tempest-DeleteServersTestJSON-2100051872 tempest-DeleteServersTestJSON-2100051872-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:48:14.819481 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-3681d9b4-f870-422f-8b91-0b1bc054b9c6 tempest-DeleteServersTestJSON-2100051872 tempest-DeleteServersTestJSON-2100051872-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:48:14.820245 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-3681d9b4-f870-422f-8b91-0b1bc054b9c6 tempest-DeleteServersTestJSON-2100051872 tempest-DeleteServersTestJSON-2100051872-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:48:14.820675 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-3681d9b4-f870-422f-8b91-0b1bc054b9c6 tempest-DeleteServersTestJSON-2100051872 tempest-DeleteServersTestJSON-2100051872-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:48:14.864265 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.compute.api [None req-3681d9b4-f870-422f-8b91-0b1bc054b9c6 tempest-DeleteServersTestJSON-2100051872 tempest-DeleteServersTestJSON-2100051872-project] [instance: 75ca93de-6825-44ce-af10-44cba59218a1] Going to try to terminate instance {{(pid=128728) delete /opt/stack/nova/nova/compute/api.py:2664}} May 14 15:48:14.960330 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: INFO nova.api.openstack.requestlog [None req-3681d9b4-f870-422f-8b91-0b1bc054b9c6 tempest-DeleteServersTestJSON-2100051872 tempest-DeleteServersTestJSON-2100051872-project] 10.222.0.61 "DELETE /compute/v2.1/servers/75ca93de-6825-44ce-af10-44cba59218a1" status: 204 len: 0 microversion: 2.1 time: 0.151834 May 14 15:48:14.961242 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: [pid: 128728|app: 0|req: 166/312] 10.222.0.61 () {58 vars in 1238 bytes} [Sat May 14 15:48:14 2022] DELETE /compute/v2.1/servers/75ca93de-6825-44ce-af10-44cba59218a1 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 14 15:48:14.970490 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi [None req-c662236e-a5b6-42d5-b7c8-4442768a9576 tempest-DeleteServersTestJSON-2100051872 tempest-DeleteServersTestJSON-2100051872-project] Calling method '>' {{(pid=128729) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 15:48:14.971127 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.compute.api [None req-c662236e-a5b6-42d5-b7c8-4442768a9576 tempest-DeleteServersTestJSON-2100051872 tempest-DeleteServersTestJSON-2100051872-project] [instance: 75ca93de-6825-44ce-af10-44cba59218a1] Fetching instance by UUID {{(pid=128729) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 15:48:14.980320 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-c662236e-a5b6-42d5-b7c8-4442768a9576 tempest-DeleteServersTestJSON-2100051872 tempest-DeleteServersTestJSON-2100051872-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:48:14.980802 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-c662236e-a5b6-42d5-b7c8-4442768a9576 tempest-DeleteServersTestJSON-2100051872 tempest-DeleteServersTestJSON-2100051872-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:48:14.981623 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-c662236e-a5b6-42d5-b7c8-4442768a9576 tempest-DeleteServersTestJSON-2100051872 tempest-DeleteServersTestJSON-2100051872-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:48:14.982060 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-c662236e-a5b6-42d5-b7c8-4442768a9576 tempest-DeleteServersTestJSON-2100051872 tempest-DeleteServersTestJSON-2100051872-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:48:15.120011 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.policy [None req-c662236e-a5b6-42d5-b7c8-4442768a9576 tempest-DeleteServersTestJSON-2100051872 tempest-DeleteServersTestJSON-2100051872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aad828d8ff314a2d82f07fb6d84f36a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6388da70b0dc48c1952570af4332dd6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128729) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:48:15.127718 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: INFO nova.api.openstack.requestlog [None req-c662236e-a5b6-42d5-b7c8-4442768a9576 tempest-DeleteServersTestJSON-2100051872 tempest-DeleteServersTestJSON-2100051872-project] 10.222.0.61 "GET /compute/v2.1/servers/75ca93de-6825-44ce-af10-44cba59218a1" status: 200 len: 1554 microversion: 2.1 time: 0.161195 May 14 15:48:15.128289 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: [pid: 128729|app: 0|req: 147/313] 10.222.0.61 () {58 vars in 1235 bytes} [Sat May 14 15:48:14 2022] GET /compute/v2.1/servers/75ca93de-6825-44ce-af10-44cba59218a1 => generated 1554 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 15:48:15.342039 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi [None req-0ea03edf-f6a0-4eeb-8d9f-2767fe26cfcd tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Calling method '>' {{(pid=128728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 15:48:15.342688 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.compute.api [None req-0ea03edf-f6a0-4eeb-8d9f-2767fe26cfcd tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] [instance: 563c74e0-060d-49d5-abc5-389cee4bd9d5] Fetching instance by UUID {{(pid=128728) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 15:48:15.349078 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-0ea03edf-f6a0-4eeb-8d9f-2767fe26cfcd tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:48:15.349528 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-0ea03edf-f6a0-4eeb-8d9f-2767fe26cfcd tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:48:15.350339 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-0ea03edf-f6a0-4eeb-8d9f-2767fe26cfcd tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:48:15.350788 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-0ea03edf-f6a0-4eeb-8d9f-2767fe26cfcd tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:48:15.488586 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.policy [None req-0ea03edf-f6a0-4eeb-8d9f-2767fe26cfcd tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b896317d96a40d6a137db0dcf5f98f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d2517d5440a4d30949f3dd36a46d813', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128728) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:48:15.503741 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: INFO nova.api.openstack.requestlog [None req-0ea03edf-f6a0-4eeb-8d9f-2767fe26cfcd tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] 10.222.0.61 "GET /compute/v2.1/servers/563c74e0-060d-49d5-abc5-389cee4bd9d5" status: 200 len: 1522 microversion: 2.1 time: 0.160774 May 14 15:48:15.503741 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: [pid: 128728|app: 0|req: 167/314] 10.222.0.61 () {58 vars in 1235 bytes} [Sat May 14 15:48:15 2022] GET /compute/v2.1/servers/563c74e0-060d-49d5-abc5-389cee4bd9d5 => generated 1522 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 15:48:16.144794 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi [None req-18af9814-69c7-41f1-b193-36663b599652 tempest-DeleteServersTestJSON-2100051872 tempest-DeleteServersTestJSON-2100051872-project] Calling method '>' {{(pid=128729) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 15:48:16.145415 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.compute.api [None req-18af9814-69c7-41f1-b193-36663b599652 tempest-DeleteServersTestJSON-2100051872 tempest-DeleteServersTestJSON-2100051872-project] [instance: 75ca93de-6825-44ce-af10-44cba59218a1] Fetching instance by UUID {{(pid=128729) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 15:48:16.152227 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-18af9814-69c7-41f1-b193-36663b599652 tempest-DeleteServersTestJSON-2100051872 tempest-DeleteServersTestJSON-2100051872-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:48:16.152860 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-18af9814-69c7-41f1-b193-36663b599652 tempest-DeleteServersTestJSON-2100051872 tempest-DeleteServersTestJSON-2100051872-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:48:16.153941 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-18af9814-69c7-41f1-b193-36663b599652 tempest-DeleteServersTestJSON-2100051872 tempest-DeleteServersTestJSON-2100051872-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:48:16.154404 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-18af9814-69c7-41f1-b193-36663b599652 tempest-DeleteServersTestJSON-2100051872 tempest-DeleteServersTestJSON-2100051872-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:48:16.304904 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.policy [None req-18af9814-69c7-41f1-b193-36663b599652 tempest-DeleteServersTestJSON-2100051872 tempest-DeleteServersTestJSON-2100051872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aad828d8ff314a2d82f07fb6d84f36a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6388da70b0dc48c1952570af4332dd6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128729) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:48:16.314048 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: INFO nova.api.openstack.requestlog [None req-18af9814-69c7-41f1-b193-36663b599652 tempest-DeleteServersTestJSON-2100051872 tempest-DeleteServersTestJSON-2100051872-project] 10.222.0.61 "GET /compute/v2.1/servers/75ca93de-6825-44ce-af10-44cba59218a1" status: 200 len: 1554 microversion: 2.1 time: 0.173001 May 14 15:48:16.317435 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: [pid: 128729|app: 0|req: 148/315] 10.222.0.61 () {58 vars in 1235 bytes} [Sat May 14 15:48:16 2022] GET /compute/v2.1/servers/75ca93de-6825-44ce-af10-44cba59218a1 => generated 1554 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 15:48:16.515438 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi [None req-c0d039ce-c262-4dbf-a201-136a9c3be0d4 tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Calling method '>' {{(pid=128728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 15:48:16.516050 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.compute.api [None req-c0d039ce-c262-4dbf-a201-136a9c3be0d4 tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] [instance: 563c74e0-060d-49d5-abc5-389cee4bd9d5] Fetching instance by UUID {{(pid=128728) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 15:48:16.521849 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-c0d039ce-c262-4dbf-a201-136a9c3be0d4 tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:48:16.522296 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-c0d039ce-c262-4dbf-a201-136a9c3be0d4 tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:48:16.523087 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-c0d039ce-c262-4dbf-a201-136a9c3be0d4 tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:48:16.523520 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-c0d039ce-c262-4dbf-a201-136a9c3be0d4 tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:48:16.646737 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.policy [None req-c0d039ce-c262-4dbf-a201-136a9c3be0d4 tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b896317d96a40d6a137db0dcf5f98f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d2517d5440a4d30949f3dd36a46d813', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128728) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:48:16.654549 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: INFO nova.api.openstack.requestlog [None req-c0d039ce-c262-4dbf-a201-136a9c3be0d4 tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] 10.222.0.61 "GET /compute/v2.1/servers/563c74e0-060d-49d5-abc5-389cee4bd9d5" status: 200 len: 1522 microversion: 2.1 time: 0.142931 May 14 15:48:16.655103 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: [pid: 128728|app: 0|req: 168/316] 10.222.0.61 () {58 vars in 1235 bytes} [Sat May 14 15:48:16 2022] GET /compute/v2.1/servers/563c74e0-060d-49d5-abc5-389cee4bd9d5 => generated 1522 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 15:48:17.333775 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi [None req-ab1b9946-bd1b-473e-a9fd-64614a847b06 tempest-DeleteServersTestJSON-2100051872 tempest-DeleteServersTestJSON-2100051872-project] Calling method '>' {{(pid=128729) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 15:48:17.334419 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.compute.api [None req-ab1b9946-bd1b-473e-a9fd-64614a847b06 tempest-DeleteServersTestJSON-2100051872 tempest-DeleteServersTestJSON-2100051872-project] [instance: 75ca93de-6825-44ce-af10-44cba59218a1] Fetching instance by UUID {{(pid=128729) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 15:48:17.340960 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-ab1b9946-bd1b-473e-a9fd-64614a847b06 tempest-DeleteServersTestJSON-2100051872 tempest-DeleteServersTestJSON-2100051872-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:48:17.341424 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-ab1b9946-bd1b-473e-a9fd-64614a847b06 tempest-DeleteServersTestJSON-2100051872 tempest-DeleteServersTestJSON-2100051872-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:48:17.342202 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-ab1b9946-bd1b-473e-a9fd-64614a847b06 tempest-DeleteServersTestJSON-2100051872 tempest-DeleteServersTestJSON-2100051872-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:48:17.342746 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-ab1b9946-bd1b-473e-a9fd-64614a847b06 tempest-DeleteServersTestJSON-2100051872 tempest-DeleteServersTestJSON-2100051872-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:48:17.484520 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.policy [None req-ab1b9946-bd1b-473e-a9fd-64614a847b06 tempest-DeleteServersTestJSON-2100051872 tempest-DeleteServersTestJSON-2100051872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aad828d8ff314a2d82f07fb6d84f36a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6388da70b0dc48c1952570af4332dd6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128729) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:48:17.492639 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: INFO nova.api.openstack.requestlog [None req-ab1b9946-bd1b-473e-a9fd-64614a847b06 tempest-DeleteServersTestJSON-2100051872 tempest-DeleteServersTestJSON-2100051872-project] 10.222.0.61 "GET /compute/v2.1/servers/75ca93de-6825-44ce-af10-44cba59218a1" status: 200 len: 1554 microversion: 2.1 time: 0.162731 May 14 15:48:17.493976 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: [pid: 128729|app: 0|req: 149/317] 10.222.0.61 () {58 vars in 1235 bytes} [Sat May 14 15:48:17 2022] GET /compute/v2.1/servers/75ca93de-6825-44ce-af10-44cba59218a1 => generated 1554 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 15:48:17.672180 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi [None req-eb6927a8-eea0-4099-b310-71bda8737805 tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Calling method '>' {{(pid=128728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 15:48:17.672824 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.compute.api [None req-eb6927a8-eea0-4099-b310-71bda8737805 tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] [instance: 563c74e0-060d-49d5-abc5-389cee4bd9d5] Fetching instance by UUID {{(pid=128728) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 15:48:17.678568 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-eb6927a8-eea0-4099-b310-71bda8737805 tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:48:17.679024 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-eb6927a8-eea0-4099-b310-71bda8737805 tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:48:17.679797 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-eb6927a8-eea0-4099-b310-71bda8737805 tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:48:17.680239 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-eb6927a8-eea0-4099-b310-71bda8737805 tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:48:17.826583 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.policy [None req-eb6927a8-eea0-4099-b310-71bda8737805 tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b896317d96a40d6a137db0dcf5f98f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d2517d5440a4d30949f3dd36a46d813', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128728) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:48:17.848045 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: INFO nova.api.openstack.requestlog [None req-eb6927a8-eea0-4099-b310-71bda8737805 tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] 10.222.0.61 "GET /compute/v2.1/servers/563c74e0-060d-49d5-abc5-389cee4bd9d5" status: 200 len: 1522 microversion: 2.1 time: 0.179504 May 14 15:48:17.848529 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: [pid: 128728|app: 0|req: 169/318] 10.222.0.61 () {58 vars in 1235 bytes} [Sat May 14 15:48:17 2022] GET /compute/v2.1/servers/563c74e0-060d-49d5-abc5-389cee4bd9d5 => generated 1522 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 15:48:18.510216 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi [None req-51bfdffe-cd4c-4b3e-8fdf-3c8abe07c5cc tempest-DeleteServersTestJSON-2100051872 tempest-DeleteServersTestJSON-2100051872-project] Calling method '>' {{(pid=128729) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 15:48:18.510864 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.compute.api [None req-51bfdffe-cd4c-4b3e-8fdf-3c8abe07c5cc tempest-DeleteServersTestJSON-2100051872 tempest-DeleteServersTestJSON-2100051872-project] [instance: 75ca93de-6825-44ce-af10-44cba59218a1] Fetching instance by UUID {{(pid=128729) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 15:48:18.517358 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-51bfdffe-cd4c-4b3e-8fdf-3c8abe07c5cc tempest-DeleteServersTestJSON-2100051872 tempest-DeleteServersTestJSON-2100051872-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:48:18.517869 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-51bfdffe-cd4c-4b3e-8fdf-3c8abe07c5cc tempest-DeleteServersTestJSON-2100051872 tempest-DeleteServersTestJSON-2100051872-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:48:18.518742 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-51bfdffe-cd4c-4b3e-8fdf-3c8abe07c5cc tempest-DeleteServersTestJSON-2100051872 tempest-DeleteServersTestJSON-2100051872-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:48:18.519249 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-51bfdffe-cd4c-4b3e-8fdf-3c8abe07c5cc tempest-DeleteServersTestJSON-2100051872 tempest-DeleteServersTestJSON-2100051872-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:48:18.533043 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi [req-b569fa56-5831-46d3-8771-737eabd57be4 req-ae4e0129-0020-4998-bc6c-54466aa2b1d9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "75ca93de-6825-44ce-af10-44cba59218a1", "name": "network-vif-deleted", "tag": "fb2bfc60-7355-48dd-9df7-9ffd7d99b7f6"}]} {{(pid=128728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 15:48:18.541907 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [req-b569fa56-5831-46d3-8771-737eabd57be4 req-ae4e0129-0020-4998-bc6c-54466aa2b1d9 service nova] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:48:18.542800 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [req-b569fa56-5831-46d3-8771-737eabd57be4 req-ae4e0129-0020-4998-bc6c-54466aa2b1d9 service nova] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:48:18.559850 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: INFO nova.api.openstack.compute.server_external_events [req-b569fa56-5831-46d3-8771-737eabd57be4 req-ae4e0129-0020-4998-bc6c-54466aa2b1d9 service nova] Creating event network-vif-deleted:fb2bfc60-7355-48dd-9df7-9ffd7d99b7f6 for instance 75ca93de-6825-44ce-af10-44cba59218a1 on hv-cinder-83979 May 14 15:48:18.565076 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: INFO nova.api.openstack.requestlog [req-b569fa56-5831-46d3-8771-737eabd57be4 req-ae4e0129-0020-4998-bc6c-54466aa2b1d9 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035694 May 14 15:48:18.566038 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: [pid: 128728|app: 0|req: 170/319] 10.222.0.61 () {64 vars in 1317 bytes} [Sat May 14 15:48:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 14 15:48:18.590485 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.policy [None req-51bfdffe-cd4c-4b3e-8fdf-3c8abe07c5cc tempest-DeleteServersTestJSON-2100051872 tempest-DeleteServersTestJSON-2100051872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aad828d8ff314a2d82f07fb6d84f36a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6388da70b0dc48c1952570af4332dd6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128729) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:48:18.599545 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: INFO nova.api.openstack.requestlog [None req-51bfdffe-cd4c-4b3e-8fdf-3c8abe07c5cc tempest-DeleteServersTestJSON-2100051872 tempest-DeleteServersTestJSON-2100051872-project] 10.222.0.61 "GET /compute/v2.1/servers/75ca93de-6825-44ce-af10-44cba59218a1" status: 200 len: 1512 microversion: 2.1 time: 0.093115 May 14 15:48:18.600135 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: [pid: 128729|app: 0|req: 150/320] 10.222.0.61 () {58 vars in 1235 bytes} [Sat May 14 15:48:18 2022] GET /compute/v2.1/servers/75ca93de-6825-44ce-af10-44cba59218a1 => generated 1512 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 15:48:18.876943 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi [None req-418ccc7f-2874-4176-a75e-7c361ed7b7ff tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Calling method '>' {{(pid=128728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 15:48:18.878472 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.compute.api [None req-418ccc7f-2874-4176-a75e-7c361ed7b7ff tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] [instance: 563c74e0-060d-49d5-abc5-389cee4bd9d5] Fetching instance by UUID {{(pid=128728) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 15:48:18.891734 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-418ccc7f-2874-4176-a75e-7c361ed7b7ff tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:48:18.892314 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-418ccc7f-2874-4176-a75e-7c361ed7b7ff tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:48:18.895616 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-418ccc7f-2874-4176-a75e-7c361ed7b7ff tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:48:18.896445 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-418ccc7f-2874-4176-a75e-7c361ed7b7ff tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:48:19.057274 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.policy [None req-418ccc7f-2874-4176-a75e-7c361ed7b7ff tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b896317d96a40d6a137db0dcf5f98f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d2517d5440a4d30949f3dd36a46d813', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128728) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:48:19.066273 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: INFO nova.api.openstack.requestlog [None req-418ccc7f-2874-4176-a75e-7c361ed7b7ff tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] 10.222.0.61 "GET /compute/v2.1/servers/563c74e0-060d-49d5-abc5-389cee4bd9d5" status: 200 len: 1522 microversion: 2.1 time: 0.202954 May 14 15:48:19.067356 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: [pid: 128728|app: 0|req: 171/321] 10.222.0.61 () {58 vars in 1235 bytes} [Sat May 14 15:48:18 2022] GET /compute/v2.1/servers/563c74e0-060d-49d5-abc5-389cee4bd9d5 => generated 1522 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 15:48:19.617249 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi [None req-3572bd32-e81b-4f6f-b73f-fe035c056f9c tempest-DeleteServersTestJSON-2100051872 tempest-DeleteServersTestJSON-2100051872-project] Calling method '>' {{(pid=128729) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 15:48:19.617853 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.compute.api [None req-3572bd32-e81b-4f6f-b73f-fe035c056f9c tempest-DeleteServersTestJSON-2100051872 tempest-DeleteServersTestJSON-2100051872-project] [instance: 75ca93de-6825-44ce-af10-44cba59218a1] Fetching instance by UUID {{(pid=128729) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 15:48:19.624528 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-3572bd32-e81b-4f6f-b73f-fe035c056f9c tempest-DeleteServersTestJSON-2100051872 tempest-DeleteServersTestJSON-2100051872-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:48:19.624974 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-3572bd32-e81b-4f6f-b73f-fe035c056f9c tempest-DeleteServersTestJSON-2100051872 tempest-DeleteServersTestJSON-2100051872-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:48:19.625765 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-3572bd32-e81b-4f6f-b73f-fe035c056f9c tempest-DeleteServersTestJSON-2100051872 tempest-DeleteServersTestJSON-2100051872-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:48:19.626205 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-3572bd32-e81b-4f6f-b73f-fe035c056f9c tempest-DeleteServersTestJSON-2100051872 tempest-DeleteServersTestJSON-2100051872-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:48:19.658529 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-3572bd32-e81b-4f6f-b73f-fe035c056f9c tempest-DeleteServersTestJSON-2100051872 tempest-DeleteServersTestJSON-2100051872-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:48:19.658984 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-3572bd32-e81b-4f6f-b73f-fe035c056f9c tempest-DeleteServersTestJSON-2100051872 tempest-DeleteServersTestJSON-2100051872-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:48:19.659446 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.objects.instance [None req-3572bd32-e81b-4f6f-b73f-fe035c056f9c tempest-DeleteServersTestJSON-2100051872 tempest-DeleteServersTestJSON-2100051872-project] Lazy-loading 'fault' on Instance uuid 75ca93de-6825-44ce-af10-44cba59218a1 {{(pid=128729) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 14 15:48:19.710032 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.policy [None req-3572bd32-e81b-4f6f-b73f-fe035c056f9c tempest-DeleteServersTestJSON-2100051872 tempest-DeleteServersTestJSON-2100051872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aad828d8ff314a2d82f07fb6d84f36a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6388da70b0dc48c1952570af4332dd6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128729) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:48:19.718991 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: INFO nova.api.openstack.requestlog [None req-3572bd32-e81b-4f6f-b73f-fe035c056f9c tempest-DeleteServersTestJSON-2100051872 tempest-DeleteServersTestJSON-2100051872-project] 10.222.0.61 "GET /compute/v2.1/servers/75ca93de-6825-44ce-af10-44cba59218a1" status: 200 len: 1351 microversion: 2.1 time: 0.105692 May 14 15:48:19.719566 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: [pid: 128729|app: 0|req: 151/322] 10.222.0.61 () {58 vars in 1235 bytes} [Sat May 14 15:48:19 2022] GET /compute/v2.1/servers/75ca93de-6825-44ce-af10-44cba59218a1 => generated 1351 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 15:48:20.083483 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi [None req-8f697748-c597-49e2-a990-d58ec54d3115 tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Calling method '>' {{(pid=128728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 15:48:20.084032 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.compute.api [None req-8f697748-c597-49e2-a990-d58ec54d3115 tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] [instance: 563c74e0-060d-49d5-abc5-389cee4bd9d5] Fetching instance by UUID {{(pid=128728) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 15:48:20.089824 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-8f697748-c597-49e2-a990-d58ec54d3115 tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:48:20.090455 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-8f697748-c597-49e2-a990-d58ec54d3115 tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:48:20.091054 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-8f697748-c597-49e2-a990-d58ec54d3115 tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:48:20.091512 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-8f697748-c597-49e2-a990-d58ec54d3115 tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:48:20.249492 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.policy [None req-8f697748-c597-49e2-a990-d58ec54d3115 tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b896317d96a40d6a137db0dcf5f98f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d2517d5440a4d30949f3dd36a46d813', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128728) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:48:20.256839 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: INFO nova.api.openstack.requestlog [None req-8f697748-c597-49e2-a990-d58ec54d3115 tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] 10.222.0.61 "GET /compute/v2.1/servers/563c74e0-060d-49d5-abc5-389cee4bd9d5" status: 200 len: 1522 microversion: 2.1 time: 0.177241 May 14 15:48:20.257427 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: [pid: 128728|app: 0|req: 172/323] 10.222.0.61 () {58 vars in 1235 bytes} [Sat May 14 15:48:20 2022] GET /compute/v2.1/servers/563c74e0-060d-49d5-abc5-389cee4bd9d5 => generated 1522 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 15:48:20.736997 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi [None req-6e9d5471-f8e4-4d2a-95ce-9a6e405dbe3e tempest-DeleteServersTestJSON-2100051872 tempest-DeleteServersTestJSON-2100051872-project] Calling method '>' {{(pid=128729) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 15:48:20.737565 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.compute.api [None req-6e9d5471-f8e4-4d2a-95ce-9a6e405dbe3e tempest-DeleteServersTestJSON-2100051872 tempest-DeleteServersTestJSON-2100051872-project] [instance: 75ca93de-6825-44ce-af10-44cba59218a1] Fetching instance by UUID {{(pid=128729) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 15:48:20.744315 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-6e9d5471-f8e4-4d2a-95ce-9a6e405dbe3e tempest-DeleteServersTestJSON-2100051872 tempest-DeleteServersTestJSON-2100051872-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:48:20.744775 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-6e9d5471-f8e4-4d2a-95ce-9a6e405dbe3e tempest-DeleteServersTestJSON-2100051872 tempest-DeleteServersTestJSON-2100051872-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:48:20.745748 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-6e9d5471-f8e4-4d2a-95ce-9a6e405dbe3e tempest-DeleteServersTestJSON-2100051872 tempest-DeleteServersTestJSON-2100051872-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:48:20.746180 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-6e9d5471-f8e4-4d2a-95ce-9a6e405dbe3e tempest-DeleteServersTestJSON-2100051872 tempest-DeleteServersTestJSON-2100051872-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:48:20.780240 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-6e9d5471-f8e4-4d2a-95ce-9a6e405dbe3e tempest-DeleteServersTestJSON-2100051872 tempest-DeleteServersTestJSON-2100051872-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:48:20.780865 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-6e9d5471-f8e4-4d2a-95ce-9a6e405dbe3e tempest-DeleteServersTestJSON-2100051872 tempest-DeleteServersTestJSON-2100051872-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:48:20.781371 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.objects.instance [None req-6e9d5471-f8e4-4d2a-95ce-9a6e405dbe3e tempest-DeleteServersTestJSON-2100051872 tempest-DeleteServersTestJSON-2100051872-project] Lazy-loading 'fault' on Instance uuid 75ca93de-6825-44ce-af10-44cba59218a1 {{(pid=128729) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 14 15:48:20.827052 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.policy [None req-6e9d5471-f8e4-4d2a-95ce-9a6e405dbe3e tempest-DeleteServersTestJSON-2100051872 tempest-DeleteServersTestJSON-2100051872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aad828d8ff314a2d82f07fb6d84f36a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6388da70b0dc48c1952570af4332dd6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128729) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:48:20.835614 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: INFO nova.api.openstack.requestlog [None req-6e9d5471-f8e4-4d2a-95ce-9a6e405dbe3e tempest-DeleteServersTestJSON-2100051872 tempest-DeleteServersTestJSON-2100051872-project] 10.222.0.61 "GET /compute/v2.1/servers/75ca93de-6825-44ce-af10-44cba59218a1" status: 200 len: 1351 microversion: 2.1 time: 0.102739 May 14 15:48:20.836196 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: [pid: 128729|app: 0|req: 152/324] 10.222.0.61 () {58 vars in 1235 bytes} [Sat May 14 15:48:20 2022] GET /compute/v2.1/servers/75ca93de-6825-44ce-af10-44cba59218a1 => generated 1351 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 15:48:21.276282 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi [None req-9bd61f76-2420-4ee4-a455-7465d592dd8a tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Calling method '>' {{(pid=128728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 15:48:21.276896 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.compute.api [None req-9bd61f76-2420-4ee4-a455-7465d592dd8a tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] [instance: 563c74e0-060d-49d5-abc5-389cee4bd9d5] Fetching instance by UUID {{(pid=128728) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 15:48:21.285456 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-9bd61f76-2420-4ee4-a455-7465d592dd8a tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:48:21.285913 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-9bd61f76-2420-4ee4-a455-7465d592dd8a tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:48:21.286714 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-9bd61f76-2420-4ee4-a455-7465d592dd8a tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:48:21.287218 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-9bd61f76-2420-4ee4-a455-7465d592dd8a tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:48:21.440950 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.policy [None req-9bd61f76-2420-4ee4-a455-7465d592dd8a tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b896317d96a40d6a137db0dcf5f98f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d2517d5440a4d30949f3dd36a46d813', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128728) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:48:21.448895 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: INFO nova.api.openstack.requestlog [None req-9bd61f76-2420-4ee4-a455-7465d592dd8a tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] 10.222.0.61 "GET /compute/v2.1/servers/563c74e0-060d-49d5-abc5-389cee4bd9d5" status: 200 len: 1522 microversion: 2.1 time: 0.177593 May 14 15:48:21.449470 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: [pid: 128728|app: 0|req: 173/325] 10.222.0.61 () {58 vars in 1235 bytes} [Sat May 14 15:48:21 2022] GET /compute/v2.1/servers/563c74e0-060d-49d5-abc5-389cee4bd9d5 => generated 1522 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 15:48:21.852939 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi [None req-08f8c7e1-15b2-447c-84fb-4127b60536d4 tempest-DeleteServersTestJSON-2100051872 tempest-DeleteServersTestJSON-2100051872-project] Calling method '>' {{(pid=128729) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 15:48:21.854008 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.compute.api [None req-08f8c7e1-15b2-447c-84fb-4127b60536d4 tempest-DeleteServersTestJSON-2100051872 tempest-DeleteServersTestJSON-2100051872-project] [instance: 75ca93de-6825-44ce-af10-44cba59218a1] Fetching instance by UUID {{(pid=128729) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 15:48:21.859764 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-08f8c7e1-15b2-447c-84fb-4127b60536d4 tempest-DeleteServersTestJSON-2100051872 tempest-DeleteServersTestJSON-2100051872-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:48:21.860215 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-08f8c7e1-15b2-447c-84fb-4127b60536d4 tempest-DeleteServersTestJSON-2100051872 tempest-DeleteServersTestJSON-2100051872-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:48:21.860986 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-08f8c7e1-15b2-447c-84fb-4127b60536d4 tempest-DeleteServersTestJSON-2100051872 tempest-DeleteServersTestJSON-2100051872-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:48:21.861419 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-08f8c7e1-15b2-447c-84fb-4127b60536d4 tempest-DeleteServersTestJSON-2100051872 tempest-DeleteServersTestJSON-2100051872-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:48:21.874929 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: INFO nova.api.openstack.wsgi [None req-08f8c7e1-15b2-447c-84fb-4127b60536d4 tempest-DeleteServersTestJSON-2100051872 tempest-DeleteServersTestJSON-2100051872-project] HTTP exception thrown: Instance 75ca93de-6825-44ce-af10-44cba59218a1 could not be found. May 14 15:48:21.879460 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi [None req-08f8c7e1-15b2-447c-84fb-4127b60536d4 tempest-DeleteServersTestJSON-2100051872 tempest-DeleteServersTestJSON-2100051872-project] Request method failure captured: May 14 15:48:21.879460 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: request: GET /compute/v2.1/servers/75ca93de-6825-44ce-af10-44cba59218a1 HTTP/1.1 May 14 15:48:21.879460 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: Accept: application/json May 14 15:48:21.879460 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: Accept-Encoding: identity May 14 15:48:21.879460 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: Connection: close May 14 15:48:21.879460 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: Content-Length: 0 May 14 15:48:21.879460 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: Content-Type: application/json May 14 15:48:21.879460 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: Host: 10.222.0.61 May 14 15:48:21.879460 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: Openstack-System-Scope: None May 14 15:48:21.879460 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: User-Agent: python-urllib3/1.26.9 May 14 15:48:21.879460 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: X-Auth-Token: gAAAAABif87Hjbrq-iCwBNfCRzyKtAF6r05r9ySB_Z37PKh3JjD06xV1AM9rzQ0I7DY1io27geNMELUHIUVNJJd9oHioTWkOobh6IvA2kFv0hvMa3mhIRm8E1af3240H7tJwOIe82jPoqulJafnlWCPT2_5MpJv-xpQZ-KZkiJ6y4cyHRs8hHXc May 14 15:48:21.879460 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: X-Domain-Id: None May 14 15:48:21.879460 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: X-Domain-Name: None May 14 15:48:21.879460 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: X-Identity-Status: Confirmed May 14 15:48:21.879460 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: X-Is-Admin-Project: True May 14 15:48:21.879460 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: X-Project-Domain-Id: default May 14 15:48:21.879460 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: X-Project-Domain-Name: Default May 14 15:48:21.879460 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: X-Project-Id: 6388da70b0dc48c1952570af4332dd6d May 14 15:48:21.879460 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: X-Project-Name: tempest-DeleteServersTestJSON-2100051872 May 14 15:48:21.879460 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: X-Role: reader,member May 14 15:48:21.879460 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: X-Roles: reader,member May 14 15:48:21.880937 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/6388da70b0dc48c1952570af4332dd6d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/6388da70b0dc48c1952570af4332dd6d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/6388da70b0dc48c1952570af4332dd6d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_6388da70b0dc48c1952570af4332dd6d"}]}] May 14 15:48:21.880937 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: X-Tenant: tempest-DeleteServersTestJSON-2100051872 May 14 15:48:21.880937 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: X-Tenant-Id: 6388da70b0dc48c1952570af4332dd6d May 14 15:48:21.880937 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: X-Tenant-Name: tempest-DeleteServersTestJSON-2100051872 May 14 15:48:21.880937 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: X-User: tempest-DeleteServersTestJSON-2100051872-project May 14 15:48:21.880937 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: X-User-Domain-Id: default May 14 15:48:21.880937 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: X-User-Domain-Name: Default May 14 15:48:21.880937 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: X-User-Id: aad828d8ff314a2d82f07fb6d84f36a8 May 14 15:48:21.880937 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: X-User-Name: tempest-DeleteServersTestJSON-2100051872-project May 14 15:48:21.880937 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: method: > May 14 15:48:21.880937 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: exception: Instance 75ca93de-6825-44ce-af10-44cba59218a1 could not be found. May 14 15:48:21.880937 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: action_args: {'id': '75ca93de-6825-44ce-af10-44cba59218a1'} May 14 15:48:21.881728 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: {{(pid=128729) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 14 15:48:21.881728 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 15:48:21.881728 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 14 15:48:21.881728 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 14 15:48:21.881728 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 14 15:48:21.881728 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 14 15:48:21.881728 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 14 15:48:21.881728 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 14 15:48:21.881728 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 14 15:48:21.881728 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 14 15:48:21.881728 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 75ca93de-6825-44ce-af10-44cba59218a1 could not be found. May 14 15:48:21.881728 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: ERROR nova.api.openstack.wsgi May 14 15:48:21.881728 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 14 15:48:21.881728 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: ERROR nova.api.openstack.wsgi May 14 15:48:21.881728 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 15:48:21.881728 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 14 15:48:21.881728 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 14 15:48:21.881728 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 14 15:48:21.881728 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 14 15:48:21.881728 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 14 15:48:21.883127 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 14 15:48:21.883127 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 14 15:48:21.883127 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 14 15:48:21.883127 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 14 15:48:21.883127 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 14 15:48:21.883127 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 14 15:48:21.883127 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 14 15:48:21.883127 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 75ca93de-6825-44ce-af10-44cba59218a1 could not be found. May 14 15:48:21.883127 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: ERROR nova.api.openstack.wsgi May 14 15:48:21.883127 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 14 15:48:21.883127 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: ERROR nova.api.openstack.wsgi May 14 15:48:21.883127 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 15:48:21.883127 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 14 15:48:21.883127 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 14 15:48:21.883127 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 14 15:48:21.883127 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 14 15:48:21.883127 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 75ca93de-6825-44ce-af10-44cba59218a1 could not be found. May 14 15:48:21.883127 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: ERROR nova.api.openstack.wsgi May 14 15:48:21.884828 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi [None req-08f8c7e1-15b2-447c-84fb-4127b60536d4 tempest-DeleteServersTestJSON-2100051872 tempest-DeleteServersTestJSON-2100051872-project] Returning 404 to user: Instance 75ca93de-6825-44ce-af10-44cba59218a1 could not be found. {{(pid=128729) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 14 15:48:21.884828 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: INFO nova.api.openstack.requestlog [None req-08f8c7e1-15b2-447c-84fb-4127b60536d4 tempest-DeleteServersTestJSON-2100051872 tempest-DeleteServersTestJSON-2100051872-project] 10.222.0.61 "GET /compute/v2.1/servers/75ca93de-6825-44ce-af10-44cba59218a1" status: 404 len: 111 microversion: 2.1 time: 0.032023 May 14 15:48:21.884828 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: [pid: 128729|app: 0|req: 153/326] 10.222.0.61 () {58 vars in 1235 bytes} [Sat May 14 15:48:21 2022] GET /compute/v2.1/servers/75ca93de-6825-44ce-af10-44cba59218a1 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 14 15:48:22.013900 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi [None req-d2f2ec1c-b9d3-4eb1-9463-f09eb068f66f tempest-DeleteServersTestJSON-2100051872 tempest-DeleteServersTestJSON-2100051872-project] Calling method '>' {{(pid=128728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 15:48:22.015464 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.compute.api [None req-d2f2ec1c-b9d3-4eb1-9463-f09eb068f66f tempest-DeleteServersTestJSON-2100051872 tempest-DeleteServersTestJSON-2100051872-project] [instance: 75ca93de-6825-44ce-af10-44cba59218a1] Fetching instance by UUID {{(pid=128728) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 15:48:22.021755 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-d2f2ec1c-b9d3-4eb1-9463-f09eb068f66f tempest-DeleteServersTestJSON-2100051872 tempest-DeleteServersTestJSON-2100051872-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:48:22.022228 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-d2f2ec1c-b9d3-4eb1-9463-f09eb068f66f tempest-DeleteServersTestJSON-2100051872 tempest-DeleteServersTestJSON-2100051872-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:48:22.023385 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-d2f2ec1c-b9d3-4eb1-9463-f09eb068f66f tempest-DeleteServersTestJSON-2100051872 tempest-DeleteServersTestJSON-2100051872-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:48:22.024077 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-d2f2ec1c-b9d3-4eb1-9463-f09eb068f66f tempest-DeleteServersTestJSON-2100051872 tempest-DeleteServersTestJSON-2100051872-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:48:22.037953 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: INFO nova.api.openstack.wsgi [None req-d2f2ec1c-b9d3-4eb1-9463-f09eb068f66f tempest-DeleteServersTestJSON-2100051872 tempest-DeleteServersTestJSON-2100051872-project] HTTP exception thrown: Instance 75ca93de-6825-44ce-af10-44cba59218a1 could not be found. May 14 15:48:22.043712 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi [None req-d2f2ec1c-b9d3-4eb1-9463-f09eb068f66f tempest-DeleteServersTestJSON-2100051872 tempest-DeleteServersTestJSON-2100051872-project] Request method failure captured: May 14 15:48:22.043712 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: request: GET /compute/v2.1/servers/75ca93de-6825-44ce-af10-44cba59218a1/os-volume_attachments HTTP/1.1 May 14 15:48:22.043712 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: Accept: application/json May 14 15:48:22.043712 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: Accept-Encoding: identity May 14 15:48:22.043712 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: Connection: close May 14 15:48:22.043712 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: Content-Length: 0 May 14 15:48:22.043712 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: Content-Type: application/json May 14 15:48:22.043712 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: Host: 10.222.0.61 May 14 15:48:22.043712 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: Openstack-System-Scope: None May 14 15:48:22.043712 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: User-Agent: python-urllib3/1.26.9 May 14 15:48:22.043712 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: X-Auth-Token: gAAAAABif87Hjbrq-iCwBNfCRzyKtAF6r05r9ySB_Z37PKh3JjD06xV1AM9rzQ0I7DY1io27geNMELUHIUVNJJd9oHioTWkOobh6IvA2kFv0hvMa3mhIRm8E1af3240H7tJwOIe82jPoqulJafnlWCPT2_5MpJv-xpQZ-KZkiJ6y4cyHRs8hHXc May 14 15:48:22.043712 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: X-Domain-Id: None May 14 15:48:22.043712 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: X-Domain-Name: None May 14 15:48:22.043712 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: X-Identity-Status: Confirmed May 14 15:48:22.043712 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: X-Is-Admin-Project: True May 14 15:48:22.043712 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: X-Project-Domain-Id: default May 14 15:48:22.043712 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: X-Project-Domain-Name: Default May 14 15:48:22.043712 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: X-Project-Id: 6388da70b0dc48c1952570af4332dd6d May 14 15:48:22.043712 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: X-Project-Name: tempest-DeleteServersTestJSON-2100051872 May 14 15:48:22.043712 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: X-Role: reader,member May 14 15:48:22.043712 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: X-Roles: reader,member May 14 15:48:22.045184 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/6388da70b0dc48c1952570af4332dd6d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/6388da70b0dc48c1952570af4332dd6d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/6388da70b0dc48c1952570af4332dd6d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_6388da70b0dc48c1952570af4332dd6d"}]}] May 14 15:48:22.045184 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: X-Tenant: tempest-DeleteServersTestJSON-2100051872 May 14 15:48:22.045184 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: X-Tenant-Id: 6388da70b0dc48c1952570af4332dd6d May 14 15:48:22.045184 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: X-Tenant-Name: tempest-DeleteServersTestJSON-2100051872 May 14 15:48:22.045184 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: X-User: tempest-DeleteServersTestJSON-2100051872-project May 14 15:48:22.045184 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: X-User-Domain-Id: default May 14 15:48:22.045184 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: X-User-Domain-Name: Default May 14 15:48:22.045184 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: X-User-Id: aad828d8ff314a2d82f07fb6d84f36a8 May 14 15:48:22.045184 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: X-User-Name: tempest-DeleteServersTestJSON-2100051872-project May 14 15:48:22.045184 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: method: > May 14 15:48:22.045184 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: exception: Instance 75ca93de-6825-44ce-af10-44cba59218a1 could not be found. May 14 15:48:22.045184 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: action_args: {'server_id': '75ca93de-6825-44ce-af10-44cba59218a1'} May 14 15:48:22.049016 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: {{(pid=128728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 14 15:48:22.049016 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 15:48:22.049016 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 14 15:48:22.049016 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 14 15:48:22.049016 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 14 15:48:22.049016 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 14 15:48:22.049016 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 14 15:48:22.049016 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 14 15:48:22.049016 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 14 15:48:22.049016 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 14 15:48:22.049016 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 75ca93de-6825-44ce-af10-44cba59218a1 could not be found. May 14 15:48:22.049016 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: ERROR nova.api.openstack.wsgi May 14 15:48:22.049016 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 14 15:48:22.049016 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: ERROR nova.api.openstack.wsgi May 14 15:48:22.049016 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 15:48:22.049016 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 14 15:48:22.049016 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 14 15:48:22.049016 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 14 15:48:22.049016 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 14 15:48:22.049016 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 14 15:48:22.050268 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 14 15:48:22.050268 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper May 14 15:48:22.050268 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 14 15:48:22.050268 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper May 14 15:48:22.050268 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 14 15:48:22.050268 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index May 14 15:48:22.050268 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) May 14 15:48:22.050268 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 14 15:48:22.050268 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 14 15:48:22.050268 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 75ca93de-6825-44ce-af10-44cba59218a1 could not be found. May 14 15:48:22.050268 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: ERROR nova.api.openstack.wsgi May 14 15:48:22.050268 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 14 15:48:22.050268 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: ERROR nova.api.openstack.wsgi May 14 15:48:22.050268 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 15:48:22.050268 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 14 15:48:22.050268 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 14 15:48:22.050268 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 14 15:48:22.050268 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 14 15:48:22.050268 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 75ca93de-6825-44ce-af10-44cba59218a1 could not be found. May 14 15:48:22.050268 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: ERROR nova.api.openstack.wsgi May 14 15:48:22.051647 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi [None req-d2f2ec1c-b9d3-4eb1-9463-f09eb068f66f tempest-DeleteServersTestJSON-2100051872 tempest-DeleteServersTestJSON-2100051872-project] Returning 404 to user: Instance 75ca93de-6825-44ce-af10-44cba59218a1 could not be found. {{(pid=128728) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 14 15:48:22.051647 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: INFO nova.api.openstack.requestlog [None req-d2f2ec1c-b9d3-4eb1-9463-f09eb068f66f tempest-DeleteServersTestJSON-2100051872 tempest-DeleteServersTestJSON-2100051872-project] 10.222.0.61 "GET /compute/v2.1/servers/75ca93de-6825-44ce-af10-44cba59218a1/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.036255 May 14 15:48:22.051647 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: [pid: 128728|app: 0|req: 174/327] 10.222.0.61 () {58 vars in 1301 bytes} [Sat May 14 15:48:22 2022] GET /compute/v2.1/servers/75ca93de-6825-44ce-af10-44cba59218a1/os-volume_attachments => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 14 15:48:22.466935 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi [None req-9d9b07d9-0c36-4397-865a-0bcb8c8029b0 tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Calling method '>' {{(pid=128729) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 15:48:22.467820 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.compute.api [None req-9d9b07d9-0c36-4397-865a-0bcb8c8029b0 tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] [instance: 563c74e0-060d-49d5-abc5-389cee4bd9d5] Fetching instance by UUID {{(pid=128729) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 15:48:22.477085 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-9d9b07d9-0c36-4397-865a-0bcb8c8029b0 tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:48:22.478447 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-9d9b07d9-0c36-4397-865a-0bcb8c8029b0 tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:48:22.479407 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-9d9b07d9-0c36-4397-865a-0bcb8c8029b0 tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:48:22.479924 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-9d9b07d9-0c36-4397-865a-0bcb8c8029b0 tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:48:22.804289 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.policy [None req-9d9b07d9-0c36-4397-865a-0bcb8c8029b0 tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b896317d96a40d6a137db0dcf5f98f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d2517d5440a4d30949f3dd36a46d813', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128729) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:48:22.817600 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: INFO nova.api.openstack.requestlog [None req-9d9b07d9-0c36-4397-865a-0bcb8c8029b0 tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] 10.222.0.61 "GET /compute/v2.1/servers/563c74e0-060d-49d5-abc5-389cee4bd9d5" status: 200 len: 1522 microversion: 2.1 time: 0.354604 May 14 15:48:22.818949 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: [pid: 128729|app: 0|req: 154/328] 10.222.0.61 () {58 vars in 1235 bytes} [Sat May 14 15:48:22 2022] GET /compute/v2.1/servers/563c74e0-060d-49d5-abc5-389cee4bd9d5 => generated 1522 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 15:48:23.278904 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi [None req-a5a63343-700c-4ff6-bafd-079ea0e153de tempest-DeleteServersTestJSON-2100051872 tempest-DeleteServersTestJSON-2100051872-project] Calling method '>' {{(pid=128728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 15:48:23.282054 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.compute.api [None req-a5a63343-700c-4ff6-bafd-079ea0e153de tempest-DeleteServersTestJSON-2100051872 tempest-DeleteServersTestJSON-2100051872-project] [instance: 75ca93de-6825-44ce-af10-44cba59218a1] Fetching instance by UUID {{(pid=128728) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 15:48:23.289903 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-a5a63343-700c-4ff6-bafd-079ea0e153de tempest-DeleteServersTestJSON-2100051872 tempest-DeleteServersTestJSON-2100051872-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:48:23.290428 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-a5a63343-700c-4ff6-bafd-079ea0e153de tempest-DeleteServersTestJSON-2100051872 tempest-DeleteServersTestJSON-2100051872-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:48:23.291389 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-a5a63343-700c-4ff6-bafd-079ea0e153de tempest-DeleteServersTestJSON-2100051872 tempest-DeleteServersTestJSON-2100051872-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:48:23.291911 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-a5a63343-700c-4ff6-bafd-079ea0e153de tempest-DeleteServersTestJSON-2100051872 tempest-DeleteServersTestJSON-2100051872-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:48:23.310208 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: INFO nova.api.openstack.wsgi [None req-a5a63343-700c-4ff6-bafd-079ea0e153de tempest-DeleteServersTestJSON-2100051872 tempest-DeleteServersTestJSON-2100051872-project] HTTP exception thrown: Instance 75ca93de-6825-44ce-af10-44cba59218a1 could not be found. May 14 15:48:23.314535 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi [None req-a5a63343-700c-4ff6-bafd-079ea0e153de tempest-DeleteServersTestJSON-2100051872 tempest-DeleteServersTestJSON-2100051872-project] Request method failure captured: May 14 15:48:23.314535 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: request: DELETE /compute/v2.1/servers/75ca93de-6825-44ce-af10-44cba59218a1 HTTP/1.1 May 14 15:48:23.314535 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: Accept: application/json May 14 15:48:23.314535 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: Accept-Encoding: identity May 14 15:48:23.314535 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: Connection: close May 14 15:48:23.314535 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: Content-Length: 0 May 14 15:48:23.314535 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: Content-Type: application/json May 14 15:48:23.314535 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: Host: 10.222.0.61 May 14 15:48:23.314535 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: Openstack-System-Scope: None May 14 15:48:23.314535 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: User-Agent: python-urllib3/1.26.9 May 14 15:48:23.314535 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: X-Auth-Token: gAAAAABif87Hjbrq-iCwBNfCRzyKtAF6r05r9ySB_Z37PKh3JjD06xV1AM9rzQ0I7DY1io27geNMELUHIUVNJJd9oHioTWkOobh6IvA2kFv0hvMa3mhIRm8E1af3240H7tJwOIe82jPoqulJafnlWCPT2_5MpJv-xpQZ-KZkiJ6y4cyHRs8hHXc May 14 15:48:23.314535 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: X-Domain-Id: None May 14 15:48:23.314535 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: X-Domain-Name: None May 14 15:48:23.314535 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: X-Identity-Status: Confirmed May 14 15:48:23.314535 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: X-Is-Admin-Project: True May 14 15:48:23.314535 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: X-Project-Domain-Id: default May 14 15:48:23.314535 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: X-Project-Domain-Name: Default May 14 15:48:23.314535 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: X-Project-Id: 6388da70b0dc48c1952570af4332dd6d May 14 15:48:23.314535 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: X-Project-Name: tempest-DeleteServersTestJSON-2100051872 May 14 15:48:23.314535 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: X-Role: reader,member May 14 15:48:23.314535 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: X-Roles: reader,member May 14 15:48:23.316054 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/6388da70b0dc48c1952570af4332dd6d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/6388da70b0dc48c1952570af4332dd6d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/6388da70b0dc48c1952570af4332dd6d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_6388da70b0dc48c1952570af4332dd6d"}]}] May 14 15:48:23.316054 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: X-Tenant: tempest-DeleteServersTestJSON-2100051872 May 14 15:48:23.316054 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: X-Tenant-Id: 6388da70b0dc48c1952570af4332dd6d May 14 15:48:23.316054 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: X-Tenant-Name: tempest-DeleteServersTestJSON-2100051872 May 14 15:48:23.316054 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: X-User: tempest-DeleteServersTestJSON-2100051872-project May 14 15:48:23.316054 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: X-User-Domain-Id: default May 14 15:48:23.316054 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: X-User-Domain-Name: Default May 14 15:48:23.316054 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: X-User-Id: aad828d8ff314a2d82f07fb6d84f36a8 May 14 15:48:23.316054 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: X-User-Name: tempest-DeleteServersTestJSON-2100051872-project May 14 15:48:23.316054 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: method: > May 14 15:48:23.316054 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: exception: Instance 75ca93de-6825-44ce-af10-44cba59218a1 could not be found. May 14 15:48:23.316054 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: action_args: {'id': '75ca93de-6825-44ce-af10-44cba59218a1'} May 14 15:48:23.316827 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: {{(pid=128728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 14 15:48:23.316827 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 15:48:23.316827 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 14 15:48:23.316827 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 14 15:48:23.316827 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 14 15:48:23.316827 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 14 15:48:23.316827 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 14 15:48:23.316827 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 14 15:48:23.316827 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 14 15:48:23.316827 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 14 15:48:23.316827 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 75ca93de-6825-44ce-af10-44cba59218a1 could not be found. May 14 15:48:23.316827 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: ERROR nova.api.openstack.wsgi May 14 15:48:23.316827 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 14 15:48:23.316827 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: ERROR nova.api.openstack.wsgi May 14 15:48:23.316827 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 15:48:23.316827 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 14 15:48:23.316827 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 14 15:48:23.316827 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 14 15:48:23.316827 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 14 15:48:23.316827 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 14 15:48:23.318131 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 14 15:48:23.318131 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 14 15:48:23.318131 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 14 15:48:23.318131 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 14 15:48:23.318131 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 14 15:48:23.318131 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 14 15:48:23.318131 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 14 15:48:23.318131 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 14 15:48:23.318131 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 14 15:48:23.318131 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 75ca93de-6825-44ce-af10-44cba59218a1 could not be found. May 14 15:48:23.318131 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: ERROR nova.api.openstack.wsgi May 14 15:48:23.318131 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 14 15:48:23.318131 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: ERROR nova.api.openstack.wsgi May 14 15:48:23.318131 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 15:48:23.318131 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 14 15:48:23.318131 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 14 15:48:23.318131 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 14 15:48:23.318131 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 14 15:48:23.318131 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 75ca93de-6825-44ce-af10-44cba59218a1 could not be found. May 14 15:48:23.318131 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: ERROR nova.api.openstack.wsgi May 14 15:48:23.323403 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi [None req-a5a63343-700c-4ff6-bafd-079ea0e153de tempest-DeleteServersTestJSON-2100051872 tempest-DeleteServersTestJSON-2100051872-project] Returning 404 to user: Instance 75ca93de-6825-44ce-af10-44cba59218a1 could not be found. {{(pid=128728) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 14 15:48:23.323403 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: INFO nova.api.openstack.requestlog [None req-a5a63343-700c-4ff6-bafd-079ea0e153de tempest-DeleteServersTestJSON-2100051872 tempest-DeleteServersTestJSON-2100051872-project] 10.222.0.61 "DELETE /compute/v2.1/servers/75ca93de-6825-44ce-af10-44cba59218a1" status: 404 len: 111 microversion: 2.1 time: 0.045977 May 14 15:48:23.323403 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: [pid: 128728|app: 0|req: 175/329] 10.222.0.61 () {58 vars in 1238 bytes} [Sat May 14 15:48:23 2022] DELETE /compute/v2.1/servers/75ca93de-6825-44ce-af10-44cba59218a1 => generated 111 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 14 15:48:23.327965 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi [None req-572d397f-e572-4720-90bb-17a0e6ccfedc tempest-DeleteServersTestJSON-2100051872 tempest-DeleteServersTestJSON-2100051872-project] Calling method '>' {{(pid=128729) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 15:48:23.328699 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.compute.api [None req-572d397f-e572-4720-90bb-17a0e6ccfedc tempest-DeleteServersTestJSON-2100051872 tempest-DeleteServersTestJSON-2100051872-project] [instance: 75ca93de-6825-44ce-af10-44cba59218a1] Fetching instance by UUID {{(pid=128729) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 15:48:23.335540 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-572d397f-e572-4720-90bb-17a0e6ccfedc tempest-DeleteServersTestJSON-2100051872 tempest-DeleteServersTestJSON-2100051872-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:48:23.335995 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-572d397f-e572-4720-90bb-17a0e6ccfedc tempest-DeleteServersTestJSON-2100051872 tempest-DeleteServersTestJSON-2100051872-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:48:23.336802 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-572d397f-e572-4720-90bb-17a0e6ccfedc tempest-DeleteServersTestJSON-2100051872 tempest-DeleteServersTestJSON-2100051872-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:48:23.337879 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-572d397f-e572-4720-90bb-17a0e6ccfedc tempest-DeleteServersTestJSON-2100051872 tempest-DeleteServersTestJSON-2100051872-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:48:23.357293 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: INFO nova.api.openstack.wsgi [None req-572d397f-e572-4720-90bb-17a0e6ccfedc tempest-DeleteServersTestJSON-2100051872 tempest-DeleteServersTestJSON-2100051872-project] HTTP exception thrown: Instance 75ca93de-6825-44ce-af10-44cba59218a1 could not be found. May 14 15:48:23.358937 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi [None req-572d397f-e572-4720-90bb-17a0e6ccfedc tempest-DeleteServersTestJSON-2100051872 tempest-DeleteServersTestJSON-2100051872-project] Request method failure captured: May 14 15:48:23.358937 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: request: GET /compute/v2.1/servers/75ca93de-6825-44ce-af10-44cba59218a1 HTTP/1.1 May 14 15:48:23.358937 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: Accept: application/json May 14 15:48:23.358937 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: Accept-Encoding: identity May 14 15:48:23.358937 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: Connection: close May 14 15:48:23.358937 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: Content-Length: 0 May 14 15:48:23.358937 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: Content-Type: application/json May 14 15:48:23.358937 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: Host: 10.222.0.61 May 14 15:48:23.358937 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: Openstack-System-Scope: None May 14 15:48:23.358937 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: User-Agent: python-urllib3/1.26.9 May 14 15:48:23.358937 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: X-Auth-Token: gAAAAABif87Hjbrq-iCwBNfCRzyKtAF6r05r9ySB_Z37PKh3JjD06xV1AM9rzQ0I7DY1io27geNMELUHIUVNJJd9oHioTWkOobh6IvA2kFv0hvMa3mhIRm8E1af3240H7tJwOIe82jPoqulJafnlWCPT2_5MpJv-xpQZ-KZkiJ6y4cyHRs8hHXc May 14 15:48:23.358937 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: X-Domain-Id: None May 14 15:48:23.358937 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: X-Domain-Name: None May 14 15:48:23.358937 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: X-Identity-Status: Confirmed May 14 15:48:23.358937 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: X-Is-Admin-Project: True May 14 15:48:23.358937 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: X-Project-Domain-Id: default May 14 15:48:23.358937 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: X-Project-Domain-Name: Default May 14 15:48:23.358937 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: X-Project-Id: 6388da70b0dc48c1952570af4332dd6d May 14 15:48:23.358937 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: X-Project-Name: tempest-DeleteServersTestJSON-2100051872 May 14 15:48:23.358937 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: X-Role: reader,member May 14 15:48:23.358937 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: X-Roles: reader,member May 14 15:48:23.360371 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/6388da70b0dc48c1952570af4332dd6d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/6388da70b0dc48c1952570af4332dd6d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/6388da70b0dc48c1952570af4332dd6d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_6388da70b0dc48c1952570af4332dd6d"}]}] May 14 15:48:23.360371 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: X-Tenant: tempest-DeleteServersTestJSON-2100051872 May 14 15:48:23.360371 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: X-Tenant-Id: 6388da70b0dc48c1952570af4332dd6d May 14 15:48:23.360371 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: X-Tenant-Name: tempest-DeleteServersTestJSON-2100051872 May 14 15:48:23.360371 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: X-User: tempest-DeleteServersTestJSON-2100051872-project May 14 15:48:23.360371 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: X-User-Domain-Id: default May 14 15:48:23.360371 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: X-User-Domain-Name: Default May 14 15:48:23.360371 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: X-User-Id: aad828d8ff314a2d82f07fb6d84f36a8 May 14 15:48:23.360371 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: X-User-Name: tempest-DeleteServersTestJSON-2100051872-project May 14 15:48:23.360371 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: method: > May 14 15:48:23.360371 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: exception: Instance 75ca93de-6825-44ce-af10-44cba59218a1 could not be found. May 14 15:48:23.360371 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: action_args: {'id': '75ca93de-6825-44ce-af10-44cba59218a1'} May 14 15:48:23.361377 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: {{(pid=128729) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 14 15:48:23.361377 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 15:48:23.361377 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 14 15:48:23.361377 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 14 15:48:23.361377 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 14 15:48:23.361377 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 14 15:48:23.361377 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 14 15:48:23.361377 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 14 15:48:23.361377 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 14 15:48:23.361377 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 14 15:48:23.361377 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 75ca93de-6825-44ce-af10-44cba59218a1 could not be found. May 14 15:48:23.361377 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: ERROR nova.api.openstack.wsgi May 14 15:48:23.361377 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 14 15:48:23.361377 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: ERROR nova.api.openstack.wsgi May 14 15:48:23.361377 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 15:48:23.361377 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 14 15:48:23.361377 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 14 15:48:23.361377 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 14 15:48:23.361377 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 14 15:48:23.361377 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 14 15:48:23.363117 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 14 15:48:23.363117 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 14 15:48:23.363117 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 14 15:48:23.363117 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 14 15:48:23.363117 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 14 15:48:23.363117 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 14 15:48:23.363117 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 14 15:48:23.363117 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 75ca93de-6825-44ce-af10-44cba59218a1 could not be found. May 14 15:48:23.363117 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: ERROR nova.api.openstack.wsgi May 14 15:48:23.363117 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 14 15:48:23.363117 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: ERROR nova.api.openstack.wsgi May 14 15:48:23.363117 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 15:48:23.363117 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 14 15:48:23.363117 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 14 15:48:23.363117 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 14 15:48:23.363117 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 14 15:48:23.363117 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 75ca93de-6825-44ce-af10-44cba59218a1 could not be found. May 14 15:48:23.363117 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: ERROR nova.api.openstack.wsgi May 14 15:48:23.364270 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi [None req-572d397f-e572-4720-90bb-17a0e6ccfedc tempest-DeleteServersTestJSON-2100051872 tempest-DeleteServersTestJSON-2100051872-project] Returning 404 to user: Instance 75ca93de-6825-44ce-af10-44cba59218a1 could not be found. {{(pid=128729) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 14 15:48:23.364270 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: INFO nova.api.openstack.requestlog [None req-572d397f-e572-4720-90bb-17a0e6ccfedc tempest-DeleteServersTestJSON-2100051872 tempest-DeleteServersTestJSON-2100051872-project] 10.222.0.61 "GET /compute/v2.1/servers/75ca93de-6825-44ce-af10-44cba59218a1" status: 404 len: 111 microversion: 2.1 time: 0.036680 May 14 15:48:23.364270 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: [pid: 128729|app: 0|req: 155/330] 10.222.0.61 () {58 vars in 1235 bytes} [Sat May 14 15:48:23 2022] GET /compute/v2.1/servers/75ca93de-6825-44ce-af10-44cba59218a1 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 14 15:48:23.838732 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi [None req-339e6f3f-bd5d-45e0-b412-1c14ebd7baba tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Calling method '>' {{(pid=128728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 15:48:23.839611 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.compute.api [None req-339e6f3f-bd5d-45e0-b412-1c14ebd7baba tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] [instance: 563c74e0-060d-49d5-abc5-389cee4bd9d5] Fetching instance by UUID {{(pid=128728) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 15:48:23.850493 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-339e6f3f-bd5d-45e0-b412-1c14ebd7baba tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:48:23.851300 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-339e6f3f-bd5d-45e0-b412-1c14ebd7baba tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:48:23.852196 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-339e6f3f-bd5d-45e0-b412-1c14ebd7baba tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:48:23.853051 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-339e6f3f-bd5d-45e0-b412-1c14ebd7baba tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:48:24.207094 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.policy [None req-339e6f3f-bd5d-45e0-b412-1c14ebd7baba tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b896317d96a40d6a137db0dcf5f98f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d2517d5440a4d30949f3dd36a46d813', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128728) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:48:24.218551 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: INFO nova.api.openstack.requestlog [None req-339e6f3f-bd5d-45e0-b412-1c14ebd7baba tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] 10.222.0.61 "GET /compute/v2.1/servers/563c74e0-060d-49d5-abc5-389cee4bd9d5" status: 200 len: 1502 microversion: 2.1 time: 0.384865 May 14 15:48:24.231402 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: [pid: 128728|app: 0|req: 176/331] 10.222.0.61 () {58 vars in 1235 bytes} [Sat May 14 15:48:23 2022] GET /compute/v2.1/servers/563c74e0-060d-49d5-abc5-389cee4bd9d5 => generated 1502 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 15:48:24.237276 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi [None req-f9a4e7e2-32a5-43dd-ba1e-827004106a8f tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Calling method '>' {{(pid=128729) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 15:48:24.237890 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.compute.api [None req-f9a4e7e2-32a5-43dd-ba1e-827004106a8f tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] [instance: 9fbb269d-11cd-49ed-81ac-570e721c15cd] Fetching instance by UUID {{(pid=128729) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 15:48:24.244707 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-f9a4e7e2-32a5-43dd-ba1e-827004106a8f tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:48:24.247075 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-f9a4e7e2-32a5-43dd-ba1e-827004106a8f tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:48:24.247953 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-f9a4e7e2-32a5-43dd-ba1e-827004106a8f tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:48:24.248392 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-f9a4e7e2-32a5-43dd-ba1e-827004106a8f tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:48:24.468721 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.policy [None req-f9a4e7e2-32a5-43dd-ba1e-827004106a8f tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b896317d96a40d6a137db0dcf5f98f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d2517d5440a4d30949f3dd36a46d813', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128729) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:48:24.479836 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: INFO nova.api.openstack.requestlog [None req-f9a4e7e2-32a5-43dd-ba1e-827004106a8f tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] 10.222.0.61 "GET /compute/v2.1/servers/9fbb269d-11cd-49ed-81ac-570e721c15cd" status: 200 len: 1517 microversion: 2.1 time: 0.246837 May 14 15:48:24.492675 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: [pid: 128729|app: 0|req: 156/332] 10.222.0.61 () {58 vars in 1235 bytes} [Sat May 14 15:48:24 2022] GET /compute/v2.1/servers/9fbb269d-11cd-49ed-81ac-570e721c15cd => generated 1517 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 15:48:27.359308 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi [None req-022b5590-3518-449d-bde8-6c8e5f9d3c0b tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=128728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 15:48:27.360976 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.compute.api [None req-022b5590-3518-449d-bde8-6c8e5f9d3c0b tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] [instance: 9fbb269d-11cd-49ed-81ac-570e721c15cd] Fetching instance by UUID {{(pid=128728) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 15:48:27.373567 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-022b5590-3518-449d-bde8-6c8e5f9d3c0b tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:48:27.375777 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-022b5590-3518-449d-bde8-6c8e5f9d3c0b tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:48:27.386814 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-022b5590-3518-449d-bde8-6c8e5f9d3c0b tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:48:27.387327 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-022b5590-3518-449d-bde8-6c8e5f9d3c0b tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:48:27.434769 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.objects.instance [None req-022b5590-3518-449d-bde8-6c8e5f9d3c0b tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Lazy-loading 'flavor' on Instance uuid 9fbb269d-11cd-49ed-81ac-570e721c15cd {{(pid=128728) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 14 15:48:27.590640 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: INFO nova.api.openstack.requestlog [None req-022b5590-3518-449d-bde8-6c8e5f9d3c0b tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] 10.222.0.61 "POST /compute/v2.1/servers/9fbb269d-11cd-49ed-81ac-570e721c15cd/action" status: 200 len: 32 microversion: 2.1 time: 0.235495 May 14 15:48:27.591239 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: [pid: 128728|app: 0|req: 177/333] 10.222.0.61 () {60 vars in 1277 bytes} [Sat May 14 15:48:27 2022] POST /compute/v2.1/servers/9fbb269d-11cd-49ed-81ac-570e721c15cd/action => generated 32 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 14 15:48:27.608994 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi [None req-7890a877-efb3-4ee8-8da8-b41b72bac58b tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Calling method '>' {{(pid=128729) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 15:48:27.609774 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.compute.api [None req-7890a877-efb3-4ee8-8da8-b41b72bac58b tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] [instance: 9fbb269d-11cd-49ed-81ac-570e721c15cd] Fetching instance by UUID {{(pid=128729) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 15:48:27.617314 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-7890a877-efb3-4ee8-8da8-b41b72bac58b tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:48:27.618774 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-7890a877-efb3-4ee8-8da8-b41b72bac58b tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:48:27.623319 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-7890a877-efb3-4ee8-8da8-b41b72bac58b tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:48:27.624052 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-7890a877-efb3-4ee8-8da8-b41b72bac58b tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:48:28.148558 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.policy [None req-7890a877-efb3-4ee8-8da8-b41b72bac58b tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b896317d96a40d6a137db0dcf5f98f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d2517d5440a4d30949f3dd36a46d813', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128729) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:48:28.160946 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: INFO nova.api.openstack.requestlog [None req-7890a877-efb3-4ee8-8da8-b41b72bac58b tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] 10.222.0.61 "GET /compute/v2.1/servers/9fbb269d-11cd-49ed-81ac-570e721c15cd" status: 200 len: 1523 microversion: 2.1 time: 0.561322 May 14 15:48:28.168692 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: [pid: 128729|app: 0|req: 157/334] 10.222.0.61 () {58 vars in 1235 bytes} [Sat May 14 15:48:27 2022] GET /compute/v2.1/servers/9fbb269d-11cd-49ed-81ac-570e721c15cd => generated 1523 bytes in 569 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 15:48:29.191356 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi [None req-1aeca224-92bc-48fb-bca0-05caec1ce887 tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Calling method '>' {{(pid=128728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 15:48:29.192802 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.compute.api [None req-1aeca224-92bc-48fb-bca0-05caec1ce887 tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] [instance: 9fbb269d-11cd-49ed-81ac-570e721c15cd] Fetching instance by UUID {{(pid=128728) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 15:48:29.213129 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-1aeca224-92bc-48fb-bca0-05caec1ce887 tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:48:29.213934 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-1aeca224-92bc-48fb-bca0-05caec1ce887 tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:48:29.216570 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-1aeca224-92bc-48fb-bca0-05caec1ce887 tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:48:29.219185 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-1aeca224-92bc-48fb-bca0-05caec1ce887 tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:48:29.396358 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.policy [None req-1aeca224-92bc-48fb-bca0-05caec1ce887 tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b896317d96a40d6a137db0dcf5f98f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d2517d5440a4d30949f3dd36a46d813', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128728) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:48:29.407835 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: INFO nova.api.openstack.requestlog [None req-1aeca224-92bc-48fb-bca0-05caec1ce887 tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] 10.222.0.61 "GET /compute/v2.1/servers/9fbb269d-11cd-49ed-81ac-570e721c15cd" status: 200 len: 1523 microversion: 2.1 time: 0.224476 May 14 15:48:29.419288 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: [pid: 128728|app: 0|req: 178/335] 10.222.0.61 () {58 vars in 1235 bytes} [Sat May 14 15:48:29 2022] GET /compute/v2.1/servers/9fbb269d-11cd-49ed-81ac-570e721c15cd => generated 1523 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 15:48:30.433313 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi [None req-2b32a6cc-9425-4e59-9c0a-3c0c74d3aac8 tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Calling method '>' {{(pid=128729) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 15:48:30.434817 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.compute.api [None req-2b32a6cc-9425-4e59-9c0a-3c0c74d3aac8 tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] [instance: 9fbb269d-11cd-49ed-81ac-570e721c15cd] Fetching instance by UUID {{(pid=128729) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 15:48:30.448329 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-2b32a6cc-9425-4e59-9c0a-3c0c74d3aac8 tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:48:30.448853 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-2b32a6cc-9425-4e59-9c0a-3c0c74d3aac8 tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:48:30.449984 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-2b32a6cc-9425-4e59-9c0a-3c0c74d3aac8 tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:48:30.450674 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-2b32a6cc-9425-4e59-9c0a-3c0c74d3aac8 tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:48:30.623831 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.policy [None req-2b32a6cc-9425-4e59-9c0a-3c0c74d3aac8 tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b896317d96a40d6a137db0dcf5f98f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d2517d5440a4d30949f3dd36a46d813', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128729) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:48:30.636200 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: INFO nova.api.openstack.requestlog [None req-2b32a6cc-9425-4e59-9c0a-3c0c74d3aac8 tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] 10.222.0.61 "GET /compute/v2.1/servers/9fbb269d-11cd-49ed-81ac-570e721c15cd" status: 200 len: 1523 microversion: 2.1 time: 0.211458 May 14 15:48:30.639598 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: [pid: 128729|app: 0|req: 158/336] 10.222.0.61 () {58 vars in 1235 bytes} [Sat May 14 15:48:30 2022] GET /compute/v2.1/servers/9fbb269d-11cd-49ed-81ac-570e721c15cd => generated 1523 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 15:48:31.657899 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi [None req-c6fe85b6-4e15-4bf5-ae9a-17357d49087c tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Calling method '>' {{(pid=128728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 15:48:31.658626 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.compute.api [None req-c6fe85b6-4e15-4bf5-ae9a-17357d49087c tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] [instance: 9fbb269d-11cd-49ed-81ac-570e721c15cd] Fetching instance by UUID {{(pid=128728) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 15:48:31.669989 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-c6fe85b6-4e15-4bf5-ae9a-17357d49087c tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:48:31.670498 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-c6fe85b6-4e15-4bf5-ae9a-17357d49087c tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:48:31.674207 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-c6fe85b6-4e15-4bf5-ae9a-17357d49087c tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:48:31.674894 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-c6fe85b6-4e15-4bf5-ae9a-17357d49087c tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:48:31.904843 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.policy [None req-c6fe85b6-4e15-4bf5-ae9a-17357d49087c tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b896317d96a40d6a137db0dcf5f98f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d2517d5440a4d30949f3dd36a46d813', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128728) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:48:31.914706 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: INFO nova.api.openstack.requestlog [None req-c6fe85b6-4e15-4bf5-ae9a-17357d49087c tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] 10.222.0.61 "GET /compute/v2.1/servers/9fbb269d-11cd-49ed-81ac-570e721c15cd" status: 200 len: 1523 microversion: 2.1 time: 0.261640 May 14 15:48:31.922182 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: [pid: 128728|app: 0|req: 179/337] 10.222.0.61 () {58 vars in 1235 bytes} [Sat May 14 15:48:31 2022] GET /compute/v2.1/servers/9fbb269d-11cd-49ed-81ac-570e721c15cd => generated 1523 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 15:48:32.940366 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi [None req-2e034f91-b831-4876-bdf7-fa0155e47ddb tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Calling method '>' {{(pid=128729) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 15:48:32.941845 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.compute.api [None req-2e034f91-b831-4876-bdf7-fa0155e47ddb tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] [instance: 9fbb269d-11cd-49ed-81ac-570e721c15cd] Fetching instance by UUID {{(pid=128729) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 15:48:32.957357 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-2e034f91-b831-4876-bdf7-fa0155e47ddb tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:48:32.959649 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-2e034f91-b831-4876-bdf7-fa0155e47ddb tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:48:32.962491 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-2e034f91-b831-4876-bdf7-fa0155e47ddb tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:48:32.963208 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-2e034f91-b831-4876-bdf7-fa0155e47ddb tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:48:33.603933 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.policy [None req-2e034f91-b831-4876-bdf7-fa0155e47ddb tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b896317d96a40d6a137db0dcf5f98f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d2517d5440a4d30949f3dd36a46d813', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128729) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:48:33.627053 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: INFO nova.api.openstack.requestlog [None req-2e034f91-b831-4876-bdf7-fa0155e47ddb tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] 10.222.0.61 "GET /compute/v2.1/servers/9fbb269d-11cd-49ed-81ac-570e721c15cd" status: 200 len: 1523 microversion: 2.1 time: 0.691495 May 14 15:48:33.630706 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: [pid: 128729|app: 0|req: 159/338] 10.222.0.61 () {58 vars in 1235 bytes} [Sat May 14 15:48:32 2022] GET /compute/v2.1/servers/9fbb269d-11cd-49ed-81ac-570e721c15cd => generated 1523 bytes in 696 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 15:48:34.644545 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi [None req-6d9ed148-4902-4070-819a-a08e8e24aac9 tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Calling method '>' {{(pid=128728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 15:48:34.645248 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.compute.api [None req-6d9ed148-4902-4070-819a-a08e8e24aac9 tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] [instance: 9fbb269d-11cd-49ed-81ac-570e721c15cd] Fetching instance by UUID {{(pid=128728) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 15:48:34.659209 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-6d9ed148-4902-4070-819a-a08e8e24aac9 tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:48:34.660345 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-6d9ed148-4902-4070-819a-a08e8e24aac9 tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:48:34.662297 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-6d9ed148-4902-4070-819a-a08e8e24aac9 tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:48:34.663102 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-6d9ed148-4902-4070-819a-a08e8e24aac9 tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:48:34.896450 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.policy [None req-6d9ed148-4902-4070-819a-a08e8e24aac9 tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b896317d96a40d6a137db0dcf5f98f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d2517d5440a4d30949f3dd36a46d813', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128728) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:48:34.909414 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: INFO nova.api.openstack.requestlog [None req-6d9ed148-4902-4070-819a-a08e8e24aac9 tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] 10.222.0.61 "GET /compute/v2.1/servers/9fbb269d-11cd-49ed-81ac-570e721c15cd" status: 200 len: 1523 microversion: 2.1 time: 0.267210 May 14 15:48:34.910171 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: [pid: 128728|app: 0|req: 180/339] 10.222.0.61 () {58 vars in 1235 bytes} [Sat May 14 15:48:34 2022] GET /compute/v2.1/servers/9fbb269d-11cd-49ed-81ac-570e721c15cd => generated 1523 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 15:48:35.928430 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi [None req-3e8fb42a-cc7f-4248-bf60-d0d223de6c81 tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Calling method '>' {{(pid=128729) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 15:48:35.929033 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.compute.api [None req-3e8fb42a-cc7f-4248-bf60-d0d223de6c81 tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] [instance: 9fbb269d-11cd-49ed-81ac-570e721c15cd] Fetching instance by UUID {{(pid=128729) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 15:48:35.935553 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-3e8fb42a-cc7f-4248-bf60-d0d223de6c81 tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:48:35.936009 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-3e8fb42a-cc7f-4248-bf60-d0d223de6c81 tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:48:35.936793 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-3e8fb42a-cc7f-4248-bf60-d0d223de6c81 tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:48:35.937236 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-3e8fb42a-cc7f-4248-bf60-d0d223de6c81 tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:48:36.135958 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.policy [None req-3e8fb42a-cc7f-4248-bf60-d0d223de6c81 tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b896317d96a40d6a137db0dcf5f98f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d2517d5440a4d30949f3dd36a46d813', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128729) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:48:36.147688 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: INFO nova.api.openstack.requestlog [None req-3e8fb42a-cc7f-4248-bf60-d0d223de6c81 tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] 10.222.0.61 "GET /compute/v2.1/servers/9fbb269d-11cd-49ed-81ac-570e721c15cd" status: 200 len: 1523 microversion: 2.1 time: 0.222986 May 14 15:48:36.150882 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: [pid: 128729|app: 0|req: 160/340] 10.222.0.61 () {58 vars in 1235 bytes} [Sat May 14 15:48:35 2022] GET /compute/v2.1/servers/9fbb269d-11cd-49ed-81ac-570e721c15cd => generated 1523 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 15:48:37.165058 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi [None req-5f50e8b1-5dd8-42e3-af0d-cc725ad800d1 tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Calling method '>' {{(pid=128728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 15:48:37.166671 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.compute.api [None req-5f50e8b1-5dd8-42e3-af0d-cc725ad800d1 tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] [instance: 9fbb269d-11cd-49ed-81ac-570e721c15cd] Fetching instance by UUID {{(pid=128728) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 15:48:37.183190 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-5f50e8b1-5dd8-42e3-af0d-cc725ad800d1 tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:48:37.184035 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-5f50e8b1-5dd8-42e3-af0d-cc725ad800d1 tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:48:37.185319 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-5f50e8b1-5dd8-42e3-af0d-cc725ad800d1 tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:48:37.185943 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-5f50e8b1-5dd8-42e3-af0d-cc725ad800d1 tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:48:37.387976 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.policy [None req-5f50e8b1-5dd8-42e3-af0d-cc725ad800d1 tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b896317d96a40d6a137db0dcf5f98f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d2517d5440a4d30949f3dd36a46d813', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128728) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:48:37.409309 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: INFO nova.api.openstack.requestlog [None req-5f50e8b1-5dd8-42e3-af0d-cc725ad800d1 tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] 10.222.0.61 "GET /compute/v2.1/servers/9fbb269d-11cd-49ed-81ac-570e721c15cd" status: 200 len: 1523 microversion: 2.1 time: 0.248092 May 14 15:48:37.409905 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: [pid: 128728|app: 0|req: 181/341] 10.222.0.61 () {58 vars in 1235 bytes} [Sat May 14 15:48:37 2022] GET /compute/v2.1/servers/9fbb269d-11cd-49ed-81ac-570e721c15cd => generated 1523 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 15:48:38.427250 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi [None req-3f31d369-7dff-44f7-92a7-a892bcded400 tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Calling method '>' {{(pid=128729) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 15:48:38.428529 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.compute.api [None req-3f31d369-7dff-44f7-92a7-a892bcded400 tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] [instance: 9fbb269d-11cd-49ed-81ac-570e721c15cd] Fetching instance by UUID {{(pid=128729) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 15:48:38.444730 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-3f31d369-7dff-44f7-92a7-a892bcded400 tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:48:38.448272 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-3f31d369-7dff-44f7-92a7-a892bcded400 tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:48:38.450116 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-3f31d369-7dff-44f7-92a7-a892bcded400 tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:48:38.451596 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-3f31d369-7dff-44f7-92a7-a892bcded400 tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:48:38.783842 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.policy [None req-3f31d369-7dff-44f7-92a7-a892bcded400 tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b896317d96a40d6a137db0dcf5f98f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d2517d5440a4d30949f3dd36a46d813', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128729) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:48:38.791880 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: INFO nova.api.openstack.requestlog [None req-3f31d369-7dff-44f7-92a7-a892bcded400 tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] 10.222.0.61 "GET /compute/v2.1/servers/9fbb269d-11cd-49ed-81ac-570e721c15cd" status: 200 len: 1523 microversion: 2.1 time: 0.368841 May 14 15:48:38.802913 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: [pid: 128729|app: 0|req: 161/342] 10.222.0.61 () {58 vars in 1235 bytes} [Sat May 14 15:48:38 2022] GET /compute/v2.1/servers/9fbb269d-11cd-49ed-81ac-570e721c15cd => generated 1523 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 15:48:39.810840 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi [None req-0d4f4f1f-c42d-48f6-b25a-4651626ae102 tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Calling method '>' {{(pid=128728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 15:48:39.812553 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.compute.api [None req-0d4f4f1f-c42d-48f6-b25a-4651626ae102 tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] [instance: 9fbb269d-11cd-49ed-81ac-570e721c15cd] Fetching instance by UUID {{(pid=128728) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 15:48:39.820068 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-0d4f4f1f-c42d-48f6-b25a-4651626ae102 tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:48:39.820607 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-0d4f4f1f-c42d-48f6-b25a-4651626ae102 tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:48:39.821638 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-0d4f4f1f-c42d-48f6-b25a-4651626ae102 tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:48:39.823577 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-0d4f4f1f-c42d-48f6-b25a-4651626ae102 tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:48:40.062907 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.policy [None req-0d4f4f1f-c42d-48f6-b25a-4651626ae102 tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b896317d96a40d6a137db0dcf5f98f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d2517d5440a4d30949f3dd36a46d813', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128728) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:48:40.120774 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: INFO nova.api.openstack.requestlog [None req-0d4f4f1f-c42d-48f6-b25a-4651626ae102 tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] 10.222.0.61 "GET /compute/v2.1/servers/9fbb269d-11cd-49ed-81ac-570e721c15cd" status: 200 len: 1523 microversion: 2.1 time: 0.315566 May 14 15:48:40.127213 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: [pid: 128728|app: 0|req: 182/343] 10.222.0.61 () {58 vars in 1235 bytes} [Sat May 14 15:48:39 2022] GET /compute/v2.1/servers/9fbb269d-11cd-49ed-81ac-570e721c15cd => generated 1523 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 15:48:41.144701 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi [None req-3c09d7c2-070b-40db-8399-c6eca6b2edf7 tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Calling method '>' {{(pid=128729) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 15:48:41.146280 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.compute.api [None req-3c09d7c2-070b-40db-8399-c6eca6b2edf7 tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] [instance: 9fbb269d-11cd-49ed-81ac-570e721c15cd] Fetching instance by UUID {{(pid=128729) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 15:48:41.154149 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-3c09d7c2-070b-40db-8399-c6eca6b2edf7 tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:48:41.154631 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-3c09d7c2-070b-40db-8399-c6eca6b2edf7 tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:48:41.155580 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-3c09d7c2-070b-40db-8399-c6eca6b2edf7 tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:48:41.156171 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-3c09d7c2-070b-40db-8399-c6eca6b2edf7 tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:48:41.316342 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.policy [None req-3c09d7c2-070b-40db-8399-c6eca6b2edf7 tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b896317d96a40d6a137db0dcf5f98f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d2517d5440a4d30949f3dd36a46d813', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128729) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:48:41.325279 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: INFO nova.api.openstack.requestlog [None req-3c09d7c2-070b-40db-8399-c6eca6b2edf7 tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] 10.222.0.61 "GET /compute/v2.1/servers/9fbb269d-11cd-49ed-81ac-570e721c15cd" status: 200 len: 1523 microversion: 2.1 time: 0.184742 May 14 15:48:41.326172 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: [pid: 128729|app: 0|req: 162/344] 10.222.0.61 () {58 vars in 1235 bytes} [Sat May 14 15:48:41 2022] GET /compute/v2.1/servers/9fbb269d-11cd-49ed-81ac-570e721c15cd => generated 1523 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 15:48:42.343445 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi [None req-aaf0d644-4c0e-48aa-8116-c847468ce040 tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Calling method '>' {{(pid=128728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 15:48:42.344799 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.compute.api [None req-aaf0d644-4c0e-48aa-8116-c847468ce040 tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] [instance: 9fbb269d-11cd-49ed-81ac-570e721c15cd] Fetching instance by UUID {{(pid=128728) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 15:48:42.351063 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-aaf0d644-4c0e-48aa-8116-c847468ce040 tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:48:42.351901 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-aaf0d644-4c0e-48aa-8116-c847468ce040 tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:48:42.354024 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-aaf0d644-4c0e-48aa-8116-c847468ce040 tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:48:42.354867 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-aaf0d644-4c0e-48aa-8116-c847468ce040 tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:48:42.539439 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.policy [None req-aaf0d644-4c0e-48aa-8116-c847468ce040 tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b896317d96a40d6a137db0dcf5f98f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d2517d5440a4d30949f3dd36a46d813', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128728) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:48:42.554647 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: INFO nova.api.openstack.requestlog [None req-aaf0d644-4c0e-48aa-8116-c847468ce040 tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] 10.222.0.61 "GET /compute/v2.1/servers/9fbb269d-11cd-49ed-81ac-570e721c15cd" status: 200 len: 1523 microversion: 2.1 time: 0.214325 May 14 15:48:42.555272 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: [pid: 128728|app: 0|req: 183/345] 10.222.0.61 () {58 vars in 1235 bytes} [Sat May 14 15:48:42 2022] GET /compute/v2.1/servers/9fbb269d-11cd-49ed-81ac-570e721c15cd => generated 1523 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 15:48:43.573269 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi [None req-1283f605-a7f0-4acf-84cf-0a7ce8b563f2 tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Calling method '>' {{(pid=128729) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 15:48:43.576720 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.compute.api [None req-1283f605-a7f0-4acf-84cf-0a7ce8b563f2 tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] [instance: 9fbb269d-11cd-49ed-81ac-570e721c15cd] Fetching instance by UUID {{(pid=128729) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 15:48:43.583836 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-1283f605-a7f0-4acf-84cf-0a7ce8b563f2 tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:48:43.584640 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-1283f605-a7f0-4acf-84cf-0a7ce8b563f2 tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:48:43.585608 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-1283f605-a7f0-4acf-84cf-0a7ce8b563f2 tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:48:43.586046 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-1283f605-a7f0-4acf-84cf-0a7ce8b563f2 tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:48:43.737390 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.policy [None req-1283f605-a7f0-4acf-84cf-0a7ce8b563f2 tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b896317d96a40d6a137db0dcf5f98f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d2517d5440a4d30949f3dd36a46d813', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128729) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:48:43.746532 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: INFO nova.api.openstack.requestlog [None req-1283f605-a7f0-4acf-84cf-0a7ce8b563f2 tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] 10.222.0.61 "GET /compute/v2.1/servers/9fbb269d-11cd-49ed-81ac-570e721c15cd" status: 200 len: 1523 microversion: 2.1 time: 0.178488 May 14 15:48:43.747352 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: [pid: 128729|app: 0|req: 163/346] 10.222.0.61 () {58 vars in 1235 bytes} [Sat May 14 15:48:43 2022] GET /compute/v2.1/servers/9fbb269d-11cd-49ed-81ac-570e721c15cd => generated 1523 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 15:48:44.764389 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi [None req-c209c73c-4c1a-4ce8-b224-0f49a0403a27 tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Calling method '>' {{(pid=128728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 15:48:44.765005 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.compute.api [None req-c209c73c-4c1a-4ce8-b224-0f49a0403a27 tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] [instance: 9fbb269d-11cd-49ed-81ac-570e721c15cd] Fetching instance by UUID {{(pid=128728) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 15:48:44.770980 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-c209c73c-4c1a-4ce8-b224-0f49a0403a27 tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:48:44.771436 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-c209c73c-4c1a-4ce8-b224-0f49a0403a27 tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:48:44.772211 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-c209c73c-4c1a-4ce8-b224-0f49a0403a27 tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:48:44.772808 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-c209c73c-4c1a-4ce8-b224-0f49a0403a27 tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:48:44.916681 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.policy [None req-c209c73c-4c1a-4ce8-b224-0f49a0403a27 tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b896317d96a40d6a137db0dcf5f98f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d2517d5440a4d30949f3dd36a46d813', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128728) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:48:44.925692 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: INFO nova.api.openstack.requestlog [None req-c209c73c-4c1a-4ce8-b224-0f49a0403a27 tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] 10.222.0.61 "GET /compute/v2.1/servers/9fbb269d-11cd-49ed-81ac-570e721c15cd" status: 200 len: 1523 microversion: 2.1 time: 0.166050 May 14 15:48:44.926781 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: [pid: 128728|app: 0|req: 184/347] 10.222.0.61 () {58 vars in 1235 bytes} [Sat May 14 15:48:44 2022] GET /compute/v2.1/servers/9fbb269d-11cd-49ed-81ac-570e721c15cd => generated 1523 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 15:48:45.827636 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi [None req-13744713-833f-4e67-a5f6-ff9925c2b6d6 tempest-TestMinimumBasicScenario-1817438735 tempest-TestMinimumBasicScenario-1817438735-project] Action: 'create', calling method: .version_select at 0x7f77d802d040>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-599156118", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLMZRitINU8boF5JOa6S4zcgcN1VtK+bbeiEsF3EVg9z7PJwkb63lgSs1Cl+4rK1hR1XFth6N8btWK5L3UeoA4rOJa40AxFXMj0O1GlxNTBbarzPMs/yWvWAJmb9nrUq5g=="}} {{(pid=128729) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 15:48:45.844018 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.quota [None req-13744713-833f-4e67-a5f6-ff9925c2b6d6 tempest-TestMinimumBasicScenario-1817438735 tempest-TestMinimumBasicScenario-1817438735-project] Getting quotas for project 5fba11e8ade54d388361c4c936a43372. Resources: {'key_pairs'} {{(pid=128729) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 14 15:48:45.849995 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.quota [None req-13744713-833f-4e67-a5f6-ff9925c2b6d6 tempest-TestMinimumBasicScenario-1817438735 tempest-TestMinimumBasicScenario-1817438735-project] Getting quotas for user 6d5f259e0b98457ea6b6b88d886c813d and project 5fba11e8ade54d388361c4c936a43372. Resources: {'key_pairs'} {{(pid=128729) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 14 15:48:45.887161 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: INFO nova.api.openstack.requestlog [None req-13744713-833f-4e67-a5f6-ff9925c2b6d6 tempest-TestMinimumBasicScenario-1817438735 tempest-TestMinimumBasicScenario-1817438735-project] 10.222.0.61 "POST /compute/v2.1/os-keypairs" status: 200 len: 402 microversion: 2.1 time: 0.064778 May 14 15:48:45.888496 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: [pid: 128729|app: 0|req: 164/348] 10.222.0.61 () {60 vars in 1158 bytes} [Sat May 14 15:48:45 2022] POST /compute/v2.1/os-keypairs => generated 402 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 14 15:48:45.943629 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi [None req-5f13493d-51f6-4f15-8bd2-e6a587da49cc tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Calling method '>' {{(pid=128728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 15:48:45.944232 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.compute.api [None req-5f13493d-51f6-4f15-8bd2-e6a587da49cc tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] [instance: 9fbb269d-11cd-49ed-81ac-570e721c15cd] Fetching instance by UUID {{(pid=128728) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 15:48:45.955787 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-5f13493d-51f6-4f15-8bd2-e6a587da49cc tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:48:45.956254 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-5f13493d-51f6-4f15-8bd2-e6a587da49cc tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:48:45.957045 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-5f13493d-51f6-4f15-8bd2-e6a587da49cc tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:48:45.957498 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-5f13493d-51f6-4f15-8bd2-e6a587da49cc tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:48:46.025794 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi [None req-763a0b61-d1d5-4f7c-bd02-b16dc1000223 tempest-TestMinimumBasicScenario-1817438735 tempest-TestMinimumBasicScenario-1817438735-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-440076796", "imageRef": "6a9d5827-42f7-436a-b0d5-77ed0ddd43b9", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-599156118", "networks": [{"uuid": "4b5e11b1-b142-4a99-ada9-a011e605383b"}]}} {{(pid=128729) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 15:48:46.103469 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.network.neutron [None req-763a0b61-d1d5-4f7c-bd02-b16dc1000223 tempest-TestMinimumBasicScenario-1817438735 tempest-TestMinimumBasicScenario-1817438735-project] validate_networks() for [('4b5e11b1-b142-4a99-ada9-a011e605383b', None, None, None, None, None)] {{(pid=128729) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 14 15:48:46.246205 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.policy [None req-5f13493d-51f6-4f15-8bd2-e6a587da49cc tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b896317d96a40d6a137db0dcf5f98f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d2517d5440a4d30949f3dd36a46d813', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128728) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:48:46.256552 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: INFO nova.api.openstack.requestlog [None req-5f13493d-51f6-4f15-8bd2-e6a587da49cc tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] 10.222.0.61 "GET /compute/v2.1/servers/9fbb269d-11cd-49ed-81ac-570e721c15cd" status: 200 len: 1523 microversion: 2.1 time: 0.317090 May 14 15:48:46.257124 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: [pid: 128728|app: 0|req: 185/349] 10.222.0.61 () {58 vars in 1235 bytes} [Sat May 14 15:48:45 2022] GET /compute/v2.1/servers/9fbb269d-11cd-49ed-81ac-570e721c15cd => generated 1523 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 15:48:46.889907 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.virt.hardware [None req-763a0b61-d1d5-4f7c-bd02-b16dc1000223 tempest-TestMinimumBasicScenario-1817438735 tempest-TestMinimumBasicScenario-1817438735-project] Flavor limits 0:0:0 {{(pid=128729) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 14 15:48:46.891169 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.virt.hardware [None req-763a0b61-d1d5-4f7c-bd02-b16dc1000223 tempest-TestMinimumBasicScenario-1817438735 tempest-TestMinimumBasicScenario-1817438735-project] Image limits 0:0:0 {{(pid=128729) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 14 15:48:46.891817 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.virt.hardware [None req-763a0b61-d1d5-4f7c-bd02-b16dc1000223 tempest-TestMinimumBasicScenario-1817438735 tempest-TestMinimumBasicScenario-1817438735-project] Flavor pref 0:0:0 {{(pid=128729) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 14 15:48:46.892230 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.virt.hardware [None req-763a0b61-d1d5-4f7c-bd02-b16dc1000223 tempest-TestMinimumBasicScenario-1817438735 tempest-TestMinimumBasicScenario-1817438735-project] Image pref 0:0:0 {{(pid=128729) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 14 15:48:46.892708 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.virt.hardware [None req-763a0b61-d1d5-4f7c-bd02-b16dc1000223 tempest-TestMinimumBasicScenario-1817438735 tempest-TestMinimumBasicScenario-1817438735-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128729) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 14 15:48:46.903277 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-763a0b61-d1d5-4f7c-bd02-b16dc1000223 tempest-TestMinimumBasicScenario-1817438735 tempest-TestMinimumBasicScenario-1817438735-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:48:46.904235 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-763a0b61-d1d5-4f7c-bd02-b16dc1000223 tempest-TestMinimumBasicScenario-1817438735 tempest-TestMinimumBasicScenario-1817438735-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:48:46.905184 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-763a0b61-d1d5-4f7c-bd02-b16dc1000223 tempest-TestMinimumBasicScenario-1817438735 tempest-TestMinimumBasicScenario-1817438735-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:48:46.906230 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-763a0b61-d1d5-4f7c-bd02-b16dc1000223 tempest-TestMinimumBasicScenario-1817438735 tempest-TestMinimumBasicScenario-1817438735-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:48:46.927963 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.quota [None req-763a0b61-d1d5-4f7c-bd02-b16dc1000223 tempest-TestMinimumBasicScenario-1817438735 tempest-TestMinimumBasicScenario-1817438735-project] Getting quotas for project 5fba11e8ade54d388361c4c936a43372. Resources: {'instances', 'cores', 'ram'} {{(pid=128729) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 14 15:48:46.932638 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.quota [None req-763a0b61-d1d5-4f7c-bd02-b16dc1000223 tempest-TestMinimumBasicScenario-1817438735 tempest-TestMinimumBasicScenario-1817438735-project] Getting quotas for user 6d5f259e0b98457ea6b6b88d886c813d and project 5fba11e8ade54d388361c4c936a43372. Resources: {'instances', 'cores', 'ram'} {{(pid=128729) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 14 15:48:46.944649 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.compute.api [None req-763a0b61-d1d5-4f7c-bd02-b16dc1000223 tempest-TestMinimumBasicScenario-1817438735 tempest-TestMinimumBasicScenario-1817438735-project] Going to run 1 instances... {{(pid=128729) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 14 15:48:46.947073 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.compute.api [None req-763a0b61-d1d5-4f7c-bd02-b16dc1000223 tempest-TestMinimumBasicScenario-1817438735 tempest-TestMinimumBasicScenario-1817438735-project] [instance: ef63d04a-87e5-4202-a672-d45a2a877c68] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='6a9d5827-42f7-436a-b0d5-77ed0ddd43b9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128729) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 14 15:48:47.003046 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: INFO nova.api.openstack.requestlog [None req-763a0b61-d1d5-4f7c-bd02-b16dc1000223 tempest-TestMinimumBasicScenario-1817438735 tempest-TestMinimumBasicScenario-1817438735-project] 10.222.0.61 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.981910 May 14 15:48:47.003684 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: [pid: 128729|app: 0|req: 165/350] 10.222.0.61 () {60 vars in 1146 bytes} [Sat May 14 15:48:46 2022] POST /compute/v2.1/servers => generated 380 bytes in 983 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) May 14 15:48:47.013539 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi [None req-9fadcb1f-3abe-4618-99e1-40fe602f6202 tempest-TestMinimumBasicScenario-1817438735 tempest-TestMinimumBasicScenario-1817438735-project] Calling method '>' {{(pid=128728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 15:48:47.014149 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.compute.api [None req-9fadcb1f-3abe-4618-99e1-40fe602f6202 tempest-TestMinimumBasicScenario-1817438735 tempest-TestMinimumBasicScenario-1817438735-project] [instance: ef63d04a-87e5-4202-a672-d45a2a877c68] Fetching instance by UUID {{(pid=128728) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 15:48:47.108674 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.policy [None req-9fadcb1f-3abe-4618-99e1-40fe602f6202 tempest-TestMinimumBasicScenario-1817438735 tempest-TestMinimumBasicScenario-1817438735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d5f259e0b98457ea6b6b88d886c813d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fba11e8ade54d388361c4c936a43372', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128728) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:48:47.115891 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: INFO nova.api.openstack.requestlog [None req-9fadcb1f-3abe-4618-99e1-40fe602f6202 tempest-TestMinimumBasicScenario-1817438735 tempest-TestMinimumBasicScenario-1817438735-project] 10.222.0.61 "GET /compute/v2.1/servers/ef63d04a-87e5-4202-a672-d45a2a877c68" status: 200 len: 1257 microversion: 2.1 time: 0.106392 May 14 15:48:47.116819 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: [pid: 128728|app: 0|req: 186/351] 10.222.0.61 () {58 vars in 1235 bytes} [Sat May 14 15:48:47 2022] GET /compute/v2.1/servers/ef63d04a-87e5-4202-a672-d45a2a877c68 => generated 1257 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 15:48:47.276868 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi [None req-16865de4-239a-4f3c-8cb9-a6d48b4a3cb7 tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Calling method '>' {{(pid=128729) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 15:48:47.277497 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.compute.api [None req-16865de4-239a-4f3c-8cb9-a6d48b4a3cb7 tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] [instance: 9fbb269d-11cd-49ed-81ac-570e721c15cd] Fetching instance by UUID {{(pid=128729) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 15:48:47.292444 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-16865de4-239a-4f3c-8cb9-a6d48b4a3cb7 tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:48:47.293193 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-16865de4-239a-4f3c-8cb9-a6d48b4a3cb7 tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:48:47.295498 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-16865de4-239a-4f3c-8cb9-a6d48b4a3cb7 tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:48:47.298042 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-16865de4-239a-4f3c-8cb9-a6d48b4a3cb7 tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:48:47.504482 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.policy [None req-16865de4-239a-4f3c-8cb9-a6d48b4a3cb7 tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b896317d96a40d6a137db0dcf5f98f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d2517d5440a4d30949f3dd36a46d813', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128729) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:48:47.518660 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: INFO nova.api.openstack.requestlog [None req-16865de4-239a-4f3c-8cb9-a6d48b4a3cb7 tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] 10.222.0.61 "GET /compute/v2.1/servers/9fbb269d-11cd-49ed-81ac-570e721c15cd" status: 200 len: 1523 microversion: 2.1 time: 0.246879 May 14 15:48:47.520657 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: [pid: 128729|app: 0|req: 166/352] 10.222.0.61 () {58 vars in 1235 bytes} [Sat May 14 15:48:47 2022] GET /compute/v2.1/servers/9fbb269d-11cd-49ed-81ac-570e721c15cd => generated 1523 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 15:48:48.131990 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi [None req-85574239-9416-47fa-bbd5-3a158a4f34de tempest-TestMinimumBasicScenario-1817438735 tempest-TestMinimumBasicScenario-1817438735-project] Calling method '>' {{(pid=128728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 15:48:48.132598 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.compute.api [None req-85574239-9416-47fa-bbd5-3a158a4f34de tempest-TestMinimumBasicScenario-1817438735 tempest-TestMinimumBasicScenario-1817438735-project] [instance: ef63d04a-87e5-4202-a672-d45a2a877c68] Fetching instance by UUID {{(pid=128728) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 15:48:48.138510 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-85574239-9416-47fa-bbd5-3a158a4f34de tempest-TestMinimumBasicScenario-1817438735 tempest-TestMinimumBasicScenario-1817438735-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:48:48.138952 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-85574239-9416-47fa-bbd5-3a158a4f34de tempest-TestMinimumBasicScenario-1817438735 tempest-TestMinimumBasicScenario-1817438735-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:48:48.139724 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-85574239-9416-47fa-bbd5-3a158a4f34de tempest-TestMinimumBasicScenario-1817438735 tempest-TestMinimumBasicScenario-1817438735-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:48:48.140161 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-85574239-9416-47fa-bbd5-3a158a4f34de tempest-TestMinimumBasicScenario-1817438735 tempest-TestMinimumBasicScenario-1817438735-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:48:48.213445 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.policy [None req-85574239-9416-47fa-bbd5-3a158a4f34de tempest-TestMinimumBasicScenario-1817438735 tempest-TestMinimumBasicScenario-1817438735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d5f259e0b98457ea6b6b88d886c813d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fba11e8ade54d388361c4c936a43372', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128728) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:48:48.221106 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: INFO nova.api.openstack.requestlog [None req-85574239-9416-47fa-bbd5-3a158a4f34de tempest-TestMinimumBasicScenario-1817438735 tempest-TestMinimumBasicScenario-1817438735-project] 10.222.0.61 "GET /compute/v2.1/servers/ef63d04a-87e5-4202-a672-d45a2a877c68" status: 200 len: 1253 microversion: 2.1 time: 0.092937 May 14 15:48:48.221674 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: [pid: 128728|app: 0|req: 187/353] 10.222.0.61 () {58 vars in 1235 bytes} [Sat May 14 15:48:48 2022] GET /compute/v2.1/servers/ef63d04a-87e5-4202-a672-d45a2a877c68 => generated 1253 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 15:48:48.535879 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi [None req-b9000f5a-92c1-4902-b4c6-1bc70130eac4 tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Calling method '>' {{(pid=128729) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 15:48:48.536490 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.compute.api [None req-b9000f5a-92c1-4902-b4c6-1bc70130eac4 tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] [instance: 9fbb269d-11cd-49ed-81ac-570e721c15cd] Fetching instance by UUID {{(pid=128729) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 15:48:48.543801 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-b9000f5a-92c1-4902-b4c6-1bc70130eac4 tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:48:48.544279 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-b9000f5a-92c1-4902-b4c6-1bc70130eac4 tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:48:48.545034 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-b9000f5a-92c1-4902-b4c6-1bc70130eac4 tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:48:48.545472 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-b9000f5a-92c1-4902-b4c6-1bc70130eac4 tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:48:48.691272 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.policy [None req-b9000f5a-92c1-4902-b4c6-1bc70130eac4 tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b896317d96a40d6a137db0dcf5f98f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d2517d5440a4d30949f3dd36a46d813', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128729) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:48:48.699245 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: INFO nova.api.openstack.requestlog [None req-b9000f5a-92c1-4902-b4c6-1bc70130eac4 tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] 10.222.0.61 "GET /compute/v2.1/servers/9fbb269d-11cd-49ed-81ac-570e721c15cd" status: 200 len: 1523 microversion: 2.1 time: 0.167204 May 14 15:48:48.699816 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: [pid: 128729|app: 0|req: 167/354] 10.222.0.61 () {58 vars in 1235 bytes} [Sat May 14 15:48:48 2022] GET /compute/v2.1/servers/9fbb269d-11cd-49ed-81ac-570e721c15cd => generated 1523 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 15:48:49.238884 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi [None req-4af9f525-37f4-48a5-9dfc-937fba90e02f tempest-TestMinimumBasicScenario-1817438735 tempest-TestMinimumBasicScenario-1817438735-project] Calling method '>' {{(pid=128728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 15:48:49.239631 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.compute.api [None req-4af9f525-37f4-48a5-9dfc-937fba90e02f tempest-TestMinimumBasicScenario-1817438735 tempest-TestMinimumBasicScenario-1817438735-project] [instance: ef63d04a-87e5-4202-a672-d45a2a877c68] Fetching instance by UUID {{(pid=128728) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 15:48:49.245985 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-4af9f525-37f4-48a5-9dfc-937fba90e02f tempest-TestMinimumBasicScenario-1817438735 tempest-TestMinimumBasicScenario-1817438735-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:48:49.246471 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-4af9f525-37f4-48a5-9dfc-937fba90e02f tempest-TestMinimumBasicScenario-1817438735 tempest-TestMinimumBasicScenario-1817438735-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:48:49.247246 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-4af9f525-37f4-48a5-9dfc-937fba90e02f tempest-TestMinimumBasicScenario-1817438735 tempest-TestMinimumBasicScenario-1817438735-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:48:49.247859 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-4af9f525-37f4-48a5-9dfc-937fba90e02f tempest-TestMinimumBasicScenario-1817438735 tempest-TestMinimumBasicScenario-1817438735-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:48:49.259662 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi [None req-5f09b0cd-1c92-4ce8-8a93-b8c49572d0d6 tempest-VolumesNegativeTest-1107689494 tempest-VolumesNegativeTest-1107689494-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-1476399293", "imageRef": "1381e3d5-fc27-4fa7-ab03-5d86278a0546", "flavorRef": "452"}} {{(pid=128729) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 15:48:49.315457 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.network.neutron [None req-5f09b0cd-1c92-4ce8-8a93-b8c49572d0d6 tempest-VolumesNegativeTest-1107689494 tempest-VolumesNegativeTest-1107689494-project] validate_networks() for None {{(pid=128729) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 14 15:48:49.315827 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.policy [None req-4af9f525-37f4-48a5-9dfc-937fba90e02f tempest-TestMinimumBasicScenario-1817438735 tempest-TestMinimumBasicScenario-1817438735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d5f259e0b98457ea6b6b88d886c813d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fba11e8ade54d388361c4c936a43372', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128728) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:48:49.324664 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: INFO nova.api.openstack.requestlog [None req-4af9f525-37f4-48a5-9dfc-937fba90e02f tempest-TestMinimumBasicScenario-1817438735 tempest-TestMinimumBasicScenario-1817438735-project] 10.222.0.61 "GET /compute/v2.1/servers/ef63d04a-87e5-4202-a672-d45a2a877c68" status: 200 len: 1317 microversion: 2.1 time: 0.089863 May 14 15:48:49.325817 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: [pid: 128728|app: 0|req: 188/355] 10.222.0.61 () {58 vars in 1235 bytes} [Sat May 14 15:48:49 2022] GET /compute/v2.1/servers/ef63d04a-87e5-4202-a672-d45a2a877c68 => generated 1317 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 15:48:49.600065 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.virt.hardware [None req-5f09b0cd-1c92-4ce8-8a93-b8c49572d0d6 tempest-VolumesNegativeTest-1107689494 tempest-VolumesNegativeTest-1107689494-project] Flavor limits 0:0:0 {{(pid=128729) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 14 15:48:49.600565 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.virt.hardware [None req-5f09b0cd-1c92-4ce8-8a93-b8c49572d0d6 tempest-VolumesNegativeTest-1107689494 tempest-VolumesNegativeTest-1107689494-project] Image limits 0:0:0 {{(pid=128729) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 14 15:48:49.600810 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.virt.hardware [None req-5f09b0cd-1c92-4ce8-8a93-b8c49572d0d6 tempest-VolumesNegativeTest-1107689494 tempest-VolumesNegativeTest-1107689494-project] Flavor pref 0:0:0 {{(pid=128729) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 14 15:48:49.601221 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.virt.hardware [None req-5f09b0cd-1c92-4ce8-8a93-b8c49572d0d6 tempest-VolumesNegativeTest-1107689494 tempest-VolumesNegativeTest-1107689494-project] Image pref 0:0:0 {{(pid=128729) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 14 15:48:49.601639 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.virt.hardware [None req-5f09b0cd-1c92-4ce8-8a93-b8c49572d0d6 tempest-VolumesNegativeTest-1107689494 tempest-VolumesNegativeTest-1107689494-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128729) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 14 15:48:49.613364 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-5f09b0cd-1c92-4ce8-8a93-b8c49572d0d6 tempest-VolumesNegativeTest-1107689494 tempest-VolumesNegativeTest-1107689494-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:48:49.613816 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-5f09b0cd-1c92-4ce8-8a93-b8c49572d0d6 tempest-VolumesNegativeTest-1107689494 tempest-VolumesNegativeTest-1107689494-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:48:49.614667 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-5f09b0cd-1c92-4ce8-8a93-b8c49572d0d6 tempest-VolumesNegativeTest-1107689494 tempest-VolumesNegativeTest-1107689494-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:48:49.615108 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-5f09b0cd-1c92-4ce8-8a93-b8c49572d0d6 tempest-VolumesNegativeTest-1107689494 tempest-VolumesNegativeTest-1107689494-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:48:49.632714 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.quota [None req-5f09b0cd-1c92-4ce8-8a93-b8c49572d0d6 tempest-VolumesNegativeTest-1107689494 tempest-VolumesNegativeTest-1107689494-project] Getting quotas for project c1e7c6697dfc4562b4c1d46ee21964a5. Resources: {'instances', 'cores', 'ram'} {{(pid=128729) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 14 15:48:49.637722 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.quota [None req-5f09b0cd-1c92-4ce8-8a93-b8c49572d0d6 tempest-VolumesNegativeTest-1107689494 tempest-VolumesNegativeTest-1107689494-project] Getting quotas for user 1e8303a1f1584ae2aae774eaf31481f0 and project c1e7c6697dfc4562b4c1d46ee21964a5. Resources: {'instances', 'cores', 'ram'} {{(pid=128729) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 14 15:48:49.648962 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.compute.api [None req-5f09b0cd-1c92-4ce8-8a93-b8c49572d0d6 tempest-VolumesNegativeTest-1107689494 tempest-VolumesNegativeTest-1107689494-project] Going to run 1 instances... {{(pid=128729) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 14 15:48:49.651171 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.compute.api [None req-5f09b0cd-1c92-4ce8-8a93-b8c49572d0d6 tempest-VolumesNegativeTest-1107689494 tempest-VolumesNegativeTest-1107689494-project] [instance: ea1f238d-3bae-4ce8-b328-d07fc2f7f272] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='1381e3d5-fc27-4fa7-ab03-5d86278a0546',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128729) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 14 15:48:49.716418 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi [None req-64fe80c2-962b-4823-b80c-131256a69d5d tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Calling method '>' {{(pid=128728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 15:48:49.717551 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.compute.api [None req-64fe80c2-962b-4823-b80c-131256a69d5d tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] [instance: 9fbb269d-11cd-49ed-81ac-570e721c15cd] Fetching instance by UUID {{(pid=128728) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 15:48:49.720607 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: INFO nova.api.openstack.requestlog [None req-5f09b0cd-1c92-4ce8-8a93-b8c49572d0d6 tempest-VolumesNegativeTest-1107689494 tempest-VolumesNegativeTest-1107689494-project] 10.222.0.61 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.465128 May 14 15:48:49.721656 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: [pid: 128729|app: 0|req: 168/356] 10.222.0.61 () {60 vars in 1146 bytes} [Sat May 14 15:48:49 2022] POST /compute/v2.1/servers => generated 380 bytes in 467 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 14 15:48:49.734128 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi [None req-85d488ad-9914-41c5-89fa-fabdb899cc81 tempest-VolumesNegativeTest-1107689494 tempest-VolumesNegativeTest-1107689494-project] Calling method '>' {{(pid=128729) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 15:48:49.735052 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.compute.api [None req-85d488ad-9914-41c5-89fa-fabdb899cc81 tempest-VolumesNegativeTest-1107689494 tempest-VolumesNegativeTest-1107689494-project] [instance: ea1f238d-3bae-4ce8-b328-d07fc2f7f272] Fetching instance by UUID {{(pid=128729) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 15:48:49.749250 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-64fe80c2-962b-4823-b80c-131256a69d5d tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:48:49.749729 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-64fe80c2-962b-4823-b80c-131256a69d5d tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:48:49.750701 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-64fe80c2-962b-4823-b80c-131256a69d5d tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:48:49.751143 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-64fe80c2-962b-4823-b80c-131256a69d5d tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:48:49.799539 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.policy [None req-85d488ad-9914-41c5-89fa-fabdb899cc81 tempest-VolumesNegativeTest-1107689494 tempest-VolumesNegativeTest-1107689494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e8303a1f1584ae2aae774eaf31481f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1e7c6697dfc4562b4c1d46ee21964a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128729) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:48:49.808974 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: INFO nova.api.openstack.requestlog [None req-85d488ad-9914-41c5-89fa-fabdb899cc81 tempest-VolumesNegativeTest-1107689494 tempest-VolumesNegativeTest-1107689494-project] 10.222.0.61 "GET /compute/v2.1/servers/ea1f238d-3bae-4ce8-b328-d07fc2f7f272" status: 200 len: 1215 microversion: 2.1 time: 0.079142 May 14 15:48:49.818291 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: [pid: 128729|app: 0|req: 169/357] 10.222.0.61 () {58 vars in 1235 bytes} [Sat May 14 15:48:49 2022] GET /compute/v2.1/servers/ea1f238d-3bae-4ce8-b328-d07fc2f7f272 => generated 1215 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 15:48:50.030300 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.policy [None req-64fe80c2-962b-4823-b80c-131256a69d5d tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b896317d96a40d6a137db0dcf5f98f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d2517d5440a4d30949f3dd36a46d813', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128728) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:48:50.044649 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: INFO nova.api.openstack.requestlog [None req-64fe80c2-962b-4823-b80c-131256a69d5d tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] 10.222.0.61 "GET /compute/v2.1/servers/9fbb269d-11cd-49ed-81ac-570e721c15cd" status: 200 len: 1503 microversion: 2.1 time: 0.332124 May 14 15:48:50.045570 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: [pid: 128728|app: 0|req: 189/358] 10.222.0.61 () {58 vars in 1235 bytes} [Sat May 14 15:48:49 2022] GET /compute/v2.1/servers/9fbb269d-11cd-49ed-81ac-570e721c15cd => generated 1503 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 15:48:50.066002 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi [None req-f2e631c6-89d0-46de-b12e-6b520f3b3ab2 tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "50cda1bf-bc5e-4cc4-8a67-1811f080e073"}} {{(pid=128729) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 15:48:50.069031 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.compute.api [None req-f2e631c6-89d0-46de-b12e-6b520f3b3ab2 tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] [instance: 9fbb269d-11cd-49ed-81ac-570e721c15cd] Fetching instance by UUID {{(pid=128729) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 15:48:50.104655 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-f2e631c6-89d0-46de-b12e-6b520f3b3ab2 tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:48:50.105350 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-f2e631c6-89d0-46de-b12e-6b520f3b3ab2 tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:48:50.107778 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-f2e631c6-89d0-46de-b12e-6b520f3b3ab2 tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:48:50.111825 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-f2e631c6-89d0-46de-b12e-6b520f3b3ab2 tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:48:50.151361 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: INFO nova.api.openstack.wsgi [None req-f2e631c6-89d0-46de-b12e-6b520f3b3ab2 tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] HTTP exception thrown: Cannot 'attach_volume' instance 9fbb269d-11cd-49ed-81ac-570e721c15cd while it is in vm_state rescued May 14 15:48:50.156174 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi [None req-f2e631c6-89d0-46de-b12e-6b520f3b3ab2 tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Request method failure captured: May 14 15:48:50.156174 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: request: POST /compute/v2.1/servers/9fbb269d-11cd-49ed-81ac-570e721c15cd/os-volume_attachments HTTP/1.1 May 14 15:48:50.156174 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: Accept: application/json May 14 15:48:50.156174 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: Accept-Encoding: identity May 14 15:48:50.156174 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: Connection: close May 14 15:48:50.156174 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: Content-Length: 74 May 14 15:48:50.156174 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: Content-Type: application/json May 14 15:48:50.156174 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: Host: 10.222.0.61 May 14 15:48:50.156174 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: Openstack-System-Scope: None May 14 15:48:50.156174 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: User-Agent: python-urllib3/1.26.9 May 14 15:48:50.156174 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: X-Auth-Token: gAAAAABif87TjanYsrrU9KpYd5057ovf5TRvtsRqqkrdTWz9P6C_YEs6Yd4CDME33lagxGClN3GtsEEl95Qsg7nFg7CgnMsPohorXTcxxG47tx7yWCVnqL6E-EqIsy7vXURQ6VzDtKaYCpcbPZh6yi-RI8tatcgKoVxklM3PcFb97OQYybSwzGM May 14 15:48:50.156174 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: X-Domain-Id: None May 14 15:48:50.156174 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: X-Domain-Name: None May 14 15:48:50.156174 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: X-Identity-Status: Confirmed May 14 15:48:50.156174 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: X-Is-Admin-Project: True May 14 15:48:50.156174 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: X-Project-Domain-Id: default May 14 15:48:50.156174 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: X-Project-Domain-Name: Default May 14 15:48:50.156174 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: X-Project-Id: 5d2517d5440a4d30949f3dd36a46d813 May 14 15:48:50.156174 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1508904783 May 14 15:48:50.156174 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: X-Role: reader,member May 14 15:48:50.156174 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: X-Roles: reader,member May 14 15:48:50.157648 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/5d2517d5440a4d30949f3dd36a46d813"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/5d2517d5440a4d30949f3dd36a46d813"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/5d2517d5440a4d30949f3dd36a46d813"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_5d2517d5440a4d30949f3dd36a46d813"}]}] May 14 15:48:50.157648 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1508904783 May 14 15:48:50.157648 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: X-Tenant-Id: 5d2517d5440a4d30949f3dd36a46d813 May 14 15:48:50.157648 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1508904783 May 14 15:48:50.157648 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: X-User: tempest-ServerRescueNegativeTestJSON-1508904783-project May 14 15:48:50.157648 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: X-User-Domain-Id: default May 14 15:48:50.157648 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: X-User-Domain-Name: Default May 14 15:48:50.157648 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: X-User-Id: 7b896317d96a40d6a137db0dcf5f98f2 May 14 15:48:50.157648 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1508904783-project May 14 15:48:50.157648 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: May 14 15:48:50.157648 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: {"volumeAttachment": {"volumeId": "50cda1bf-bc5e-4cc4-8a67-1811f080e073"}} May 14 15:48:50.157648 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: method: > May 14 15:48:50.159094 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: exception: Cannot 'attach_volume' instance 9fbb269d-11cd-49ed-81ac-570e721c15cd while it is in vm_state rescued May 14 15:48:50.159094 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: action_args: {'server_id': '9fbb269d-11cd-49ed-81ac-570e721c15cd', 'body': {'volumeAttachment': {'volumeId': '50cda1bf-bc5e-4cc4-8a67-1811f080e073'}}} May 14 15:48:50.159094 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: {{(pid=128729) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 14 15:48:50.159094 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 15:48:50.159094 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create May 14 15:48:50.159094 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( May 14 15:48:50.159094 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner May 14 15:48:50.159094 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) May 14 15:48:50.159094 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner May 14 15:48:50.159094 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( May 14 15:48:50.159094 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 9fbb269d-11cd-49ed-81ac-570e721c15cd in vm_state rescued. Cannot attach_volume while the instance is in this state. May 14 15:48:50.159094 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: ERROR nova.api.openstack.wsgi May 14 15:48:50.159094 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 14 15:48:50.159094 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: ERROR nova.api.openstack.wsgi May 14 15:48:50.159094 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 15:48:50.159094 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 14 15:48:50.159094 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 14 15:48:50.159094 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 14 15:48:50.159094 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 14 15:48:50.160650 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 14 15:48:50.160650 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 14 15:48:50.160650 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 14 15:48:50.160650 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 14 15:48:50.160650 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 14 15:48:50.160650 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 14 15:48:50.160650 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 14 15:48:50.160650 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 14 15:48:50.160650 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 398, in create May 14 15:48:50.160650 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, May 14 15:48:50.160650 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state May 14 15:48:50.160650 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) May 14 15:48:50.160650 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'attach_volume' instance 9fbb269d-11cd-49ed-81ac-570e721c15cd while it is in vm_state rescued May 14 15:48:50.160650 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: ERROR nova.api.openstack.wsgi May 14 15:48:50.160650 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 14 15:48:50.160650 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: ERROR nova.api.openstack.wsgi May 14 15:48:50.160650 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 15:48:50.160650 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 14 15:48:50.160650 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 14 15:48:50.162065 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 14 15:48:50.162065 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 14 15:48:50.162065 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'attach_volume' instance 9fbb269d-11cd-49ed-81ac-570e721c15cd while it is in vm_state rescued May 14 15:48:50.162065 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: ERROR nova.api.openstack.wsgi May 14 15:48:50.163686 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi [None req-f2e631c6-89d0-46de-b12e-6b520f3b3ab2 tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Returning 409 to user: Cannot 'attach_volume' instance 9fbb269d-11cd-49ed-81ac-570e721c15cd while it is in vm_state rescued {{(pid=128729) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 14 15:48:50.165461 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: INFO nova.api.openstack.requestlog [None req-f2e631c6-89d0-46de-b12e-6b520f3b3ab2 tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] 10.222.0.61 "POST /compute/v2.1/servers/9fbb269d-11cd-49ed-81ac-570e721c15cd/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.104546 May 14 15:48:50.172181 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: [pid: 128729|app: 0|req: 170/359] 10.222.0.61 () {60 vars in 1322 bytes} [Sat May 14 15:48:50 2022] POST /compute/v2.1/servers/9fbb269d-11cd-49ed-81ac-570e721c15cd/os-volume_attachments => generated 152 bytes in 114 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) May 14 15:48:50.179889 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi [None req-5589f1f1-01ff-45b2-b59f-67a934460136 tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=128728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 15:48:50.182770 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.compute.api [None req-5589f1f1-01ff-45b2-b59f-67a934460136 tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] [instance: 9fbb269d-11cd-49ed-81ac-570e721c15cd] Fetching instance by UUID {{(pid=128728) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 15:48:50.193368 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-5589f1f1-01ff-45b2-b59f-67a934460136 tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:48:50.194065 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-5589f1f1-01ff-45b2-b59f-67a934460136 tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:48:50.195571 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-5589f1f1-01ff-45b2-b59f-67a934460136 tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:48:50.196216 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-5589f1f1-01ff-45b2-b59f-67a934460136 tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:48:50.324751 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: INFO nova.api.openstack.requestlog [None req-5589f1f1-01ff-45b2-b59f-67a934460136 tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] 10.222.0.61 "POST /compute/v2.1/servers/9fbb269d-11cd-49ed-81ac-570e721c15cd/action" status: 202 len: 0 microversion: 2.1 time: 0.150799 May 14 15:48:50.343878 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi [None req-afaf6fad-5e9d-4b5b-83be-ec26fa869323 tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Calling method '>' {{(pid=128729) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 15:48:50.344513 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.compute.api [None req-afaf6fad-5e9d-4b5b-83be-ec26fa869323 tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] [instance: 9fbb269d-11cd-49ed-81ac-570e721c15cd] Fetching instance by UUID {{(pid=128729) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 15:48:50.349853 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: [pid: 128728|app: 0|req: 190/360] 10.222.0.61 () {60 vars in 1277 bytes} [Sat May 14 15:48:50 2022] POST /compute/v2.1/servers/9fbb269d-11cd-49ed-81ac-570e721c15cd/action => generated 0 bytes in 176 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 14 15:48:50.359426 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-afaf6fad-5e9d-4b5b-83be-ec26fa869323 tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:48:50.363733 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-afaf6fad-5e9d-4b5b-83be-ec26fa869323 tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:48:50.369032 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-afaf6fad-5e9d-4b5b-83be-ec26fa869323 tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:48:50.371863 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-afaf6fad-5e9d-4b5b-83be-ec26fa869323 tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:48:50.374124 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi [None req-cb7ac812-ef47-4a9e-910f-363a44c75ed2 tempest-TestMinimumBasicScenario-1817438735 tempest-TestMinimumBasicScenario-1817438735-project] Calling method '>' {{(pid=128728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 15:48:50.377059 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.compute.api [None req-cb7ac812-ef47-4a9e-910f-363a44c75ed2 tempest-TestMinimumBasicScenario-1817438735 tempest-TestMinimumBasicScenario-1817438735-project] [instance: ef63d04a-87e5-4202-a672-d45a2a877c68] Fetching instance by UUID {{(pid=128728) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 15:48:50.402521 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-cb7ac812-ef47-4a9e-910f-363a44c75ed2 tempest-TestMinimumBasicScenario-1817438735 tempest-TestMinimumBasicScenario-1817438735-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:48:50.402972 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-cb7ac812-ef47-4a9e-910f-363a44c75ed2 tempest-TestMinimumBasicScenario-1817438735 tempest-TestMinimumBasicScenario-1817438735-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:48:50.407783 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-cb7ac812-ef47-4a9e-910f-363a44c75ed2 tempest-TestMinimumBasicScenario-1817438735 tempest-TestMinimumBasicScenario-1817438735-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:48:50.411885 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-cb7ac812-ef47-4a9e-910f-363a44c75ed2 tempest-TestMinimumBasicScenario-1817438735 tempest-TestMinimumBasicScenario-1817438735-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:48:50.747350 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.policy [None req-cb7ac812-ef47-4a9e-910f-363a44c75ed2 tempest-TestMinimumBasicScenario-1817438735 tempest-TestMinimumBasicScenario-1817438735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d5f259e0b98457ea6b6b88d886c813d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fba11e8ade54d388361c4c936a43372', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128728) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:48:50.764075 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: INFO nova.api.openstack.requestlog [None req-cb7ac812-ef47-4a9e-910f-363a44c75ed2 tempest-TestMinimumBasicScenario-1817438735 tempest-TestMinimumBasicScenario-1817438735-project] 10.222.0.61 "GET /compute/v2.1/servers/ef63d04a-87e5-4202-a672-d45a2a877c68" status: 200 len: 1315 microversion: 2.1 time: 0.411497 May 14 15:48:50.764865 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: [pid: 128728|app: 0|req: 191/361] 10.222.0.61 () {58 vars in 1235 bytes} [Sat May 14 15:48:50 2022] GET /compute/v2.1/servers/ef63d04a-87e5-4202-a672-d45a2a877c68 => generated 1315 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 15:48:50.826028 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi [None req-6881b362-3221-4eb4-adfa-1cc9013b78bc tempest-VolumesNegativeTest-1107689494 tempest-VolumesNegativeTest-1107689494-project] Calling method '>' {{(pid=128728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 15:48:50.827126 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.compute.api [None req-6881b362-3221-4eb4-adfa-1cc9013b78bc tempest-VolumesNegativeTest-1107689494 tempest-VolumesNegativeTest-1107689494-project] [instance: ea1f238d-3bae-4ce8-b328-d07fc2f7f272] Fetching instance by UUID {{(pid=128728) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 15:48:50.861118 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-6881b362-3221-4eb4-adfa-1cc9013b78bc tempest-VolumesNegativeTest-1107689494 tempest-VolumesNegativeTest-1107689494-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:48:50.862121 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-6881b362-3221-4eb4-adfa-1cc9013b78bc tempest-VolumesNegativeTest-1107689494 tempest-VolumesNegativeTest-1107689494-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:48:50.863145 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-6881b362-3221-4eb4-adfa-1cc9013b78bc tempest-VolumesNegativeTest-1107689494 tempest-VolumesNegativeTest-1107689494-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:48:50.863738 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-6881b362-3221-4eb4-adfa-1cc9013b78bc tempest-VolumesNegativeTest-1107689494 tempest-VolumesNegativeTest-1107689494-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:48:50.941763 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.policy [None req-afaf6fad-5e9d-4b5b-83be-ec26fa869323 tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b896317d96a40d6a137db0dcf5f98f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d2517d5440a4d30949f3dd36a46d813', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128729) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:48:50.952135 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: INFO nova.api.openstack.requestlog [None req-afaf6fad-5e9d-4b5b-83be-ec26fa869323 tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] 10.222.0.61 "GET /compute/v2.1/servers/9fbb269d-11cd-49ed-81ac-570e721c15cd" status: 200 len: 1511 microversion: 2.1 time: 0.613559 May 14 15:48:50.954643 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: [pid: 128729|app: 0|req: 171/362] 10.222.0.61 () {58 vars in 1235 bytes} [Sat May 14 15:48:50 2022] GET /compute/v2.1/servers/9fbb269d-11cd-49ed-81ac-570e721c15cd => generated 1511 bytes in 617 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 15:48:51.005665 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.policy [None req-6881b362-3221-4eb4-adfa-1cc9013b78bc tempest-VolumesNegativeTest-1107689494 tempest-VolumesNegativeTest-1107689494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e8303a1f1584ae2aae774eaf31481f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1e7c6697dfc4562b4c1d46ee21964a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128728) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:48:51.021629 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: INFO nova.api.openstack.requestlog [None req-6881b362-3221-4eb4-adfa-1cc9013b78bc tempest-VolumesNegativeTest-1107689494 tempest-VolumesNegativeTest-1107689494-project] 10.222.0.61 "GET /compute/v2.1/servers/ea1f238d-3bae-4ce8-b328-d07fc2f7f272" status: 200 len: 1267 microversion: 2.1 time: 0.200224 May 14 15:48:51.037804 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: [pid: 128728|app: 0|req: 192/363] 10.222.0.61 () {58 vars in 1235 bytes} [Sat May 14 15:48:50 2022] GET /compute/v2.1/servers/ea1f238d-3bae-4ce8-b328-d07fc2f7f272 => generated 1267 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 15:48:51.781698 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi [None req-8912a62b-b91a-41ab-a551-de060de78698 tempest-TestMinimumBasicScenario-1817438735 tempest-TestMinimumBasicScenario-1817438735-project] Calling method '>' {{(pid=128729) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 15:48:51.782342 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.compute.api [None req-8912a62b-b91a-41ab-a551-de060de78698 tempest-TestMinimumBasicScenario-1817438735 tempest-TestMinimumBasicScenario-1817438735-project] [instance: ef63d04a-87e5-4202-a672-d45a2a877c68] Fetching instance by UUID {{(pid=128729) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 15:48:51.788987 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-8912a62b-b91a-41ab-a551-de060de78698 tempest-TestMinimumBasicScenario-1817438735 tempest-TestMinimumBasicScenario-1817438735-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:48:51.789773 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-8912a62b-b91a-41ab-a551-de060de78698 tempest-TestMinimumBasicScenario-1817438735 tempest-TestMinimumBasicScenario-1817438735-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:48:51.791462 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-8912a62b-b91a-41ab-a551-de060de78698 tempest-TestMinimumBasicScenario-1817438735 tempest-TestMinimumBasicScenario-1817438735-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:48:51.792211 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-8912a62b-b91a-41ab-a551-de060de78698 tempest-TestMinimumBasicScenario-1817438735 tempest-TestMinimumBasicScenario-1817438735-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:48:51.970395 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.policy [None req-8912a62b-b91a-41ab-a551-de060de78698 tempest-TestMinimumBasicScenario-1817438735 tempest-TestMinimumBasicScenario-1817438735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d5f259e0b98457ea6b6b88d886c813d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fba11e8ade54d388361c4c936a43372', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128729) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:48:51.975372 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi [None req-46b74929-347c-4ffe-89de-f03b726f59b7 tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Calling method '>' {{(pid=128728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 15:48:51.976006 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.compute.api [None req-46b74929-347c-4ffe-89de-f03b726f59b7 tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] [instance: 9fbb269d-11cd-49ed-81ac-570e721c15cd] Fetching instance by UUID {{(pid=128728) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 15:48:51.981005 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: INFO nova.api.openstack.requestlog [None req-8912a62b-b91a-41ab-a551-de060de78698 tempest-TestMinimumBasicScenario-1817438735 tempest-TestMinimumBasicScenario-1817438735-project] 10.222.0.61 "GET /compute/v2.1/servers/ef63d04a-87e5-4202-a672-d45a2a877c68" status: 200 len: 1357 microversion: 2.1 time: 0.201504 May 14 15:48:51.981967 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: [pid: 128729|app: 0|req: 172/364] 10.222.0.61 () {58 vars in 1235 bytes} [Sat May 14 15:48:51 2022] GET /compute/v2.1/servers/ef63d04a-87e5-4202-a672-d45a2a877c68 => generated 1357 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 15:48:51.984441 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-46b74929-347c-4ffe-89de-f03b726f59b7 tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:48:51.984857 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-46b74929-347c-4ffe-89de-f03b726f59b7 tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:48:51.989597 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-46b74929-347c-4ffe-89de-f03b726f59b7 tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:48:51.989597 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-46b74929-347c-4ffe-89de-f03b726f59b7 tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:48:52.044067 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi [None req-bc027c26-7bac-4621-a3c1-b7d891ce8dee tempest-VolumesNegativeTest-1107689494 tempest-VolumesNegativeTest-1107689494-project] Calling method '>' {{(pid=128729) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 15:48:52.044572 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.compute.api [None req-bc027c26-7bac-4621-a3c1-b7d891ce8dee tempest-VolumesNegativeTest-1107689494 tempest-VolumesNegativeTest-1107689494-project] [instance: ea1f238d-3bae-4ce8-b328-d07fc2f7f272] Fetching instance by UUID {{(pid=128729) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 15:48:52.051167 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-bc027c26-7bac-4621-a3c1-b7d891ce8dee tempest-VolumesNegativeTest-1107689494 tempest-VolumesNegativeTest-1107689494-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:48:52.051723 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-bc027c26-7bac-4621-a3c1-b7d891ce8dee tempest-VolumesNegativeTest-1107689494 tempest-VolumesNegativeTest-1107689494-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:48:52.052594 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-bc027c26-7bac-4621-a3c1-b7d891ce8dee tempest-VolumesNegativeTest-1107689494 tempest-VolumesNegativeTest-1107689494-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:48:52.053152 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-bc027c26-7bac-4621-a3c1-b7d891ce8dee tempest-VolumesNegativeTest-1107689494 tempest-VolumesNegativeTest-1107689494-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:48:52.130232 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.policy [None req-bc027c26-7bac-4621-a3c1-b7d891ce8dee tempest-VolumesNegativeTest-1107689494 tempest-VolumesNegativeTest-1107689494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e8303a1f1584ae2aae774eaf31481f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1e7c6697dfc4562b4c1d46ee21964a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128729) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:48:52.138756 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: INFO nova.api.openstack.requestlog [None req-bc027c26-7bac-4621-a3c1-b7d891ce8dee tempest-VolumesNegativeTest-1107689494 tempest-VolumesNegativeTest-1107689494-project] 10.222.0.61 "GET /compute/v2.1/servers/ea1f238d-3bae-4ce8-b328-d07fc2f7f272" status: 200 len: 1267 microversion: 2.1 time: 0.098713 May 14 15:48:52.150516 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: [pid: 128729|app: 0|req: 173/365] 10.222.0.61 () {58 vars in 1235 bytes} [Sat May 14 15:48:52 2022] GET /compute/v2.1/servers/ea1f238d-3bae-4ce8-b328-d07fc2f7f272 => generated 1267 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 15:48:52.157018 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.policy [None req-46b74929-347c-4ffe-89de-f03b726f59b7 tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b896317d96a40d6a137db0dcf5f98f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d2517d5440a4d30949f3dd36a46d813', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128728) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:48:52.164716 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: INFO nova.api.openstack.requestlog [None req-46b74929-347c-4ffe-89de-f03b726f59b7 tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] 10.222.0.61 "GET /compute/v2.1/servers/9fbb269d-11cd-49ed-81ac-570e721c15cd" status: 200 len: 1511 microversion: 2.1 time: 0.198954 May 14 15:48:52.165279 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: [pid: 128728|app: 0|req: 193/366] 10.222.0.61 () {58 vars in 1235 bytes} [Sat May 14 15:48:51 2022] GET /compute/v2.1/servers/9fbb269d-11cd-49ed-81ac-570e721c15cd => generated 1511 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 15:48:52.998581 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi [None req-c9df0b11-aa7d-4a83-b50c-f06fcf6e8708 tempest-TestMinimumBasicScenario-1817438735 tempest-TestMinimumBasicScenario-1817438735-project] Calling method '>' {{(pid=128729) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 15:48:52.999198 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.compute.api [None req-c9df0b11-aa7d-4a83-b50c-f06fcf6e8708 tempest-TestMinimumBasicScenario-1817438735 tempest-TestMinimumBasicScenario-1817438735-project] [instance: ef63d04a-87e5-4202-a672-d45a2a877c68] Fetching instance by UUID {{(pid=128729) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 15:48:53.005373 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-c9df0b11-aa7d-4a83-b50c-f06fcf6e8708 tempest-TestMinimumBasicScenario-1817438735 tempest-TestMinimumBasicScenario-1817438735-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:48:53.010262 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-c9df0b11-aa7d-4a83-b50c-f06fcf6e8708 tempest-TestMinimumBasicScenario-1817438735 tempest-TestMinimumBasicScenario-1817438735-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:48:53.012564 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-c9df0b11-aa7d-4a83-b50c-f06fcf6e8708 tempest-TestMinimumBasicScenario-1817438735 tempest-TestMinimumBasicScenario-1817438735-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:48:53.015699 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-c9df0b11-aa7d-4a83-b50c-f06fcf6e8708 tempest-TestMinimumBasicScenario-1817438735 tempest-TestMinimumBasicScenario-1817438735-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:48:53.157333 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi [None req-69015536-5ba1-46e3-84fc-60d647e5658b tempest-VolumesNegativeTest-1107689494 tempest-VolumesNegativeTest-1107689494-project] Calling method '>' {{(pid=128728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 15:48:53.157993 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.compute.api [None req-69015536-5ba1-46e3-84fc-60d647e5658b tempest-VolumesNegativeTest-1107689494 tempest-VolumesNegativeTest-1107689494-project] [instance: ea1f238d-3bae-4ce8-b328-d07fc2f7f272] Fetching instance by UUID {{(pid=128728) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 15:48:53.165018 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-69015536-5ba1-46e3-84fc-60d647e5658b tempest-VolumesNegativeTest-1107689494 tempest-VolumesNegativeTest-1107689494-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:48:53.165479 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-69015536-5ba1-46e3-84fc-60d647e5658b tempest-VolumesNegativeTest-1107689494 tempest-VolumesNegativeTest-1107689494-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:48:53.166912 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-69015536-5ba1-46e3-84fc-60d647e5658b tempest-VolumesNegativeTest-1107689494 tempest-VolumesNegativeTest-1107689494-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:48:53.167368 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-69015536-5ba1-46e3-84fc-60d647e5658b tempest-VolumesNegativeTest-1107689494 tempest-VolumesNegativeTest-1107689494-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:48:53.206570 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.policy [None req-c9df0b11-aa7d-4a83-b50c-f06fcf6e8708 tempest-TestMinimumBasicScenario-1817438735 tempest-TestMinimumBasicScenario-1817438735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d5f259e0b98457ea6b6b88d886c813d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fba11e8ade54d388361c4c936a43372', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128729) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:48:53.214903 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: INFO nova.api.openstack.requestlog [None req-c9df0b11-aa7d-4a83-b50c-f06fcf6e8708 tempest-TestMinimumBasicScenario-1817438735 tempest-TestMinimumBasicScenario-1817438735-project] 10.222.0.61 "GET /compute/v2.1/servers/ef63d04a-87e5-4202-a672-d45a2a877c68" status: 200 len: 1357 microversion: 2.1 time: 0.220595 May 14 15:48:53.216885 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: [pid: 128729|app: 0|req: 174/367] 10.222.0.61 () {58 vars in 1235 bytes} [Sat May 14 15:48:52 2022] GET /compute/v2.1/servers/ef63d04a-87e5-4202-a672-d45a2a877c68 => generated 1357 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 15:48:53.231525 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi [None req-a12cf584-e741-4625-8fda-6f87e2dc8be1 tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Calling method '>' {{(pid=128729) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 15:48:53.232593 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.compute.api [None req-a12cf584-e741-4625-8fda-6f87e2dc8be1 tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] [instance: 9fbb269d-11cd-49ed-81ac-570e721c15cd] Fetching instance by UUID {{(pid=128729) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 15:48:53.241908 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-a12cf584-e741-4625-8fda-6f87e2dc8be1 tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:48:53.242551 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-a12cf584-e741-4625-8fda-6f87e2dc8be1 tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:48:53.243482 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-a12cf584-e741-4625-8fda-6f87e2dc8be1 tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:48:53.244034 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-a12cf584-e741-4625-8fda-6f87e2dc8be1 tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:48:53.263309 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.policy [None req-69015536-5ba1-46e3-84fc-60d647e5658b tempest-VolumesNegativeTest-1107689494 tempest-VolumesNegativeTest-1107689494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e8303a1f1584ae2aae774eaf31481f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1e7c6697dfc4562b4c1d46ee21964a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128728) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:48:53.272514 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: INFO nova.api.openstack.requestlog [None req-69015536-5ba1-46e3-84fc-60d647e5658b tempest-VolumesNegativeTest-1107689494 tempest-VolumesNegativeTest-1107689494-project] 10.222.0.61 "GET /compute/v2.1/servers/ea1f238d-3bae-4ce8-b328-d07fc2f7f272" status: 200 len: 1267 microversion: 2.1 time: 0.119233 May 14 15:48:53.273640 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: [pid: 128728|app: 0|req: 194/368] 10.222.0.61 () {58 vars in 1235 bytes} [Sat May 14 15:48:53 2022] GET /compute/v2.1/servers/ea1f238d-3bae-4ce8-b328-d07fc2f7f272 => generated 1267 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 15:48:53.419410 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.policy [None req-a12cf584-e741-4625-8fda-6f87e2dc8be1 tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b896317d96a40d6a137db0dcf5f98f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d2517d5440a4d30949f3dd36a46d813', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128729) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:48:53.434837 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: INFO nova.api.openstack.requestlog [None req-a12cf584-e741-4625-8fda-6f87e2dc8be1 tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] 10.222.0.61 "GET /compute/v2.1/servers/9fbb269d-11cd-49ed-81ac-570e721c15cd" status: 200 len: 1511 microversion: 2.1 time: 0.213533 May 14 15:48:53.436146 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: [pid: 128729|app: 0|req: 175/369] 10.222.0.61 () {58 vars in 1235 bytes} [Sat May 14 15:48:53 2022] GET /compute/v2.1/servers/9fbb269d-11cd-49ed-81ac-570e721c15cd => generated 1511 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 15:48:54.233736 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi [None req-80b1caf0-3f3d-483c-9988-8052bd58d092 tempest-TestMinimumBasicScenario-1817438735 tempest-TestMinimumBasicScenario-1817438735-project] Calling method '>' {{(pid=128728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 15:48:54.234540 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.compute.api [None req-80b1caf0-3f3d-483c-9988-8052bd58d092 tempest-TestMinimumBasicScenario-1817438735 tempest-TestMinimumBasicScenario-1817438735-project] [instance: ef63d04a-87e5-4202-a672-d45a2a877c68] Fetching instance by UUID {{(pid=128728) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 15:48:54.240642 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-80b1caf0-3f3d-483c-9988-8052bd58d092 tempest-TestMinimumBasicScenario-1817438735 tempest-TestMinimumBasicScenario-1817438735-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:48:54.241095 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-80b1caf0-3f3d-483c-9988-8052bd58d092 tempest-TestMinimumBasicScenario-1817438735 tempest-TestMinimumBasicScenario-1817438735-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:48:54.241877 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-80b1caf0-3f3d-483c-9988-8052bd58d092 tempest-TestMinimumBasicScenario-1817438735 tempest-TestMinimumBasicScenario-1817438735-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:48:54.242333 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-80b1caf0-3f3d-483c-9988-8052bd58d092 tempest-TestMinimumBasicScenario-1817438735 tempest-TestMinimumBasicScenario-1817438735-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:48:54.291828 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi [None req-028d698d-35ce-4c45-9127-44fc58f2eb4f tempest-VolumesNegativeTest-1107689494 tempest-VolumesNegativeTest-1107689494-project] Calling method '>' {{(pid=128729) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 15:48:54.292759 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.compute.api [None req-028d698d-35ce-4c45-9127-44fc58f2eb4f tempest-VolumesNegativeTest-1107689494 tempest-VolumesNegativeTest-1107689494-project] [instance: ea1f238d-3bae-4ce8-b328-d07fc2f7f272] Fetching instance by UUID {{(pid=128729) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 15:48:54.299419 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-028d698d-35ce-4c45-9127-44fc58f2eb4f tempest-VolumesNegativeTest-1107689494 tempest-VolumesNegativeTest-1107689494-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:48:54.299878 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-028d698d-35ce-4c45-9127-44fc58f2eb4f tempest-VolumesNegativeTest-1107689494 tempest-VolumesNegativeTest-1107689494-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:48:54.300664 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-028d698d-35ce-4c45-9127-44fc58f2eb4f tempest-VolumesNegativeTest-1107689494 tempest-VolumesNegativeTest-1107689494-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:48:54.301102 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-028d698d-35ce-4c45-9127-44fc58f2eb4f tempest-VolumesNegativeTest-1107689494 tempest-VolumesNegativeTest-1107689494-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:48:54.368654 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.policy [None req-028d698d-35ce-4c45-9127-44fc58f2eb4f tempest-VolumesNegativeTest-1107689494 tempest-VolumesNegativeTest-1107689494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e8303a1f1584ae2aae774eaf31481f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1e7c6697dfc4562b4c1d46ee21964a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128729) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:48:54.377502 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: INFO nova.api.openstack.requestlog [None req-028d698d-35ce-4c45-9127-44fc58f2eb4f tempest-VolumesNegativeTest-1107689494 tempest-VolumesNegativeTest-1107689494-project] 10.222.0.61 "GET /compute/v2.1/servers/ea1f238d-3bae-4ce8-b328-d07fc2f7f272" status: 200 len: 1267 microversion: 2.1 time: 0.090159 May 14 15:48:54.378089 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: [pid: 128729|app: 0|req: 176/370] 10.222.0.61 () {58 vars in 1235 bytes} [Sat May 14 15:48:54 2022] GET /compute/v2.1/servers/ea1f238d-3bae-4ce8-b328-d07fc2f7f272 => generated 1267 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 15:48:54.404559 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.policy [None req-80b1caf0-3f3d-483c-9988-8052bd58d092 tempest-TestMinimumBasicScenario-1817438735 tempest-TestMinimumBasicScenario-1817438735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d5f259e0b98457ea6b6b88d886c813d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fba11e8ade54d388361c4c936a43372', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128728) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:48:54.412097 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: INFO nova.api.openstack.requestlog [None req-80b1caf0-3f3d-483c-9988-8052bd58d092 tempest-TestMinimumBasicScenario-1817438735 tempest-TestMinimumBasicScenario-1817438735-project] 10.222.0.61 "GET /compute/v2.1/servers/ef63d04a-87e5-4202-a672-d45a2a877c68" status: 200 len: 1357 microversion: 2.1 time: 0.182421 May 14 15:48:54.412654 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: [pid: 128728|app: 0|req: 195/371] 10.222.0.61 () {58 vars in 1235 bytes} [Sat May 14 15:48:54 2022] GET /compute/v2.1/servers/ef63d04a-87e5-4202-a672-d45a2a877c68 => generated 1357 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 15:48:54.455731 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi [None req-55eecd5e-c272-40ee-92b1-2d503cfa1e5a tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Calling method '>' {{(pid=128729) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 15:48:54.456338 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.compute.api [None req-55eecd5e-c272-40ee-92b1-2d503cfa1e5a tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] [instance: 9fbb269d-11cd-49ed-81ac-570e721c15cd] Fetching instance by UUID {{(pid=128729) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 15:48:54.462717 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-55eecd5e-c272-40ee-92b1-2d503cfa1e5a tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:48:54.463284 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-55eecd5e-c272-40ee-92b1-2d503cfa1e5a tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:48:54.464316 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-55eecd5e-c272-40ee-92b1-2d503cfa1e5a tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:48:54.464746 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-55eecd5e-c272-40ee-92b1-2d503cfa1e5a tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:48:54.607297 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.policy [None req-55eecd5e-c272-40ee-92b1-2d503cfa1e5a tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b896317d96a40d6a137db0dcf5f98f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d2517d5440a4d30949f3dd36a46d813', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128729) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:48:54.615052 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: INFO nova.api.openstack.requestlog [None req-55eecd5e-c272-40ee-92b1-2d503cfa1e5a tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] 10.222.0.61 "GET /compute/v2.1/servers/9fbb269d-11cd-49ed-81ac-570e721c15cd" status: 200 len: 1511 microversion: 2.1 time: 0.163142 May 14 15:48:54.615628 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: [pid: 128729|app: 0|req: 177/372] 10.222.0.61 () {58 vars in 1235 bytes} [Sat May 14 15:48:54 2022] GET /compute/v2.1/servers/9fbb269d-11cd-49ed-81ac-570e721c15cd => generated 1511 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 15:48:55.191300 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi [None req-af9beba2-c856-49d5-af85-5a357cd53b58 tempest-VolumesActionsTest-1534566879 tempest-VolumesActionsTest-1534566879-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-2025730288", "imageRef": "1381e3d5-fc27-4fa7-ab03-5d86278a0546", "flavorRef": "452", "networks": [{"uuid": "a8d27839-074b-4ab6-8eee-a26beda7dc34"}]}} {{(pid=128728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 15:48:55.242888 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.network.neutron [None req-af9beba2-c856-49d5-af85-5a357cd53b58 tempest-VolumesActionsTest-1534566879 tempest-VolumesActionsTest-1534566879-project] validate_networks() for [('a8d27839-074b-4ab6-8eee-a26beda7dc34', None, None, None, None, None)] {{(pid=128728) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 14 15:48:55.394552 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi [None req-acaa810c-5586-4f6d-b408-5536319ecf0a tempest-VolumesNegativeTest-1107689494 tempest-VolumesNegativeTest-1107689494-project] Calling method '>' {{(pid=128729) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 15:48:55.395242 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.compute.api [None req-acaa810c-5586-4f6d-b408-5536319ecf0a tempest-VolumesNegativeTest-1107689494 tempest-VolumesNegativeTest-1107689494-project] [instance: ea1f238d-3bae-4ce8-b328-d07fc2f7f272] Fetching instance by UUID {{(pid=128729) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 15:48:55.402291 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-acaa810c-5586-4f6d-b408-5536319ecf0a tempest-VolumesNegativeTest-1107689494 tempest-VolumesNegativeTest-1107689494-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:48:55.403117 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-acaa810c-5586-4f6d-b408-5536319ecf0a tempest-VolumesNegativeTest-1107689494 tempest-VolumesNegativeTest-1107689494-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:48:55.404111 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-acaa810c-5586-4f6d-b408-5536319ecf0a tempest-VolumesNegativeTest-1107689494 tempest-VolumesNegativeTest-1107689494-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:48:55.404746 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-acaa810c-5586-4f6d-b408-5536319ecf0a tempest-VolumesNegativeTest-1107689494 tempest-VolumesNegativeTest-1107689494-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:48:55.500000 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.policy [None req-acaa810c-5586-4f6d-b408-5536319ecf0a tempest-VolumesNegativeTest-1107689494 tempest-VolumesNegativeTest-1107689494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e8303a1f1584ae2aae774eaf31481f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1e7c6697dfc4562b4c1d46ee21964a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128729) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:48:55.507252 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: INFO nova.api.openstack.requestlog [None req-acaa810c-5586-4f6d-b408-5536319ecf0a tempest-VolumesNegativeTest-1107689494 tempest-VolumesNegativeTest-1107689494-project] 10.222.0.61 "GET /compute/v2.1/servers/ea1f238d-3bae-4ce8-b328-d07fc2f7f272" status: 200 len: 1267 microversion: 2.1 time: 0.116846 May 14 15:48:55.507917 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: [pid: 128729|app: 0|req: 178/373] 10.222.0.61 () {58 vars in 1235 bytes} [Sat May 14 15:48:55 2022] GET /compute/v2.1/servers/ea1f238d-3bae-4ce8-b328-d07fc2f7f272 => generated 1267 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 15:48:55.514888 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi [None req-d1d286eb-2185-4da2-b23c-ff4f35350538 tempest-TestMinimumBasicScenario-1817438735 tempest-TestMinimumBasicScenario-1817438735-project] Calling method '>' {{(pid=128729) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 15:48:55.515635 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.compute.api [None req-d1d286eb-2185-4da2-b23c-ff4f35350538 tempest-TestMinimumBasicScenario-1817438735 tempest-TestMinimumBasicScenario-1817438735-project] [instance: ef63d04a-87e5-4202-a672-d45a2a877c68] Fetching instance by UUID {{(pid=128729) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 15:48:55.522444 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-d1d286eb-2185-4da2-b23c-ff4f35350538 tempest-TestMinimumBasicScenario-1817438735 tempest-TestMinimumBasicScenario-1817438735-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:48:55.523233 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-d1d286eb-2185-4da2-b23c-ff4f35350538 tempest-TestMinimumBasicScenario-1817438735 tempest-TestMinimumBasicScenario-1817438735-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:48:55.524117 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-d1d286eb-2185-4da2-b23c-ff4f35350538 tempest-TestMinimumBasicScenario-1817438735 tempest-TestMinimumBasicScenario-1817438735-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:48:55.524625 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-d1d286eb-2185-4da2-b23c-ff4f35350538 tempest-TestMinimumBasicScenario-1817438735 tempest-TestMinimumBasicScenario-1817438735-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:48:55.683298 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.virt.hardware [None req-af9beba2-c856-49d5-af85-5a357cd53b58 tempest-VolumesActionsTest-1534566879 tempest-VolumesActionsTest-1534566879-project] Flavor limits 0:0:0 {{(pid=128728) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 14 15:48:55.683298 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.virt.hardware [None req-af9beba2-c856-49d5-af85-5a357cd53b58 tempest-VolumesActionsTest-1534566879 tempest-VolumesActionsTest-1534566879-project] Image limits 0:0:0 {{(pid=128728) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 14 15:48:55.683298 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.virt.hardware [None req-af9beba2-c856-49d5-af85-5a357cd53b58 tempest-VolumesActionsTest-1534566879 tempest-VolumesActionsTest-1534566879-project] Flavor pref 0:0:0 {{(pid=128728) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 14 15:48:55.683298 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.virt.hardware [None req-af9beba2-c856-49d5-af85-5a357cd53b58 tempest-VolumesActionsTest-1534566879 tempest-VolumesActionsTest-1534566879-project] Image pref 0:0:0 {{(pid=128728) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 14 15:48:55.683298 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.virt.hardware [None req-af9beba2-c856-49d5-af85-5a357cd53b58 tempest-VolumesActionsTest-1534566879 tempest-VolumesActionsTest-1534566879-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128728) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 14 15:48:55.690159 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-af9beba2-c856-49d5-af85-5a357cd53b58 tempest-VolumesActionsTest-1534566879 tempest-VolumesActionsTest-1534566879-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:48:55.690660 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-af9beba2-c856-49d5-af85-5a357cd53b58 tempest-VolumesActionsTest-1534566879 tempest-VolumesActionsTest-1534566879-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:48:55.692158 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-af9beba2-c856-49d5-af85-5a357cd53b58 tempest-VolumesActionsTest-1534566879 tempest-VolumesActionsTest-1534566879-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:48:55.703213 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-af9beba2-c856-49d5-af85-5a357cd53b58 tempest-VolumesActionsTest-1534566879 tempest-VolumesActionsTest-1534566879-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:48:55.721614 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.policy [None req-d1d286eb-2185-4da2-b23c-ff4f35350538 tempest-TestMinimumBasicScenario-1817438735 tempest-TestMinimumBasicScenario-1817438735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d5f259e0b98457ea6b6b88d886c813d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fba11e8ade54d388361c4c936a43372', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128729) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:48:55.729897 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: INFO nova.api.openstack.requestlog [None req-d1d286eb-2185-4da2-b23c-ff4f35350538 tempest-TestMinimumBasicScenario-1817438735 tempest-TestMinimumBasicScenario-1817438735-project] 10.222.0.61 "GET /compute/v2.1/servers/ef63d04a-87e5-4202-a672-d45a2a877c68" status: 200 len: 1357 microversion: 2.1 time: 0.220068 May 14 15:48:55.731623 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.quota [None req-af9beba2-c856-49d5-af85-5a357cd53b58 tempest-VolumesActionsTest-1534566879 tempest-VolumesActionsTest-1534566879-project] Getting quotas for project 71b09f9f20b340b5a615b24e05312703. Resources: {'instances', 'cores', 'ram'} {{(pid=128728) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 14 15:48:55.735656 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.quota [None req-af9beba2-c856-49d5-af85-5a357cd53b58 tempest-VolumesActionsTest-1534566879 tempest-VolumesActionsTest-1534566879-project] Getting quotas for user e0156ed87a5b4efca7ef5056429db1a0 and project 71b09f9f20b340b5a615b24e05312703. Resources: {'instances', 'cores', 'ram'} {{(pid=128728) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 14 15:48:55.740984 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: [pid: 128729|app: 0|req: 179/374] 10.222.0.61 () {58 vars in 1235 bytes} [Sat May 14 15:48:55 2022] GET /compute/v2.1/servers/ef63d04a-87e5-4202-a672-d45a2a877c68 => generated 1357 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 15:48:55.746661 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi [None req-e202c181-c5b3-4150-a746-6ce6c7cde511 tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Calling method '>' {{(pid=128729) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 15:48:55.748730 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.compute.api [None req-af9beba2-c856-49d5-af85-5a357cd53b58 tempest-VolumesActionsTest-1534566879 tempest-VolumesActionsTest-1534566879-project] Going to run 1 instances... {{(pid=128728) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 14 15:48:55.750470 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.compute.api [None req-e202c181-c5b3-4150-a746-6ce6c7cde511 tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] [instance: 9fbb269d-11cd-49ed-81ac-570e721c15cd] Fetching instance by UUID {{(pid=128729) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 15:48:55.753755 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.compute.api [None req-af9beba2-c856-49d5-af85-5a357cd53b58 tempest-VolumesActionsTest-1534566879 tempest-VolumesActionsTest-1534566879-project] [instance: 656dffc0-256e-40ba-b670-f08e247a0d95] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='1381e3d5-fc27-4fa7-ab03-5d86278a0546',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128728) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 14 15:48:55.756828 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-e202c181-c5b3-4150-a746-6ce6c7cde511 tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:48:55.757488 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-e202c181-c5b3-4150-a746-6ce6c7cde511 tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:48:55.758280 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-e202c181-c5b3-4150-a746-6ce6c7cde511 tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:48:55.758948 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-e202c181-c5b3-4150-a746-6ce6c7cde511 tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:48:55.847921 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: INFO nova.api.openstack.requestlog [None req-af9beba2-c856-49d5-af85-5a357cd53b58 tempest-VolumesActionsTest-1534566879 tempest-VolumesActionsTest-1534566879-project] 10.222.0.61 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.660363 May 14 15:48:55.848650 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: [pid: 128728|app: 0|req: 196/375] 10.222.0.61 () {60 vars in 1146 bytes} [Sat May 14 15:48:55 2022] POST /compute/v2.1/servers => generated 380 bytes in 662 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 14 15:48:55.859712 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi [None req-1650a4c6-e10a-4d88-9b34-6257bdea7c25 tempest-VolumesActionsTest-1534566879 tempest-VolumesActionsTest-1534566879-project] Calling method '>' {{(pid=128728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 15:48:55.860334 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.compute.api [None req-1650a4c6-e10a-4d88-9b34-6257bdea7c25 tempest-VolumesActionsTest-1534566879 tempest-VolumesActionsTest-1534566879-project] [instance: 656dffc0-256e-40ba-b670-f08e247a0d95] Fetching instance by UUID {{(pid=128728) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 15:48:55.929056 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.policy [None req-e202c181-c5b3-4150-a746-6ce6c7cde511 tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b896317d96a40d6a137db0dcf5f98f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d2517d5440a4d30949f3dd36a46d813', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128729) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:48:55.940440 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: INFO nova.api.openstack.requestlog [None req-e202c181-c5b3-4150-a746-6ce6c7cde511 tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] 10.222.0.61 "GET /compute/v2.1/servers/9fbb269d-11cd-49ed-81ac-570e721c15cd" status: 200 len: 1511 microversion: 2.1 time: 0.196385 May 14 15:48:55.941555 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: [pid: 128729|app: 0|req: 180/376] 10.222.0.61 () {58 vars in 1235 bytes} [Sat May 14 15:48:55 2022] GET /compute/v2.1/servers/9fbb269d-11cd-49ed-81ac-570e721c15cd => generated 1511 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 15:48:55.989282 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.policy [None req-1650a4c6-e10a-4d88-9b34-6257bdea7c25 tempest-VolumesActionsTest-1534566879 tempest-VolumesActionsTest-1534566879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0156ed87a5b4efca7ef5056429db1a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71b09f9f20b340b5a615b24e05312703', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128728) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:48:55.996943 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: INFO nova.api.openstack.requestlog [None req-1650a4c6-e10a-4d88-9b34-6257bdea7c25 tempest-VolumesActionsTest-1534566879 tempest-VolumesActionsTest-1534566879-project] 10.222.0.61 "GET /compute/v2.1/servers/656dffc0-256e-40ba-b670-f08e247a0d95" status: 200 len: 1214 microversion: 2.1 time: 0.141179 May 14 15:48:55.997720 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: [pid: 128728|app: 0|req: 197/377] 10.222.0.61 () {58 vars in 1235 bytes} [Sat May 14 15:48:55 2022] GET /compute/v2.1/servers/656dffc0-256e-40ba-b670-f08e247a0d95 => generated 1214 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 15:48:56.526484 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi [None req-ccc714cc-7b56-44be-ba24-6356571b57cd tempest-VolumesNegativeTest-1107689494 tempest-VolumesNegativeTest-1107689494-project] Calling method '>' {{(pid=128729) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 15:48:56.527170 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.compute.api [None req-ccc714cc-7b56-44be-ba24-6356571b57cd tempest-VolumesNegativeTest-1107689494 tempest-VolumesNegativeTest-1107689494-project] [instance: ea1f238d-3bae-4ce8-b328-d07fc2f7f272] Fetching instance by UUID {{(pid=128729) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 15:48:56.534459 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-ccc714cc-7b56-44be-ba24-6356571b57cd tempest-VolumesNegativeTest-1107689494 tempest-VolumesNegativeTest-1107689494-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:48:56.534915 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-ccc714cc-7b56-44be-ba24-6356571b57cd tempest-VolumesNegativeTest-1107689494 tempest-VolumesNegativeTest-1107689494-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:48:56.535889 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-ccc714cc-7b56-44be-ba24-6356571b57cd tempest-VolumesNegativeTest-1107689494 tempest-VolumesNegativeTest-1107689494-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:48:56.536496 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-ccc714cc-7b56-44be-ba24-6356571b57cd tempest-VolumesNegativeTest-1107689494 tempest-VolumesNegativeTest-1107689494-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:48:56.606483 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.policy [None req-ccc714cc-7b56-44be-ba24-6356571b57cd tempest-VolumesNegativeTest-1107689494 tempest-VolumesNegativeTest-1107689494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e8303a1f1584ae2aae774eaf31481f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1e7c6697dfc4562b4c1d46ee21964a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128729) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:48:56.614132 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: INFO nova.api.openstack.requestlog [None req-ccc714cc-7b56-44be-ba24-6356571b57cd tempest-VolumesNegativeTest-1107689494 tempest-VolumesNegativeTest-1107689494-project] 10.222.0.61 "GET /compute/v2.1/servers/ea1f238d-3bae-4ce8-b328-d07fc2f7f272" status: 200 len: 1267 microversion: 2.1 time: 0.092487 May 14 15:48:56.614736 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: [pid: 128729|app: 0|req: 181/378] 10.222.0.61 () {58 vars in 1235 bytes} [Sat May 14 15:48:56 2022] GET /compute/v2.1/servers/ea1f238d-3bae-4ce8-b328-d07fc2f7f272 => generated 1267 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 15:48:56.747839 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi [None req-f12a98fc-c1d7-4aab-8f0d-0a03e136745d tempest-TestMinimumBasicScenario-1817438735 tempest-TestMinimumBasicScenario-1817438735-project] Calling method '>' {{(pid=128728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 15:48:56.748443 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.compute.api [None req-f12a98fc-c1d7-4aab-8f0d-0a03e136745d tempest-TestMinimumBasicScenario-1817438735 tempest-TestMinimumBasicScenario-1817438735-project] [instance: ef63d04a-87e5-4202-a672-d45a2a877c68] Fetching instance by UUID {{(pid=128728) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 15:48:56.754580 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-f12a98fc-c1d7-4aab-8f0d-0a03e136745d tempest-TestMinimumBasicScenario-1817438735 tempest-TestMinimumBasicScenario-1817438735-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:48:56.755030 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-f12a98fc-c1d7-4aab-8f0d-0a03e136745d tempest-TestMinimumBasicScenario-1817438735 tempest-TestMinimumBasicScenario-1817438735-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:48:56.755809 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-f12a98fc-c1d7-4aab-8f0d-0a03e136745d tempest-TestMinimumBasicScenario-1817438735 tempest-TestMinimumBasicScenario-1817438735-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:48:56.756241 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-f12a98fc-c1d7-4aab-8f0d-0a03e136745d tempest-TestMinimumBasicScenario-1817438735 tempest-TestMinimumBasicScenario-1817438735-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:48:56.889742 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.policy [None req-f12a98fc-c1d7-4aab-8f0d-0a03e136745d tempest-TestMinimumBasicScenario-1817438735 tempest-TestMinimumBasicScenario-1817438735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d5f259e0b98457ea6b6b88d886c813d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fba11e8ade54d388361c4c936a43372', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128728) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:48:56.897135 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: INFO nova.api.openstack.requestlog [None req-f12a98fc-c1d7-4aab-8f0d-0a03e136745d tempest-TestMinimumBasicScenario-1817438735 tempest-TestMinimumBasicScenario-1817438735-project] 10.222.0.61 "GET /compute/v2.1/servers/ef63d04a-87e5-4202-a672-d45a2a877c68" status: 200 len: 1357 microversion: 2.1 time: 0.153217 May 14 15:48:56.897699 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: [pid: 128728|app: 0|req: 198/379] 10.222.0.61 () {58 vars in 1235 bytes} [Sat May 14 15:48:56 2022] GET /compute/v2.1/servers/ef63d04a-87e5-4202-a672-d45a2a877c68 => generated 1357 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 15:48:56.959161 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi [None req-1a4c24e7-22fc-4e3b-a17b-17c11c1b49b6 tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Calling method '>' {{(pid=128729) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 15:48:56.960229 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.compute.api [None req-1a4c24e7-22fc-4e3b-a17b-17c11c1b49b6 tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] [instance: 9fbb269d-11cd-49ed-81ac-570e721c15cd] Fetching instance by UUID {{(pid=128729) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 15:48:56.966549 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-1a4c24e7-22fc-4e3b-a17b-17c11c1b49b6 tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:48:56.967074 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-1a4c24e7-22fc-4e3b-a17b-17c11c1b49b6 tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:48:56.967920 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-1a4c24e7-22fc-4e3b-a17b-17c11c1b49b6 tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:48:56.968419 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-1a4c24e7-22fc-4e3b-a17b-17c11c1b49b6 tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:48:57.015949 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi [None req-ca466e16-a63b-44ed-acc4-57adda58a003 tempest-VolumesActionsTest-1534566879 tempest-VolumesActionsTest-1534566879-project] Calling method '>' {{(pid=128728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 15:48:57.016567 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.compute.api [None req-ca466e16-a63b-44ed-acc4-57adda58a003 tempest-VolumesActionsTest-1534566879 tempest-VolumesActionsTest-1534566879-project] [instance: 656dffc0-256e-40ba-b670-f08e247a0d95] Fetching instance by UUID {{(pid=128728) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 15:48:57.023415 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-ca466e16-a63b-44ed-acc4-57adda58a003 tempest-VolumesActionsTest-1534566879 tempest-VolumesActionsTest-1534566879-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:48:57.023873 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-ca466e16-a63b-44ed-acc4-57adda58a003 tempest-VolumesActionsTest-1534566879 tempest-VolumesActionsTest-1534566879-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:48:57.024659 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-ca466e16-a63b-44ed-acc4-57adda58a003 tempest-VolumesActionsTest-1534566879 tempest-VolumesActionsTest-1534566879-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:48:57.025177 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-ca466e16-a63b-44ed-acc4-57adda58a003 tempest-VolumesActionsTest-1534566879 tempest-VolumesActionsTest-1534566879-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:48:57.108718 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.policy [None req-ca466e16-a63b-44ed-acc4-57adda58a003 tempest-VolumesActionsTest-1534566879 tempest-VolumesActionsTest-1534566879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0156ed87a5b4efca7ef5056429db1a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71b09f9f20b340b5a615b24e05312703', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128728) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:48:57.117150 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: INFO nova.api.openstack.requestlog [None req-ca466e16-a63b-44ed-acc4-57adda58a003 tempest-VolumesActionsTest-1534566879 tempest-VolumesActionsTest-1534566879-project] 10.222.0.61 "GET /compute/v2.1/servers/656dffc0-256e-40ba-b670-f08e247a0d95" status: 200 len: 1218 microversion: 2.1 time: 0.104930 May 14 15:48:57.118047 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: [pid: 128728|app: 0|req: 199/380] 10.222.0.61 () {58 vars in 1235 bytes} [Sat May 14 15:48:57 2022] GET /compute/v2.1/servers/656dffc0-256e-40ba-b670-f08e247a0d95 => generated 1218 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 15:48:57.152486 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.policy [None req-1a4c24e7-22fc-4e3b-a17b-17c11c1b49b6 tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b896317d96a40d6a137db0dcf5f98f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d2517d5440a4d30949f3dd36a46d813', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128729) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:48:57.161305 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: INFO nova.api.openstack.requestlog [None req-1a4c24e7-22fc-4e3b-a17b-17c11c1b49b6 tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] 10.222.0.61 "GET /compute/v2.1/servers/9fbb269d-11cd-49ed-81ac-570e721c15cd" status: 200 len: 1511 microversion: 2.1 time: 0.206796 May 14 15:48:57.161876 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: [pid: 128729|app: 0|req: 182/381] 10.222.0.61 () {58 vars in 1235 bytes} [Sat May 14 15:48:56 2022] GET /compute/v2.1/servers/9fbb269d-11cd-49ed-81ac-570e721c15cd => generated 1511 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 15:48:57.631743 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi [None req-62298455-f68a-48f3-bbdf-a26d6ea83ec4 tempest-VolumesNegativeTest-1107689494 tempest-VolumesNegativeTest-1107689494-project] Calling method '>' {{(pid=128728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 15:48:57.632357 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.compute.api [None req-62298455-f68a-48f3-bbdf-a26d6ea83ec4 tempest-VolumesNegativeTest-1107689494 tempest-VolumesNegativeTest-1107689494-project] [instance: ea1f238d-3bae-4ce8-b328-d07fc2f7f272] Fetching instance by UUID {{(pid=128728) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 15:48:57.638957 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-62298455-f68a-48f3-bbdf-a26d6ea83ec4 tempest-VolumesNegativeTest-1107689494 tempest-VolumesNegativeTest-1107689494-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:48:57.639414 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-62298455-f68a-48f3-bbdf-a26d6ea83ec4 tempest-VolumesNegativeTest-1107689494 tempest-VolumesNegativeTest-1107689494-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:48:57.640194 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-62298455-f68a-48f3-bbdf-a26d6ea83ec4 tempest-VolumesNegativeTest-1107689494 tempest-VolumesNegativeTest-1107689494-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:48:57.640629 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-62298455-f68a-48f3-bbdf-a26d6ea83ec4 tempest-VolumesNegativeTest-1107689494 tempest-VolumesNegativeTest-1107689494-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:48:57.703155 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.policy [None req-62298455-f68a-48f3-bbdf-a26d6ea83ec4 tempest-VolumesNegativeTest-1107689494 tempest-VolumesNegativeTest-1107689494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e8303a1f1584ae2aae774eaf31481f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1e7c6697dfc4562b4c1d46ee21964a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128728) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:48:57.710531 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: INFO nova.api.openstack.requestlog [None req-62298455-f68a-48f3-bbdf-a26d6ea83ec4 tempest-VolumesNegativeTest-1107689494 tempest-VolumesNegativeTest-1107689494-project] 10.222.0.61 "GET /compute/v2.1/servers/ea1f238d-3bae-4ce8-b328-d07fc2f7f272" status: 200 len: 1267 microversion: 2.1 time: 0.083267 May 14 15:48:57.711288 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: [pid: 128728|app: 0|req: 200/382] 10.222.0.61 () {58 vars in 1235 bytes} [Sat May 14 15:48:57 2022] GET /compute/v2.1/servers/ea1f238d-3bae-4ce8-b328-d07fc2f7f272 => generated 1267 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 15:48:57.914353 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi [None req-d06fc214-afcf-4bd6-bde1-82df4a3d936f tempest-TestMinimumBasicScenario-1817438735 tempest-TestMinimumBasicScenario-1817438735-project] Calling method '>' {{(pid=128729) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 15:48:57.915616 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.compute.api [None req-d06fc214-afcf-4bd6-bde1-82df4a3d936f tempest-TestMinimumBasicScenario-1817438735 tempest-TestMinimumBasicScenario-1817438735-project] [instance: ef63d04a-87e5-4202-a672-d45a2a877c68] Fetching instance by UUID {{(pid=128729) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 15:48:57.922844 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-d06fc214-afcf-4bd6-bde1-82df4a3d936f tempest-TestMinimumBasicScenario-1817438735 tempest-TestMinimumBasicScenario-1817438735-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:48:57.923305 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-d06fc214-afcf-4bd6-bde1-82df4a3d936f tempest-TestMinimumBasicScenario-1817438735 tempest-TestMinimumBasicScenario-1817438735-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:48:57.924087 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-d06fc214-afcf-4bd6-bde1-82df4a3d936f tempest-TestMinimumBasicScenario-1817438735 tempest-TestMinimumBasicScenario-1817438735-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:48:57.924557 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-d06fc214-afcf-4bd6-bde1-82df4a3d936f tempest-TestMinimumBasicScenario-1817438735 tempest-TestMinimumBasicScenario-1817438735-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:48:58.056108 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.policy [None req-d06fc214-afcf-4bd6-bde1-82df4a3d936f tempest-TestMinimumBasicScenario-1817438735 tempest-TestMinimumBasicScenario-1817438735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d5f259e0b98457ea6b6b88d886c813d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fba11e8ade54d388361c4c936a43372', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128729) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:48:58.064155 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: INFO nova.api.openstack.requestlog [None req-d06fc214-afcf-4bd6-bde1-82df4a3d936f tempest-TestMinimumBasicScenario-1817438735 tempest-TestMinimumBasicScenario-1817438735-project] 10.222.0.61 "GET /compute/v2.1/servers/ef63d04a-87e5-4202-a672-d45a2a877c68" status: 200 len: 1357 microversion: 2.1 time: 0.153701 May 14 15:48:58.064717 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: [pid: 128729|app: 0|req: 183/383] 10.222.0.61 () {58 vars in 1235 bytes} [Sat May 14 15:48:57 2022] GET /compute/v2.1/servers/ef63d04a-87e5-4202-a672-d45a2a877c68 => generated 1357 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 15:48:58.135605 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi [None req-2a51a451-a78f-4e01-9cd3-bcd8010237cb tempest-VolumesActionsTest-1534566879 tempest-VolumesActionsTest-1534566879-project] Calling method '>' {{(pid=128728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 15:48:58.136242 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.compute.api [None req-2a51a451-a78f-4e01-9cd3-bcd8010237cb tempest-VolumesActionsTest-1534566879 tempest-VolumesActionsTest-1534566879-project] [instance: 656dffc0-256e-40ba-b670-f08e247a0d95] Fetching instance by UUID {{(pid=128728) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 15:48:58.142277 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-2a51a451-a78f-4e01-9cd3-bcd8010237cb tempest-VolumesActionsTest-1534566879 tempest-VolumesActionsTest-1534566879-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:48:58.142755 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-2a51a451-a78f-4e01-9cd3-bcd8010237cb tempest-VolumesActionsTest-1534566879 tempest-VolumesActionsTest-1534566879-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:48:58.143526 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-2a51a451-a78f-4e01-9cd3-bcd8010237cb tempest-VolumesActionsTest-1534566879 tempest-VolumesActionsTest-1534566879-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:48:58.143959 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-2a51a451-a78f-4e01-9cd3-bcd8010237cb tempest-VolumesActionsTest-1534566879 tempest-VolumesActionsTest-1534566879-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:48:58.180609 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi [None req-72d77930-a668-46f0-a6f2-17dd56ae4f46 tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Calling method '>' {{(pid=128729) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 15:48:58.181320 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.compute.api [None req-72d77930-a668-46f0-a6f2-17dd56ae4f46 tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] [instance: 9fbb269d-11cd-49ed-81ac-570e721c15cd] Fetching instance by UUID {{(pid=128729) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 15:48:58.188653 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-72d77930-a668-46f0-a6f2-17dd56ae4f46 tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:48:58.189204 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-72d77930-a668-46f0-a6f2-17dd56ae4f46 tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:48:58.190239 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-72d77930-a668-46f0-a6f2-17dd56ae4f46 tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:48:58.190817 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-72d77930-a668-46f0-a6f2-17dd56ae4f46 tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:48:58.207307 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.policy [None req-2a51a451-a78f-4e01-9cd3-bcd8010237cb tempest-VolumesActionsTest-1534566879 tempest-VolumesActionsTest-1534566879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0156ed87a5b4efca7ef5056429db1a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71b09f9f20b340b5a615b24e05312703', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128728) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:48:58.215893 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: INFO nova.api.openstack.requestlog [None req-2a51a451-a78f-4e01-9cd3-bcd8010237cb tempest-VolumesActionsTest-1534566879 tempest-VolumesActionsTest-1534566879-project] 10.222.0.61 "GET /compute/v2.1/servers/656dffc0-256e-40ba-b670-f08e247a0d95" status: 200 len: 1218 microversion: 2.1 time: 0.084523 May 14 15:48:58.217093 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: [pid: 128728|app: 0|req: 201/384] 10.222.0.61 () {58 vars in 1235 bytes} [Sat May 14 15:48:58 2022] GET /compute/v2.1/servers/656dffc0-256e-40ba-b670-f08e247a0d95 => generated 1218 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 15:48:58.332125 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.policy [None req-72d77930-a668-46f0-a6f2-17dd56ae4f46 tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b896317d96a40d6a137db0dcf5f98f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d2517d5440a4d30949f3dd36a46d813', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128729) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:48:58.340974 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: INFO nova.api.openstack.requestlog [None req-72d77930-a668-46f0-a6f2-17dd56ae4f46 tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] 10.222.0.61 "GET /compute/v2.1/servers/9fbb269d-11cd-49ed-81ac-570e721c15cd" status: 200 len: 1511 microversion: 2.1 time: 0.164797 May 14 15:48:58.341813 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: [pid: 128729|app: 0|req: 184/385] 10.222.0.61 () {58 vars in 1235 bytes} [Sat May 14 15:48:58 2022] GET /compute/v2.1/servers/9fbb269d-11cd-49ed-81ac-570e721c15cd => generated 1511 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 15:48:58.727870 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi [None req-0d93265e-b9d5-457d-b816-c040a11beb29 tempest-VolumesNegativeTest-1107689494 tempest-VolumesNegativeTest-1107689494-project] Calling method '>' {{(pid=128728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 15:48:58.728564 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.compute.api [None req-0d93265e-b9d5-457d-b816-c040a11beb29 tempest-VolumesNegativeTest-1107689494 tempest-VolumesNegativeTest-1107689494-project] [instance: ea1f238d-3bae-4ce8-b328-d07fc2f7f272] Fetching instance by UUID {{(pid=128728) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 15:48:58.734718 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-0d93265e-b9d5-457d-b816-c040a11beb29 tempest-VolumesNegativeTest-1107689494 tempest-VolumesNegativeTest-1107689494-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:48:58.735166 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-0d93265e-b9d5-457d-b816-c040a11beb29 tempest-VolumesNegativeTest-1107689494 tempest-VolumesNegativeTest-1107689494-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:48:58.735976 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-0d93265e-b9d5-457d-b816-c040a11beb29 tempest-VolumesNegativeTest-1107689494 tempest-VolumesNegativeTest-1107689494-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:48:58.736379 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-0d93265e-b9d5-457d-b816-c040a11beb29 tempest-VolumesNegativeTest-1107689494 tempest-VolumesNegativeTest-1107689494-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:48:58.801788 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.policy [None req-0d93265e-b9d5-457d-b816-c040a11beb29 tempest-VolumesNegativeTest-1107689494 tempest-VolumesNegativeTest-1107689494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e8303a1f1584ae2aae774eaf31481f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1e7c6697dfc4562b4c1d46ee21964a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128728) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:48:58.809583 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: INFO nova.api.openstack.requestlog [None req-0d93265e-b9d5-457d-b816-c040a11beb29 tempest-VolumesNegativeTest-1107689494 tempest-VolumesNegativeTest-1107689494-project] 10.222.0.61 "GET /compute/v2.1/servers/ea1f238d-3bae-4ce8-b328-d07fc2f7f272" status: 200 len: 1267 microversion: 2.1 time: 0.085515 May 14 15:48:58.810163 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: [pid: 128728|app: 0|req: 202/386] 10.222.0.61 () {58 vars in 1235 bytes} [Sat May 14 15:48:58 2022] GET /compute/v2.1/servers/ea1f238d-3bae-4ce8-b328-d07fc2f7f272 => generated 1267 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 15:48:59.082008 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi [None req-93546b88-1e67-43e3-8df8-162232f94e9c tempest-TestMinimumBasicScenario-1817438735 tempest-TestMinimumBasicScenario-1817438735-project] Calling method '>' {{(pid=128729) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 15:48:59.083314 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.compute.api [None req-93546b88-1e67-43e3-8df8-162232f94e9c tempest-TestMinimumBasicScenario-1817438735 tempest-TestMinimumBasicScenario-1817438735-project] [instance: ef63d04a-87e5-4202-a672-d45a2a877c68] Fetching instance by UUID {{(pid=128729) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 15:48:59.090477 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-93546b88-1e67-43e3-8df8-162232f94e9c tempest-TestMinimumBasicScenario-1817438735 tempest-TestMinimumBasicScenario-1817438735-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:48:59.091048 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-93546b88-1e67-43e3-8df8-162232f94e9c tempest-TestMinimumBasicScenario-1817438735 tempest-TestMinimumBasicScenario-1817438735-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:48:59.091912 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-93546b88-1e67-43e3-8df8-162232f94e9c tempest-TestMinimumBasicScenario-1817438735 tempest-TestMinimumBasicScenario-1817438735-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:48:59.092351 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-93546b88-1e67-43e3-8df8-162232f94e9c tempest-TestMinimumBasicScenario-1817438735 tempest-TestMinimumBasicScenario-1817438735-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:48:59.229013 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.policy [None req-93546b88-1e67-43e3-8df8-162232f94e9c tempest-TestMinimumBasicScenario-1817438735 tempest-TestMinimumBasicScenario-1817438735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d5f259e0b98457ea6b6b88d886c813d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fba11e8ade54d388361c4c936a43372', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128729) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:48:59.233102 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi [None req-282440f7-cbc3-4489-98d6-38c144eca373 tempest-VolumesActionsTest-1534566879 tempest-VolumesActionsTest-1534566879-project] Calling method '>' {{(pid=128728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 15:48:59.233982 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.compute.api [None req-282440f7-cbc3-4489-98d6-38c144eca373 tempest-VolumesActionsTest-1534566879 tempest-VolumesActionsTest-1534566879-project] [instance: 656dffc0-256e-40ba-b670-f08e247a0d95] Fetching instance by UUID {{(pid=128728) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 15:48:59.238608 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: INFO nova.api.openstack.requestlog [None req-93546b88-1e67-43e3-8df8-162232f94e9c tempest-TestMinimumBasicScenario-1817438735 tempest-TestMinimumBasicScenario-1817438735-project] 10.222.0.61 "GET /compute/v2.1/servers/ef63d04a-87e5-4202-a672-d45a2a877c68" status: 200 len: 1357 microversion: 2.1 time: 0.161111 May 14 15:48:59.240970 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-282440f7-cbc3-4489-98d6-38c144eca373 tempest-VolumesActionsTest-1534566879 tempest-VolumesActionsTest-1534566879-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:48:59.241815 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-282440f7-cbc3-4489-98d6-38c144eca373 tempest-VolumesActionsTest-1534566879 tempest-VolumesActionsTest-1534566879-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:48:59.243156 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-282440f7-cbc3-4489-98d6-38c144eca373 tempest-VolumesActionsTest-1534566879 tempest-VolumesActionsTest-1534566879-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:48:59.246234 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: [pid: 128729|app: 0|req: 185/387] 10.222.0.61 () {58 vars in 1235 bytes} [Sat May 14 15:48:59 2022] GET /compute/v2.1/servers/ef63d04a-87e5-4202-a672-d45a2a877c68 => generated 1357 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 15:48:59.246600 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-282440f7-cbc3-4489-98d6-38c144eca373 tempest-VolumesActionsTest-1534566879 tempest-VolumesActionsTest-1534566879-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:48:59.311238 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.policy [None req-282440f7-cbc3-4489-98d6-38c144eca373 tempest-VolumesActionsTest-1534566879 tempest-VolumesActionsTest-1534566879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0156ed87a5b4efca7ef5056429db1a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71b09f9f20b340b5a615b24e05312703', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128728) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:48:59.318827 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: INFO nova.api.openstack.requestlog [None req-282440f7-cbc3-4489-98d6-38c144eca373 tempest-VolumesActionsTest-1534566879 tempest-VolumesActionsTest-1534566879-project] 10.222.0.61 "GET /compute/v2.1/servers/656dffc0-256e-40ba-b670-f08e247a0d95" status: 200 len: 1218 microversion: 2.1 time: 0.089641 May 14 15:48:59.319464 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: [pid: 128728|app: 0|req: 203/388] 10.222.0.61 () {58 vars in 1235 bytes} [Sat May 14 15:48:59 2022] GET /compute/v2.1/servers/656dffc0-256e-40ba-b670-f08e247a0d95 => generated 1218 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 15:48:59.358760 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi [None req-2fb20baf-65d4-411c-94ac-3d6553ee6e87 tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Calling method '>' {{(pid=128729) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 15:48:59.359284 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.compute.api [None req-2fb20baf-65d4-411c-94ac-3d6553ee6e87 tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] [instance: 9fbb269d-11cd-49ed-81ac-570e721c15cd] Fetching instance by UUID {{(pid=128729) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 15:48:59.365726 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-2fb20baf-65d4-411c-94ac-3d6553ee6e87 tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:48:59.366178 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-2fb20baf-65d4-411c-94ac-3d6553ee6e87 tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:48:59.366987 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-2fb20baf-65d4-411c-94ac-3d6553ee6e87 tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:48:59.367425 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-2fb20baf-65d4-411c-94ac-3d6553ee6e87 tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:48:59.506490 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.policy [None req-2fb20baf-65d4-411c-94ac-3d6553ee6e87 tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b896317d96a40d6a137db0dcf5f98f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d2517d5440a4d30949f3dd36a46d813', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128729) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:48:59.520471 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: INFO nova.api.openstack.requestlog [None req-2fb20baf-65d4-411c-94ac-3d6553ee6e87 tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] 10.222.0.61 "GET /compute/v2.1/servers/9fbb269d-11cd-49ed-81ac-570e721c15cd" status: 200 len: 1511 microversion: 2.1 time: 0.165509 May 14 15:48:59.521258 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: [pid: 128729|app: 0|req: 186/389] 10.222.0.61 () {58 vars in 1235 bytes} [Sat May 14 15:48:59 2022] GET /compute/v2.1/servers/9fbb269d-11cd-49ed-81ac-570e721c15cd => generated 1511 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 15:48:59.827002 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi [None req-dc4f234e-c687-4201-b914-5d46029370ff tempest-VolumesNegativeTest-1107689494 tempest-VolumesNegativeTest-1107689494-project] Calling method '>' {{(pid=128728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 15:48:59.827605 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.compute.api [None req-dc4f234e-c687-4201-b914-5d46029370ff tempest-VolumesNegativeTest-1107689494 tempest-VolumesNegativeTest-1107689494-project] [instance: ea1f238d-3bae-4ce8-b328-d07fc2f7f272] Fetching instance by UUID {{(pid=128728) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 15:48:59.845400 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-dc4f234e-c687-4201-b914-5d46029370ff tempest-VolumesNegativeTest-1107689494 tempest-VolumesNegativeTest-1107689494-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:48:59.846035 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-dc4f234e-c687-4201-b914-5d46029370ff tempest-VolumesNegativeTest-1107689494 tempest-VolumesNegativeTest-1107689494-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:48:59.847015 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-dc4f234e-c687-4201-b914-5d46029370ff tempest-VolumesNegativeTest-1107689494 tempest-VolumesNegativeTest-1107689494-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:48:59.847598 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-dc4f234e-c687-4201-b914-5d46029370ff tempest-VolumesNegativeTest-1107689494 tempest-VolumesNegativeTest-1107689494-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:48:59.911601 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.policy [None req-dc4f234e-c687-4201-b914-5d46029370ff tempest-VolumesNegativeTest-1107689494 tempest-VolumesNegativeTest-1107689494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e8303a1f1584ae2aae774eaf31481f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1e7c6697dfc4562b4c1d46ee21964a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128728) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:48:59.921314 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: INFO nova.api.openstack.requestlog [None req-dc4f234e-c687-4201-b914-5d46029370ff tempest-VolumesNegativeTest-1107689494 tempest-VolumesNegativeTest-1107689494-project] 10.222.0.61 "GET /compute/v2.1/servers/ea1f238d-3bae-4ce8-b328-d07fc2f7f272" status: 200 len: 1267 microversion: 2.1 time: 0.098072 May 14 15:48:59.922137 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: [pid: 128728|app: 0|req: 204/390] 10.222.0.61 () {58 vars in 1235 bytes} [Sat May 14 15:48:59 2022] GET /compute/v2.1/servers/ea1f238d-3bae-4ce8-b328-d07fc2f7f272 => generated 1267 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 15:49:00.257046 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi [None req-5e9e6d44-58a6-4ac8-9566-08dfa5555935 tempest-TestMinimumBasicScenario-1817438735 tempest-TestMinimumBasicScenario-1817438735-project] Calling method '>' {{(pid=128729) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 15:49:00.257672 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.compute.api [None req-5e9e6d44-58a6-4ac8-9566-08dfa5555935 tempest-TestMinimumBasicScenario-1817438735 tempest-TestMinimumBasicScenario-1817438735-project] [instance: ef63d04a-87e5-4202-a672-d45a2a877c68] Fetching instance by UUID {{(pid=128729) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 15:49:00.264835 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-5e9e6d44-58a6-4ac8-9566-08dfa5555935 tempest-TestMinimumBasicScenario-1817438735 tempest-TestMinimumBasicScenario-1817438735-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:49:00.265289 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-5e9e6d44-58a6-4ac8-9566-08dfa5555935 tempest-TestMinimumBasicScenario-1817438735 tempest-TestMinimumBasicScenario-1817438735-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:49:00.266064 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-5e9e6d44-58a6-4ac8-9566-08dfa5555935 tempest-TestMinimumBasicScenario-1817438735 tempest-TestMinimumBasicScenario-1817438735-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:49:00.266529 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-5e9e6d44-58a6-4ac8-9566-08dfa5555935 tempest-TestMinimumBasicScenario-1817438735 tempest-TestMinimumBasicScenario-1817438735-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:49:00.336162 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi [None req-194bb494-42a8-4677-84b8-95bf9734fe44 tempest-VolumesActionsTest-1534566879 tempest-VolumesActionsTest-1534566879-project] Calling method '>' {{(pid=128728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 15:49:00.337441 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.compute.api [None req-194bb494-42a8-4677-84b8-95bf9734fe44 tempest-VolumesActionsTest-1534566879 tempest-VolumesActionsTest-1534566879-project] [instance: 656dffc0-256e-40ba-b670-f08e247a0d95] Fetching instance by UUID {{(pid=128728) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 15:49:00.345400 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-194bb494-42a8-4677-84b8-95bf9734fe44 tempest-VolumesActionsTest-1534566879 tempest-VolumesActionsTest-1534566879-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:49:00.346002 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-194bb494-42a8-4677-84b8-95bf9734fe44 tempest-VolumesActionsTest-1534566879 tempest-VolumesActionsTest-1534566879-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:49:00.346913 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-194bb494-42a8-4677-84b8-95bf9734fe44 tempest-VolumesActionsTest-1534566879 tempest-VolumesActionsTest-1534566879-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:49:00.347351 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-194bb494-42a8-4677-84b8-95bf9734fe44 tempest-VolumesActionsTest-1534566879 tempest-VolumesActionsTest-1534566879-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:49:00.410242 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.policy [None req-5e9e6d44-58a6-4ac8-9566-08dfa5555935 tempest-TestMinimumBasicScenario-1817438735 tempest-TestMinimumBasicScenario-1817438735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d5f259e0b98457ea6b6b88d886c813d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fba11e8ade54d388361c4c936a43372', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128729) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:49:00.425637 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: INFO nova.api.openstack.requestlog [None req-5e9e6d44-58a6-4ac8-9566-08dfa5555935 tempest-TestMinimumBasicScenario-1817438735 tempest-TestMinimumBasicScenario-1817438735-project] 10.222.0.61 "GET /compute/v2.1/servers/ef63d04a-87e5-4202-a672-d45a2a877c68" status: 200 len: 1357 microversion: 2.1 time: 0.172441 May 14 15:49:00.426623 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: [pid: 128729|app: 0|req: 187/391] 10.222.0.61 () {58 vars in 1235 bytes} [Sat May 14 15:49:00 2022] GET /compute/v2.1/servers/ef63d04a-87e5-4202-a672-d45a2a877c68 => generated 1357 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 15:49:00.448101 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.policy [None req-194bb494-42a8-4677-84b8-95bf9734fe44 tempest-VolumesActionsTest-1534566879 tempest-VolumesActionsTest-1534566879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0156ed87a5b4efca7ef5056429db1a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71b09f9f20b340b5a615b24e05312703', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128728) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:49:00.456285 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: INFO nova.api.openstack.requestlog [None req-194bb494-42a8-4677-84b8-95bf9734fe44 tempest-VolumesActionsTest-1534566879 tempest-VolumesActionsTest-1534566879-project] 10.222.0.61 "GET /compute/v2.1/servers/656dffc0-256e-40ba-b670-f08e247a0d95" status: 200 len: 1218 microversion: 2.1 time: 0.123813 May 14 15:49:00.457214 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: [pid: 128728|app: 0|req: 205/392] 10.222.0.61 () {58 vars in 1235 bytes} [Sat May 14 15:49:00 2022] GET /compute/v2.1/servers/656dffc0-256e-40ba-b670-f08e247a0d95 => generated 1218 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 15:49:00.537048 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi [None req-0e8fc700-857c-45d1-a4b9-0e0044ef7568 tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Calling method '>' {{(pid=128729) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 15:49:00.537574 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.compute.api [None req-0e8fc700-857c-45d1-a4b9-0e0044ef7568 tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] [instance: 9fbb269d-11cd-49ed-81ac-570e721c15cd] Fetching instance by UUID {{(pid=128729) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 15:49:00.543609 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-0e8fc700-857c-45d1-a4b9-0e0044ef7568 tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:49:00.544068 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-0e8fc700-857c-45d1-a4b9-0e0044ef7568 tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:49:00.544843 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-0e8fc700-857c-45d1-a4b9-0e0044ef7568 tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:49:00.545287 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-0e8fc700-857c-45d1-a4b9-0e0044ef7568 tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:49:00.678769 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.policy [None req-0e8fc700-857c-45d1-a4b9-0e0044ef7568 tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b896317d96a40d6a137db0dcf5f98f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d2517d5440a4d30949f3dd36a46d813', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128729) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:49:00.686789 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: INFO nova.api.openstack.requestlog [None req-0e8fc700-857c-45d1-a4b9-0e0044ef7568 tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] 10.222.0.61 "GET /compute/v2.1/servers/9fbb269d-11cd-49ed-81ac-570e721c15cd" status: 200 len: 1511 microversion: 2.1 time: 0.153670 May 14 15:49:00.687372 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: [pid: 128729|app: 0|req: 188/393] 10.222.0.61 () {58 vars in 1235 bytes} [Sat May 14 15:49:00 2022] GET /compute/v2.1/servers/9fbb269d-11cd-49ed-81ac-570e721c15cd => generated 1511 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 15:49:00.938984 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi [None req-fae1871f-6f08-4824-88ae-5c9c7d4dc31e tempest-VolumesNegativeTest-1107689494 tempest-VolumesNegativeTest-1107689494-project] Calling method '>' {{(pid=128728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 15:49:00.939597 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.compute.api [None req-fae1871f-6f08-4824-88ae-5c9c7d4dc31e tempest-VolumesNegativeTest-1107689494 tempest-VolumesNegativeTest-1107689494-project] [instance: ea1f238d-3bae-4ce8-b328-d07fc2f7f272] Fetching instance by UUID {{(pid=128728) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 15:49:00.945864 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-fae1871f-6f08-4824-88ae-5c9c7d4dc31e tempest-VolumesNegativeTest-1107689494 tempest-VolumesNegativeTest-1107689494-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:49:00.946340 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-fae1871f-6f08-4824-88ae-5c9c7d4dc31e tempest-VolumesNegativeTest-1107689494 tempest-VolumesNegativeTest-1107689494-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:49:00.947147 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-fae1871f-6f08-4824-88ae-5c9c7d4dc31e tempest-VolumesNegativeTest-1107689494 tempest-VolumesNegativeTest-1107689494-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:49:00.947617 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-fae1871f-6f08-4824-88ae-5c9c7d4dc31e tempest-VolumesNegativeTest-1107689494 tempest-VolumesNegativeTest-1107689494-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:49:01.015685 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.policy [None req-fae1871f-6f08-4824-88ae-5c9c7d4dc31e tempest-VolumesNegativeTest-1107689494 tempest-VolumesNegativeTest-1107689494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e8303a1f1584ae2aae774eaf31481f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1e7c6697dfc4562b4c1d46ee21964a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128728) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:49:01.023628 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: INFO nova.api.openstack.requestlog [None req-fae1871f-6f08-4824-88ae-5c9c7d4dc31e tempest-VolumesNegativeTest-1107689494 tempest-VolumesNegativeTest-1107689494-project] 10.222.0.61 "GET /compute/v2.1/servers/ea1f238d-3bae-4ce8-b328-d07fc2f7f272" status: 200 len: 1267 microversion: 2.1 time: 0.088406 May 14 15:49:01.024421 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: [pid: 128728|app: 0|req: 206/394] 10.222.0.61 () {58 vars in 1235 bytes} [Sat May 14 15:49:00 2022] GET /compute/v2.1/servers/ea1f238d-3bae-4ce8-b328-d07fc2f7f272 => generated 1267 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 15:49:01.442146 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi [None req-b1f57ce2-1441-4eb1-be51-7ee5b795ea5e tempest-TestMinimumBasicScenario-1817438735 tempest-TestMinimumBasicScenario-1817438735-project] Calling method '>' {{(pid=128729) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 15:49:01.442775 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.compute.api [None req-b1f57ce2-1441-4eb1-be51-7ee5b795ea5e tempest-TestMinimumBasicScenario-1817438735 tempest-TestMinimumBasicScenario-1817438735-project] [instance: ef63d04a-87e5-4202-a672-d45a2a877c68] Fetching instance by UUID {{(pid=128729) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 15:49:01.449684 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-b1f57ce2-1441-4eb1-be51-7ee5b795ea5e tempest-TestMinimumBasicScenario-1817438735 tempest-TestMinimumBasicScenario-1817438735-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:49:01.450182 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-b1f57ce2-1441-4eb1-be51-7ee5b795ea5e tempest-TestMinimumBasicScenario-1817438735 tempest-TestMinimumBasicScenario-1817438735-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:49:01.450990 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-b1f57ce2-1441-4eb1-be51-7ee5b795ea5e tempest-TestMinimumBasicScenario-1817438735 tempest-TestMinimumBasicScenario-1817438735-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:49:01.451429 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-b1f57ce2-1441-4eb1-be51-7ee5b795ea5e tempest-TestMinimumBasicScenario-1817438735 tempest-TestMinimumBasicScenario-1817438735-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:49:01.474870 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi [None req-6d9f5c8b-5e2c-4f6c-a481-7074140d73c6 tempest-VolumesActionsTest-1534566879 tempest-VolumesActionsTest-1534566879-project] Calling method '>' {{(pid=128728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 15:49:01.475567 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.compute.api [None req-6d9f5c8b-5e2c-4f6c-a481-7074140d73c6 tempest-VolumesActionsTest-1534566879 tempest-VolumesActionsTest-1534566879-project] [instance: 656dffc0-256e-40ba-b670-f08e247a0d95] Fetching instance by UUID {{(pid=128728) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 15:49:01.481750 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-6d9f5c8b-5e2c-4f6c-a481-7074140d73c6 tempest-VolumesActionsTest-1534566879 tempest-VolumesActionsTest-1534566879-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:49:01.482202 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-6d9f5c8b-5e2c-4f6c-a481-7074140d73c6 tempest-VolumesActionsTest-1534566879 tempest-VolumesActionsTest-1534566879-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:49:01.483011 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-6d9f5c8b-5e2c-4f6c-a481-7074140d73c6 tempest-VolumesActionsTest-1534566879 tempest-VolumesActionsTest-1534566879-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:49:01.483451 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-6d9f5c8b-5e2c-4f6c-a481-7074140d73c6 tempest-VolumesActionsTest-1534566879 tempest-VolumesActionsTest-1534566879-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:49:01.566911 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.policy [None req-6d9f5c8b-5e2c-4f6c-a481-7074140d73c6 tempest-VolumesActionsTest-1534566879 tempest-VolumesActionsTest-1534566879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0156ed87a5b4efca7ef5056429db1a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71b09f9f20b340b5a615b24e05312703', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128728) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:49:01.575343 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: INFO nova.api.openstack.requestlog [None req-6d9f5c8b-5e2c-4f6c-a481-7074140d73c6 tempest-VolumesActionsTest-1534566879 tempest-VolumesActionsTest-1534566879-project] 10.222.0.61 "GET /compute/v2.1/servers/656dffc0-256e-40ba-b670-f08e247a0d95" status: 200 len: 1218 microversion: 2.1 time: 0.104304 May 14 15:49:01.575923 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: [pid: 128728|app: 0|req: 207/395] 10.222.0.61 () {58 vars in 1235 bytes} [Sat May 14 15:49:01 2022] GET /compute/v2.1/servers/656dffc0-256e-40ba-b670-f08e247a0d95 => generated 1218 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 15:49:01.603531 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.policy [None req-b1f57ce2-1441-4eb1-be51-7ee5b795ea5e tempest-TestMinimumBasicScenario-1817438735 tempest-TestMinimumBasicScenario-1817438735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d5f259e0b98457ea6b6b88d886c813d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fba11e8ade54d388361c4c936a43372', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128729) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:49:01.611456 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: INFO nova.api.openstack.requestlog [None req-b1f57ce2-1441-4eb1-be51-7ee5b795ea5e tempest-TestMinimumBasicScenario-1817438735 tempest-TestMinimumBasicScenario-1817438735-project] 10.222.0.61 "GET /compute/v2.1/servers/ef63d04a-87e5-4202-a672-d45a2a877c68" status: 200 len: 1357 microversion: 2.1 time: 0.173182 May 14 15:49:01.612267 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: [pid: 128729|app: 0|req: 189/396] 10.222.0.61 () {58 vars in 1235 bytes} [Sat May 14 15:49:01 2022] GET /compute/v2.1/servers/ef63d04a-87e5-4202-a672-d45a2a877c68 => generated 1357 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 15:49:01.707127 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi [None req-33a1b8a5-38a8-481e-958f-fb4c33f30b3d tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Calling method '>' {{(pid=128728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 15:49:01.707730 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.compute.api [None req-33a1b8a5-38a8-481e-958f-fb4c33f30b3d tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] [instance: 9fbb269d-11cd-49ed-81ac-570e721c15cd] Fetching instance by UUID {{(pid=128728) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 15:49:01.713482 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-33a1b8a5-38a8-481e-958f-fb4c33f30b3d tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:49:01.713934 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-33a1b8a5-38a8-481e-958f-fb4c33f30b3d tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:49:01.715355 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-33a1b8a5-38a8-481e-958f-fb4c33f30b3d tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:49:01.715850 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-33a1b8a5-38a8-481e-958f-fb4c33f30b3d tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:49:01.843971 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.policy [None req-33a1b8a5-38a8-481e-958f-fb4c33f30b3d tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b896317d96a40d6a137db0dcf5f98f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d2517d5440a4d30949f3dd36a46d813', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128728) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:49:01.851432 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: INFO nova.api.openstack.requestlog [None req-33a1b8a5-38a8-481e-958f-fb4c33f30b3d tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] 10.222.0.61 "GET /compute/v2.1/servers/9fbb269d-11cd-49ed-81ac-570e721c15cd" status: 200 len: 1511 microversion: 2.1 time: 0.147998 May 14 15:49:01.852035 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: [pid: 128728|app: 0|req: 208/397] 10.222.0.61 () {58 vars in 1235 bytes} [Sat May 14 15:49:01 2022] GET /compute/v2.1/servers/9fbb269d-11cd-49ed-81ac-570e721c15cd => generated 1511 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 15:49:02.040944 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi [None req-58a5a393-1132-43d7-9504-416fccef281e tempest-VolumesNegativeTest-1107689494 tempest-VolumesNegativeTest-1107689494-project] Calling method '>' {{(pid=128729) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 15:49:02.041953 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.compute.api [None req-58a5a393-1132-43d7-9504-416fccef281e tempest-VolumesNegativeTest-1107689494 tempest-VolumesNegativeTest-1107689494-project] [instance: ea1f238d-3bae-4ce8-b328-d07fc2f7f272] Fetching instance by UUID {{(pid=128729) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 15:49:02.049650 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-58a5a393-1132-43d7-9504-416fccef281e tempest-VolumesNegativeTest-1107689494 tempest-VolumesNegativeTest-1107689494-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:49:02.050101 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-58a5a393-1132-43d7-9504-416fccef281e tempest-VolumesNegativeTest-1107689494 tempest-VolumesNegativeTest-1107689494-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:49:02.050906 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-58a5a393-1132-43d7-9504-416fccef281e tempest-VolumesNegativeTest-1107689494 tempest-VolumesNegativeTest-1107689494-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:49:02.051344 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-58a5a393-1132-43d7-9504-416fccef281e tempest-VolumesNegativeTest-1107689494 tempest-VolumesNegativeTest-1107689494-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:49:02.119029 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.policy [None req-58a5a393-1132-43d7-9504-416fccef281e tempest-VolumesNegativeTest-1107689494 tempest-VolumesNegativeTest-1107689494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e8303a1f1584ae2aae774eaf31481f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1e7c6697dfc4562b4c1d46ee21964a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128729) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:49:02.126226 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: INFO nova.api.openstack.requestlog [None req-58a5a393-1132-43d7-9504-416fccef281e tempest-VolumesNegativeTest-1107689494 tempest-VolumesNegativeTest-1107689494-project] 10.222.0.61 "GET /compute/v2.1/servers/ea1f238d-3bae-4ce8-b328-d07fc2f7f272" status: 200 len: 1267 microversion: 2.1 time: 0.089065 May 14 15:49:02.126827 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: [pid: 128729|app: 0|req: 190/398] 10.222.0.61 () {58 vars in 1235 bytes} [Sat May 14 15:49:02 2022] GET /compute/v2.1/servers/ea1f238d-3bae-4ce8-b328-d07fc2f7f272 => generated 1267 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 15:49:02.592634 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi [None req-01859821-dec6-4fd7-b303-946ead15b7e7 tempest-VolumesActionsTest-1534566879 tempest-VolumesActionsTest-1534566879-project] Calling method '>' {{(pid=128728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 15:49:02.593303 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.compute.api [None req-01859821-dec6-4fd7-b303-946ead15b7e7 tempest-VolumesActionsTest-1534566879 tempest-VolumesActionsTest-1534566879-project] [instance: 656dffc0-256e-40ba-b670-f08e247a0d95] Fetching instance by UUID {{(pid=128728) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 15:49:02.599189 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-01859821-dec6-4fd7-b303-946ead15b7e7 tempest-VolumesActionsTest-1534566879 tempest-VolumesActionsTest-1534566879-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:49:02.599632 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-01859821-dec6-4fd7-b303-946ead15b7e7 tempest-VolumesActionsTest-1534566879 tempest-VolumesActionsTest-1534566879-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:49:02.600394 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-01859821-dec6-4fd7-b303-946ead15b7e7 tempest-VolumesActionsTest-1534566879 tempest-VolumesActionsTest-1534566879-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:49:02.600824 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-01859821-dec6-4fd7-b303-946ead15b7e7 tempest-VolumesActionsTest-1534566879 tempest-VolumesActionsTest-1534566879-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:49:02.628512 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi [None req-27ef6041-81a1-4562-aa68-cf9dd1f1b9f9 tempest-TestMinimumBasicScenario-1817438735 tempest-TestMinimumBasicScenario-1817438735-project] Calling method '>' {{(pid=128729) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 15:49:02.629119 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.compute.api [None req-27ef6041-81a1-4562-aa68-cf9dd1f1b9f9 tempest-TestMinimumBasicScenario-1817438735 tempest-TestMinimumBasicScenario-1817438735-project] [instance: ef63d04a-87e5-4202-a672-d45a2a877c68] Fetching instance by UUID {{(pid=128729) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 15:49:02.635472 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-27ef6041-81a1-4562-aa68-cf9dd1f1b9f9 tempest-TestMinimumBasicScenario-1817438735 tempest-TestMinimumBasicScenario-1817438735-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:49:02.635911 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-27ef6041-81a1-4562-aa68-cf9dd1f1b9f9 tempest-TestMinimumBasicScenario-1817438735 tempest-TestMinimumBasicScenario-1817438735-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:49:02.637209 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-27ef6041-81a1-4562-aa68-cf9dd1f1b9f9 tempest-TestMinimumBasicScenario-1817438735 tempest-TestMinimumBasicScenario-1817438735-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:49:02.637634 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-27ef6041-81a1-4562-aa68-cf9dd1f1b9f9 tempest-TestMinimumBasicScenario-1817438735 tempest-TestMinimumBasicScenario-1817438735-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:49:02.660443 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.policy [None req-01859821-dec6-4fd7-b303-946ead15b7e7 tempest-VolumesActionsTest-1534566879 tempest-VolumesActionsTest-1534566879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0156ed87a5b4efca7ef5056429db1a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71b09f9f20b340b5a615b24e05312703', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128728) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:49:02.667885 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: INFO nova.api.openstack.requestlog [None req-01859821-dec6-4fd7-b303-946ead15b7e7 tempest-VolumesActionsTest-1534566879 tempest-VolumesActionsTest-1534566879-project] 10.222.0.61 "GET /compute/v2.1/servers/656dffc0-256e-40ba-b670-f08e247a0d95" status: 200 len: 1218 microversion: 2.1 time: 0.079652 May 14 15:49:02.668461 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: [pid: 128728|app: 0|req: 209/399] 10.222.0.61 () {58 vars in 1235 bytes} [Sat May 14 15:49:02 2022] GET /compute/v2.1/servers/656dffc0-256e-40ba-b670-f08e247a0d95 => generated 1218 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 15:49:02.763287 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.policy [None req-27ef6041-81a1-4562-aa68-cf9dd1f1b9f9 tempest-TestMinimumBasicScenario-1817438735 tempest-TestMinimumBasicScenario-1817438735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d5f259e0b98457ea6b6b88d886c813d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fba11e8ade54d388361c4c936a43372', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128729) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:49:02.770727 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: INFO nova.api.openstack.requestlog [None req-27ef6041-81a1-4562-aa68-cf9dd1f1b9f9 tempest-TestMinimumBasicScenario-1817438735 tempest-TestMinimumBasicScenario-1817438735-project] 10.222.0.61 "GET /compute/v2.1/servers/ef63d04a-87e5-4202-a672-d45a2a877c68" status: 200 len: 1357 microversion: 2.1 time: 0.145978 May 14 15:49:02.771297 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: [pid: 128729|app: 0|req: 191/400] 10.222.0.61 () {58 vars in 1235 bytes} [Sat May 14 15:49:02 2022] GET /compute/v2.1/servers/ef63d04a-87e5-4202-a672-d45a2a877c68 => generated 1357 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 15:49:02.868845 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi [None req-2580ca05-7373-4727-86a2-ed946aab42b8 tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Calling method '>' {{(pid=128728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 15:49:02.869426 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.compute.api [None req-2580ca05-7373-4727-86a2-ed946aab42b8 tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] [instance: 9fbb269d-11cd-49ed-81ac-570e721c15cd] Fetching instance by UUID {{(pid=128728) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 15:49:02.875282 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-2580ca05-7373-4727-86a2-ed946aab42b8 tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:49:02.875730 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-2580ca05-7373-4727-86a2-ed946aab42b8 tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:49:02.876501 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-2580ca05-7373-4727-86a2-ed946aab42b8 tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:49:02.876939 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-2580ca05-7373-4727-86a2-ed946aab42b8 tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:49:03.001758 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.policy [None req-2580ca05-7373-4727-86a2-ed946aab42b8 tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b896317d96a40d6a137db0dcf5f98f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d2517d5440a4d30949f3dd36a46d813', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128728) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:49:03.009029 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: INFO nova.api.openstack.requestlog [None req-2580ca05-7373-4727-86a2-ed946aab42b8 tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] 10.222.0.61 "GET /compute/v2.1/servers/9fbb269d-11cd-49ed-81ac-570e721c15cd" status: 200 len: 1511 microversion: 2.1 time: 0.144081 May 14 15:49:03.009591 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: [pid: 128728|app: 0|req: 210/401] 10.222.0.61 () {58 vars in 1235 bytes} [Sat May 14 15:49:02 2022] GET /compute/v2.1/servers/9fbb269d-11cd-49ed-81ac-570e721c15cd => generated 1511 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 15:49:03.143969 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi [None req-7f61560c-e2d1-4950-a19e-7e2243c6ba41 tempest-VolumesNegativeTest-1107689494 tempest-VolumesNegativeTest-1107689494-project] Calling method '>' {{(pid=128729) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 15:49:03.144545 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.compute.api [None req-7f61560c-e2d1-4950-a19e-7e2243c6ba41 tempest-VolumesNegativeTest-1107689494 tempest-VolumesNegativeTest-1107689494-project] [instance: ea1f238d-3bae-4ce8-b328-d07fc2f7f272] Fetching instance by UUID {{(pid=128729) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 15:49:03.150362 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-7f61560c-e2d1-4950-a19e-7e2243c6ba41 tempest-VolumesNegativeTest-1107689494 tempest-VolumesNegativeTest-1107689494-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:49:03.150819 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-7f61560c-e2d1-4950-a19e-7e2243c6ba41 tempest-VolumesNegativeTest-1107689494 tempest-VolumesNegativeTest-1107689494-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:49:03.152279 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-7f61560c-e2d1-4950-a19e-7e2243c6ba41 tempest-VolumesNegativeTest-1107689494 tempest-VolumesNegativeTest-1107689494-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:49:03.152733 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-7f61560c-e2d1-4950-a19e-7e2243c6ba41 tempest-VolumesNegativeTest-1107689494 tempest-VolumesNegativeTest-1107689494-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:49:03.211987 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.policy [None req-7f61560c-e2d1-4950-a19e-7e2243c6ba41 tempest-VolumesNegativeTest-1107689494 tempest-VolumesNegativeTest-1107689494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e8303a1f1584ae2aae774eaf31481f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1e7c6697dfc4562b4c1d46ee21964a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128729) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:49:03.219842 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: INFO nova.api.openstack.requestlog [None req-7f61560c-e2d1-4950-a19e-7e2243c6ba41 tempest-VolumesNegativeTest-1107689494 tempest-VolumesNegativeTest-1107689494-project] 10.222.0.61 "GET /compute/v2.1/servers/ea1f238d-3bae-4ce8-b328-d07fc2f7f272" status: 200 len: 1267 microversion: 2.1 time: 0.079690 May 14 15:49:03.220403 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: [pid: 128729|app: 0|req: 192/402] 10.222.0.61 () {58 vars in 1235 bytes} [Sat May 14 15:49:03 2022] GET /compute/v2.1/servers/ea1f238d-3bae-4ce8-b328-d07fc2f7f272 => generated 1267 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 15:49:03.685126 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi [None req-b90df2af-ab52-49e7-882e-3c14ee4424c3 tempest-VolumesActionsTest-1534566879 tempest-VolumesActionsTest-1534566879-project] Calling method '>' {{(pid=128728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 15:49:03.685711 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.compute.api [None req-b90df2af-ab52-49e7-882e-3c14ee4424c3 tempest-VolumesActionsTest-1534566879 tempest-VolumesActionsTest-1534566879-project] [instance: 656dffc0-256e-40ba-b670-f08e247a0d95] Fetching instance by UUID {{(pid=128728) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 15:49:03.692094 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-b90df2af-ab52-49e7-882e-3c14ee4424c3 tempest-VolumesActionsTest-1534566879 tempest-VolumesActionsTest-1534566879-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:49:03.692534 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-b90df2af-ab52-49e7-882e-3c14ee4424c3 tempest-VolumesActionsTest-1534566879 tempest-VolumesActionsTest-1534566879-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:49:03.693294 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-b90df2af-ab52-49e7-882e-3c14ee4424c3 tempest-VolumesActionsTest-1534566879 tempest-VolumesActionsTest-1534566879-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:49:03.693724 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-b90df2af-ab52-49e7-882e-3c14ee4424c3 tempest-VolumesActionsTest-1534566879 tempest-VolumesActionsTest-1534566879-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:49:03.752409 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.policy [None req-b90df2af-ab52-49e7-882e-3c14ee4424c3 tempest-VolumesActionsTest-1534566879 tempest-VolumesActionsTest-1534566879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0156ed87a5b4efca7ef5056429db1a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71b09f9f20b340b5a615b24e05312703', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128728) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:49:03.759459 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: INFO nova.api.openstack.requestlog [None req-b90df2af-ab52-49e7-882e-3c14ee4424c3 tempest-VolumesActionsTest-1534566879 tempest-VolumesActionsTest-1534566879-project] 10.222.0.61 "GET /compute/v2.1/servers/656dffc0-256e-40ba-b670-f08e247a0d95" status: 200 len: 1218 microversion: 2.1 time: 0.078850 May 14 15:49:03.760039 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: [pid: 128728|app: 0|req: 211/403] 10.222.0.61 () {58 vars in 1235 bytes} [Sat May 14 15:49:03 2022] GET /compute/v2.1/servers/656dffc0-256e-40ba-b670-f08e247a0d95 => generated 1218 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 15:49:03.787975 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi [None req-3cb9cf35-3f63-446d-87b8-5d867b3836b5 tempest-TestMinimumBasicScenario-1817438735 tempest-TestMinimumBasicScenario-1817438735-project] Calling method '>' {{(pid=128729) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 15:49:03.788690 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.compute.api [None req-3cb9cf35-3f63-446d-87b8-5d867b3836b5 tempest-TestMinimumBasicScenario-1817438735 tempest-TestMinimumBasicScenario-1817438735-project] [instance: ef63d04a-87e5-4202-a672-d45a2a877c68] Fetching instance by UUID {{(pid=128729) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 15:49:03.795514 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-3cb9cf35-3f63-446d-87b8-5d867b3836b5 tempest-TestMinimumBasicScenario-1817438735 tempest-TestMinimumBasicScenario-1817438735-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:49:03.795972 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-3cb9cf35-3f63-446d-87b8-5d867b3836b5 tempest-TestMinimumBasicScenario-1817438735 tempest-TestMinimumBasicScenario-1817438735-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:49:03.796744 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-3cb9cf35-3f63-446d-87b8-5d867b3836b5 tempest-TestMinimumBasicScenario-1817438735 tempest-TestMinimumBasicScenario-1817438735-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:49:03.797183 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-3cb9cf35-3f63-446d-87b8-5d867b3836b5 tempest-TestMinimumBasicScenario-1817438735 tempest-TestMinimumBasicScenario-1817438735-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:49:03.927724 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.policy [None req-3cb9cf35-3f63-446d-87b8-5d867b3836b5 tempest-TestMinimumBasicScenario-1817438735 tempest-TestMinimumBasicScenario-1817438735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d5f259e0b98457ea6b6b88d886c813d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fba11e8ade54d388361c4c936a43372', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128729) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:49:03.934953 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: INFO nova.api.openstack.requestlog [None req-3cb9cf35-3f63-446d-87b8-5d867b3836b5 tempest-TestMinimumBasicScenario-1817438735 tempest-TestMinimumBasicScenario-1817438735-project] 10.222.0.61 "GET /compute/v2.1/servers/ef63d04a-87e5-4202-a672-d45a2a877c68" status: 200 len: 1357 microversion: 2.1 time: 0.150849 May 14 15:49:03.935723 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: [pid: 128729|app: 0|req: 193/404] 10.222.0.61 () {58 vars in 1235 bytes} [Sat May 14 15:49:03 2022] GET /compute/v2.1/servers/ef63d04a-87e5-4202-a672-d45a2a877c68 => generated 1357 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 15:49:04.025604 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi [None req-5f5faceb-c36b-46a5-915a-c7b9454e7f0f tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Calling method '>' {{(pid=128728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 15:49:04.026216 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.compute.api [None req-5f5faceb-c36b-46a5-915a-c7b9454e7f0f tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] [instance: 9fbb269d-11cd-49ed-81ac-570e721c15cd] Fetching instance by UUID {{(pid=128728) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 15:49:04.032978 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-5f5faceb-c36b-46a5-915a-c7b9454e7f0f tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:49:04.033434 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-5f5faceb-c36b-46a5-915a-c7b9454e7f0f tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:49:04.034210 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-5f5faceb-c36b-46a5-915a-c7b9454e7f0f tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:49:04.034687 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-5f5faceb-c36b-46a5-915a-c7b9454e7f0f tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:49:04.161712 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.policy [None req-5f5faceb-c36b-46a5-915a-c7b9454e7f0f tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b896317d96a40d6a137db0dcf5f98f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d2517d5440a4d30949f3dd36a46d813', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128728) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:49:04.169345 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: INFO nova.api.openstack.requestlog [None req-5f5faceb-c36b-46a5-915a-c7b9454e7f0f tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] 10.222.0.61 "GET /compute/v2.1/servers/9fbb269d-11cd-49ed-81ac-570e721c15cd" status: 200 len: 1511 microversion: 2.1 time: 0.147571 May 14 15:49:04.169894 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: [pid: 128728|app: 0|req: 212/405] 10.222.0.61 () {58 vars in 1235 bytes} [Sat May 14 15:49:04 2022] GET /compute/v2.1/servers/9fbb269d-11cd-49ed-81ac-570e721c15cd => generated 1511 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 15:49:04.236679 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi [None req-6bb19ee8-4245-452f-846a-a7fea9213f4a tempest-VolumesNegativeTest-1107689494 tempest-VolumesNegativeTest-1107689494-project] Calling method '>' {{(pid=128729) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 15:49:04.237474 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.compute.api [None req-6bb19ee8-4245-452f-846a-a7fea9213f4a tempest-VolumesNegativeTest-1107689494 tempest-VolumesNegativeTest-1107689494-project] [instance: ea1f238d-3bae-4ce8-b328-d07fc2f7f272] Fetching instance by UUID {{(pid=128729) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 15:49:04.243422 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-6bb19ee8-4245-452f-846a-a7fea9213f4a tempest-VolumesNegativeTest-1107689494 tempest-VolumesNegativeTest-1107689494-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:49:04.243877 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-6bb19ee8-4245-452f-846a-a7fea9213f4a tempest-VolumesNegativeTest-1107689494 tempest-VolumesNegativeTest-1107689494-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:49:04.244651 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-6bb19ee8-4245-452f-846a-a7fea9213f4a tempest-VolumesNegativeTest-1107689494 tempest-VolumesNegativeTest-1107689494-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:49:04.245092 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-6bb19ee8-4245-452f-846a-a7fea9213f4a tempest-VolumesNegativeTest-1107689494 tempest-VolumesNegativeTest-1107689494-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:49:04.307189 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.policy [None req-6bb19ee8-4245-452f-846a-a7fea9213f4a tempest-VolumesNegativeTest-1107689494 tempest-VolumesNegativeTest-1107689494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e8303a1f1584ae2aae774eaf31481f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1e7c6697dfc4562b4c1d46ee21964a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128729) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:49:04.315085 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: INFO nova.api.openstack.requestlog [None req-6bb19ee8-4245-452f-846a-a7fea9213f4a tempest-VolumesNegativeTest-1107689494 tempest-VolumesNegativeTest-1107689494-project] 10.222.0.61 "GET /compute/v2.1/servers/ea1f238d-3bae-4ce8-b328-d07fc2f7f272" status: 200 len: 1267 microversion: 2.1 time: 0.082312 May 14 15:49:04.315648 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: [pid: 128729|app: 0|req: 194/406] 10.222.0.61 () {58 vars in 1235 bytes} [Sat May 14 15:49:04 2022] GET /compute/v2.1/servers/ea1f238d-3bae-4ce8-b328-d07fc2f7f272 => generated 1267 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 15:49:04.777312 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi [None req-46f57bdf-052a-468d-940b-c98dae5aa02d tempest-VolumesActionsTest-1534566879 tempest-VolumesActionsTest-1534566879-project] Calling method '>' {{(pid=128728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 15:49:04.777917 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.compute.api [None req-46f57bdf-052a-468d-940b-c98dae5aa02d tempest-VolumesActionsTest-1534566879 tempest-VolumesActionsTest-1534566879-project] [instance: 656dffc0-256e-40ba-b670-f08e247a0d95] Fetching instance by UUID {{(pid=128728) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 15:49:04.784558 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-46f57bdf-052a-468d-940b-c98dae5aa02d tempest-VolumesActionsTest-1534566879 tempest-VolumesActionsTest-1534566879-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:49:04.785006 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-46f57bdf-052a-468d-940b-c98dae5aa02d tempest-VolumesActionsTest-1534566879 tempest-VolumesActionsTest-1534566879-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:49:04.785812 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-46f57bdf-052a-468d-940b-c98dae5aa02d tempest-VolumesActionsTest-1534566879 tempest-VolumesActionsTest-1534566879-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:49:04.786279 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-46f57bdf-052a-468d-940b-c98dae5aa02d tempest-VolumesActionsTest-1534566879 tempest-VolumesActionsTest-1534566879-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:49:04.846086 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.policy [None req-46f57bdf-052a-468d-940b-c98dae5aa02d tempest-VolumesActionsTest-1534566879 tempest-VolumesActionsTest-1534566879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0156ed87a5b4efca7ef5056429db1a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71b09f9f20b340b5a615b24e05312703', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128728) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:49:04.853290 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: INFO nova.api.openstack.requestlog [None req-46f57bdf-052a-468d-940b-c98dae5aa02d tempest-VolumesActionsTest-1534566879 tempest-VolumesActionsTest-1534566879-project] 10.222.0.61 "GET /compute/v2.1/servers/656dffc0-256e-40ba-b670-f08e247a0d95" status: 200 len: 1218 microversion: 2.1 time: 0.080468 May 14 15:49:04.853850 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: [pid: 128728|app: 0|req: 213/407] 10.222.0.61 () {58 vars in 1235 bytes} [Sat May 14 15:49:04 2022] GET /compute/v2.1/servers/656dffc0-256e-40ba-b670-f08e247a0d95 => generated 1218 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 15:49:04.952417 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi [None req-f4be7a67-cec7-47e9-a9a3-6da3155f1ceb tempest-TestMinimumBasicScenario-1817438735 tempest-TestMinimumBasicScenario-1817438735-project] Calling method '>' {{(pid=128729) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 15:49:04.953024 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.compute.api [None req-f4be7a67-cec7-47e9-a9a3-6da3155f1ceb tempest-TestMinimumBasicScenario-1817438735 tempest-TestMinimumBasicScenario-1817438735-project] [instance: ef63d04a-87e5-4202-a672-d45a2a877c68] Fetching instance by UUID {{(pid=128729) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 15:49:04.959271 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-f4be7a67-cec7-47e9-a9a3-6da3155f1ceb tempest-TestMinimumBasicScenario-1817438735 tempest-TestMinimumBasicScenario-1817438735-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:49:04.959721 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-f4be7a67-cec7-47e9-a9a3-6da3155f1ceb tempest-TestMinimumBasicScenario-1817438735 tempest-TestMinimumBasicScenario-1817438735-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:49:04.960520 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-f4be7a67-cec7-47e9-a9a3-6da3155f1ceb tempest-TestMinimumBasicScenario-1817438735 tempest-TestMinimumBasicScenario-1817438735-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:49:04.960956 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-f4be7a67-cec7-47e9-a9a3-6da3155f1ceb tempest-TestMinimumBasicScenario-1817438735 tempest-TestMinimumBasicScenario-1817438735-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:49:05.088454 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.policy [None req-f4be7a67-cec7-47e9-a9a3-6da3155f1ceb tempest-TestMinimumBasicScenario-1817438735 tempest-TestMinimumBasicScenario-1817438735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d5f259e0b98457ea6b6b88d886c813d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fba11e8ade54d388361c4c936a43372', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128729) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:49:05.096127 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: INFO nova.api.openstack.requestlog [None req-f4be7a67-cec7-47e9-a9a3-6da3155f1ceb tempest-TestMinimumBasicScenario-1817438735 tempest-TestMinimumBasicScenario-1817438735-project] 10.222.0.61 "GET /compute/v2.1/servers/ef63d04a-87e5-4202-a672-d45a2a877c68" status: 200 len: 1357 microversion: 2.1 time: 0.148253 May 14 15:49:05.096682 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: [pid: 128729|app: 0|req: 195/408] 10.222.0.61 () {58 vars in 1235 bytes} [Sat May 14 15:49:04 2022] GET /compute/v2.1/servers/ef63d04a-87e5-4202-a672-d45a2a877c68 => generated 1357 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 15:49:05.186713 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi [None req-0a5a5d40-74b5-4d20-b54d-dbf0d46cca61 tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Calling method '>' {{(pid=128728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 15:49:05.187328 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.compute.api [None req-0a5a5d40-74b5-4d20-b54d-dbf0d46cca61 tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] [instance: 9fbb269d-11cd-49ed-81ac-570e721c15cd] Fetching instance by UUID {{(pid=128728) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 15:49:05.193253 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-0a5a5d40-74b5-4d20-b54d-dbf0d46cca61 tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:49:05.193768 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-0a5a5d40-74b5-4d20-b54d-dbf0d46cca61 tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:49:05.194577 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-0a5a5d40-74b5-4d20-b54d-dbf0d46cca61 tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:49:05.195016 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-0a5a5d40-74b5-4d20-b54d-dbf0d46cca61 tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:49:05.319525 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.policy [None req-0a5a5d40-74b5-4d20-b54d-dbf0d46cca61 tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b896317d96a40d6a137db0dcf5f98f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d2517d5440a4d30949f3dd36a46d813', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128728) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:49:05.327025 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: INFO nova.api.openstack.requestlog [None req-0a5a5d40-74b5-4d20-b54d-dbf0d46cca61 tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] 10.222.0.61 "GET /compute/v2.1/servers/9fbb269d-11cd-49ed-81ac-570e721c15cd" status: 200 len: 1511 microversion: 2.1 time: 0.144962 May 14 15:49:05.327764 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: [pid: 128728|app: 0|req: 214/409] 10.222.0.61 () {58 vars in 1235 bytes} [Sat May 14 15:49:05 2022] GET /compute/v2.1/servers/9fbb269d-11cd-49ed-81ac-570e721c15cd => generated 1511 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 15:49:05.332106 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi [None req-c4b474b4-9853-418d-9ddb-cf535eda301f tempest-VolumesNegativeTest-1107689494 tempest-VolumesNegativeTest-1107689494-project] Calling method '>' {{(pid=128729) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 15:49:05.332716 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.compute.api [None req-c4b474b4-9853-418d-9ddb-cf535eda301f tempest-VolumesNegativeTest-1107689494 tempest-VolumesNegativeTest-1107689494-project] [instance: ea1f238d-3bae-4ce8-b328-d07fc2f7f272] Fetching instance by UUID {{(pid=128729) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 15:49:05.338515 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-c4b474b4-9853-418d-9ddb-cf535eda301f tempest-VolumesNegativeTest-1107689494 tempest-VolumesNegativeTest-1107689494-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:49:05.338965 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-c4b474b4-9853-418d-9ddb-cf535eda301f tempest-VolumesNegativeTest-1107689494 tempest-VolumesNegativeTest-1107689494-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:49:05.340263 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-c4b474b4-9853-418d-9ddb-cf535eda301f tempest-VolumesNegativeTest-1107689494 tempest-VolumesNegativeTest-1107689494-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:49:05.340704 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-c4b474b4-9853-418d-9ddb-cf535eda301f tempest-VolumesNegativeTest-1107689494 tempest-VolumesNegativeTest-1107689494-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:49:05.403913 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.policy [None req-c4b474b4-9853-418d-9ddb-cf535eda301f tempest-VolumesNegativeTest-1107689494 tempest-VolumesNegativeTest-1107689494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e8303a1f1584ae2aae774eaf31481f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1e7c6697dfc4562b4c1d46ee21964a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128729) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:49:05.411211 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: INFO nova.api.openstack.requestlog [None req-c4b474b4-9853-418d-9ddb-cf535eda301f tempest-VolumesNegativeTest-1107689494 tempest-VolumesNegativeTest-1107689494-project] 10.222.0.61 "GET /compute/v2.1/servers/ea1f238d-3bae-4ce8-b328-d07fc2f7f272" status: 200 len: 1267 microversion: 2.1 time: 0.082851 May 14 15:49:05.412079 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: [pid: 128729|app: 0|req: 196/410] 10.222.0.61 () {58 vars in 1235 bytes} [Sat May 14 15:49:05 2022] GET /compute/v2.1/servers/ea1f238d-3bae-4ce8-b328-d07fc2f7f272 => generated 1267 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 15:49:05.869896 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi [None req-3ff605c4-a1f5-4a00-b0fd-daae317b51bb tempest-VolumesActionsTest-1534566879 tempest-VolumesActionsTest-1534566879-project] Calling method '>' {{(pid=128728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 15:49:05.871126 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.compute.api [None req-3ff605c4-a1f5-4a00-b0fd-daae317b51bb tempest-VolumesActionsTest-1534566879 tempest-VolumesActionsTest-1534566879-project] [instance: 656dffc0-256e-40ba-b670-f08e247a0d95] Fetching instance by UUID {{(pid=128728) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 15:49:05.876880 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-3ff605c4-a1f5-4a00-b0fd-daae317b51bb tempest-VolumesActionsTest-1534566879 tempest-VolumesActionsTest-1534566879-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:49:05.877321 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-3ff605c4-a1f5-4a00-b0fd-daae317b51bb tempest-VolumesActionsTest-1534566879 tempest-VolumesActionsTest-1534566879-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:49:05.878085 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-3ff605c4-a1f5-4a00-b0fd-daae317b51bb tempest-VolumesActionsTest-1534566879 tempest-VolumesActionsTest-1534566879-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:49:05.878540 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-3ff605c4-a1f5-4a00-b0fd-daae317b51bb tempest-VolumesActionsTest-1534566879 tempest-VolumesActionsTest-1534566879-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:49:05.937248 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.policy [None req-3ff605c4-a1f5-4a00-b0fd-daae317b51bb tempest-VolumesActionsTest-1534566879 tempest-VolumesActionsTest-1534566879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0156ed87a5b4efca7ef5056429db1a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71b09f9f20b340b5a615b24e05312703', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128728) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:49:05.944512 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: INFO nova.api.openstack.requestlog [None req-3ff605c4-a1f5-4a00-b0fd-daae317b51bb tempest-VolumesActionsTest-1534566879 tempest-VolumesActionsTest-1534566879-project] 10.222.0.61 "GET /compute/v2.1/servers/656dffc0-256e-40ba-b670-f08e247a0d95" status: 200 len: 1218 microversion: 2.1 time: 0.078408 May 14 15:49:05.945068 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: [pid: 128728|app: 0|req: 215/411] 10.222.0.61 () {58 vars in 1235 bytes} [Sat May 14 15:49:05 2022] GET /compute/v2.1/servers/656dffc0-256e-40ba-b670-f08e247a0d95 => generated 1218 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 15:49:06.113578 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi [None req-7eaf519f-5b00-4ccf-8f6a-0b994dbf14a2 tempest-TestMinimumBasicScenario-1817438735 tempest-TestMinimumBasicScenario-1817438735-project] Calling method '>' {{(pid=128729) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 15:49:06.114276 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.compute.api [None req-7eaf519f-5b00-4ccf-8f6a-0b994dbf14a2 tempest-TestMinimumBasicScenario-1817438735 tempest-TestMinimumBasicScenario-1817438735-project] [instance: ef63d04a-87e5-4202-a672-d45a2a877c68] Fetching instance by UUID {{(pid=128729) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 15:49:06.121125 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-7eaf519f-5b00-4ccf-8f6a-0b994dbf14a2 tempest-TestMinimumBasicScenario-1817438735 tempest-TestMinimumBasicScenario-1817438735-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:49:06.121598 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-7eaf519f-5b00-4ccf-8f6a-0b994dbf14a2 tempest-TestMinimumBasicScenario-1817438735 tempest-TestMinimumBasicScenario-1817438735-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:49:06.122409 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-7eaf519f-5b00-4ccf-8f6a-0b994dbf14a2 tempest-TestMinimumBasicScenario-1817438735 tempest-TestMinimumBasicScenario-1817438735-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:49:06.122847 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-7eaf519f-5b00-4ccf-8f6a-0b994dbf14a2 tempest-TestMinimumBasicScenario-1817438735 tempest-TestMinimumBasicScenario-1817438735-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:49:06.248082 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.policy [None req-7eaf519f-5b00-4ccf-8f6a-0b994dbf14a2 tempest-TestMinimumBasicScenario-1817438735 tempest-TestMinimumBasicScenario-1817438735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d5f259e0b98457ea6b6b88d886c813d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fba11e8ade54d388361c4c936a43372', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128729) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:49:06.255312 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: INFO nova.api.openstack.requestlog [None req-7eaf519f-5b00-4ccf-8f6a-0b994dbf14a2 tempest-TestMinimumBasicScenario-1817438735 tempest-TestMinimumBasicScenario-1817438735-project] 10.222.0.61 "GET /compute/v2.1/servers/ef63d04a-87e5-4202-a672-d45a2a877c68" status: 200 len: 1357 microversion: 2.1 time: 0.146103 May 14 15:49:06.255886 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: [pid: 128729|app: 0|req: 197/412] 10.222.0.61 () {58 vars in 1235 bytes} [Sat May 14 15:49:06 2022] GET /compute/v2.1/servers/ef63d04a-87e5-4202-a672-d45a2a877c68 => generated 1357 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 15:49:06.344413 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi [None req-ddbca971-ae56-4669-9a3c-9520ee55c5a0 tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Calling method '>' {{(pid=128728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 15:49:06.345015 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.compute.api [None req-ddbca971-ae56-4669-9a3c-9520ee55c5a0 tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] [instance: 9fbb269d-11cd-49ed-81ac-570e721c15cd] Fetching instance by UUID {{(pid=128728) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 15:49:06.350929 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-ddbca971-ae56-4669-9a3c-9520ee55c5a0 tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:49:06.351377 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-ddbca971-ae56-4669-9a3c-9520ee55c5a0 tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:49:06.352234 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-ddbca971-ae56-4669-9a3c-9520ee55c5a0 tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:49:06.352669 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-ddbca971-ae56-4669-9a3c-9520ee55c5a0 tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:49:06.428335 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi [None req-74a869d9-3555-4ed6-b3c6-24d028592f3c tempest-VolumesNegativeTest-1107689494 tempest-VolumesNegativeTest-1107689494-project] Calling method '>' {{(pid=128729) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 15:49:06.429105 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.compute.api [None req-74a869d9-3555-4ed6-b3c6-24d028592f3c tempest-VolumesNegativeTest-1107689494 tempest-VolumesNegativeTest-1107689494-project] [instance: ea1f238d-3bae-4ce8-b328-d07fc2f7f272] Fetching instance by UUID {{(pid=128729) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 15:49:06.435074 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-74a869d9-3555-4ed6-b3c6-24d028592f3c tempest-VolumesNegativeTest-1107689494 tempest-VolumesNegativeTest-1107689494-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:49:06.435525 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-74a869d9-3555-4ed6-b3c6-24d028592f3c tempest-VolumesNegativeTest-1107689494 tempest-VolumesNegativeTest-1107689494-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:49:06.436301 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-74a869d9-3555-4ed6-b3c6-24d028592f3c tempest-VolumesNegativeTest-1107689494 tempest-VolumesNegativeTest-1107689494-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:49:06.436739 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-74a869d9-3555-4ed6-b3c6-24d028592f3c tempest-VolumesNegativeTest-1107689494 tempest-VolumesNegativeTest-1107689494-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:49:06.491699 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.policy [None req-ddbca971-ae56-4669-9a3c-9520ee55c5a0 tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b896317d96a40d6a137db0dcf5f98f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d2517d5440a4d30949f3dd36a46d813', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128728) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:49:06.499692 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: INFO nova.api.openstack.requestlog [None req-ddbca971-ae56-4669-9a3c-9520ee55c5a0 tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] 10.222.0.61 "GET /compute/v2.1/servers/9fbb269d-11cd-49ed-81ac-570e721c15cd" status: 200 len: 1511 microversion: 2.1 time: 0.159120 May 14 15:49:06.500393 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: [pid: 128728|app: 0|req: 216/413] 10.222.0.61 () {58 vars in 1235 bytes} [Sat May 14 15:49:06 2022] GET /compute/v2.1/servers/9fbb269d-11cd-49ed-81ac-570e721c15cd => generated 1511 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 15:49:06.507668 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.policy [None req-74a869d9-3555-4ed6-b3c6-24d028592f3c tempest-VolumesNegativeTest-1107689494 tempest-VolumesNegativeTest-1107689494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e8303a1f1584ae2aae774eaf31481f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1e7c6697dfc4562b4c1d46ee21964a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128729) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:49:06.515506 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: INFO nova.api.openstack.requestlog [None req-74a869d9-3555-4ed6-b3c6-24d028592f3c tempest-VolumesNegativeTest-1107689494 tempest-VolumesNegativeTest-1107689494-project] 10.222.0.61 "GET /compute/v2.1/servers/ea1f238d-3bae-4ce8-b328-d07fc2f7f272" status: 200 len: 1267 microversion: 2.1 time: 0.091096 May 14 15:49:06.516010 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: [pid: 128729|app: 0|req: 198/414] 10.222.0.61 () {58 vars in 1235 bytes} [Sat May 14 15:49:06 2022] GET /compute/v2.1/servers/ea1f238d-3bae-4ce8-b328-d07fc2f7f272 => generated 1267 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 15:49:06.960954 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi [None req-b194d6ad-3009-439f-bb34-17b1f384ed2f tempest-VolumesActionsTest-1534566879 tempest-VolumesActionsTest-1534566879-project] Calling method '>' {{(pid=128728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 15:49:06.961565 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.compute.api [None req-b194d6ad-3009-439f-bb34-17b1f384ed2f tempest-VolumesActionsTest-1534566879 tempest-VolumesActionsTest-1534566879-project] [instance: 656dffc0-256e-40ba-b670-f08e247a0d95] Fetching instance by UUID {{(pid=128728) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 15:49:06.968062 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-b194d6ad-3009-439f-bb34-17b1f384ed2f tempest-VolumesActionsTest-1534566879 tempest-VolumesActionsTest-1534566879-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:49:06.968513 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-b194d6ad-3009-439f-bb34-17b1f384ed2f tempest-VolumesActionsTest-1534566879 tempest-VolumesActionsTest-1534566879-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:49:06.969329 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-b194d6ad-3009-439f-bb34-17b1f384ed2f tempest-VolumesActionsTest-1534566879 tempest-VolumesActionsTest-1534566879-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:49:06.969725 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-b194d6ad-3009-439f-bb34-17b1f384ed2f tempest-VolumesActionsTest-1534566879 tempest-VolumesActionsTest-1534566879-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:49:07.029267 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.policy [None req-b194d6ad-3009-439f-bb34-17b1f384ed2f tempest-VolumesActionsTest-1534566879 tempest-VolumesActionsTest-1534566879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0156ed87a5b4efca7ef5056429db1a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71b09f9f20b340b5a615b24e05312703', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128728) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:49:07.036488 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: INFO nova.api.openstack.requestlog [None req-b194d6ad-3009-439f-bb34-17b1f384ed2f tempest-VolumesActionsTest-1534566879 tempest-VolumesActionsTest-1534566879-project] 10.222.0.61 "GET /compute/v2.1/servers/656dffc0-256e-40ba-b670-f08e247a0d95" status: 200 len: 1218 microversion: 2.1 time: 0.079383 May 14 15:49:07.037056 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: [pid: 128728|app: 0|req: 217/415] 10.222.0.61 () {58 vars in 1235 bytes} [Sat May 14 15:49:06 2022] GET /compute/v2.1/servers/656dffc0-256e-40ba-b670-f08e247a0d95 => generated 1218 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 15:49:07.272642 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi [None req-04b3898c-e7e8-4d14-b7d3-203830cccc61 tempest-TestMinimumBasicScenario-1817438735 tempest-TestMinimumBasicScenario-1817438735-project] Calling method '>' {{(pid=128729) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 15:49:07.273170 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.compute.api [None req-04b3898c-e7e8-4d14-b7d3-203830cccc61 tempest-TestMinimumBasicScenario-1817438735 tempest-TestMinimumBasicScenario-1817438735-project] [instance: ef63d04a-87e5-4202-a672-d45a2a877c68] Fetching instance by UUID {{(pid=128729) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 15:49:07.280728 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-04b3898c-e7e8-4d14-b7d3-203830cccc61 tempest-TestMinimumBasicScenario-1817438735 tempest-TestMinimumBasicScenario-1817438735-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:49:07.281178 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-04b3898c-e7e8-4d14-b7d3-203830cccc61 tempest-TestMinimumBasicScenario-1817438735 tempest-TestMinimumBasicScenario-1817438735-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:49:07.281938 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-04b3898c-e7e8-4d14-b7d3-203830cccc61 tempest-TestMinimumBasicScenario-1817438735 tempest-TestMinimumBasicScenario-1817438735-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:49:07.282396 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-04b3898c-e7e8-4d14-b7d3-203830cccc61 tempest-TestMinimumBasicScenario-1817438735 tempest-TestMinimumBasicScenario-1817438735-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:49:07.408052 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.policy [None req-04b3898c-e7e8-4d14-b7d3-203830cccc61 tempest-TestMinimumBasicScenario-1817438735 tempest-TestMinimumBasicScenario-1817438735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d5f259e0b98457ea6b6b88d886c813d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fba11e8ade54d388361c4c936a43372', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128729) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:49:07.415157 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: INFO nova.api.openstack.requestlog [None req-04b3898c-e7e8-4d14-b7d3-203830cccc61 tempest-TestMinimumBasicScenario-1817438735 tempest-TestMinimumBasicScenario-1817438735-project] 10.222.0.61 "GET /compute/v2.1/servers/ef63d04a-87e5-4202-a672-d45a2a877c68" status: 200 len: 1357 microversion: 2.1 time: 0.146377 May 14 15:49:07.415713 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: [pid: 128729|app: 0|req: 199/416] 10.222.0.61 () {58 vars in 1235 bytes} [Sat May 14 15:49:07 2022] GET /compute/v2.1/servers/ef63d04a-87e5-4202-a672-d45a2a877c68 => generated 1357 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 15:49:07.516612 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi [None req-0920d818-7914-45d2-9bb8-22322837ed83 tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Calling method '>' {{(pid=128728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 15:49:07.517219 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.compute.api [None req-0920d818-7914-45d2-9bb8-22322837ed83 tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] [instance: 9fbb269d-11cd-49ed-81ac-570e721c15cd] Fetching instance by UUID {{(pid=128728) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 15:49:07.523187 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-0920d818-7914-45d2-9bb8-22322837ed83 tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:49:07.523581 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-0920d818-7914-45d2-9bb8-22322837ed83 tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:49:07.524411 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-0920d818-7914-45d2-9bb8-22322837ed83 tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:49:07.524845 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-0920d818-7914-45d2-9bb8-22322837ed83 tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:49:07.532192 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi [None req-40514063-9ba5-4217-9dfd-bf2a98d05734 tempest-VolumesNegativeTest-1107689494 tempest-VolumesNegativeTest-1107689494-project] Calling method '>' {{(pid=128729) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 15:49:07.532795 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.compute.api [None req-40514063-9ba5-4217-9dfd-bf2a98d05734 tempest-VolumesNegativeTest-1107689494 tempest-VolumesNegativeTest-1107689494-project] [instance: ea1f238d-3bae-4ce8-b328-d07fc2f7f272] Fetching instance by UUID {{(pid=128729) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 15:49:07.538474 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-40514063-9ba5-4217-9dfd-bf2a98d05734 tempest-VolumesNegativeTest-1107689494 tempest-VolumesNegativeTest-1107689494-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:49:07.538925 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-40514063-9ba5-4217-9dfd-bf2a98d05734 tempest-VolumesNegativeTest-1107689494 tempest-VolumesNegativeTest-1107689494-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:49:07.539686 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-40514063-9ba5-4217-9dfd-bf2a98d05734 tempest-VolumesNegativeTest-1107689494 tempest-VolumesNegativeTest-1107689494-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:49:07.540127 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-40514063-9ba5-4217-9dfd-bf2a98d05734 tempest-VolumesNegativeTest-1107689494 tempest-VolumesNegativeTest-1107689494-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:49:07.821744 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.policy [None req-40514063-9ba5-4217-9dfd-bf2a98d05734 tempest-VolumesNegativeTest-1107689494 tempest-VolumesNegativeTest-1107689494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e8303a1f1584ae2aae774eaf31481f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1e7c6697dfc4562b4c1d46ee21964a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128729) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:49:07.830076 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: INFO nova.api.openstack.requestlog [None req-40514063-9ba5-4217-9dfd-bf2a98d05734 tempest-VolumesNegativeTest-1107689494 tempest-VolumesNegativeTest-1107689494-project] 10.222.0.61 "GET /compute/v2.1/servers/ea1f238d-3bae-4ce8-b328-d07fc2f7f272" status: 200 len: 1267 microversion: 2.1 time: 0.301612 May 14 15:49:07.839811 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: [pid: 128729|app: 0|req: 200/417] 10.222.0.61 () {58 vars in 1235 bytes} [Sat May 14 15:49:07 2022] GET /compute/v2.1/servers/ea1f238d-3bae-4ce8-b328-d07fc2f7f272 => generated 1267 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 15:49:07.878445 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.policy [None req-0920d818-7914-45d2-9bb8-22322837ed83 tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b896317d96a40d6a137db0dcf5f98f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d2517d5440a4d30949f3dd36a46d813', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128728) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:49:07.885625 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: INFO nova.api.openstack.requestlog [None req-0920d818-7914-45d2-9bb8-22322837ed83 tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] 10.222.0.61 "GET /compute/v2.1/servers/9fbb269d-11cd-49ed-81ac-570e721c15cd" status: 200 len: 1511 microversion: 2.1 time: 0.372839 May 14 15:49:07.886793 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: [pid: 128728|app: 0|req: 218/418] 10.222.0.61 () {58 vars in 1235 bytes} [Sat May 14 15:49:07 2022] GET /compute/v2.1/servers/9fbb269d-11cd-49ed-81ac-570e721c15cd => generated 1511 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 15:49:08.052964 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi [None req-6b7c517f-7955-4e8c-b2e2-b23b2aa61973 tempest-VolumesActionsTest-1534566879 tempest-VolumesActionsTest-1534566879-project] Calling method '>' {{(pid=128729) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 15:49:08.054444 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.compute.api [None req-6b7c517f-7955-4e8c-b2e2-b23b2aa61973 tempest-VolumesActionsTest-1534566879 tempest-VolumesActionsTest-1534566879-project] [instance: 656dffc0-256e-40ba-b670-f08e247a0d95] Fetching instance by UUID {{(pid=128729) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 15:49:08.061221 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-6b7c517f-7955-4e8c-b2e2-b23b2aa61973 tempest-VolumesActionsTest-1534566879 tempest-VolumesActionsTest-1534566879-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:49:08.061676 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-6b7c517f-7955-4e8c-b2e2-b23b2aa61973 tempest-VolumesActionsTest-1534566879 tempest-VolumesActionsTest-1534566879-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:49:08.062652 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-6b7c517f-7955-4e8c-b2e2-b23b2aa61973 tempest-VolumesActionsTest-1534566879 tempest-VolumesActionsTest-1534566879-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:49:08.062984 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-6b7c517f-7955-4e8c-b2e2-b23b2aa61973 tempest-VolumesActionsTest-1534566879 tempest-VolumesActionsTest-1534566879-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:49:08.140898 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.policy [None req-6b7c517f-7955-4e8c-b2e2-b23b2aa61973 tempest-VolumesActionsTest-1534566879 tempest-VolumesActionsTest-1534566879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0156ed87a5b4efca7ef5056429db1a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71b09f9f20b340b5a615b24e05312703', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128729) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:49:08.149675 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: INFO nova.api.openstack.requestlog [None req-6b7c517f-7955-4e8c-b2e2-b23b2aa61973 tempest-VolumesActionsTest-1534566879 tempest-VolumesActionsTest-1534566879-project] 10.222.0.61 "GET /compute/v2.1/servers/656dffc0-256e-40ba-b670-f08e247a0d95" status: 200 len: 1218 microversion: 2.1 time: 0.100261 May 14 15:49:08.150182 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: [pid: 128729|app: 0|req: 201/419] 10.222.0.61 () {58 vars in 1235 bytes} [Sat May 14 15:49:08 2022] GET /compute/v2.1/servers/656dffc0-256e-40ba-b670-f08e247a0d95 => generated 1218 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 15:49:08.431934 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi [None req-e0093407-c978-4821-90ed-e59a61171e6b tempest-TestMinimumBasicScenario-1817438735 tempest-TestMinimumBasicScenario-1817438735-project] Calling method '>' {{(pid=128728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 15:49:08.432668 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.compute.api [None req-e0093407-c978-4821-90ed-e59a61171e6b tempest-TestMinimumBasicScenario-1817438735 tempest-TestMinimumBasicScenario-1817438735-project] [instance: ef63d04a-87e5-4202-a672-d45a2a877c68] Fetching instance by UUID {{(pid=128728) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 15:49:08.439315 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-e0093407-c978-4821-90ed-e59a61171e6b tempest-TestMinimumBasicScenario-1817438735 tempest-TestMinimumBasicScenario-1817438735-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:49:08.440024 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-e0093407-c978-4821-90ed-e59a61171e6b tempest-TestMinimumBasicScenario-1817438735 tempest-TestMinimumBasicScenario-1817438735-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:49:08.440980 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-e0093407-c978-4821-90ed-e59a61171e6b tempest-TestMinimumBasicScenario-1817438735 tempest-TestMinimumBasicScenario-1817438735-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:49:08.441428 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-e0093407-c978-4821-90ed-e59a61171e6b tempest-TestMinimumBasicScenario-1817438735 tempest-TestMinimumBasicScenario-1817438735-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:49:08.575723 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.policy [None req-e0093407-c978-4821-90ed-e59a61171e6b tempest-TestMinimumBasicScenario-1817438735 tempest-TestMinimumBasicScenario-1817438735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d5f259e0b98457ea6b6b88d886c813d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fba11e8ade54d388361c4c936a43372', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128728) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:49:08.586292 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: INFO nova.api.openstack.requestlog [None req-e0093407-c978-4821-90ed-e59a61171e6b tempest-TestMinimumBasicScenario-1817438735 tempest-TestMinimumBasicScenario-1817438735-project] 10.222.0.61 "GET /compute/v2.1/servers/ef63d04a-87e5-4202-a672-d45a2a877c68" status: 200 len: 1357 microversion: 2.1 time: 0.158227 May 14 15:49:08.586904 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: [pid: 128728|app: 0|req: 219/420] 10.222.0.61 () {58 vars in 1235 bytes} [Sat May 14 15:49:08 2022] GET /compute/v2.1/servers/ef63d04a-87e5-4202-a672-d45a2a877c68 => generated 1357 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 15:49:08.798438 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi [req-59b33824-7384-4360-8316-f888f77d8e92 req-ae75d829-18db-450b-b753-5866cf63a094 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ef63d04a-87e5-4202-a672-d45a2a877c68", "tag": "61226c22-8028-48c9-8e04-0f0c0cf9fa30"}]} {{(pid=128729) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 15:49:08.806420 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [req-59b33824-7384-4360-8316-f888f77d8e92 req-ae75d829-18db-450b-b753-5866cf63a094 service nova] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:49:08.806860 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [req-59b33824-7384-4360-8316-f888f77d8e92 req-ae75d829-18db-450b-b753-5866cf63a094 service nova] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:49:08.818571 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: INFO nova.api.openstack.compute.server_external_events [req-59b33824-7384-4360-8316-f888f77d8e92 req-ae75d829-18db-450b-b753-5866cf63a094 service nova] Creating event network-changed:61226c22-8028-48c9-8e04-0f0c0cf9fa30 for instance ef63d04a-87e5-4202-a672-d45a2a877c68 on hv-cinder-83979 May 14 15:49:08.824467 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: INFO nova.api.openstack.requestlog [req-59b33824-7384-4360-8316-f888f77d8e92 req-ae75d829-18db-450b-b753-5866cf63a094 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.028900 May 14 15:49:08.825060 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: [pid: 128729|app: 0|req: 202/421] 10.222.0.61 () {64 vars in 1317 bytes} [Sat May 14 15:49:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 14 15:49:08.849451 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi [None req-956db76e-76bc-4d08-99c2-2caaecb189a0 tempest-VolumesNegativeTest-1107689494 tempest-VolumesNegativeTest-1107689494-project] Calling method '>' {{(pid=128728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 15:49:08.850066 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.compute.api [None req-956db76e-76bc-4d08-99c2-2caaecb189a0 tempest-VolumesNegativeTest-1107689494 tempest-VolumesNegativeTest-1107689494-project] [instance: ea1f238d-3bae-4ce8-b328-d07fc2f7f272] Fetching instance by UUID {{(pid=128728) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 15:49:08.857063 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-956db76e-76bc-4d08-99c2-2caaecb189a0 tempest-VolumesNegativeTest-1107689494 tempest-VolumesNegativeTest-1107689494-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:49:08.857517 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-956db76e-76bc-4d08-99c2-2caaecb189a0 tempest-VolumesNegativeTest-1107689494 tempest-VolumesNegativeTest-1107689494-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:49:08.858326 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-956db76e-76bc-4d08-99c2-2caaecb189a0 tempest-VolumesNegativeTest-1107689494 tempest-VolumesNegativeTest-1107689494-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:49:08.858780 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-956db76e-76bc-4d08-99c2-2caaecb189a0 tempest-VolumesNegativeTest-1107689494 tempest-VolumesNegativeTest-1107689494-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:49:08.904705 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi [None req-91c67c80-1448-475b-9290-08672f5c93fd tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Calling method '>' {{(pid=128729) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 15:49:08.905415 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.compute.api [None req-91c67c80-1448-475b-9290-08672f5c93fd tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] [instance: 9fbb269d-11cd-49ed-81ac-570e721c15cd] Fetching instance by UUID {{(pid=128729) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 15:49:08.911869 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-91c67c80-1448-475b-9290-08672f5c93fd tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:49:08.912277 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-91c67c80-1448-475b-9290-08672f5c93fd tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:49:08.913248 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-91c67c80-1448-475b-9290-08672f5c93fd tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:49:08.913695 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-91c67c80-1448-475b-9290-08672f5c93fd tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:49:08.923200 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.policy [None req-956db76e-76bc-4d08-99c2-2caaecb189a0 tempest-VolumesNegativeTest-1107689494 tempest-VolumesNegativeTest-1107689494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e8303a1f1584ae2aae774eaf31481f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1e7c6697dfc4562b4c1d46ee21964a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128728) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:49:08.931192 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: INFO nova.api.openstack.requestlog [None req-956db76e-76bc-4d08-99c2-2caaecb189a0 tempest-VolumesNegativeTest-1107689494 tempest-VolumesNegativeTest-1107689494-project] 10.222.0.61 "GET /compute/v2.1/servers/ea1f238d-3bae-4ce8-b328-d07fc2f7f272" status: 200 len: 1273 microversion: 2.1 time: 0.086113 May 14 15:49:08.931967 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: [pid: 128728|app: 0|req: 220/422] 10.222.0.61 () {58 vars in 1235 bytes} [Sat May 14 15:49:08 2022] GET /compute/v2.1/servers/ea1f238d-3bae-4ce8-b328-d07fc2f7f272 => generated 1273 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 15:49:09.045410 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.policy [None req-91c67c80-1448-475b-9290-08672f5c93fd tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b896317d96a40d6a137db0dcf5f98f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d2517d5440a4d30949f3dd36a46d813', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128729) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:49:09.052571 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: INFO nova.api.openstack.requestlog [None req-91c67c80-1448-475b-9290-08672f5c93fd tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] 10.222.0.61 "GET /compute/v2.1/servers/9fbb269d-11cd-49ed-81ac-570e721c15cd" status: 200 len: 1511 microversion: 2.1 time: 0.153210 May 14 15:49:09.053127 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: [pid: 128729|app: 0|req: 203/423] 10.222.0.61 () {58 vars in 1235 bytes} [Sat May 14 15:49:08 2022] GET /compute/v2.1/servers/9fbb269d-11cd-49ed-81ac-570e721c15cd => generated 1511 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 15:49:09.167374 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi [None req-47d4be5c-f028-4003-b6b2-7395c5b83eca tempest-VolumesActionsTest-1534566879 tempest-VolumesActionsTest-1534566879-project] Calling method '>' {{(pid=128728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 15:49:09.167740 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.compute.api [None req-47d4be5c-f028-4003-b6b2-7395c5b83eca tempest-VolumesActionsTest-1534566879 tempest-VolumesActionsTest-1534566879-project] [instance: 656dffc0-256e-40ba-b670-f08e247a0d95] Fetching instance by UUID {{(pid=128728) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 15:49:09.173497 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-47d4be5c-f028-4003-b6b2-7395c5b83eca tempest-VolumesActionsTest-1534566879 tempest-VolumesActionsTest-1534566879-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:49:09.173940 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-47d4be5c-f028-4003-b6b2-7395c5b83eca tempest-VolumesActionsTest-1534566879 tempest-VolumesActionsTest-1534566879-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:49:09.174733 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-47d4be5c-f028-4003-b6b2-7395c5b83eca tempest-VolumesActionsTest-1534566879 tempest-VolumesActionsTest-1534566879-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:49:09.175164 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-47d4be5c-f028-4003-b6b2-7395c5b83eca tempest-VolumesActionsTest-1534566879 tempest-VolumesActionsTest-1534566879-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:49:09.238705 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.policy [None req-47d4be5c-f028-4003-b6b2-7395c5b83eca tempest-VolumesActionsTest-1534566879 tempest-VolumesActionsTest-1534566879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0156ed87a5b4efca7ef5056429db1a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71b09f9f20b340b5a615b24e05312703', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128728) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:49:09.246735 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: INFO nova.api.openstack.requestlog [None req-47d4be5c-f028-4003-b6b2-7395c5b83eca tempest-VolumesActionsTest-1534566879 tempest-VolumesActionsTest-1534566879-project] 10.222.0.61 "GET /compute/v2.1/servers/656dffc0-256e-40ba-b670-f08e247a0d95" status: 200 len: 1266 microversion: 2.1 time: 0.083340 May 14 15:49:09.247308 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: [pid: 128728|app: 0|req: 221/424] 10.222.0.61 () {58 vars in 1235 bytes} [Sat May 14 15:49:09 2022] GET /compute/v2.1/servers/656dffc0-256e-40ba-b670-f08e247a0d95 => generated 1266 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 15:49:09.603347 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi [None req-26d40fee-1ee3-4429-b8ed-de91044a4861 tempest-TestMinimumBasicScenario-1817438735 tempest-TestMinimumBasicScenario-1817438735-project] Calling method '>' {{(pid=128729) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 15:49:09.603955 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.compute.api [None req-26d40fee-1ee3-4429-b8ed-de91044a4861 tempest-TestMinimumBasicScenario-1817438735 tempest-TestMinimumBasicScenario-1817438735-project] [instance: ef63d04a-87e5-4202-a672-d45a2a877c68] Fetching instance by UUID {{(pid=128729) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 15:49:09.610042 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-26d40fee-1ee3-4429-b8ed-de91044a4861 tempest-TestMinimumBasicScenario-1817438735 tempest-TestMinimumBasicScenario-1817438735-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:49:09.610521 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-26d40fee-1ee3-4429-b8ed-de91044a4861 tempest-TestMinimumBasicScenario-1817438735 tempest-TestMinimumBasicScenario-1817438735-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:49:09.611289 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-26d40fee-1ee3-4429-b8ed-de91044a4861 tempest-TestMinimumBasicScenario-1817438735 tempest-TestMinimumBasicScenario-1817438735-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:49:09.611728 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-26d40fee-1ee3-4429-b8ed-de91044a4861 tempest-TestMinimumBasicScenario-1817438735 tempest-TestMinimumBasicScenario-1817438735-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:49:09.737916 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.policy [None req-26d40fee-1ee3-4429-b8ed-de91044a4861 tempest-TestMinimumBasicScenario-1817438735 tempest-TestMinimumBasicScenario-1817438735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d5f259e0b98457ea6b6b88d886c813d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fba11e8ade54d388361c4c936a43372', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128729) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:49:09.745072 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: INFO nova.api.openstack.requestlog [None req-26d40fee-1ee3-4429-b8ed-de91044a4861 tempest-TestMinimumBasicScenario-1817438735 tempest-TestMinimumBasicScenario-1817438735-project] 10.222.0.61 "GET /compute/v2.1/servers/ef63d04a-87e5-4202-a672-d45a2a877c68" status: 200 len: 1357 microversion: 2.1 time: 0.145553 May 14 15:49:09.746190 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: [pid: 128729|app: 0|req: 204/425] 10.222.0.61 () {58 vars in 1235 bytes} [Sat May 14 15:49:09 2022] GET /compute/v2.1/servers/ef63d04a-87e5-4202-a672-d45a2a877c68 => generated 1357 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 15:49:09.948014 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi [None req-1eb87f28-ac80-4ce5-a236-893e8019c94c tempest-VolumesNegativeTest-1107689494 tempest-VolumesNegativeTest-1107689494-project] Calling method '>' {{(pid=128728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 15:49:09.948551 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.compute.api [None req-1eb87f28-ac80-4ce5-a236-893e8019c94c tempest-VolumesNegativeTest-1107689494 tempest-VolumesNegativeTest-1107689494-project] [instance: ea1f238d-3bae-4ce8-b328-d07fc2f7f272] Fetching instance by UUID {{(pid=128728) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 15:49:09.954391 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-1eb87f28-ac80-4ce5-a236-893e8019c94c tempest-VolumesNegativeTest-1107689494 tempest-VolumesNegativeTest-1107689494-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:49:09.954842 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-1eb87f28-ac80-4ce5-a236-893e8019c94c tempest-VolumesNegativeTest-1107689494 tempest-VolumesNegativeTest-1107689494-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:49:09.955601 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-1eb87f28-ac80-4ce5-a236-893e8019c94c tempest-VolumesNegativeTest-1107689494 tempest-VolumesNegativeTest-1107689494-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:49:09.956033 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-1eb87f28-ac80-4ce5-a236-893e8019c94c tempest-VolumesNegativeTest-1107689494 tempest-VolumesNegativeTest-1107689494-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:49:10.017005 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.policy [None req-1eb87f28-ac80-4ce5-a236-893e8019c94c tempest-VolumesNegativeTest-1107689494 tempest-VolumesNegativeTest-1107689494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e8303a1f1584ae2aae774eaf31481f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1e7c6697dfc4562b4c1d46ee21964a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128728) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:49:10.024052 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: INFO nova.api.openstack.requestlog [None req-1eb87f28-ac80-4ce5-a236-893e8019c94c tempest-VolumesNegativeTest-1107689494 tempest-VolumesNegativeTest-1107689494-project] 10.222.0.61 "GET /compute/v2.1/servers/ea1f238d-3bae-4ce8-b328-d07fc2f7f272" status: 200 len: 1273 microversion: 2.1 time: 0.079936 May 14 15:49:10.024605 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: [pid: 128728|app: 0|req: 222/426] 10.222.0.61 () {58 vars in 1235 bytes} [Sat May 14 15:49:09 2022] GET /compute/v2.1/servers/ea1f238d-3bae-4ce8-b328-d07fc2f7f272 => generated 1273 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 15:49:10.068770 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi [None req-ade34041-26d4-4ccb-ae7d-540b8dfd1762 tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Calling method '>' {{(pid=128729) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 15:49:10.069375 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.compute.api [None req-ade34041-26d4-4ccb-ae7d-540b8dfd1762 tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] [instance: 9fbb269d-11cd-49ed-81ac-570e721c15cd] Fetching instance by UUID {{(pid=128729) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 15:49:10.076312 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-ade34041-26d4-4ccb-ae7d-540b8dfd1762 tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:49:10.076765 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-ade34041-26d4-4ccb-ae7d-540b8dfd1762 tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:49:10.077532 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-ade34041-26d4-4ccb-ae7d-540b8dfd1762 tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:49:10.078078 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-ade34041-26d4-4ccb-ae7d-540b8dfd1762 tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:49:10.212709 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.policy [None req-ade34041-26d4-4ccb-ae7d-540b8dfd1762 tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b896317d96a40d6a137db0dcf5f98f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d2517d5440a4d30949f3dd36a46d813', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128729) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:49:10.220728 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: INFO nova.api.openstack.requestlog [None req-ade34041-26d4-4ccb-ae7d-540b8dfd1762 tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] 10.222.0.61 "GET /compute/v2.1/servers/9fbb269d-11cd-49ed-81ac-570e721c15cd" status: 200 len: 1511 microversion: 2.1 time: 0.155723 May 14 15:49:10.221289 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: [pid: 128729|app: 0|req: 205/427] 10.222.0.61 () {58 vars in 1235 bytes} [Sat May 14 15:49:10 2022] GET /compute/v2.1/servers/9fbb269d-11cd-49ed-81ac-570e721c15cd => generated 1511 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 15:49:10.263714 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi [None req-30d7a58e-b6ad-485b-b24f-935c96d1c5c8 tempest-VolumesActionsTest-1534566879 tempest-VolumesActionsTest-1534566879-project] Calling method '>' {{(pid=128728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 15:49:10.264313 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.compute.api [None req-30d7a58e-b6ad-485b-b24f-935c96d1c5c8 tempest-VolumesActionsTest-1534566879 tempest-VolumesActionsTest-1534566879-project] [instance: 656dffc0-256e-40ba-b670-f08e247a0d95] Fetching instance by UUID {{(pid=128728) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 15:49:10.270094 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-30d7a58e-b6ad-485b-b24f-935c96d1c5c8 tempest-VolumesActionsTest-1534566879 tempest-VolumesActionsTest-1534566879-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:49:10.270578 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-30d7a58e-b6ad-485b-b24f-935c96d1c5c8 tempest-VolumesActionsTest-1534566879 tempest-VolumesActionsTest-1534566879-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:49:10.271340 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-30d7a58e-b6ad-485b-b24f-935c96d1c5c8 tempest-VolumesActionsTest-1534566879 tempest-VolumesActionsTest-1534566879-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:49:10.271772 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-30d7a58e-b6ad-485b-b24f-935c96d1c5c8 tempest-VolumesActionsTest-1534566879 tempest-VolumesActionsTest-1534566879-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:49:10.331930 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.policy [None req-30d7a58e-b6ad-485b-b24f-935c96d1c5c8 tempest-VolumesActionsTest-1534566879 tempest-VolumesActionsTest-1534566879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0156ed87a5b4efca7ef5056429db1a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71b09f9f20b340b5a615b24e05312703', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128728) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:49:10.339085 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: INFO nova.api.openstack.requestlog [None req-30d7a58e-b6ad-485b-b24f-935c96d1c5c8 tempest-VolumesActionsTest-1534566879 tempest-VolumesActionsTest-1534566879-project] 10.222.0.61 "GET /compute/v2.1/servers/656dffc0-256e-40ba-b670-f08e247a0d95" status: 200 len: 1266 microversion: 2.1 time: 0.079672 May 14 15:49:10.339638 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: [pid: 128728|app: 0|req: 223/428] 10.222.0.61 () {58 vars in 1235 bytes} [Sat May 14 15:49:10 2022] GET /compute/v2.1/servers/656dffc0-256e-40ba-b670-f08e247a0d95 => generated 1266 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 15:49:10.762294 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi [None req-2f5f1797-99fe-4466-bdd6-f0b692aab716 tempest-TestMinimumBasicScenario-1817438735 tempest-TestMinimumBasicScenario-1817438735-project] Calling method '>' {{(pid=128729) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 15:49:10.762919 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.compute.api [None req-2f5f1797-99fe-4466-bdd6-f0b692aab716 tempest-TestMinimumBasicScenario-1817438735 tempest-TestMinimumBasicScenario-1817438735-project] [instance: ef63d04a-87e5-4202-a672-d45a2a877c68] Fetching instance by UUID {{(pid=128729) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 15:49:10.768921 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-2f5f1797-99fe-4466-bdd6-f0b692aab716 tempest-TestMinimumBasicScenario-1817438735 tempest-TestMinimumBasicScenario-1817438735-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:49:10.769512 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-2f5f1797-99fe-4466-bdd6-f0b692aab716 tempest-TestMinimumBasicScenario-1817438735 tempest-TestMinimumBasicScenario-1817438735-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:49:10.770277 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-2f5f1797-99fe-4466-bdd6-f0b692aab716 tempest-TestMinimumBasicScenario-1817438735 tempest-TestMinimumBasicScenario-1817438735-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:49:10.770740 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-2f5f1797-99fe-4466-bdd6-f0b692aab716 tempest-TestMinimumBasicScenario-1817438735 tempest-TestMinimumBasicScenario-1817438735-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:49:10.897274 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.policy [None req-2f5f1797-99fe-4466-bdd6-f0b692aab716 tempest-TestMinimumBasicScenario-1817438735 tempest-TestMinimumBasicScenario-1817438735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d5f259e0b98457ea6b6b88d886c813d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fba11e8ade54d388361c4c936a43372', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128729) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:49:10.904570 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: INFO nova.api.openstack.requestlog [None req-2f5f1797-99fe-4466-bdd6-f0b692aab716 tempest-TestMinimumBasicScenario-1817438735 tempest-TestMinimumBasicScenario-1817438735-project] 10.222.0.61 "GET /compute/v2.1/servers/ef63d04a-87e5-4202-a672-d45a2a877c68" status: 200 len: 1357 microversion: 2.1 time: 0.146105 May 14 15:49:10.905124 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: [pid: 128729|app: 0|req: 206/429] 10.222.0.61 () {58 vars in 1235 bytes} [Sat May 14 15:49:10 2022] GET /compute/v2.1/servers/ef63d04a-87e5-4202-a672-d45a2a877c68 => generated 1357 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 15:49:11.041658 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi [None req-c97c527e-0a50-45c0-b3ba-50affbab13b9 tempest-VolumesNegativeTest-1107689494 tempest-VolumesNegativeTest-1107689494-project] Calling method '>' {{(pid=128728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 15:49:11.042823 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.compute.api [None req-c97c527e-0a50-45c0-b3ba-50affbab13b9 tempest-VolumesNegativeTest-1107689494 tempest-VolumesNegativeTest-1107689494-project] [instance: ea1f238d-3bae-4ce8-b328-d07fc2f7f272] Fetching instance by UUID {{(pid=128728) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 15:49:11.049499 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-c97c527e-0a50-45c0-b3ba-50affbab13b9 tempest-VolumesNegativeTest-1107689494 tempest-VolumesNegativeTest-1107689494-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:49:11.050300 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-c97c527e-0a50-45c0-b3ba-50affbab13b9 tempest-VolumesNegativeTest-1107689494 tempest-VolumesNegativeTest-1107689494-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:49:11.051149 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-c97c527e-0a50-45c0-b3ba-50affbab13b9 tempest-VolumesNegativeTest-1107689494 tempest-VolumesNegativeTest-1107689494-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:49:11.051579 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-c97c527e-0a50-45c0-b3ba-50affbab13b9 tempest-VolumesNegativeTest-1107689494 tempest-VolumesNegativeTest-1107689494-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:49:11.116262 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.policy [None req-c97c527e-0a50-45c0-b3ba-50affbab13b9 tempest-VolumesNegativeTest-1107689494 tempest-VolumesNegativeTest-1107689494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e8303a1f1584ae2aae774eaf31481f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1e7c6697dfc4562b4c1d46ee21964a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128728) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:49:11.123510 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: INFO nova.api.openstack.requestlog [None req-c97c527e-0a50-45c0-b3ba-50affbab13b9 tempest-VolumesNegativeTest-1107689494 tempest-VolumesNegativeTest-1107689494-project] 10.222.0.61 "GET /compute/v2.1/servers/ea1f238d-3bae-4ce8-b328-d07fc2f7f272" status: 200 len: 1273 microversion: 2.1 time: 0.086410 May 14 15:49:11.124062 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: [pid: 128728|app: 0|req: 224/430] 10.222.0.61 () {58 vars in 1235 bytes} [Sat May 14 15:49:11 2022] GET /compute/v2.1/servers/ea1f238d-3bae-4ce8-b328-d07fc2f7f272 => generated 1273 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 15:49:11.237967 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi [None req-d78f0c38-5e82-4275-b4b3-ffa5d65338f1 tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Calling method '>' {{(pid=128729) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 15:49:11.238692 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.compute.api [None req-d78f0c38-5e82-4275-b4b3-ffa5d65338f1 tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] [instance: 9fbb269d-11cd-49ed-81ac-570e721c15cd] Fetching instance by UUID {{(pid=128729) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 15:49:11.245173 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-d78f0c38-5e82-4275-b4b3-ffa5d65338f1 tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:49:11.245879 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-d78f0c38-5e82-4275-b4b3-ffa5d65338f1 tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:49:11.246705 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-d78f0c38-5e82-4275-b4b3-ffa5d65338f1 tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:49:11.247139 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-d78f0c38-5e82-4275-b4b3-ffa5d65338f1 tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:49:11.355920 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi [None req-7136575a-3863-4eb4-8655-5281757b4e74 tempest-VolumesActionsTest-1534566879 tempest-VolumesActionsTest-1534566879-project] Calling method '>' {{(pid=128728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 15:49:11.356527 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.compute.api [None req-7136575a-3863-4eb4-8655-5281757b4e74 tempest-VolumesActionsTest-1534566879 tempest-VolumesActionsTest-1534566879-project] [instance: 656dffc0-256e-40ba-b670-f08e247a0d95] Fetching instance by UUID {{(pid=128728) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 15:49:11.362632 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-7136575a-3863-4eb4-8655-5281757b4e74 tempest-VolumesActionsTest-1534566879 tempest-VolumesActionsTest-1534566879-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:49:11.363079 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-7136575a-3863-4eb4-8655-5281757b4e74 tempest-VolumesActionsTest-1534566879 tempest-VolumesActionsTest-1534566879-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:49:11.363836 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-7136575a-3863-4eb4-8655-5281757b4e74 tempest-VolumesActionsTest-1534566879 tempest-VolumesActionsTest-1534566879-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:49:11.364266 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-7136575a-3863-4eb4-8655-5281757b4e74 tempest-VolumesActionsTest-1534566879 tempest-VolumesActionsTest-1534566879-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:49:11.372778 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.policy [None req-d78f0c38-5e82-4275-b4b3-ffa5d65338f1 tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b896317d96a40d6a137db0dcf5f98f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d2517d5440a4d30949f3dd36a46d813', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128729) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:49:11.379936 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: INFO nova.api.openstack.requestlog [None req-d78f0c38-5e82-4275-b4b3-ffa5d65338f1 tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] 10.222.0.61 "GET /compute/v2.1/servers/9fbb269d-11cd-49ed-81ac-570e721c15cd" status: 200 len: 1511 microversion: 2.1 time: 0.146105 May 14 15:49:11.380509 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: [pid: 128729|app: 0|req: 207/431] 10.222.0.61 () {58 vars in 1235 bytes} [Sat May 14 15:49:11 2022] GET /compute/v2.1/servers/9fbb269d-11cd-49ed-81ac-570e721c15cd => generated 1511 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 15:49:11.424760 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.policy [None req-7136575a-3863-4eb4-8655-5281757b4e74 tempest-VolumesActionsTest-1534566879 tempest-VolumesActionsTest-1534566879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0156ed87a5b4efca7ef5056429db1a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71b09f9f20b340b5a615b24e05312703', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128728) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:49:11.431843 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: INFO nova.api.openstack.requestlog [None req-7136575a-3863-4eb4-8655-5281757b4e74 tempest-VolumesActionsTest-1534566879 tempest-VolumesActionsTest-1534566879-project] 10.222.0.61 "GET /compute/v2.1/servers/656dffc0-256e-40ba-b670-f08e247a0d95" status: 200 len: 1266 microversion: 2.1 time: 0.080322 May 14 15:49:11.432407 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: [pid: 128728|app: 0|req: 225/432] 10.222.0.61 () {58 vars in 1235 bytes} [Sat May 14 15:49:11 2022] GET /compute/v2.1/servers/656dffc0-256e-40ba-b670-f08e247a0d95 => generated 1266 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 15:49:11.920943 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi [None req-8e70fbf7-d7d8-4385-9e9b-493d00563dce tempest-TestMinimumBasicScenario-1817438735 tempest-TestMinimumBasicScenario-1817438735-project] Calling method '>' {{(pid=128729) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 15:49:11.921551 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.compute.api [None req-8e70fbf7-d7d8-4385-9e9b-493d00563dce tempest-TestMinimumBasicScenario-1817438735 tempest-TestMinimumBasicScenario-1817438735-project] [instance: ef63d04a-87e5-4202-a672-d45a2a877c68] Fetching instance by UUID {{(pid=128729) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 15:49:11.927465 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-8e70fbf7-d7d8-4385-9e9b-493d00563dce tempest-TestMinimumBasicScenario-1817438735 tempest-TestMinimumBasicScenario-1817438735-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:49:11.927915 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-8e70fbf7-d7d8-4385-9e9b-493d00563dce tempest-TestMinimumBasicScenario-1817438735 tempest-TestMinimumBasicScenario-1817438735-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:49:11.928712 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-8e70fbf7-d7d8-4385-9e9b-493d00563dce tempest-TestMinimumBasicScenario-1817438735 tempest-TestMinimumBasicScenario-1817438735-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:49:11.929147 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-8e70fbf7-d7d8-4385-9e9b-493d00563dce tempest-TestMinimumBasicScenario-1817438735 tempest-TestMinimumBasicScenario-1817438735-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:49:12.060743 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.policy [None req-8e70fbf7-d7d8-4385-9e9b-493d00563dce tempest-TestMinimumBasicScenario-1817438735 tempest-TestMinimumBasicScenario-1817438735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d5f259e0b98457ea6b6b88d886c813d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fba11e8ade54d388361c4c936a43372', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128729) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:49:12.067947 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: INFO nova.api.openstack.requestlog [None req-8e70fbf7-d7d8-4385-9e9b-493d00563dce tempest-TestMinimumBasicScenario-1817438735 tempest-TestMinimumBasicScenario-1817438735-project] 10.222.0.61 "GET /compute/v2.1/servers/ef63d04a-87e5-4202-a672-d45a2a877c68" status: 200 len: 1357 microversion: 2.1 time: 0.150853 May 14 15:49:12.068505 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: [pid: 128729|app: 0|req: 208/433] 10.222.0.61 () {58 vars in 1235 bytes} [Sat May 14 15:49:11 2022] GET /compute/v2.1/servers/ef63d04a-87e5-4202-a672-d45a2a877c68 => generated 1357 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 15:49:12.141007 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi [None req-027b3884-cc22-467d-ae15-b27d2067ba34 tempest-VolumesNegativeTest-1107689494 tempest-VolumesNegativeTest-1107689494-project] Calling method '>' {{(pid=128728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 15:49:12.141566 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.compute.api [None req-027b3884-cc22-467d-ae15-b27d2067ba34 tempest-VolumesNegativeTest-1107689494 tempest-VolumesNegativeTest-1107689494-project] [instance: ea1f238d-3bae-4ce8-b328-d07fc2f7f272] Fetching instance by UUID {{(pid=128728) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 15:49:12.147436 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-027b3884-cc22-467d-ae15-b27d2067ba34 tempest-VolumesNegativeTest-1107689494 tempest-VolumesNegativeTest-1107689494-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:49:12.147889 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-027b3884-cc22-467d-ae15-b27d2067ba34 tempest-VolumesNegativeTest-1107689494 tempest-VolumesNegativeTest-1107689494-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:49:12.148658 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-027b3884-cc22-467d-ae15-b27d2067ba34 tempest-VolumesNegativeTest-1107689494 tempest-VolumesNegativeTest-1107689494-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:49:12.149101 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-027b3884-cc22-467d-ae15-b27d2067ba34 tempest-VolumesNegativeTest-1107689494 tempest-VolumesNegativeTest-1107689494-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:49:12.209605 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.policy [None req-027b3884-cc22-467d-ae15-b27d2067ba34 tempest-VolumesNegativeTest-1107689494 tempest-VolumesNegativeTest-1107689494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e8303a1f1584ae2aae774eaf31481f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1e7c6697dfc4562b4c1d46ee21964a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128728) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:49:12.217938 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: INFO nova.api.openstack.requestlog [None req-027b3884-cc22-467d-ae15-b27d2067ba34 tempest-VolumesNegativeTest-1107689494 tempest-VolumesNegativeTest-1107689494-project] 10.222.0.61 "GET /compute/v2.1/servers/ea1f238d-3bae-4ce8-b328-d07fc2f7f272" status: 200 len: 1273 microversion: 2.1 time: 0.081834 May 14 15:49:12.218537 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: [pid: 128728|app: 0|req: 226/434] 10.222.0.61 () {58 vars in 1235 bytes} [Sat May 14 15:49:12 2022] GET /compute/v2.1/servers/ea1f238d-3bae-4ce8-b328-d07fc2f7f272 => generated 1273 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 15:49:12.396915 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi [None req-3d51b41b-dd94-422b-b2c7-8617f4966f9a tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Calling method '>' {{(pid=128729) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 15:49:12.397477 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.compute.api [None req-3d51b41b-dd94-422b-b2c7-8617f4966f9a tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] [instance: 9fbb269d-11cd-49ed-81ac-570e721c15cd] Fetching instance by UUID {{(pid=128729) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 15:49:12.404700 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-3d51b41b-dd94-422b-b2c7-8617f4966f9a tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:49:12.405160 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-3d51b41b-dd94-422b-b2c7-8617f4966f9a tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:49:12.405946 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-3d51b41b-dd94-422b-b2c7-8617f4966f9a tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:49:12.406430 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-3d51b41b-dd94-422b-b2c7-8617f4966f9a tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:49:12.449089 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi [None req-e7f5a6ec-9754-4465-85e9-f4ceb38abc82 tempest-VolumesActionsTest-1534566879 tempest-VolumesActionsTest-1534566879-project] Calling method '>' {{(pid=128728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 15:49:12.449965 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.compute.api [None req-e7f5a6ec-9754-4465-85e9-f4ceb38abc82 tempest-VolumesActionsTest-1534566879 tempest-VolumesActionsTest-1534566879-project] [instance: 656dffc0-256e-40ba-b670-f08e247a0d95] Fetching instance by UUID {{(pid=128728) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 15:49:12.455914 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-e7f5a6ec-9754-4465-85e9-f4ceb38abc82 tempest-VolumesActionsTest-1534566879 tempest-VolumesActionsTest-1534566879-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:49:12.456366 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-e7f5a6ec-9754-4465-85e9-f4ceb38abc82 tempest-VolumesActionsTest-1534566879 tempest-VolumesActionsTest-1534566879-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:49:12.457145 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-e7f5a6ec-9754-4465-85e9-f4ceb38abc82 tempest-VolumesActionsTest-1534566879 tempest-VolumesActionsTest-1534566879-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:49:12.457622 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-e7f5a6ec-9754-4465-85e9-f4ceb38abc82 tempest-VolumesActionsTest-1534566879 tempest-VolumesActionsTest-1534566879-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:49:12.529118 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.policy [None req-e7f5a6ec-9754-4465-85e9-f4ceb38abc82 tempest-VolumesActionsTest-1534566879 tempest-VolumesActionsTest-1534566879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0156ed87a5b4efca7ef5056429db1a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71b09f9f20b340b5a615b24e05312703', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128728) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:49:12.536321 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: INFO nova.api.openstack.requestlog [None req-e7f5a6ec-9754-4465-85e9-f4ceb38abc82 tempest-VolumesActionsTest-1534566879 tempest-VolumesActionsTest-1534566879-project] 10.222.0.61 "GET /compute/v2.1/servers/656dffc0-256e-40ba-b670-f08e247a0d95" status: 200 len: 1266 microversion: 2.1 time: 0.092265 May 14 15:49:12.536891 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: [pid: 128728|app: 0|req: 227/435] 10.222.0.61 () {58 vars in 1235 bytes} [Sat May 14 15:49:12 2022] GET /compute/v2.1/servers/656dffc0-256e-40ba-b670-f08e247a0d95 => generated 1266 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 15:49:12.558131 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.policy [None req-3d51b41b-dd94-422b-b2c7-8617f4966f9a tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b896317d96a40d6a137db0dcf5f98f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d2517d5440a4d30949f3dd36a46d813', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128729) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:49:12.565376 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: INFO nova.api.openstack.requestlog [None req-3d51b41b-dd94-422b-b2c7-8617f4966f9a tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] 10.222.0.61 "GET /compute/v2.1/servers/9fbb269d-11cd-49ed-81ac-570e721c15cd" status: 200 len: 1511 microversion: 2.1 time: 0.172349 May 14 15:49:12.565932 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: [pid: 128729|app: 0|req: 209/436] 10.222.0.61 () {58 vars in 1235 bytes} [Sat May 14 15:49:12 2022] GET /compute/v2.1/servers/9fbb269d-11cd-49ed-81ac-570e721c15cd => generated 1511 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 15:49:13.085763 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi [None req-b9f184d0-3810-422b-851f-a25c550bdc75 tempest-TestMinimumBasicScenario-1817438735 tempest-TestMinimumBasicScenario-1817438735-project] Calling method '>' {{(pid=128728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 15:49:13.086511 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.compute.api [None req-b9f184d0-3810-422b-851f-a25c550bdc75 tempest-TestMinimumBasicScenario-1817438735 tempest-TestMinimumBasicScenario-1817438735-project] [instance: ef63d04a-87e5-4202-a672-d45a2a877c68] Fetching instance by UUID {{(pid=128728) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 15:49:13.093168 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-b9f184d0-3810-422b-851f-a25c550bdc75 tempest-TestMinimumBasicScenario-1817438735 tempest-TestMinimumBasicScenario-1817438735-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:49:13.093612 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-b9f184d0-3810-422b-851f-a25c550bdc75 tempest-TestMinimumBasicScenario-1817438735 tempest-TestMinimumBasicScenario-1817438735-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:49:13.094405 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-b9f184d0-3810-422b-851f-a25c550bdc75 tempest-TestMinimumBasicScenario-1817438735 tempest-TestMinimumBasicScenario-1817438735-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:49:13.094840 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-b9f184d0-3810-422b-851f-a25c550bdc75 tempest-TestMinimumBasicScenario-1817438735 tempest-TestMinimumBasicScenario-1817438735-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:49:13.234789 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi [None req-8aa12bf6-d4c9-4c2c-be1d-2b9228eeef15 tempest-VolumesNegativeTest-1107689494 tempest-VolumesNegativeTest-1107689494-project] Calling method '>' {{(pid=128729) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 15:49:13.235318 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.compute.api [None req-8aa12bf6-d4c9-4c2c-be1d-2b9228eeef15 tempest-VolumesNegativeTest-1107689494 tempest-VolumesNegativeTest-1107689494-project] [instance: ea1f238d-3bae-4ce8-b328-d07fc2f7f272] Fetching instance by UUID {{(pid=128729) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 15:49:13.249941 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-8aa12bf6-d4c9-4c2c-be1d-2b9228eeef15 tempest-VolumesNegativeTest-1107689494 tempest-VolumesNegativeTest-1107689494-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:49:13.250431 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-8aa12bf6-d4c9-4c2c-be1d-2b9228eeef15 tempest-VolumesNegativeTest-1107689494 tempest-VolumesNegativeTest-1107689494-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:49:13.251221 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-8aa12bf6-d4c9-4c2c-be1d-2b9228eeef15 tempest-VolumesNegativeTest-1107689494 tempest-VolumesNegativeTest-1107689494-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:49:13.251656 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-8aa12bf6-d4c9-4c2c-be1d-2b9228eeef15 tempest-VolumesNegativeTest-1107689494 tempest-VolumesNegativeTest-1107689494-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:49:13.343590 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.policy [None req-b9f184d0-3810-422b-851f-a25c550bdc75 tempest-TestMinimumBasicScenario-1817438735 tempest-TestMinimumBasicScenario-1817438735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d5f259e0b98457ea6b6b88d886c813d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fba11e8ade54d388361c4c936a43372', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128728) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:49:13.351172 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.policy [None req-8aa12bf6-d4c9-4c2c-be1d-2b9228eeef15 tempest-VolumesNegativeTest-1107689494 tempest-VolumesNegativeTest-1107689494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e8303a1f1584ae2aae774eaf31481f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1e7c6697dfc4562b4c1d46ee21964a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128729) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:49:13.355832 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: INFO nova.api.openstack.requestlog [None req-b9f184d0-3810-422b-851f-a25c550bdc75 tempest-TestMinimumBasicScenario-1817438735 tempest-TestMinimumBasicScenario-1817438735-project] 10.222.0.61 "GET /compute/v2.1/servers/ef63d04a-87e5-4202-a672-d45a2a877c68" status: 200 len: 1357 microversion: 2.1 time: 0.274464 May 14 15:49:13.360991 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: INFO nova.api.openstack.requestlog [None req-8aa12bf6-d4c9-4c2c-be1d-2b9228eeef15 tempest-VolumesNegativeTest-1107689494 tempest-VolumesNegativeTest-1107689494-project] 10.222.0.61 "GET /compute/v2.1/servers/ea1f238d-3bae-4ce8-b328-d07fc2f7f272" status: 200 len: 1273 microversion: 2.1 time: 0.129960 May 14 15:49:13.374638 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: [pid: 128729|app: 0|req: 210/437] 10.222.0.61 () {58 vars in 1235 bytes} [Sat May 14 15:49:13 2022] GET /compute/v2.1/servers/ea1f238d-3bae-4ce8-b328-d07fc2f7f272 => generated 1273 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 15:49:13.374851 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: [pid: 128728|app: 0|req: 228/438] 10.222.0.61 () {58 vars in 1235 bytes} [Sat May 14 15:49:13 2022] GET /compute/v2.1/servers/ef63d04a-87e5-4202-a672-d45a2a877c68 => generated 1357 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 15:49:13.552990 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi [None req-fc7680c7-7f80-4c8a-a103-28acbd94bb2d tempest-VolumesActionsTest-1534566879 tempest-VolumesActionsTest-1534566879-project] Calling method '>' {{(pid=128729) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 15:49:13.553705 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.compute.api [None req-fc7680c7-7f80-4c8a-a103-28acbd94bb2d tempest-VolumesActionsTest-1534566879 tempest-VolumesActionsTest-1534566879-project] [instance: 656dffc0-256e-40ba-b670-f08e247a0d95] Fetching instance by UUID {{(pid=128729) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 15:49:13.564268 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-fc7680c7-7f80-4c8a-a103-28acbd94bb2d tempest-VolumesActionsTest-1534566879 tempest-VolumesActionsTest-1534566879-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:49:13.570830 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-fc7680c7-7f80-4c8a-a103-28acbd94bb2d tempest-VolumesActionsTest-1534566879 tempest-VolumesActionsTest-1534566879-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:49:13.571727 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-fc7680c7-7f80-4c8a-a103-28acbd94bb2d tempest-VolumesActionsTest-1534566879 tempest-VolumesActionsTest-1534566879-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:49:13.572238 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-fc7680c7-7f80-4c8a-a103-28acbd94bb2d tempest-VolumesActionsTest-1534566879 tempest-VolumesActionsTest-1534566879-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:49:13.582720 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi [None req-a1cf24c3-1a23-4bc3-bc4a-cb4591c23e9d tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Calling method '>' {{(pid=128728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 15:49:13.583651 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.compute.api [None req-a1cf24c3-1a23-4bc3-bc4a-cb4591c23e9d tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] [instance: 9fbb269d-11cd-49ed-81ac-570e721c15cd] Fetching instance by UUID {{(pid=128728) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 15:49:13.592350 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-a1cf24c3-1a23-4bc3-bc4a-cb4591c23e9d tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:49:13.597588 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-a1cf24c3-1a23-4bc3-bc4a-cb4591c23e9d tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:49:13.598669 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-a1cf24c3-1a23-4bc3-bc4a-cb4591c23e9d tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:49:13.599446 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-a1cf24c3-1a23-4bc3-bc4a-cb4591c23e9d tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:49:13.775685 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.policy [None req-fc7680c7-7f80-4c8a-a103-28acbd94bb2d tempest-VolumesActionsTest-1534566879 tempest-VolumesActionsTest-1534566879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0156ed87a5b4efca7ef5056429db1a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71b09f9f20b340b5a615b24e05312703', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128729) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:49:13.788807 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: INFO nova.api.openstack.requestlog [None req-fc7680c7-7f80-4c8a-a103-28acbd94bb2d tempest-VolumesActionsTest-1534566879 tempest-VolumesActionsTest-1534566879-project] 10.222.0.61 "GET /compute/v2.1/servers/656dffc0-256e-40ba-b670-f08e247a0d95" status: 200 len: 1272 microversion: 2.1 time: 0.239609 May 14 15:49:13.789402 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: [pid: 128729|app: 0|req: 211/439] 10.222.0.61 () {58 vars in 1235 bytes} [Sat May 14 15:49:13 2022] GET /compute/v2.1/servers/656dffc0-256e-40ba-b670-f08e247a0d95 => generated 1272 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 15:49:13.908717 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.policy [None req-a1cf24c3-1a23-4bc3-bc4a-cb4591c23e9d tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b896317d96a40d6a137db0dcf5f98f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d2517d5440a4d30949f3dd36a46d813', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128728) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:49:13.916311 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: INFO nova.api.openstack.requestlog [None req-a1cf24c3-1a23-4bc3-bc4a-cb4591c23e9d tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] 10.222.0.61 "GET /compute/v2.1/servers/9fbb269d-11cd-49ed-81ac-570e721c15cd" status: 200 len: 1511 microversion: 2.1 time: 0.337335 May 14 15:49:13.916925 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: [pid: 128728|app: 0|req: 229/440] 10.222.0.61 () {58 vars in 1235 bytes} [Sat May 14 15:49:13 2022] GET /compute/v2.1/servers/9fbb269d-11cd-49ed-81ac-570e721c15cd => generated 1511 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 15:49:14.373535 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi [None req-0438442f-6131-48d5-a39b-fcfeeb119749 tempest-TestMinimumBasicScenario-1817438735 tempest-TestMinimumBasicScenario-1817438735-project] Calling method '>' {{(pid=128729) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 15:49:14.374240 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.compute.api [None req-0438442f-6131-48d5-a39b-fcfeeb119749 tempest-TestMinimumBasicScenario-1817438735 tempest-TestMinimumBasicScenario-1817438735-project] [instance: ef63d04a-87e5-4202-a672-d45a2a877c68] Fetching instance by UUID {{(pid=128729) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 15:49:14.381610 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-0438442f-6131-48d5-a39b-fcfeeb119749 tempest-TestMinimumBasicScenario-1817438735 tempest-TestMinimumBasicScenario-1817438735-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:49:14.382233 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-0438442f-6131-48d5-a39b-fcfeeb119749 tempest-TestMinimumBasicScenario-1817438735 tempest-TestMinimumBasicScenario-1817438735-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:49:14.383335 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-0438442f-6131-48d5-a39b-fcfeeb119749 tempest-TestMinimumBasicScenario-1817438735 tempest-TestMinimumBasicScenario-1817438735-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:49:14.383973 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-0438442f-6131-48d5-a39b-fcfeeb119749 tempest-TestMinimumBasicScenario-1817438735 tempest-TestMinimumBasicScenario-1817438735-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:49:14.390363 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi [None req-33ef8efb-a272-4dbc-9a2a-ab2cef5dea98 tempest-VolumesNegativeTest-1107689494 tempest-VolumesNegativeTest-1107689494-project] Calling method '>' {{(pid=128728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 15:49:14.391673 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.compute.api [None req-33ef8efb-a272-4dbc-9a2a-ab2cef5dea98 tempest-VolumesNegativeTest-1107689494 tempest-VolumesNegativeTest-1107689494-project] [instance: ea1f238d-3bae-4ce8-b328-d07fc2f7f272] Fetching instance by UUID {{(pid=128728) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 15:49:14.402852 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-33ef8efb-a272-4dbc-9a2a-ab2cef5dea98 tempest-VolumesNegativeTest-1107689494 tempest-VolumesNegativeTest-1107689494-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:49:14.404324 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-33ef8efb-a272-4dbc-9a2a-ab2cef5dea98 tempest-VolumesNegativeTest-1107689494 tempest-VolumesNegativeTest-1107689494-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:49:14.405439 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-33ef8efb-a272-4dbc-9a2a-ab2cef5dea98 tempest-VolumesNegativeTest-1107689494 tempest-VolumesNegativeTest-1107689494-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:49:14.405785 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-33ef8efb-a272-4dbc-9a2a-ab2cef5dea98 tempest-VolumesNegativeTest-1107689494 tempest-VolumesNegativeTest-1107689494-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:49:14.704331 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.policy [None req-0438442f-6131-48d5-a39b-fcfeeb119749 tempest-TestMinimumBasicScenario-1817438735 tempest-TestMinimumBasicScenario-1817438735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d5f259e0b98457ea6b6b88d886c813d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fba11e8ade54d388361c4c936a43372', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128729) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:49:14.710465 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.policy [None req-33ef8efb-a272-4dbc-9a2a-ab2cef5dea98 tempest-VolumesNegativeTest-1107689494 tempest-VolumesNegativeTest-1107689494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e8303a1f1584ae2aae774eaf31481f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1e7c6697dfc4562b4c1d46ee21964a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128728) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:49:14.715065 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: INFO nova.api.openstack.requestlog [None req-0438442f-6131-48d5-a39b-fcfeeb119749 tempest-TestMinimumBasicScenario-1817438735 tempest-TestMinimumBasicScenario-1817438735-project] 10.222.0.61 "GET /compute/v2.1/servers/ef63d04a-87e5-4202-a672-d45a2a877c68" status: 200 len: 1357 microversion: 2.1 time: 0.345511 May 14 15:49:14.725788 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: INFO nova.api.openstack.requestlog [None req-33ef8efb-a272-4dbc-9a2a-ab2cef5dea98 tempest-VolumesNegativeTest-1107689494 tempest-VolumesNegativeTest-1107689494-project] 10.222.0.61 "GET /compute/v2.1/servers/ea1f238d-3bae-4ce8-b328-d07fc2f7f272" status: 200 len: 1315 microversion: 2.1 time: 0.342419 May 14 15:49:14.725788 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: [pid: 128728|app: 0|req: 230/441] 10.222.0.61 () {58 vars in 1235 bytes} [Sat May 14 15:49:14 2022] GET /compute/v2.1/servers/ea1f238d-3bae-4ce8-b328-d07fc2f7f272 => generated 1315 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 15:49:14.728777 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: [pid: 128729|app: 0|req: 212/442] 10.222.0.61 () {58 vars in 1235 bytes} [Sat May 14 15:49:14 2022] GET /compute/v2.1/servers/ef63d04a-87e5-4202-a672-d45a2a877c68 => generated 1357 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 15:49:14.806530 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi [None req-ae959f1f-878e-4671-8b0c-f282b008d0d5 tempest-VolumesActionsTest-1534566879 tempest-VolumesActionsTest-1534566879-project] Calling method '>' {{(pid=128728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 15:49:14.807342 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.compute.api [None req-ae959f1f-878e-4671-8b0c-f282b008d0d5 tempest-VolumesActionsTest-1534566879 tempest-VolumesActionsTest-1534566879-project] [instance: 656dffc0-256e-40ba-b670-f08e247a0d95] Fetching instance by UUID {{(pid=128728) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 15:49:14.813473 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-ae959f1f-878e-4671-8b0c-f282b008d0d5 tempest-VolumesActionsTest-1534566879 tempest-VolumesActionsTest-1534566879-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:49:14.813677 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-ae959f1f-878e-4671-8b0c-f282b008d0d5 tempest-VolumesActionsTest-1534566879 tempest-VolumesActionsTest-1534566879-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:49:14.814470 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-ae959f1f-878e-4671-8b0c-f282b008d0d5 tempest-VolumesActionsTest-1534566879 tempest-VolumesActionsTest-1534566879-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:49:14.814903 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-ae959f1f-878e-4671-8b0c-f282b008d0d5 tempest-VolumesActionsTest-1534566879 tempest-VolumesActionsTest-1534566879-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:49:14.856505 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi [req-6041fdf1-f6ae-4d8b-ba87-827509b34229 req-55aa8450-3d91-479e-b9ef-738304b1e161 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ea1f238d-3bae-4ce8-b328-d07fc2f7f272", "tag": "e4c131d9-3887-4760-96f8-18f3e257f1f7"}]} {{(pid=128729) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 15:49:14.865598 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [req-6041fdf1-f6ae-4d8b-ba87-827509b34229 req-55aa8450-3d91-479e-b9ef-738304b1e161 service nova] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:49:14.866048 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [req-6041fdf1-f6ae-4d8b-ba87-827509b34229 req-55aa8450-3d91-479e-b9ef-738304b1e161 service nova] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:49:14.877720 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: INFO nova.api.openstack.compute.server_external_events [req-6041fdf1-f6ae-4d8b-ba87-827509b34229 req-55aa8450-3d91-479e-b9ef-738304b1e161 service nova] Creating event network-changed:e4c131d9-3887-4760-96f8-18f3e257f1f7 for instance ea1f238d-3bae-4ce8-b328-d07fc2f7f272 on hv-cinder-83979 May 14 15:49:14.884959 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: INFO nova.api.openstack.requestlog [req-6041fdf1-f6ae-4d8b-ba87-827509b34229 req-55aa8450-3d91-479e-b9ef-738304b1e161 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035839 May 14 15:49:14.885831 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: [pid: 128729|app: 0|req: 213/443] 10.222.0.61 () {64 vars in 1317 bytes} [Sat May 14 15:49:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 14 15:49:14.935069 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi [None req-b1ed2958-5d39-43a7-9688-1f2f89f01e53 tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Calling method '>' {{(pid=128729) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 15:49:14.936111 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.compute.api [None req-b1ed2958-5d39-43a7-9688-1f2f89f01e53 tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] [instance: 9fbb269d-11cd-49ed-81ac-570e721c15cd] Fetching instance by UUID {{(pid=128729) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 15:49:14.943354 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-b1ed2958-5d39-43a7-9688-1f2f89f01e53 tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:49:14.944054 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-b1ed2958-5d39-43a7-9688-1f2f89f01e53 tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:49:14.945170 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-b1ed2958-5d39-43a7-9688-1f2f89f01e53 tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:49:14.945771 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-b1ed2958-5d39-43a7-9688-1f2f89f01e53 tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:49:15.012291 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.policy [None req-ae959f1f-878e-4671-8b0c-f282b008d0d5 tempest-VolumesActionsTest-1534566879 tempest-VolumesActionsTest-1534566879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0156ed87a5b4efca7ef5056429db1a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71b09f9f20b340b5a615b24e05312703', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128728) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:49:15.020877 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: INFO nova.api.openstack.requestlog [None req-ae959f1f-878e-4671-8b0c-f282b008d0d5 tempest-VolumesActionsTest-1534566879 tempest-VolumesActionsTest-1534566879-project] 10.222.0.61 "GET /compute/v2.1/servers/656dffc0-256e-40ba-b670-f08e247a0d95" status: 200 len: 1314 microversion: 2.1 time: 0.218259 May 14 15:49:15.021762 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: [pid: 128728|app: 0|req: 231/444] 10.222.0.61 () {58 vars in 1235 bytes} [Sat May 14 15:49:14 2022] GET /compute/v2.1/servers/656dffc0-256e-40ba-b670-f08e247a0d95 => generated 1314 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 15:49:15.107104 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.policy [None req-b1ed2958-5d39-43a7-9688-1f2f89f01e53 tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b896317d96a40d6a137db0dcf5f98f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d2517d5440a4d30949f3dd36a46d813', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128729) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:49:15.115139 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: INFO nova.api.openstack.requestlog [None req-b1ed2958-5d39-43a7-9688-1f2f89f01e53 tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] 10.222.0.61 "GET /compute/v2.1/servers/9fbb269d-11cd-49ed-81ac-570e721c15cd" status: 200 len: 1511 microversion: 2.1 time: 0.185403 May 14 15:49:15.115652 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: [pid: 128729|app: 0|req: 214/445] 10.222.0.61 () {58 vars in 1235 bytes} [Sat May 14 15:49:14 2022] GET /compute/v2.1/servers/9fbb269d-11cd-49ed-81ac-570e721c15cd => generated 1511 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 15:49:15.734061 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi [None req-90e3c697-7197-47d1-9362-f553ebdae027 tempest-TestMinimumBasicScenario-1817438735 tempest-TestMinimumBasicScenario-1817438735-project] Calling method '>' {{(pid=128728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 15:49:15.734679 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.compute.api [None req-90e3c697-7197-47d1-9362-f553ebdae027 tempest-TestMinimumBasicScenario-1817438735 tempest-TestMinimumBasicScenario-1817438735-project] [instance: ef63d04a-87e5-4202-a672-d45a2a877c68] Fetching instance by UUID {{(pid=128728) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 15:49:15.741519 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi [None req-394c377a-0bcf-4bb7-8f52-2dc6f72688eb tempest-VolumesNegativeTest-1107689494 tempest-VolumesNegativeTest-1107689494-project] Calling method '>' {{(pid=128729) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 15:49:15.742156 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.compute.api [None req-394c377a-0bcf-4bb7-8f52-2dc6f72688eb tempest-VolumesNegativeTest-1107689494 tempest-VolumesNegativeTest-1107689494-project] [instance: ea1f238d-3bae-4ce8-b328-d07fc2f7f272] Fetching instance by UUID {{(pid=128729) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 15:49:15.744150 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-90e3c697-7197-47d1-9362-f553ebdae027 tempest-TestMinimumBasicScenario-1817438735 tempest-TestMinimumBasicScenario-1817438735-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:49:15.744982 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-90e3c697-7197-47d1-9362-f553ebdae027 tempest-TestMinimumBasicScenario-1817438735 tempest-TestMinimumBasicScenario-1817438735-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:49:15.746212 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-90e3c697-7197-47d1-9362-f553ebdae027 tempest-TestMinimumBasicScenario-1817438735 tempest-TestMinimumBasicScenario-1817438735-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:49:15.746678 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-90e3c697-7197-47d1-9362-f553ebdae027 tempest-TestMinimumBasicScenario-1817438735 tempest-TestMinimumBasicScenario-1817438735-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:49:15.748804 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-394c377a-0bcf-4bb7-8f52-2dc6f72688eb tempest-VolumesNegativeTest-1107689494 tempest-VolumesNegativeTest-1107689494-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:49:15.749306 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-394c377a-0bcf-4bb7-8f52-2dc6f72688eb tempest-VolumesNegativeTest-1107689494 tempest-VolumesNegativeTest-1107689494-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:49:15.750078 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-394c377a-0bcf-4bb7-8f52-2dc6f72688eb tempest-VolumesNegativeTest-1107689494 tempest-VolumesNegativeTest-1107689494-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:49:15.750546 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-394c377a-0bcf-4bb7-8f52-2dc6f72688eb tempest-VolumesNegativeTest-1107689494 tempest-VolumesNegativeTest-1107689494-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:49:15.940006 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.policy [None req-394c377a-0bcf-4bb7-8f52-2dc6f72688eb tempest-VolumesNegativeTest-1107689494 tempest-VolumesNegativeTest-1107689494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e8303a1f1584ae2aae774eaf31481f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1e7c6697dfc4562b4c1d46ee21964a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128729) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:49:15.947958 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: INFO nova.api.openstack.requestlog [None req-394c377a-0bcf-4bb7-8f52-2dc6f72688eb tempest-VolumesNegativeTest-1107689494 tempest-VolumesNegativeTest-1107689494-project] 10.222.0.61 "GET /compute/v2.1/servers/ea1f238d-3bae-4ce8-b328-d07fc2f7f272" status: 200 len: 1315 microversion: 2.1 time: 0.211622 May 14 15:49:15.949065 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: [pid: 128729|app: 0|req: 215/446] 10.222.0.61 () {58 vars in 1235 bytes} [Sat May 14 15:49:15 2022] GET /compute/v2.1/servers/ea1f238d-3bae-4ce8-b328-d07fc2f7f272 => generated 1315 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 15:49:15.951370 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.policy [None req-90e3c697-7197-47d1-9362-f553ebdae027 tempest-TestMinimumBasicScenario-1817438735 tempest-TestMinimumBasicScenario-1817438735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d5f259e0b98457ea6b6b88d886c813d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fba11e8ade54d388361c4c936a43372', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128728) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:49:15.958898 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: INFO nova.api.openstack.requestlog [None req-90e3c697-7197-47d1-9362-f553ebdae027 tempest-TestMinimumBasicScenario-1817438735 tempest-TestMinimumBasicScenario-1817438735-project] 10.222.0.61 "GET /compute/v2.1/servers/ef63d04a-87e5-4202-a672-d45a2a877c68" status: 200 len: 1357 microversion: 2.1 time: 0.229853 May 14 15:49:15.959463 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: [pid: 128728|app: 0|req: 232/447] 10.222.0.61 () {58 vars in 1235 bytes} [Sat May 14 15:49:15 2022] GET /compute/v2.1/servers/ef63d04a-87e5-4202-a672-d45a2a877c68 => generated 1357 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 15:49:16.036814 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi [None req-825d54ea-5fa0-4aa5-8fb4-d2f31fb778ea tempest-VolumesActionsTest-1534566879 tempest-VolumesActionsTest-1534566879-project] Calling method '>' {{(pid=128729) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 15:49:16.037341 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.compute.api [None req-825d54ea-5fa0-4aa5-8fb4-d2f31fb778ea tempest-VolumesActionsTest-1534566879 tempest-VolumesActionsTest-1534566879-project] [instance: 656dffc0-256e-40ba-b670-f08e247a0d95] Fetching instance by UUID {{(pid=128729) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 15:49:16.043874 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-825d54ea-5fa0-4aa5-8fb4-d2f31fb778ea tempest-VolumesActionsTest-1534566879 tempest-VolumesActionsTest-1534566879-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:49:16.044345 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-825d54ea-5fa0-4aa5-8fb4-d2f31fb778ea tempest-VolumesActionsTest-1534566879 tempest-VolumesActionsTest-1534566879-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:49:16.045103 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-825d54ea-5fa0-4aa5-8fb4-d2f31fb778ea tempest-VolumesActionsTest-1534566879 tempest-VolumesActionsTest-1534566879-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:49:16.045538 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-825d54ea-5fa0-4aa5-8fb4-d2f31fb778ea tempest-VolumesActionsTest-1534566879 tempest-VolumesActionsTest-1534566879-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:49:16.132918 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi [None req-3bc931ec-5d65-4ce0-9e64-4ecb19ea00d3 tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Calling method '>' {{(pid=128728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 15:49:16.133617 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.compute.api [None req-3bc931ec-5d65-4ce0-9e64-4ecb19ea00d3 tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] [instance: 9fbb269d-11cd-49ed-81ac-570e721c15cd] Fetching instance by UUID {{(pid=128728) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 15:49:16.140086 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-3bc931ec-5d65-4ce0-9e64-4ecb19ea00d3 tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:49:16.140543 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-3bc931ec-5d65-4ce0-9e64-4ecb19ea00d3 tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:49:16.141318 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-3bc931ec-5d65-4ce0-9e64-4ecb19ea00d3 tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:49:16.141788 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-3bc931ec-5d65-4ce0-9e64-4ecb19ea00d3 tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:49:16.175340 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.policy [None req-825d54ea-5fa0-4aa5-8fb4-d2f31fb778ea tempest-VolumesActionsTest-1534566879 tempest-VolumesActionsTest-1534566879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0156ed87a5b4efca7ef5056429db1a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71b09f9f20b340b5a615b24e05312703', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128729) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:49:16.183021 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: INFO nova.api.openstack.requestlog [None req-825d54ea-5fa0-4aa5-8fb4-d2f31fb778ea tempest-VolumesActionsTest-1534566879 tempest-VolumesActionsTest-1534566879-project] 10.222.0.61 "GET /compute/v2.1/servers/656dffc0-256e-40ba-b670-f08e247a0d95" status: 200 len: 1314 microversion: 2.1 time: 0.149635 May 14 15:49:16.183597 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: [pid: 128729|app: 0|req: 216/448] 10.222.0.61 () {58 vars in 1235 bytes} [Sat May 14 15:49:16 2022] GET /compute/v2.1/servers/656dffc0-256e-40ba-b670-f08e247a0d95 => generated 1314 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 15:49:16.276642 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.policy [None req-3bc931ec-5d65-4ce0-9e64-4ecb19ea00d3 tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b896317d96a40d6a137db0dcf5f98f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d2517d5440a4d30949f3dd36a46d813', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128728) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:49:16.284023 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: INFO nova.api.openstack.requestlog [None req-3bc931ec-5d65-4ce0-9e64-4ecb19ea00d3 tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] 10.222.0.61 "GET /compute/v2.1/servers/9fbb269d-11cd-49ed-81ac-570e721c15cd" status: 200 len: 1511 microversion: 2.1 time: 0.155030 May 14 15:49:16.284591 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: [pid: 128728|app: 0|req: 233/449] 10.222.0.61 () {58 vars in 1235 bytes} [Sat May 14 15:49:16 2022] GET /compute/v2.1/servers/9fbb269d-11cd-49ed-81ac-570e721c15cd => generated 1511 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 15:49:16.965958 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi [None req-5dcc788e-988d-47d4-9007-7635d4047f68 tempest-VolumesNegativeTest-1107689494 tempest-VolumesNegativeTest-1107689494-project] Calling method '>' {{(pid=128729) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 15:49:16.966625 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.compute.api [None req-5dcc788e-988d-47d4-9007-7635d4047f68 tempest-VolumesNegativeTest-1107689494 tempest-VolumesNegativeTest-1107689494-project] [instance: ea1f238d-3bae-4ce8-b328-d07fc2f7f272] Fetching instance by UUID {{(pid=128729) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 15:49:16.973269 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-5dcc788e-988d-47d4-9007-7635d4047f68 tempest-VolumesNegativeTest-1107689494 tempest-VolumesNegativeTest-1107689494-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:49:16.973641 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-5dcc788e-988d-47d4-9007-7635d4047f68 tempest-VolumesNegativeTest-1107689494 tempest-VolumesNegativeTest-1107689494-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:49:16.974503 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-5dcc788e-988d-47d4-9007-7635d4047f68 tempest-VolumesNegativeTest-1107689494 tempest-VolumesNegativeTest-1107689494-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:49:16.974944 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-5dcc788e-988d-47d4-9007-7635d4047f68 tempest-VolumesNegativeTest-1107689494 tempest-VolumesNegativeTest-1107689494-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:49:16.975435 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi [None req-5766b65c-8e76-4ac4-8842-bcf99f04ad38 tempest-TestMinimumBasicScenario-1817438735 tempest-TestMinimumBasicScenario-1817438735-project] Calling method '>' {{(pid=128728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 15:49:16.976741 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.compute.api [None req-5766b65c-8e76-4ac4-8842-bcf99f04ad38 tempest-TestMinimumBasicScenario-1817438735 tempest-TestMinimumBasicScenario-1817438735-project] [instance: ef63d04a-87e5-4202-a672-d45a2a877c68] Fetching instance by UUID {{(pid=128728) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 15:49:16.984611 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-5766b65c-8e76-4ac4-8842-bcf99f04ad38 tempest-TestMinimumBasicScenario-1817438735 tempest-TestMinimumBasicScenario-1817438735-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:49:16.985250 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-5766b65c-8e76-4ac4-8842-bcf99f04ad38 tempest-TestMinimumBasicScenario-1817438735 tempest-TestMinimumBasicScenario-1817438735-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:49:16.986043 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-5766b65c-8e76-4ac4-8842-bcf99f04ad38 tempest-TestMinimumBasicScenario-1817438735 tempest-TestMinimumBasicScenario-1817438735-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:49:16.986535 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-5766b65c-8e76-4ac4-8842-bcf99f04ad38 tempest-TestMinimumBasicScenario-1817438735 tempest-TestMinimumBasicScenario-1817438735-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:49:17.170672 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.policy [None req-5dcc788e-988d-47d4-9007-7635d4047f68 tempest-VolumesNegativeTest-1107689494 tempest-VolumesNegativeTest-1107689494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e8303a1f1584ae2aae774eaf31481f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1e7c6697dfc4562b4c1d46ee21964a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128729) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:49:17.178013 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: INFO nova.api.openstack.requestlog [None req-5dcc788e-988d-47d4-9007-7635d4047f68 tempest-VolumesNegativeTest-1107689494 tempest-VolumesNegativeTest-1107689494-project] 10.222.0.61 "GET /compute/v2.1/servers/ea1f238d-3bae-4ce8-b328-d07fc2f7f272" status: 200 len: 1315 microversion: 2.1 time: 0.216886 May 14 15:49:17.178617 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: [pid: 128729|app: 0|req: 217/450] 10.222.0.61 () {58 vars in 1235 bytes} [Sat May 14 15:49:16 2022] GET /compute/v2.1/servers/ea1f238d-3bae-4ce8-b328-d07fc2f7f272 => generated 1315 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 15:49:17.183542 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi [req-9a68380b-4c16-40f2-b902-2bc31f6252f3 req-13ba2ec5-29b6-48aa-bae0-dabfd9c938c5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "656dffc0-256e-40ba-b670-f08e247a0d95", "tag": "9d525f2e-84e9-4747-99b0-489de117e060"}]} {{(pid=128729) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 15:49:17.185724 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.policy [None req-5766b65c-8e76-4ac4-8842-bcf99f04ad38 tempest-TestMinimumBasicScenario-1817438735 tempest-TestMinimumBasicScenario-1817438735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d5f259e0b98457ea6b6b88d886c813d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fba11e8ade54d388361c4c936a43372', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128728) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:49:17.191383 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [req-9a68380b-4c16-40f2-b902-2bc31f6252f3 req-13ba2ec5-29b6-48aa-bae0-dabfd9c938c5 service nova] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:49:17.191854 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [req-9a68380b-4c16-40f2-b902-2bc31f6252f3 req-13ba2ec5-29b6-48aa-bae0-dabfd9c938c5 service nova] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:49:17.194128 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: INFO nova.api.openstack.requestlog [None req-5766b65c-8e76-4ac4-8842-bcf99f04ad38 tempest-TestMinimumBasicScenario-1817438735 tempest-TestMinimumBasicScenario-1817438735-project] 10.222.0.61 "GET /compute/v2.1/servers/ef63d04a-87e5-4202-a672-d45a2a877c68" status: 200 len: 1357 microversion: 2.1 time: 0.221411 May 14 15:49:17.194128 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: [pid: 128728|app: 0|req: 234/451] 10.222.0.61 () {58 vars in 1235 bytes} [Sat May 14 15:49:16 2022] GET /compute/v2.1/servers/ef63d04a-87e5-4202-a672-d45a2a877c68 => generated 1357 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 15:49:17.199138 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi [None req-f083c95d-812f-4f72-8143-885b735e9381 tempest-VolumesActionsTest-1534566879 tempest-VolumesActionsTest-1534566879-project] Calling method '>' {{(pid=128728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 15:49:17.199811 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.compute.api [None req-f083c95d-812f-4f72-8143-885b735e9381 tempest-VolumesActionsTest-1534566879 tempest-VolumesActionsTest-1534566879-project] [instance: 656dffc0-256e-40ba-b670-f08e247a0d95] Fetching instance by UUID {{(pid=128728) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 15:49:17.203307 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: INFO nova.api.openstack.compute.server_external_events [req-9a68380b-4c16-40f2-b902-2bc31f6252f3 req-13ba2ec5-29b6-48aa-bae0-dabfd9c938c5 service nova] Creating event network-changed:9d525f2e-84e9-4747-99b0-489de117e060 for instance 656dffc0-256e-40ba-b670-f08e247a0d95 on hv-cinder-83979 May 14 15:49:17.205543 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-f083c95d-812f-4f72-8143-885b735e9381 tempest-VolumesActionsTest-1534566879 tempest-VolumesActionsTest-1534566879-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:49:17.205987 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-f083c95d-812f-4f72-8143-885b735e9381 tempest-VolumesActionsTest-1534566879 tempest-VolumesActionsTest-1534566879-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:49:17.206778 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-f083c95d-812f-4f72-8143-885b735e9381 tempest-VolumesActionsTest-1534566879 tempest-VolumesActionsTest-1534566879-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:49:17.207221 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-f083c95d-812f-4f72-8143-885b735e9381 tempest-VolumesActionsTest-1534566879 tempest-VolumesActionsTest-1534566879-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:49:17.208537 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: INFO nova.api.openstack.requestlog [req-9a68380b-4c16-40f2-b902-2bc31f6252f3 req-13ba2ec5-29b6-48aa-bae0-dabfd9c938c5 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.028747 May 14 15:49:17.209256 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: [pid: 128729|app: 0|req: 218/452] 10.222.0.61 () {64 vars in 1317 bytes} [Sat May 14 15:49:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 14 15:49:17.301295 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi [None req-9bcd47e5-9137-4277-a5d8-ccad4c880585 tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Calling method '>' {{(pid=128729) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 15:49:17.302083 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.compute.api [None req-9bcd47e5-9137-4277-a5d8-ccad4c880585 tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] [instance: 9fbb269d-11cd-49ed-81ac-570e721c15cd] Fetching instance by UUID {{(pid=128729) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 15:49:17.308448 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-9bcd47e5-9137-4277-a5d8-ccad4c880585 tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:49:17.308975 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-9bcd47e5-9137-4277-a5d8-ccad4c880585 tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:49:17.309866 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-9bcd47e5-9137-4277-a5d8-ccad4c880585 tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:49:17.310398 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-9bcd47e5-9137-4277-a5d8-ccad4c880585 tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:49:17.338375 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.policy [None req-f083c95d-812f-4f72-8143-885b735e9381 tempest-VolumesActionsTest-1534566879 tempest-VolumesActionsTest-1534566879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0156ed87a5b4efca7ef5056429db1a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71b09f9f20b340b5a615b24e05312703', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128728) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:49:17.346351 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: INFO nova.api.openstack.requestlog [None req-f083c95d-812f-4f72-8143-885b735e9381 tempest-VolumesActionsTest-1534566879 tempest-VolumesActionsTest-1534566879-project] 10.222.0.61 "GET /compute/v2.1/servers/656dffc0-256e-40ba-b670-f08e247a0d95" status: 200 len: 1314 microversion: 2.1 time: 0.150595 May 14 15:49:17.347073 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: [pid: 128728|app: 0|req: 235/453] 10.222.0.61 () {58 vars in 1235 bytes} [Sat May 14 15:49:17 2022] GET /compute/v2.1/servers/656dffc0-256e-40ba-b670-f08e247a0d95 => generated 1314 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 15:49:17.435115 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.policy [None req-9bcd47e5-9137-4277-a5d8-ccad4c880585 tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b896317d96a40d6a137db0dcf5f98f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d2517d5440a4d30949f3dd36a46d813', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128729) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:49:17.442361 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: INFO nova.api.openstack.requestlog [None req-9bcd47e5-9137-4277-a5d8-ccad4c880585 tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] 10.222.0.61 "GET /compute/v2.1/servers/9fbb269d-11cd-49ed-81ac-570e721c15cd" status: 200 len: 1517 microversion: 2.1 time: 0.145201 May 14 15:49:17.442919 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: [pid: 128729|app: 0|req: 219/454] 10.222.0.61 () {58 vars in 1235 bytes} [Sat May 14 15:49:17 2022] GET /compute/v2.1/servers/9fbb269d-11cd-49ed-81ac-570e721c15cd => generated 1517 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 15:49:18.195906 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi [None req-3f330fd9-2077-463b-b369-35731c986a00 tempest-VolumesNegativeTest-1107689494 tempest-VolumesNegativeTest-1107689494-project] Calling method '>' {{(pid=128728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 15:49:18.196481 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.compute.api [None req-3f330fd9-2077-463b-b369-35731c986a00 tempest-VolumesNegativeTest-1107689494 tempest-VolumesNegativeTest-1107689494-project] [instance: ea1f238d-3bae-4ce8-b328-d07fc2f7f272] Fetching instance by UUID {{(pid=128728) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 15:49:18.203016 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-3f330fd9-2077-463b-b369-35731c986a00 tempest-VolumesNegativeTest-1107689494 tempest-VolumesNegativeTest-1107689494-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:49:18.203465 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-3f330fd9-2077-463b-b369-35731c986a00 tempest-VolumesNegativeTest-1107689494 tempest-VolumesNegativeTest-1107689494-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:49:18.204252 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-3f330fd9-2077-463b-b369-35731c986a00 tempest-VolumesNegativeTest-1107689494 tempest-VolumesNegativeTest-1107689494-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:49:18.204674 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-3f330fd9-2077-463b-b369-35731c986a00 tempest-VolumesNegativeTest-1107689494 tempest-VolumesNegativeTest-1107689494-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:49:18.209987 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi [None req-629b0ecb-238c-4399-b762-55703d34da98 tempest-TestMinimumBasicScenario-1817438735 tempest-TestMinimumBasicScenario-1817438735-project] Calling method '>' {{(pid=128729) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 15:49:18.210644 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.compute.api [None req-629b0ecb-238c-4399-b762-55703d34da98 tempest-TestMinimumBasicScenario-1817438735 tempest-TestMinimumBasicScenario-1817438735-project] [instance: ef63d04a-87e5-4202-a672-d45a2a877c68] Fetching instance by UUID {{(pid=128729) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 15:49:18.217894 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-629b0ecb-238c-4399-b762-55703d34da98 tempest-TestMinimumBasicScenario-1817438735 tempest-TestMinimumBasicScenario-1817438735-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:49:18.218372 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-629b0ecb-238c-4399-b762-55703d34da98 tempest-TestMinimumBasicScenario-1817438735 tempest-TestMinimumBasicScenario-1817438735-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:49:18.219147 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-629b0ecb-238c-4399-b762-55703d34da98 tempest-TestMinimumBasicScenario-1817438735 tempest-TestMinimumBasicScenario-1817438735-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:49:18.219583 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-629b0ecb-238c-4399-b762-55703d34da98 tempest-TestMinimumBasicScenario-1817438735 tempest-TestMinimumBasicScenario-1817438735-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:49:18.394246 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.policy [None req-3f330fd9-2077-463b-b369-35731c986a00 tempest-VolumesNegativeTest-1107689494 tempest-VolumesNegativeTest-1107689494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e8303a1f1584ae2aae774eaf31481f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1e7c6697dfc4562b4c1d46ee21964a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128728) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:49:18.402293 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: INFO nova.api.openstack.requestlog [None req-3f330fd9-2077-463b-b369-35731c986a00 tempest-VolumesNegativeTest-1107689494 tempest-VolumesNegativeTest-1107689494-project] 10.222.0.61 "GET /compute/v2.1/servers/ea1f238d-3bae-4ce8-b328-d07fc2f7f272" status: 200 len: 1315 microversion: 2.1 time: 0.209369 May 14 15:49:18.402899 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: [pid: 128728|app: 0|req: 236/455] 10.222.0.61 () {58 vars in 1235 bytes} [Sat May 14 15:49:18 2022] GET /compute/v2.1/servers/ea1f238d-3bae-4ce8-b328-d07fc2f7f272 => generated 1315 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 15:49:18.406109 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.policy [None req-629b0ecb-238c-4399-b762-55703d34da98 tempest-TestMinimumBasicScenario-1817438735 tempest-TestMinimumBasicScenario-1817438735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d5f259e0b98457ea6b6b88d886c813d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fba11e8ade54d388361c4c936a43372', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128729) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:49:18.407268 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi [None req-2e2caed7-2cb7-4eef-bc1f-98b9fda7a3a8 tempest-VolumesActionsTest-1534566879 tempest-VolumesActionsTest-1534566879-project] Calling method '>' {{(pid=128728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 15:49:18.407863 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.compute.api [None req-2e2caed7-2cb7-4eef-bc1f-98b9fda7a3a8 tempest-VolumesActionsTest-1534566879 tempest-VolumesActionsTest-1534566879-project] [instance: 656dffc0-256e-40ba-b670-f08e247a0d95] Fetching instance by UUID {{(pid=128728) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 15:49:18.413565 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: INFO nova.api.openstack.requestlog [None req-629b0ecb-238c-4399-b762-55703d34da98 tempest-TestMinimumBasicScenario-1817438735 tempest-TestMinimumBasicScenario-1817438735-project] 10.222.0.61 "GET /compute/v2.1/servers/ef63d04a-87e5-4202-a672-d45a2a877c68" status: 200 len: 1357 microversion: 2.1 time: 0.207453 May 14 15:49:18.413706 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-2e2caed7-2cb7-4eef-bc1f-98b9fda7a3a8 tempest-VolumesActionsTest-1534566879 tempest-VolumesActionsTest-1534566879-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:49:18.414063 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-2e2caed7-2cb7-4eef-bc1f-98b9fda7a3a8 tempest-VolumesActionsTest-1534566879 tempest-VolumesActionsTest-1534566879-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:49:18.414159 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: [pid: 128729|app: 0|req: 220/456] 10.222.0.61 () {58 vars in 1235 bytes} [Sat May 14 15:49:18 2022] GET /compute/v2.1/servers/ef63d04a-87e5-4202-a672-d45a2a877c68 => generated 1357 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 15:49:18.414872 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-2e2caed7-2cb7-4eef-bc1f-98b9fda7a3a8 tempest-VolumesActionsTest-1534566879 tempest-VolumesActionsTest-1534566879-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:49:18.415301 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-2e2caed7-2cb7-4eef-bc1f-98b9fda7a3a8 tempest-VolumesActionsTest-1534566879 tempest-VolumesActionsTest-1534566879-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:49:18.546672 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.policy [None req-2e2caed7-2cb7-4eef-bc1f-98b9fda7a3a8 tempest-VolumesActionsTest-1534566879 tempest-VolumesActionsTest-1534566879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0156ed87a5b4efca7ef5056429db1a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71b09f9f20b340b5a615b24e05312703', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128728) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:49:18.553878 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: INFO nova.api.openstack.requestlog [None req-2e2caed7-2cb7-4eef-bc1f-98b9fda7a3a8 tempest-VolumesActionsTest-1534566879 tempest-VolumesActionsTest-1534566879-project] 10.222.0.61 "GET /compute/v2.1/servers/656dffc0-256e-40ba-b670-f08e247a0d95" status: 200 len: 1314 microversion: 2.1 time: 0.150078 May 14 15:49:18.554462 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: [pid: 128728|app: 0|req: 237/457] 10.222.0.61 () {58 vars in 1235 bytes} [Sat May 14 15:49:18 2022] GET /compute/v2.1/servers/656dffc0-256e-40ba-b670-f08e247a0d95 => generated 1314 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 15:49:18.765164 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi [None req-a0994c5e-dbec-42d5-9c83-66df081a2c39 tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Action: 'create', calling method: .version_select at 0x7f77d8118b80>, body: {"keypair": {"name": "tempest-keypair-914910257", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHtRhQFXjcfTVrU97Vb/0MQPPoMitgCxFjMHoRcS7iln+hwMoY8y2e3ht4+PAp2vF3Ghb0FBCaWCRljqVkdUktijaL9q+KwWkd8qZ1vjhdTocFDXog6gVpUTXzOZ/tA4Nw=="}} {{(pid=128729) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 15:49:18.778671 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.quota [None req-a0994c5e-dbec-42d5-9c83-66df081a2c39 tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Getting quotas for project 5d2517d5440a4d30949f3dd36a46d813. Resources: {'key_pairs'} {{(pid=128729) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 14 15:49:18.782440 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.quota [None req-a0994c5e-dbec-42d5-9c83-66df081a2c39 tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Getting quotas for user 7b896317d96a40d6a137db0dcf5f98f2 and project 5d2517d5440a4d30949f3dd36a46d813. Resources: {'key_pairs'} {{(pid=128729) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 14 15:49:18.803768 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: INFO nova.api.openstack.requestlog [None req-a0994c5e-dbec-42d5-9c83-66df081a2c39 tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] 10.222.0.61 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.042990 May 14 15:49:18.804389 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: [pid: 128729|app: 0|req: 221/458] 10.222.0.61 () {60 vars in 1158 bytes} [Sat May 14 15:49:18 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 14 15:49:19.419364 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi [None req-b76f716e-6417-4c78-b164-2ea848b6c3cb tempest-VolumesNegativeTest-1107689494 tempest-VolumesNegativeTest-1107689494-project] Calling method '>' {{(pid=128728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 15:49:19.420437 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.compute.api [None req-b76f716e-6417-4c78-b164-2ea848b6c3cb tempest-VolumesNegativeTest-1107689494 tempest-VolumesNegativeTest-1107689494-project] [instance: ea1f238d-3bae-4ce8-b328-d07fc2f7f272] Fetching instance by UUID {{(pid=128728) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 15:49:19.425899 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-b76f716e-6417-4c78-b164-2ea848b6c3cb tempest-VolumesNegativeTest-1107689494 tempest-VolumesNegativeTest-1107689494-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:49:19.426581 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-b76f716e-6417-4c78-b164-2ea848b6c3cb tempest-VolumesNegativeTest-1107689494 tempest-VolumesNegativeTest-1107689494-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:49:19.427587 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-b76f716e-6417-4c78-b164-2ea848b6c3cb tempest-VolumesNegativeTest-1107689494 tempest-VolumesNegativeTest-1107689494-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:49:19.428173 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-b76f716e-6417-4c78-b164-2ea848b6c3cb tempest-VolumesNegativeTest-1107689494 tempest-VolumesNegativeTest-1107689494-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:49:19.431607 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi [None req-828e3e64-9fb7-4662-9494-b95f0bc22ccd tempest-TestMinimumBasicScenario-1817438735 tempest-TestMinimumBasicScenario-1817438735-project] Calling method '>' {{(pid=128729) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 15:49:19.433302 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.compute.api [None req-828e3e64-9fb7-4662-9494-b95f0bc22ccd tempest-TestMinimumBasicScenario-1817438735 tempest-TestMinimumBasicScenario-1817438735-project] [instance: ef63d04a-87e5-4202-a672-d45a2a877c68] Fetching instance by UUID {{(pid=128729) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 15:49:19.439474 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-828e3e64-9fb7-4662-9494-b95f0bc22ccd tempest-TestMinimumBasicScenario-1817438735 tempest-TestMinimumBasicScenario-1817438735-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:49:19.440028 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-828e3e64-9fb7-4662-9494-b95f0bc22ccd tempest-TestMinimumBasicScenario-1817438735 tempest-TestMinimumBasicScenario-1817438735-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:49:19.440888 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-828e3e64-9fb7-4662-9494-b95f0bc22ccd tempest-TestMinimumBasicScenario-1817438735 tempest-TestMinimumBasicScenario-1817438735-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:49:19.441406 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-828e3e64-9fb7-4662-9494-b95f0bc22ccd tempest-TestMinimumBasicScenario-1817438735 tempest-TestMinimumBasicScenario-1817438735-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:49:19.996952 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.policy [None req-828e3e64-9fb7-4662-9494-b95f0bc22ccd tempest-TestMinimumBasicScenario-1817438735 tempest-TestMinimumBasicScenario-1817438735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d5f259e0b98457ea6b6b88d886c813d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fba11e8ade54d388361c4c936a43372', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128729) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:49:20.000005 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.policy [None req-b76f716e-6417-4c78-b164-2ea848b6c3cb tempest-VolumesNegativeTest-1107689494 tempest-VolumesNegativeTest-1107689494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e8303a1f1584ae2aae774eaf31481f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1e7c6697dfc4562b4c1d46ee21964a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128728) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:49:20.006012 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: INFO nova.api.openstack.requestlog [None req-828e3e64-9fb7-4662-9494-b95f0bc22ccd tempest-TestMinimumBasicScenario-1817438735 tempest-TestMinimumBasicScenario-1817438735-project] 10.222.0.61 "GET /compute/v2.1/servers/ef63d04a-87e5-4202-a672-d45a2a877c68" status: 200 len: 1357 microversion: 2.1 time: 0.578813 May 14 15:49:20.010190 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: INFO nova.api.openstack.requestlog [None req-b76f716e-6417-4c78-b164-2ea848b6c3cb tempest-VolumesNegativeTest-1107689494 tempest-VolumesNegativeTest-1107689494-project] 10.222.0.61 "GET /compute/v2.1/servers/ea1f238d-3bae-4ce8-b328-d07fc2f7f272" status: 200 len: 1315 microversion: 2.1 time: 0.595247 May 14 15:49:20.012347 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: [pid: 128728|app: 0|req: 238/459] 10.222.0.61 () {58 vars in 1235 bytes} [Sat May 14 15:49:19 2022] GET /compute/v2.1/servers/ea1f238d-3bae-4ce8-b328-d07fc2f7f272 => generated 1315 bytes in 598 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 15:49:20.017205 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi [None req-61d5c225-39a6-4c47-8492-934a183d58ba tempest-VolumesActionsTest-1534566879 tempest-VolumesActionsTest-1534566879-project] Calling method '>' {{(pid=128728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 15:49:20.017585 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: [pid: 128729|app: 0|req: 222/460] 10.222.0.61 () {58 vars in 1235 bytes} [Sat May 14 15:49:19 2022] GET /compute/v2.1/servers/ef63d04a-87e5-4202-a672-d45a2a877c68 => generated 1357 bytes in 591 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 15:49:20.017994 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.compute.api [None req-61d5c225-39a6-4c47-8492-934a183d58ba tempest-VolumesActionsTest-1534566879 tempest-VolumesActionsTest-1534566879-project] [instance: 656dffc0-256e-40ba-b670-f08e247a0d95] Fetching instance by UUID {{(pid=128728) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 15:49:20.028241 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-61d5c225-39a6-4c47-8492-934a183d58ba tempest-VolumesActionsTest-1534566879 tempest-VolumesActionsTest-1534566879-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:49:20.028695 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-61d5c225-39a6-4c47-8492-934a183d58ba tempest-VolumesActionsTest-1534566879 tempest-VolumesActionsTest-1534566879-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:49:20.029486 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-61d5c225-39a6-4c47-8492-934a183d58ba tempest-VolumesActionsTest-1534566879 tempest-VolumesActionsTest-1534566879-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:49:20.029927 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-61d5c225-39a6-4c47-8492-934a183d58ba tempest-VolumesActionsTest-1534566879 tempest-VolumesActionsTest-1534566879-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:49:20.344200 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.policy [None req-61d5c225-39a6-4c47-8492-934a183d58ba tempest-VolumesActionsTest-1534566879 tempest-VolumesActionsTest-1534566879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0156ed87a5b4efca7ef5056429db1a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71b09f9f20b340b5a615b24e05312703', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128728) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:49:20.351727 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: INFO nova.api.openstack.requestlog [None req-61d5c225-39a6-4c47-8492-934a183d58ba tempest-VolumesActionsTest-1534566879 tempest-VolumesActionsTest-1534566879-project] 10.222.0.61 "GET /compute/v2.1/servers/656dffc0-256e-40ba-b670-f08e247a0d95" status: 200 len: 1314 microversion: 2.1 time: 0.338308 May 14 15:49:20.352325 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: [pid: 128728|app: 0|req: 239/461] 10.222.0.61 () {58 vars in 1235 bytes} [Sat May 14 15:49:20 2022] GET /compute/v2.1/servers/656dffc0-256e-40ba-b670-f08e247a0d95 => generated 1314 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 15:49:20.767432 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi [None req-6187813c-6b57-4c52-99c6-73b2bc3f48ec tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-454409287", "imageRef": "1381e3d5-fc27-4fa7-ab03-5d86278a0546", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "3e026b24-9d5e-4f74-ac5a-5d47dc1338b8"}], "security_groups": [{"name": "tempest-securitygroup--1695025150"}], "key_name": "tempest-keypair-914910257", "user_data": "}} {{(pid=128729) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 15:49:20.870784 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.network.neutron [None req-6187813c-6b57-4c52-99c6-73b2bc3f48ec tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] validate_networks() for [('3e026b24-9d5e-4f74-ac5a-5d47dc1338b8', None, None, None, None, None)] {{(pid=128729) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 14 15:49:21.023704 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi [None req-0d2f8c22-b367-4501-aac9-accdfe4d5f8e tempest-TestMinimumBasicScenario-1817438735 tempest-TestMinimumBasicScenario-1817438735-project] Calling method '>' {{(pid=128728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 15:49:21.024316 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.compute.api [None req-0d2f8c22-b367-4501-aac9-accdfe4d5f8e tempest-TestMinimumBasicScenario-1817438735 tempest-TestMinimumBasicScenario-1817438735-project] [instance: ef63d04a-87e5-4202-a672-d45a2a877c68] Fetching instance by UUID {{(pid=128728) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 15:49:21.030795 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-0d2f8c22-b367-4501-aac9-accdfe4d5f8e tempest-TestMinimumBasicScenario-1817438735 tempest-TestMinimumBasicScenario-1817438735-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:49:21.031246 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-0d2f8c22-b367-4501-aac9-accdfe4d5f8e tempest-TestMinimumBasicScenario-1817438735 tempest-TestMinimumBasicScenario-1817438735-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:49:21.032026 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-0d2f8c22-b367-4501-aac9-accdfe4d5f8e tempest-TestMinimumBasicScenario-1817438735 tempest-TestMinimumBasicScenario-1817438735-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:49:21.032462 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-0d2f8c22-b367-4501-aac9-accdfe4d5f8e tempest-TestMinimumBasicScenario-1817438735 tempest-TestMinimumBasicScenario-1817438735-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:49:21.230858 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.policy [None req-0d2f8c22-b367-4501-aac9-accdfe4d5f8e tempest-TestMinimumBasicScenario-1817438735 tempest-TestMinimumBasicScenario-1817438735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d5f259e0b98457ea6b6b88d886c813d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fba11e8ade54d388361c4c936a43372', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128728) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:49:21.238551 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: INFO nova.api.openstack.requestlog [None req-0d2f8c22-b367-4501-aac9-accdfe4d5f8e tempest-TestMinimumBasicScenario-1817438735 tempest-TestMinimumBasicScenario-1817438735-project] 10.222.0.61 "GET /compute/v2.1/servers/ef63d04a-87e5-4202-a672-d45a2a877c68" status: 200 len: 1357 microversion: 2.1 time: 0.218653 May 14 15:49:21.239133 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: [pid: 128728|app: 0|req: 240/462] 10.222.0.61 () {58 vars in 1235 bytes} [Sat May 14 15:49:21 2022] GET /compute/v2.1/servers/ef63d04a-87e5-4202-a672-d45a2a877c68 => generated 1357 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 15:49:21.243573 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi [None req-30adbcc2-c044-4188-ad37-6ec1e78ff01a tempest-VolumesNegativeTest-1107689494 tempest-VolumesNegativeTest-1107689494-project] Calling method '>' {{(pid=128728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 15:49:21.244174 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.compute.api [None req-30adbcc2-c044-4188-ad37-6ec1e78ff01a tempest-VolumesNegativeTest-1107689494 tempest-VolumesNegativeTest-1107689494-project] [instance: ea1f238d-3bae-4ce8-b328-d07fc2f7f272] Fetching instance by UUID {{(pid=128728) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 15:49:21.249850 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-30adbcc2-c044-4188-ad37-6ec1e78ff01a tempest-VolumesNegativeTest-1107689494 tempest-VolumesNegativeTest-1107689494-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:49:21.250329 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-30adbcc2-c044-4188-ad37-6ec1e78ff01a tempest-VolumesNegativeTest-1107689494 tempest-VolumesNegativeTest-1107689494-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:49:21.251097 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-30adbcc2-c044-4188-ad37-6ec1e78ff01a tempest-VolumesNegativeTest-1107689494 tempest-VolumesNegativeTest-1107689494-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:49:21.251716 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-30adbcc2-c044-4188-ad37-6ec1e78ff01a tempest-VolumesNegativeTest-1107689494 tempest-VolumesNegativeTest-1107689494-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:49:21.348565 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.virt.hardware [None req-6187813c-6b57-4c52-99c6-73b2bc3f48ec tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Flavor limits 0:0:0 {{(pid=128729) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 14 15:49:21.348988 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.virt.hardware [None req-6187813c-6b57-4c52-99c6-73b2bc3f48ec tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Image limits 0:0:0 {{(pid=128729) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 14 15:49:21.349488 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.virt.hardware [None req-6187813c-6b57-4c52-99c6-73b2bc3f48ec tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Flavor pref 0:0:0 {{(pid=128729) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 14 15:49:21.349895 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.virt.hardware [None req-6187813c-6b57-4c52-99c6-73b2bc3f48ec tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Image pref 0:0:0 {{(pid=128729) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 14 15:49:21.350325 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.virt.hardware [None req-6187813c-6b57-4c52-99c6-73b2bc3f48ec tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128729) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 14 15:49:21.359190 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-6187813c-6b57-4c52-99c6-73b2bc3f48ec tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:49:21.359648 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-6187813c-6b57-4c52-99c6-73b2bc3f48ec tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:49:21.360484 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-6187813c-6b57-4c52-99c6-73b2bc3f48ec tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:49:21.360923 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-6187813c-6b57-4c52-99c6-73b2bc3f48ec tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:49:21.378028 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.quota [None req-6187813c-6b57-4c52-99c6-73b2bc3f48ec tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Getting quotas for project 5d2517d5440a4d30949f3dd36a46d813. Resources: {'instances', 'cores', 'ram'} {{(pid=128729) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 14 15:49:21.382107 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.quota [None req-6187813c-6b57-4c52-99c6-73b2bc3f48ec tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Getting quotas for user 7b896317d96a40d6a137db0dcf5f98f2 and project 5d2517d5440a4d30949f3dd36a46d813. Resources: {'instances', 'cores', 'ram'} {{(pid=128729) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 14 15:49:21.393773 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.policy [None req-30adbcc2-c044-4188-ad37-6ec1e78ff01a tempest-VolumesNegativeTest-1107689494 tempest-VolumesNegativeTest-1107689494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e8303a1f1584ae2aae774eaf31481f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1e7c6697dfc4562b4c1d46ee21964a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128728) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:49:21.394447 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.compute.api [None req-6187813c-6b57-4c52-99c6-73b2bc3f48ec tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Going to run 1 instances... {{(pid=128729) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 14 15:49:21.396730 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.compute.api [None req-6187813c-6b57-4c52-99c6-73b2bc3f48ec tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] [instance: 7c21adbe-7a79-46cf-aa7c-9b2a6548c767] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='1381e3d5-fc27-4fa7-ab03-5d86278a0546',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128729) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 14 15:49:21.401958 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: INFO nova.api.openstack.requestlog [None req-30adbcc2-c044-4188-ad37-6ec1e78ff01a tempest-VolumesNegativeTest-1107689494 tempest-VolumesNegativeTest-1107689494-project] 10.222.0.61 "GET /compute/v2.1/servers/ea1f238d-3bae-4ce8-b328-d07fc2f7f272" status: 200 len: 1315 microversion: 2.1 time: 0.161295 May 14 15:49:21.402722 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: [pid: 128728|app: 0|req: 241/463] 10.222.0.61 () {58 vars in 1235 bytes} [Sat May 14 15:49:21 2022] GET /compute/v2.1/servers/ea1f238d-3bae-4ce8-b328-d07fc2f7f272 => generated 1315 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 15:49:21.415757 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi [None req-aa300242-be63-48e7-b076-5e058611a438 tempest-VolumesActionsTest-1534566879 tempest-VolumesActionsTest-1534566879-project] Calling method '>' {{(pid=128728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 15:49:21.416361 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.compute.api [None req-aa300242-be63-48e7-b076-5e058611a438 tempest-VolumesActionsTest-1534566879 tempest-VolumesActionsTest-1534566879-project] [instance: 656dffc0-256e-40ba-b670-f08e247a0d95] Fetching instance by UUID {{(pid=128728) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 15:49:21.422475 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-aa300242-be63-48e7-b076-5e058611a438 tempest-VolumesActionsTest-1534566879 tempest-VolumesActionsTest-1534566879-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:49:21.422928 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-aa300242-be63-48e7-b076-5e058611a438 tempest-VolumesActionsTest-1534566879 tempest-VolumesActionsTest-1534566879-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:49:21.423766 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-aa300242-be63-48e7-b076-5e058611a438 tempest-VolumesActionsTest-1534566879 tempest-VolumesActionsTest-1534566879-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:49:21.424206 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-aa300242-be63-48e7-b076-5e058611a438 tempest-VolumesActionsTest-1534566879 tempest-VolumesActionsTest-1534566879-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:49:21.445418 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: INFO nova.api.openstack.requestlog [None req-6187813c-6b57-4c52-99c6-73b2bc3f48ec tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] 10.222.0.61 "POST /compute/v2.1/servers" status: 202 len: 409 microversion: 2.1 time: 0.682479 May 14 15:49:21.446261 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: [pid: 128729|app: 0|req: 223/464] 10.222.0.61 () {60 vars in 1146 bytes} [Sat May 14 15:49:20 2022] POST /compute/v2.1/servers => generated 409 bytes in 684 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 14 15:49:21.456515 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi [None req-8fdb9185-5027-422a-b3b6-41cfa5112bff tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Calling method '>' {{(pid=128729) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 15:49:21.457137 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.compute.api [None req-8fdb9185-5027-422a-b3b6-41cfa5112bff tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] [instance: 7c21adbe-7a79-46cf-aa7c-9b2a6548c767] Fetching instance by UUID {{(pid=128729) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 15:49:21.536240 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.policy [None req-8fdb9185-5027-422a-b3b6-41cfa5112bff tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b896317d96a40d6a137db0dcf5f98f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d2517d5440a4d30949f3dd36a46d813', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128729) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:49:21.545805 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: INFO nova.api.openstack.requestlog [None req-8fdb9185-5027-422a-b3b6-41cfa5112bff tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] 10.222.0.61 "GET /compute/v2.1/servers/7c21adbe-7a79-46cf-aa7c-9b2a6548c767" status: 200 len: 1244 microversion: 2.1 time: 0.092994 May 14 15:49:21.548058 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: [pid: 128729|app: 0|req: 224/465] 10.222.0.61 () {58 vars in 1235 bytes} [Sat May 14 15:49:21 2022] GET /compute/v2.1/servers/7c21adbe-7a79-46cf-aa7c-9b2a6548c767 => generated 1244 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 15:49:21.591465 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.policy [None req-aa300242-be63-48e7-b076-5e058611a438 tempest-VolumesActionsTest-1534566879 tempest-VolumesActionsTest-1534566879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0156ed87a5b4efca7ef5056429db1a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71b09f9f20b340b5a615b24e05312703', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128728) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:49:21.598723 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: INFO nova.api.openstack.requestlog [None req-aa300242-be63-48e7-b076-5e058611a438 tempest-VolumesActionsTest-1534566879 tempest-VolumesActionsTest-1534566879-project] 10.222.0.61 "GET /compute/v2.1/servers/656dffc0-256e-40ba-b670-f08e247a0d95" status: 200 len: 1314 microversion: 2.1 time: 0.186546 May 14 15:49:21.599282 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: [pid: 128728|app: 0|req: 242/466] 10.222.0.61 () {58 vars in 1235 bytes} [Sat May 14 15:49:21 2022] GET /compute/v2.1/servers/656dffc0-256e-40ba-b670-f08e247a0d95 => generated 1314 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 15:49:22.255913 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi [None req-2ab468bd-09f6-428f-9640-118885ceab57 tempest-TestMinimumBasicScenario-1817438735 tempest-TestMinimumBasicScenario-1817438735-project] Calling method '>' {{(pid=128729) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 15:49:22.256518 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.compute.api [None req-2ab468bd-09f6-428f-9640-118885ceab57 tempest-TestMinimumBasicScenario-1817438735 tempest-TestMinimumBasicScenario-1817438735-project] [instance: ef63d04a-87e5-4202-a672-d45a2a877c68] Fetching instance by UUID {{(pid=128729) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 15:49:22.263450 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-2ab468bd-09f6-428f-9640-118885ceab57 tempest-TestMinimumBasicScenario-1817438735 tempest-TestMinimumBasicScenario-1817438735-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:49:22.264008 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-2ab468bd-09f6-428f-9640-118885ceab57 tempest-TestMinimumBasicScenario-1817438735 tempest-TestMinimumBasicScenario-1817438735-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:49:22.264782 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-2ab468bd-09f6-428f-9640-118885ceab57 tempest-TestMinimumBasicScenario-1817438735 tempest-TestMinimumBasicScenario-1817438735-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:49:22.265276 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-2ab468bd-09f6-428f-9640-118885ceab57 tempest-TestMinimumBasicScenario-1817438735 tempest-TestMinimumBasicScenario-1817438735-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:49:22.398690 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.policy [None req-2ab468bd-09f6-428f-9640-118885ceab57 tempest-TestMinimumBasicScenario-1817438735 tempest-TestMinimumBasicScenario-1817438735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d5f259e0b98457ea6b6b88d886c813d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fba11e8ade54d388361c4c936a43372', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128729) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:49:22.406535 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: INFO nova.api.openstack.requestlog [None req-2ab468bd-09f6-428f-9640-118885ceab57 tempest-TestMinimumBasicScenario-1817438735 tempest-TestMinimumBasicScenario-1817438735-project] 10.222.0.61 "GET /compute/v2.1/servers/ef63d04a-87e5-4202-a672-d45a2a877c68" status: 200 len: 1357 microversion: 2.1 time: 0.154502 May 14 15:49:22.407102 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: [pid: 128729|app: 0|req: 225/467] 10.222.0.61 () {58 vars in 1235 bytes} [Sat May 14 15:49:22 2022] GET /compute/v2.1/servers/ef63d04a-87e5-4202-a672-d45a2a877c68 => generated 1357 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 15:49:22.419137 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi [None req-5a3cba86-b53a-42d9-a406-e128f31b0b39 tempest-VolumesNegativeTest-1107689494 tempest-VolumesNegativeTest-1107689494-project] Calling method '>' {{(pid=128728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 15:49:22.419742 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.compute.api [None req-5a3cba86-b53a-42d9-a406-e128f31b0b39 tempest-VolumesNegativeTest-1107689494 tempest-VolumesNegativeTest-1107689494-project] [instance: ea1f238d-3bae-4ce8-b328-d07fc2f7f272] Fetching instance by UUID {{(pid=128728) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 15:49:22.425389 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-5a3cba86-b53a-42d9-a406-e128f31b0b39 tempest-VolumesNegativeTest-1107689494 tempest-VolumesNegativeTest-1107689494-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:49:22.425835 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-5a3cba86-b53a-42d9-a406-e128f31b0b39 tempest-VolumesNegativeTest-1107689494 tempest-VolumesNegativeTest-1107689494-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:49:22.426632 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-5a3cba86-b53a-42d9-a406-e128f31b0b39 tempest-VolumesNegativeTest-1107689494 tempest-VolumesNegativeTest-1107689494-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:49:22.427065 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-5a3cba86-b53a-42d9-a406-e128f31b0b39 tempest-VolumesNegativeTest-1107689494 tempest-VolumesNegativeTest-1107689494-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:49:22.555933 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.policy [None req-5a3cba86-b53a-42d9-a406-e128f31b0b39 tempest-VolumesNegativeTest-1107689494 tempest-VolumesNegativeTest-1107689494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e8303a1f1584ae2aae774eaf31481f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1e7c6697dfc4562b4c1d46ee21964a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128728) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:49:22.563942 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: INFO nova.api.openstack.requestlog [None req-5a3cba86-b53a-42d9-a406-e128f31b0b39 tempest-VolumesNegativeTest-1107689494 tempest-VolumesNegativeTest-1107689494-project] 10.222.0.61 "GET /compute/v2.1/servers/ea1f238d-3bae-4ce8-b328-d07fc2f7f272" status: 200 len: 1315 microversion: 2.1 time: 0.149121 May 14 15:49:22.564170 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi [None req-65780ae7-f0bc-4e51-ae5b-296ba4a273a1 tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Calling method '>' {{(pid=128729) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 15:49:22.564514 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: [pid: 128728|app: 0|req: 243/468] 10.222.0.61 () {58 vars in 1235 bytes} [Sat May 14 15:49:22 2022] GET /compute/v2.1/servers/ea1f238d-3bae-4ce8-b328-d07fc2f7f272 => generated 1315 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 15:49:22.564783 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.compute.api [None req-65780ae7-f0bc-4e51-ae5b-296ba4a273a1 tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] [instance: 7c21adbe-7a79-46cf-aa7c-9b2a6548c767] Fetching instance by UUID {{(pid=128729) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 15:49:22.570525 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-65780ae7-f0bc-4e51-ae5b-296ba4a273a1 tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:49:22.570977 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-65780ae7-f0bc-4e51-ae5b-296ba4a273a1 tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:49:22.571746 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-65780ae7-f0bc-4e51-ae5b-296ba4a273a1 tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:49:22.572184 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-65780ae7-f0bc-4e51-ae5b-296ba4a273a1 tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:49:22.615363 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi [None req-a640fdb5-aa0e-4d32-97ef-89d701d1fb3d tempest-VolumesActionsTest-1534566879 tempest-VolumesActionsTest-1534566879-project] Calling method '>' {{(pid=128728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 15:49:22.615995 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.compute.api [None req-a640fdb5-aa0e-4d32-97ef-89d701d1fb3d tempest-VolumesActionsTest-1534566879 tempest-VolumesActionsTest-1534566879-project] [instance: 656dffc0-256e-40ba-b670-f08e247a0d95] Fetching instance by UUID {{(pid=128728) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 15:49:22.622488 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-a640fdb5-aa0e-4d32-97ef-89d701d1fb3d tempest-VolumesActionsTest-1534566879 tempest-VolumesActionsTest-1534566879-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:49:22.622945 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-a640fdb5-aa0e-4d32-97ef-89d701d1fb3d tempest-VolumesActionsTest-1534566879 tempest-VolumesActionsTest-1534566879-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:49:22.623715 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-a640fdb5-aa0e-4d32-97ef-89d701d1fb3d tempest-VolumesActionsTest-1534566879 tempest-VolumesActionsTest-1534566879-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:49:22.624152 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-a640fdb5-aa0e-4d32-97ef-89d701d1fb3d tempest-VolumesActionsTest-1534566879 tempest-VolumesActionsTest-1534566879-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:49:22.633911 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.policy [None req-65780ae7-f0bc-4e51-ae5b-296ba4a273a1 tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b896317d96a40d6a137db0dcf5f98f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d2517d5440a4d30949f3dd36a46d813', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128729) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:49:22.641420 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: INFO nova.api.openstack.requestlog [None req-65780ae7-f0bc-4e51-ae5b-296ba4a273a1 tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] 10.222.0.61 "GET /compute/v2.1/servers/7c21adbe-7a79-46cf-aa7c-9b2a6548c767" status: 200 len: 1248 microversion: 2.1 time: 0.080965 May 14 15:49:22.641989 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: [pid: 128729|app: 0|req: 226/469] 10.222.0.61 () {58 vars in 1235 bytes} [Sat May 14 15:49:22 2022] GET /compute/v2.1/servers/7c21adbe-7a79-46cf-aa7c-9b2a6548c767 => generated 1248 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 15:49:22.753304 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.policy [None req-a640fdb5-aa0e-4d32-97ef-89d701d1fb3d tempest-VolumesActionsTest-1534566879 tempest-VolumesActionsTest-1534566879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0156ed87a5b4efca7ef5056429db1a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71b09f9f20b340b5a615b24e05312703', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128728) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:49:22.760926 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: INFO nova.api.openstack.requestlog [None req-a640fdb5-aa0e-4d32-97ef-89d701d1fb3d tempest-VolumesActionsTest-1534566879 tempest-VolumesActionsTest-1534566879-project] 10.222.0.61 "GET /compute/v2.1/servers/656dffc0-256e-40ba-b670-f08e247a0d95" status: 200 len: 1314 microversion: 2.1 time: 0.149126 May 14 15:49:22.761486 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: [pid: 128728|app: 0|req: 244/470] 10.222.0.61 () {58 vars in 1235 bytes} [Sat May 14 15:49:22 2022] GET /compute/v2.1/servers/656dffc0-256e-40ba-b670-f08e247a0d95 => generated 1314 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 15:49:23.423904 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi [None req-c8687328-4d02-4285-9502-47ed56d6bd0e tempest-TestMinimumBasicScenario-1817438735 tempest-TestMinimumBasicScenario-1817438735-project] Calling method '>' {{(pid=128729) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 15:49:23.424535 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.compute.api [None req-c8687328-4d02-4285-9502-47ed56d6bd0e tempest-TestMinimumBasicScenario-1817438735 tempest-TestMinimumBasicScenario-1817438735-project] [instance: ef63d04a-87e5-4202-a672-d45a2a877c68] Fetching instance by UUID {{(pid=128729) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 15:49:23.430765 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-c8687328-4d02-4285-9502-47ed56d6bd0e tempest-TestMinimumBasicScenario-1817438735 tempest-TestMinimumBasicScenario-1817438735-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:49:23.431208 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-c8687328-4d02-4285-9502-47ed56d6bd0e tempest-TestMinimumBasicScenario-1817438735 tempest-TestMinimumBasicScenario-1817438735-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:49:23.431962 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-c8687328-4d02-4285-9502-47ed56d6bd0e tempest-TestMinimumBasicScenario-1817438735 tempest-TestMinimumBasicScenario-1817438735-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:49:23.433109 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-c8687328-4d02-4285-9502-47ed56d6bd0e tempest-TestMinimumBasicScenario-1817438735 tempest-TestMinimumBasicScenario-1817438735-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:49:23.560711 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.policy [None req-c8687328-4d02-4285-9502-47ed56d6bd0e tempest-TestMinimumBasicScenario-1817438735 tempest-TestMinimumBasicScenario-1817438735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d5f259e0b98457ea6b6b88d886c813d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fba11e8ade54d388361c4c936a43372', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128729) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:49:23.567786 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: INFO nova.api.openstack.requestlog [None req-c8687328-4d02-4285-9502-47ed56d6bd0e tempest-TestMinimumBasicScenario-1817438735 tempest-TestMinimumBasicScenario-1817438735-project] 10.222.0.61 "GET /compute/v2.1/servers/ef63d04a-87e5-4202-a672-d45a2a877c68" status: 200 len: 1357 microversion: 2.1 time: 0.147852 May 14 15:49:23.568341 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: [pid: 128729|app: 0|req: 227/471] 10.222.0.61 () {58 vars in 1235 bytes} [Sat May 14 15:49:23 2022] GET /compute/v2.1/servers/ef63d04a-87e5-4202-a672-d45a2a877c68 => generated 1357 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 15:49:23.580658 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi [None req-e91746fb-18d2-4fdb-889b-5435ba23b894 tempest-VolumesNegativeTest-1107689494 tempest-VolumesNegativeTest-1107689494-project] Calling method '>' {{(pid=128728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 15:49:23.581275 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.compute.api [None req-e91746fb-18d2-4fdb-889b-5435ba23b894 tempest-VolumesNegativeTest-1107689494 tempest-VolumesNegativeTest-1107689494-project] [instance: ea1f238d-3bae-4ce8-b328-d07fc2f7f272] Fetching instance by UUID {{(pid=128728) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 15:49:23.587080 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-e91746fb-18d2-4fdb-889b-5435ba23b894 tempest-VolumesNegativeTest-1107689494 tempest-VolumesNegativeTest-1107689494-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:49:23.587529 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-e91746fb-18d2-4fdb-889b-5435ba23b894 tempest-VolumesNegativeTest-1107689494 tempest-VolumesNegativeTest-1107689494-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:49:23.588291 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-e91746fb-18d2-4fdb-889b-5435ba23b894 tempest-VolumesNegativeTest-1107689494 tempest-VolumesNegativeTest-1107689494-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:49:23.588766 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-e91746fb-18d2-4fdb-889b-5435ba23b894 tempest-VolumesNegativeTest-1107689494 tempest-VolumesNegativeTest-1107689494-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:49:23.657563 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi [None req-13b013e9-c7d9-40ca-8d49-aa8df3b77c93 tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Calling method '>' {{(pid=128729) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 15:49:23.658173 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.compute.api [None req-13b013e9-c7d9-40ca-8d49-aa8df3b77c93 tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] [instance: 7c21adbe-7a79-46cf-aa7c-9b2a6548c767] Fetching instance by UUID {{(pid=128729) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 15:49:23.663883 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-13b013e9-c7d9-40ca-8d49-aa8df3b77c93 tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:49:23.664337 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-13b013e9-c7d9-40ca-8d49-aa8df3b77c93 tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:49:23.665104 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-13b013e9-c7d9-40ca-8d49-aa8df3b77c93 tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:49:23.665541 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-13b013e9-c7d9-40ca-8d49-aa8df3b77c93 tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:49:23.735919 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.policy [None req-13b013e9-c7d9-40ca-8d49-aa8df3b77c93 tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b896317d96a40d6a137db0dcf5f98f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d2517d5440a4d30949f3dd36a46d813', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128729) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:49:23.743294 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: INFO nova.api.openstack.requestlog [None req-13b013e9-c7d9-40ca-8d49-aa8df3b77c93 tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] 10.222.0.61 "GET /compute/v2.1/servers/7c21adbe-7a79-46cf-aa7c-9b2a6548c767" status: 200 len: 1248 microversion: 2.1 time: 0.089630 May 14 15:49:23.743429 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.policy [None req-e91746fb-18d2-4fdb-889b-5435ba23b894 tempest-VolumesNegativeTest-1107689494 tempest-VolumesNegativeTest-1107689494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e8303a1f1584ae2aae774eaf31481f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1e7c6697dfc4562b4c1d46ee21964a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128728) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:49:23.743863 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: [pid: 128729|app: 0|req: 228/472] 10.222.0.61 () {58 vars in 1235 bytes} [Sat May 14 15:49:23 2022] GET /compute/v2.1/servers/7c21adbe-7a79-46cf-aa7c-9b2a6548c767 => generated 1248 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 15:49:23.751093 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: INFO nova.api.openstack.requestlog [None req-e91746fb-18d2-4fdb-889b-5435ba23b894 tempest-VolumesNegativeTest-1107689494 tempest-VolumesNegativeTest-1107689494-project] 10.222.0.61 "GET /compute/v2.1/servers/ea1f238d-3bae-4ce8-b328-d07fc2f7f272" status: 200 len: 1315 microversion: 2.1 time: 0.174186 May 14 15:49:23.751655 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: [pid: 128728|app: 0|req: 245/473] 10.222.0.61 () {58 vars in 1235 bytes} [Sat May 14 15:49:23 2022] GET /compute/v2.1/servers/ea1f238d-3bae-4ce8-b328-d07fc2f7f272 => generated 1315 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 15:49:23.776578 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi [None req-e671263a-d9e6-4cf4-9781-a1f2455daa88 tempest-VolumesActionsTest-1534566879 tempest-VolumesActionsTest-1534566879-project] Calling method '>' {{(pid=128729) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 15:49:23.777182 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.compute.api [None req-e671263a-d9e6-4cf4-9781-a1f2455daa88 tempest-VolumesActionsTest-1534566879 tempest-VolumesActionsTest-1534566879-project] [instance: 656dffc0-256e-40ba-b670-f08e247a0d95] Fetching instance by UUID {{(pid=128729) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 15:49:23.783071 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-e671263a-d9e6-4cf4-9781-a1f2455daa88 tempest-VolumesActionsTest-1534566879 tempest-VolumesActionsTest-1534566879-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:49:23.783519 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-e671263a-d9e6-4cf4-9781-a1f2455daa88 tempest-VolumesActionsTest-1534566879 tempest-VolumesActionsTest-1534566879-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:49:23.784281 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-e671263a-d9e6-4cf4-9781-a1f2455daa88 tempest-VolumesActionsTest-1534566879 tempest-VolumesActionsTest-1534566879-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:49:23.784717 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-e671263a-d9e6-4cf4-9781-a1f2455daa88 tempest-VolumesActionsTest-1534566879 tempest-VolumesActionsTest-1534566879-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:49:23.911722 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.policy [None req-e671263a-d9e6-4cf4-9781-a1f2455daa88 tempest-VolumesActionsTest-1534566879 tempest-VolumesActionsTest-1534566879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0156ed87a5b4efca7ef5056429db1a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71b09f9f20b340b5a615b24e05312703', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128729) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:49:23.918967 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: INFO nova.api.openstack.requestlog [None req-e671263a-d9e6-4cf4-9781-a1f2455daa88 tempest-VolumesActionsTest-1534566879 tempest-VolumesActionsTest-1534566879-project] 10.222.0.61 "GET /compute/v2.1/servers/656dffc0-256e-40ba-b670-f08e247a0d95" status: 200 len: 1314 microversion: 2.1 time: 0.146080 May 14 15:49:23.919510 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: [pid: 128729|app: 0|req: 229/474] 10.222.0.61 () {58 vars in 1235 bytes} [Sat May 14 15:49:23 2022] GET /compute/v2.1/servers/656dffc0-256e-40ba-b670-f08e247a0d95 => generated 1314 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 15:49:24.583960 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi [None req-32126a7c-e981-4979-a6e4-b6d0034d8098 tempest-TestMinimumBasicScenario-1817438735 tempest-TestMinimumBasicScenario-1817438735-project] Calling method '>' {{(pid=128728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 15:49:24.584567 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.compute.api [None req-32126a7c-e981-4979-a6e4-b6d0034d8098 tempest-TestMinimumBasicScenario-1817438735 tempest-TestMinimumBasicScenario-1817438735-project] [instance: ef63d04a-87e5-4202-a672-d45a2a877c68] Fetching instance by UUID {{(pid=128728) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 15:49:24.590952 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-32126a7c-e981-4979-a6e4-b6d0034d8098 tempest-TestMinimumBasicScenario-1817438735 tempest-TestMinimumBasicScenario-1817438735-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:49:24.591396 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-32126a7c-e981-4979-a6e4-b6d0034d8098 tempest-TestMinimumBasicScenario-1817438735 tempest-TestMinimumBasicScenario-1817438735-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:49:24.592348 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-32126a7c-e981-4979-a6e4-b6d0034d8098 tempest-TestMinimumBasicScenario-1817438735 tempest-TestMinimumBasicScenario-1817438735-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:49:24.592780 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-32126a7c-e981-4979-a6e4-b6d0034d8098 tempest-TestMinimumBasicScenario-1817438735 tempest-TestMinimumBasicScenario-1817438735-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:49:24.722667 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.policy [None req-32126a7c-e981-4979-a6e4-b6d0034d8098 tempest-TestMinimumBasicScenario-1817438735 tempest-TestMinimumBasicScenario-1817438735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d5f259e0b98457ea6b6b88d886c813d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fba11e8ade54d388361c4c936a43372', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128728) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:49:24.733662 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: INFO nova.api.openstack.requestlog [None req-32126a7c-e981-4979-a6e4-b6d0034d8098 tempest-TestMinimumBasicScenario-1817438735 tempest-TestMinimumBasicScenario-1817438735-project] 10.222.0.61 "GET /compute/v2.1/servers/ef63d04a-87e5-4202-a672-d45a2a877c68" status: 200 len: 1357 microversion: 2.1 time: 0.153259 May 14 15:49:24.743099 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: [pid: 128728|app: 0|req: 246/475] 10.222.0.61 () {58 vars in 1235 bytes} [Sat May 14 15:49:24 2022] GET /compute/v2.1/servers/ef63d04a-87e5-4202-a672-d45a2a877c68 => generated 1357 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 15:49:24.760516 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi [None req-3bdb892b-57b5-410e-b5d5-978894b1ccee tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Calling method '>' {{(pid=128729) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 15:49:24.761129 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.compute.api [None req-3bdb892b-57b5-410e-b5d5-978894b1ccee tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] [instance: 7c21adbe-7a79-46cf-aa7c-9b2a6548c767] Fetching instance by UUID {{(pid=128729) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 15:49:24.767560 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi [None req-1611539d-7b79-4019-a873-ac6bb10bba7b tempest-VolumesNegativeTest-1107689494 tempest-VolumesNegativeTest-1107689494-project] Calling method '>' {{(pid=128728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 15:49:24.768167 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.compute.api [None req-1611539d-7b79-4019-a873-ac6bb10bba7b tempest-VolumesNegativeTest-1107689494 tempest-VolumesNegativeTest-1107689494-project] [instance: ea1f238d-3bae-4ce8-b328-d07fc2f7f272] Fetching instance by UUID {{(pid=128728) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 15:49:24.768404 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-3bdb892b-57b5-410e-b5d5-978894b1ccee tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:49:24.768954 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-3bdb892b-57b5-410e-b5d5-978894b1ccee tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:49:24.769835 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-3bdb892b-57b5-410e-b5d5-978894b1ccee tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:49:24.770552 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-3bdb892b-57b5-410e-b5d5-978894b1ccee tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:49:24.773963 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-1611539d-7b79-4019-a873-ac6bb10bba7b tempest-VolumesNegativeTest-1107689494 tempest-VolumesNegativeTest-1107689494-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:49:24.774574 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-1611539d-7b79-4019-a873-ac6bb10bba7b tempest-VolumesNegativeTest-1107689494 tempest-VolumesNegativeTest-1107689494-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:49:24.775700 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-1611539d-7b79-4019-a873-ac6bb10bba7b tempest-VolumesNegativeTest-1107689494 tempest-VolumesNegativeTest-1107689494-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:49:24.775793 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-1611539d-7b79-4019-a873-ac6bb10bba7b tempest-VolumesNegativeTest-1107689494 tempest-VolumesNegativeTest-1107689494-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:49:24.861374 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.policy [None req-3bdb892b-57b5-410e-b5d5-978894b1ccee tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b896317d96a40d6a137db0dcf5f98f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d2517d5440a4d30949f3dd36a46d813', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128729) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:49:24.868719 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: INFO nova.api.openstack.requestlog [None req-3bdb892b-57b5-410e-b5d5-978894b1ccee tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] 10.222.0.61 "GET /compute/v2.1/servers/7c21adbe-7a79-46cf-aa7c-9b2a6548c767" status: 200 len: 1248 microversion: 2.1 time: 0.112015 May 14 15:49:24.869282 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: [pid: 128729|app: 0|req: 230/476] 10.222.0.61 () {58 vars in 1235 bytes} [Sat May 14 15:49:24 2022] GET /compute/v2.1/servers/7c21adbe-7a79-46cf-aa7c-9b2a6548c767 => generated 1248 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 15:49:24.927420 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.policy [None req-1611539d-7b79-4019-a873-ac6bb10bba7b tempest-VolumesNegativeTest-1107689494 tempest-VolumesNegativeTest-1107689494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e8303a1f1584ae2aae774eaf31481f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1e7c6697dfc4562b4c1d46ee21964a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128728) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:49:24.935098 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi [None req-54592308-c277-4d2f-9e74-c4d2c12c2e9b tempest-VolumesActionsTest-1534566879 tempest-VolumesActionsTest-1534566879-project] Calling method '>' {{(pid=128729) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 15:49:24.935290 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: INFO nova.api.openstack.requestlog [None req-1611539d-7b79-4019-a873-ac6bb10bba7b tempest-VolumesNegativeTest-1107689494 tempest-VolumesNegativeTest-1107689494-project] 10.222.0.61 "GET /compute/v2.1/servers/ea1f238d-3bae-4ce8-b328-d07fc2f7f272" status: 200 len: 1315 microversion: 2.1 time: 0.171614 May 14 15:49:24.935699 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.compute.api [None req-54592308-c277-4d2f-9e74-c4d2c12c2e9b tempest-VolumesActionsTest-1534566879 tempest-VolumesActionsTest-1534566879-project] [instance: 656dffc0-256e-40ba-b670-f08e247a0d95] Fetching instance by UUID {{(pid=128729) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 15:49:24.935828 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: [pid: 128728|app: 0|req: 247/477] 10.222.0.61 () {58 vars in 1235 bytes} [Sat May 14 15:49:24 2022] GET /compute/v2.1/servers/ea1f238d-3bae-4ce8-b328-d07fc2f7f272 => generated 1315 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 15:49:24.941951 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-54592308-c277-4d2f-9e74-c4d2c12c2e9b tempest-VolumesActionsTest-1534566879 tempest-VolumesActionsTest-1534566879-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:49:24.942558 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-54592308-c277-4d2f-9e74-c4d2c12c2e9b tempest-VolumesActionsTest-1534566879 tempest-VolumesActionsTest-1534566879-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:49:24.943558 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-54592308-c277-4d2f-9e74-c4d2c12c2e9b tempest-VolumesActionsTest-1534566879 tempest-VolumesActionsTest-1534566879-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:49:24.944017 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-54592308-c277-4d2f-9e74-c4d2c12c2e9b tempest-VolumesActionsTest-1534566879 tempest-VolumesActionsTest-1534566879-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:49:25.074453 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.policy [None req-54592308-c277-4d2f-9e74-c4d2c12c2e9b tempest-VolumesActionsTest-1534566879 tempest-VolumesActionsTest-1534566879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0156ed87a5b4efca7ef5056429db1a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71b09f9f20b340b5a615b24e05312703', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128729) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:49:25.082237 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: INFO nova.api.openstack.requestlog [None req-54592308-c277-4d2f-9e74-c4d2c12c2e9b tempest-VolumesActionsTest-1534566879 tempest-VolumesActionsTest-1534566879-project] 10.222.0.61 "GET /compute/v2.1/servers/656dffc0-256e-40ba-b670-f08e247a0d95" status: 200 len: 1314 microversion: 2.1 time: 0.150841 May 14 15:49:25.086335 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: [pid: 128729|app: 0|req: 231/478] 10.222.0.61 () {58 vars in 1235 bytes} [Sat May 14 15:49:24 2022] GET /compute/v2.1/servers/656dffc0-256e-40ba-b670-f08e247a0d95 => generated 1314 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 15:49:25.751201 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi [None req-0766c9d6-f187-40e9-80c6-52f577092c0e tempest-TestMinimumBasicScenario-1817438735 tempest-TestMinimumBasicScenario-1817438735-project] Calling method '>' {{(pid=128728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 15:49:25.751810 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.compute.api [None req-0766c9d6-f187-40e9-80c6-52f577092c0e tempest-TestMinimumBasicScenario-1817438735 tempest-TestMinimumBasicScenario-1817438735-project] [instance: ef63d04a-87e5-4202-a672-d45a2a877c68] Fetching instance by UUID {{(pid=128728) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 15:49:25.757732 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-0766c9d6-f187-40e9-80c6-52f577092c0e tempest-TestMinimumBasicScenario-1817438735 tempest-TestMinimumBasicScenario-1817438735-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:49:25.758186 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-0766c9d6-f187-40e9-80c6-52f577092c0e tempest-TestMinimumBasicScenario-1817438735 tempest-TestMinimumBasicScenario-1817438735-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:49:25.759055 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-0766c9d6-f187-40e9-80c6-52f577092c0e tempest-TestMinimumBasicScenario-1817438735 tempest-TestMinimumBasicScenario-1817438735-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:49:25.759438 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-0766c9d6-f187-40e9-80c6-52f577092c0e tempest-TestMinimumBasicScenario-1817438735 tempest-TestMinimumBasicScenario-1817438735-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:49:25.863987 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi [req-370b9a1d-3853-48dc-8d6c-2e106ddbe7a1 req-b71fe38f-f9ed-4f16-abfa-6a88bbe951c9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ef63d04a-87e5-4202-a672-d45a2a877c68", "name": "network-vif-plugged", "status": "completed", "tag": "61226c22-8028-48c9-8e04-0f0c0cf9fa30"}]} {{(pid=128729) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 15:49:25.879595 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [req-370b9a1d-3853-48dc-8d6c-2e106ddbe7a1 req-b71fe38f-f9ed-4f16-abfa-6a88bbe951c9 service nova] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:49:25.881581 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [req-370b9a1d-3853-48dc-8d6c-2e106ddbe7a1 req-b71fe38f-f9ed-4f16-abfa-6a88bbe951c9 service nova] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:49:25.896229 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: INFO nova.api.openstack.compute.server_external_events [req-370b9a1d-3853-48dc-8d6c-2e106ddbe7a1 req-b71fe38f-f9ed-4f16-abfa-6a88bbe951c9 service nova] Creating event network-vif-plugged:61226c22-8028-48c9-8e04-0f0c0cf9fa30 for instance ef63d04a-87e5-4202-a672-d45a2a877c68 on hv-cinder-83979 May 14 15:49:25.904390 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: INFO nova.api.openstack.requestlog [req-370b9a1d-3853-48dc-8d6c-2e106ddbe7a1 req-b71fe38f-f9ed-4f16-abfa-6a88bbe951c9 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044204 May 14 15:49:25.905693 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: [pid: 128729|app: 0|req: 232/479] 10.222.0.61 () {64 vars in 1317 bytes} [Sat May 14 15:49:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 14 15:49:25.913637 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi [None req-e9d446f5-b51f-4f12-912d-0aa0fa645c17 tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Calling method '>' {{(pid=128729) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 15:49:25.914739 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.compute.api [None req-e9d446f5-b51f-4f12-912d-0aa0fa645c17 tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] [instance: 7c21adbe-7a79-46cf-aa7c-9b2a6548c767] Fetching instance by UUID {{(pid=128729) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 15:49:25.919088 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.policy [None req-0766c9d6-f187-40e9-80c6-52f577092c0e tempest-TestMinimumBasicScenario-1817438735 tempest-TestMinimumBasicScenario-1817438735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d5f259e0b98457ea6b6b88d886c813d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fba11e8ade54d388361c4c936a43372', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128728) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:49:25.924591 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-e9d446f5-b51f-4f12-912d-0aa0fa645c17 tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:49:25.925283 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-e9d446f5-b51f-4f12-912d-0aa0fa645c17 tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:49:25.926179 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-e9d446f5-b51f-4f12-912d-0aa0fa645c17 tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:49:25.926737 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-e9d446f5-b51f-4f12-912d-0aa0fa645c17 tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:49:25.930746 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: INFO nova.api.openstack.requestlog [None req-0766c9d6-f187-40e9-80c6-52f577092c0e tempest-TestMinimumBasicScenario-1817438735 tempest-TestMinimumBasicScenario-1817438735-project] 10.222.0.61 "GET /compute/v2.1/servers/ef63d04a-87e5-4202-a672-d45a2a877c68" status: 200 len: 1357 microversion: 2.1 time: 0.183312 May 14 15:49:25.939863 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: [pid: 128728|app: 0|req: 248/480] 10.222.0.61 () {58 vars in 1235 bytes} [Sat May 14 15:49:25 2022] GET /compute/v2.1/servers/ef63d04a-87e5-4202-a672-d45a2a877c68 => generated 1357 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 15:49:25.952078 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi [None req-bdbbd506-feb4-43a4-a46d-ac6c3be5b871 tempest-VolumesNegativeTest-1107689494 tempest-VolumesNegativeTest-1107689494-project] Calling method '>' {{(pid=128728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 15:49:25.952839 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.compute.api [None req-bdbbd506-feb4-43a4-a46d-ac6c3be5b871 tempest-VolumesNegativeTest-1107689494 tempest-VolumesNegativeTest-1107689494-project] [instance: ea1f238d-3bae-4ce8-b328-d07fc2f7f272] Fetching instance by UUID {{(pid=128728) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 15:49:25.959286 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-bdbbd506-feb4-43a4-a46d-ac6c3be5b871 tempest-VolumesNegativeTest-1107689494 tempest-VolumesNegativeTest-1107689494-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:49:25.959839 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-bdbbd506-feb4-43a4-a46d-ac6c3be5b871 tempest-VolumesNegativeTest-1107689494 tempest-VolumesNegativeTest-1107689494-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:49:25.960900 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-bdbbd506-feb4-43a4-a46d-ac6c3be5b871 tempest-VolumesNegativeTest-1107689494 tempest-VolumesNegativeTest-1107689494-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:49:25.961430 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-bdbbd506-feb4-43a4-a46d-ac6c3be5b871 tempest-VolumesNegativeTest-1107689494 tempest-VolumesNegativeTest-1107689494-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:49:26.006215 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.policy [None req-e9d446f5-b51f-4f12-912d-0aa0fa645c17 tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b896317d96a40d6a137db0dcf5f98f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d2517d5440a4d30949f3dd36a46d813', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128729) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:49:26.020290 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: INFO nova.api.openstack.requestlog [None req-e9d446f5-b51f-4f12-912d-0aa0fa645c17 tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] 10.222.0.61 "GET /compute/v2.1/servers/7c21adbe-7a79-46cf-aa7c-9b2a6548c767" status: 200 len: 1248 microversion: 2.1 time: 0.112183 May 14 15:49:26.020889 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: [pid: 128729|app: 0|req: 233/481] 10.222.0.61 () {58 vars in 1235 bytes} [Sat May 14 15:49:25 2022] GET /compute/v2.1/servers/7c21adbe-7a79-46cf-aa7c-9b2a6548c767 => generated 1248 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 15:49:26.101103 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi [None req-8cac9810-0416-4629-85f2-4b58188cbc10 tempest-VolumesActionsTest-1534566879 tempest-VolumesActionsTest-1534566879-project] Calling method '>' {{(pid=128729) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 15:49:26.101878 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.compute.api [None req-8cac9810-0416-4629-85f2-4b58188cbc10 tempest-VolumesActionsTest-1534566879 tempest-VolumesActionsTest-1534566879-project] [instance: 656dffc0-256e-40ba-b670-f08e247a0d95] Fetching instance by UUID {{(pid=128729) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 15:49:26.108361 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-8cac9810-0416-4629-85f2-4b58188cbc10 tempest-VolumesActionsTest-1534566879 tempest-VolumesActionsTest-1534566879-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:49:26.108823 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-8cac9810-0416-4629-85f2-4b58188cbc10 tempest-VolumesActionsTest-1534566879 tempest-VolumesActionsTest-1534566879-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:49:26.109603 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-8cac9810-0416-4629-85f2-4b58188cbc10 tempest-VolumesActionsTest-1534566879 tempest-VolumesActionsTest-1534566879-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:49:26.110087 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-8cac9810-0416-4629-85f2-4b58188cbc10 tempest-VolumesActionsTest-1534566879 tempest-VolumesActionsTest-1534566879-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:49:26.127843 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.policy [None req-bdbbd506-feb4-43a4-a46d-ac6c3be5b871 tempest-VolumesNegativeTest-1107689494 tempest-VolumesNegativeTest-1107689494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e8303a1f1584ae2aae774eaf31481f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1e7c6697dfc4562b4c1d46ee21964a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128728) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:49:26.137795 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: INFO nova.api.openstack.requestlog [None req-bdbbd506-feb4-43a4-a46d-ac6c3be5b871 tempest-VolumesNegativeTest-1107689494 tempest-VolumesNegativeTest-1107689494-project] 10.222.0.61 "GET /compute/v2.1/servers/ea1f238d-3bae-4ce8-b328-d07fc2f7f272" status: 200 len: 1315 microversion: 2.1 time: 0.189882 May 14 15:49:26.147399 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: [pid: 128728|app: 0|req: 249/482] 10.222.0.61 () {58 vars in 1235 bytes} [Sat May 14 15:49:25 2022] GET /compute/v2.1/servers/ea1f238d-3bae-4ce8-b328-d07fc2f7f272 => generated 1315 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 15:49:26.260114 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.policy [None req-8cac9810-0416-4629-85f2-4b58188cbc10 tempest-VolumesActionsTest-1534566879 tempest-VolumesActionsTest-1534566879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0156ed87a5b4efca7ef5056429db1a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71b09f9f20b340b5a615b24e05312703', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128729) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:49:26.267534 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: INFO nova.api.openstack.requestlog [None req-8cac9810-0416-4629-85f2-4b58188cbc10 tempest-VolumesActionsTest-1534566879 tempest-VolumesActionsTest-1534566879-project] 10.222.0.61 "GET /compute/v2.1/servers/656dffc0-256e-40ba-b670-f08e247a0d95" status: 200 len: 1314 microversion: 2.1 time: 0.170596 May 14 15:49:26.268097 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: [pid: 128729|app: 0|req: 234/483] 10.222.0.61 () {58 vars in 1235 bytes} [Sat May 14 15:49:26 2022] GET /compute/v2.1/servers/656dffc0-256e-40ba-b670-f08e247a0d95 => generated 1314 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 15:49:26.947350 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi [None req-93e30eb8-ec8b-403e-9444-14dcfd6fbb24 tempest-TestMinimumBasicScenario-1817438735 tempest-TestMinimumBasicScenario-1817438735-project] Calling method '>' {{(pid=128728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 15:49:26.948010 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.compute.api [None req-93e30eb8-ec8b-403e-9444-14dcfd6fbb24 tempest-TestMinimumBasicScenario-1817438735 tempest-TestMinimumBasicScenario-1817438735-project] [instance: ef63d04a-87e5-4202-a672-d45a2a877c68] Fetching instance by UUID {{(pid=128728) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 15:49:26.953827 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-93e30eb8-ec8b-403e-9444-14dcfd6fbb24 tempest-TestMinimumBasicScenario-1817438735 tempest-TestMinimumBasicScenario-1817438735-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:49:26.954276 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-93e30eb8-ec8b-403e-9444-14dcfd6fbb24 tempest-TestMinimumBasicScenario-1817438735 tempest-TestMinimumBasicScenario-1817438735-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:49:26.955069 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-93e30eb8-ec8b-403e-9444-14dcfd6fbb24 tempest-TestMinimumBasicScenario-1817438735 tempest-TestMinimumBasicScenario-1817438735-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:49:26.955506 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-93e30eb8-ec8b-403e-9444-14dcfd6fbb24 tempest-TestMinimumBasicScenario-1817438735 tempest-TestMinimumBasicScenario-1817438735-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:49:27.036856 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi [None req-2bcf66fe-161c-4f5c-8183-022bd3faae5e tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Calling method '>' {{(pid=128729) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 15:49:27.037455 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.compute.api [None req-2bcf66fe-161c-4f5c-8183-022bd3faae5e tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] [instance: 7c21adbe-7a79-46cf-aa7c-9b2a6548c767] Fetching instance by UUID {{(pid=128729) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 15:49:27.044598 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-2bcf66fe-161c-4f5c-8183-022bd3faae5e tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:49:27.045045 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-2bcf66fe-161c-4f5c-8183-022bd3faae5e tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:49:27.045812 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-2bcf66fe-161c-4f5c-8183-022bd3faae5e tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:49:27.046245 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-2bcf66fe-161c-4f5c-8183-022bd3faae5e tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:49:27.097532 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.policy [None req-93e30eb8-ec8b-403e-9444-14dcfd6fbb24 tempest-TestMinimumBasicScenario-1817438735 tempest-TestMinimumBasicScenario-1817438735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d5f259e0b98457ea6b6b88d886c813d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fba11e8ade54d388361c4c936a43372', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128728) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:49:27.105605 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: INFO nova.api.openstack.requestlog [None req-93e30eb8-ec8b-403e-9444-14dcfd6fbb24 tempest-TestMinimumBasicScenario-1817438735 tempest-TestMinimumBasicScenario-1817438735-project] 10.222.0.61 "GET /compute/v2.1/servers/ef63d04a-87e5-4202-a672-d45a2a877c68" status: 200 len: 1357 microversion: 2.1 time: 0.162035 May 14 15:49:27.106169 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: [pid: 128728|app: 0|req: 250/484] 10.222.0.61 () {58 vars in 1235 bytes} [Sat May 14 15:49:26 2022] GET /compute/v2.1/servers/ef63d04a-87e5-4202-a672-d45a2a877c68 => generated 1357 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 15:49:27.114797 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.policy [None req-2bcf66fe-161c-4f5c-8183-022bd3faae5e tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b896317d96a40d6a137db0dcf5f98f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d2517d5440a4d30949f3dd36a46d813', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128729) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:49:27.122031 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: INFO nova.api.openstack.requestlog [None req-2bcf66fe-161c-4f5c-8183-022bd3faae5e tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] 10.222.0.61 "GET /compute/v2.1/servers/7c21adbe-7a79-46cf-aa7c-9b2a6548c767" status: 200 len: 1296 microversion: 2.1 time: 0.088976 May 14 15:49:27.122621 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: [pid: 128729|app: 0|req: 235/485] 10.222.0.61 () {58 vars in 1235 bytes} [Sat May 14 15:49:27 2022] GET /compute/v2.1/servers/7c21adbe-7a79-46cf-aa7c-9b2a6548c767 => generated 1296 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 15:49:27.154864 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi [None req-136667b1-64a0-41bb-981e-dc5dd1dd6194 tempest-VolumesNegativeTest-1107689494 tempest-VolumesNegativeTest-1107689494-project] Calling method '>' {{(pid=128728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 15:49:27.155500 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.compute.api [None req-136667b1-64a0-41bb-981e-dc5dd1dd6194 tempest-VolumesNegativeTest-1107689494 tempest-VolumesNegativeTest-1107689494-project] [instance: ea1f238d-3bae-4ce8-b328-d07fc2f7f272] Fetching instance by UUID {{(pid=128728) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 15:49:27.161305 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-136667b1-64a0-41bb-981e-dc5dd1dd6194 tempest-VolumesNegativeTest-1107689494 tempest-VolumesNegativeTest-1107689494-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:49:27.161758 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-136667b1-64a0-41bb-981e-dc5dd1dd6194 tempest-VolumesNegativeTest-1107689494 tempest-VolumesNegativeTest-1107689494-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:49:27.162551 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-136667b1-64a0-41bb-981e-dc5dd1dd6194 tempest-VolumesNegativeTest-1107689494 tempest-VolumesNegativeTest-1107689494-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:49:27.162987 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-136667b1-64a0-41bb-981e-dc5dd1dd6194 tempest-VolumesNegativeTest-1107689494 tempest-VolumesNegativeTest-1107689494-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:49:27.286161 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi [None req-0bda4028-8c34-489c-9e19-e345752f5f02 tempest-VolumesActionsTest-1534566879 tempest-VolumesActionsTest-1534566879-project] Calling method '>' {{(pid=128729) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 15:49:27.286833 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.compute.api [None req-0bda4028-8c34-489c-9e19-e345752f5f02 tempest-VolumesActionsTest-1534566879 tempest-VolumesActionsTest-1534566879-project] [instance: 656dffc0-256e-40ba-b670-f08e247a0d95] Fetching instance by UUID {{(pid=128729) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 15:49:27.307889 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-0bda4028-8c34-489c-9e19-e345752f5f02 tempest-VolumesActionsTest-1534566879 tempest-VolumesActionsTest-1534566879-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:49:27.308346 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-0bda4028-8c34-489c-9e19-e345752f5f02 tempest-VolumesActionsTest-1534566879 tempest-VolumesActionsTest-1534566879-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:49:27.309148 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-0bda4028-8c34-489c-9e19-e345752f5f02 tempest-VolumesActionsTest-1534566879 tempest-VolumesActionsTest-1534566879-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:49:27.314178 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-0bda4028-8c34-489c-9e19-e345752f5f02 tempest-VolumesActionsTest-1534566879 tempest-VolumesActionsTest-1534566879-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:49:27.430136 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.policy [None req-136667b1-64a0-41bb-981e-dc5dd1dd6194 tempest-VolumesNegativeTest-1107689494 tempest-VolumesNegativeTest-1107689494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e8303a1f1584ae2aae774eaf31481f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1e7c6697dfc4562b4c1d46ee21964a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128728) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:49:27.439236 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: INFO nova.api.openstack.requestlog [None req-136667b1-64a0-41bb-981e-dc5dd1dd6194 tempest-VolumesNegativeTest-1107689494 tempest-VolumesNegativeTest-1107689494-project] 10.222.0.61 "GET /compute/v2.1/servers/ea1f238d-3bae-4ce8-b328-d07fc2f7f272" status: 200 len: 1315 microversion: 2.1 time: 0.288509 May 14 15:49:27.439749 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: [pid: 128728|app: 0|req: 251/486] 10.222.0.61 () {58 vars in 1235 bytes} [Sat May 14 15:49:27 2022] GET /compute/v2.1/servers/ea1f238d-3bae-4ce8-b328-d07fc2f7f272 => generated 1315 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 15:49:27.499671 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.policy [None req-0bda4028-8c34-489c-9e19-e345752f5f02 tempest-VolumesActionsTest-1534566879 tempest-VolumesActionsTest-1534566879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0156ed87a5b4efca7ef5056429db1a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71b09f9f20b340b5a615b24e05312703', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128729) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:49:27.507424 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: INFO nova.api.openstack.requestlog [None req-0bda4028-8c34-489c-9e19-e345752f5f02 tempest-VolumesActionsTest-1534566879 tempest-VolumesActionsTest-1534566879-project] 10.222.0.61 "GET /compute/v2.1/servers/656dffc0-256e-40ba-b670-f08e247a0d95" status: 200 len: 1314 microversion: 2.1 time: 0.226566 May 14 15:49:27.507998 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: [pid: 128729|app: 0|req: 236/487] 10.222.0.61 () {58 vars in 1235 bytes} [Sat May 14 15:49:27 2022] GET /compute/v2.1/servers/656dffc0-256e-40ba-b670-f08e247a0d95 => generated 1314 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 15:49:28.123616 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi [None req-50030c89-dd97-4cb6-b206-6517d410a612 tempest-TestMinimumBasicScenario-1817438735 tempest-TestMinimumBasicScenario-1817438735-project] Calling method '>' {{(pid=128728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 15:49:28.124224 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.compute.api [None req-50030c89-dd97-4cb6-b206-6517d410a612 tempest-TestMinimumBasicScenario-1817438735 tempest-TestMinimumBasicScenario-1817438735-project] [instance: ef63d04a-87e5-4202-a672-d45a2a877c68] Fetching instance by UUID {{(pid=128728) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 15:49:28.131403 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-50030c89-dd97-4cb6-b206-6517d410a612 tempest-TestMinimumBasicScenario-1817438735 tempest-TestMinimumBasicScenario-1817438735-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:49:28.131533 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-50030c89-dd97-4cb6-b206-6517d410a612 tempest-TestMinimumBasicScenario-1817438735 tempest-TestMinimumBasicScenario-1817438735-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:49:28.133931 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-50030c89-dd97-4cb6-b206-6517d410a612 tempest-TestMinimumBasicScenario-1817438735 tempest-TestMinimumBasicScenario-1817438735-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:49:28.134518 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-50030c89-dd97-4cb6-b206-6517d410a612 tempest-TestMinimumBasicScenario-1817438735 tempest-TestMinimumBasicScenario-1817438735-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:49:28.143673 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi [None req-c6a3ab6c-593e-4222-9578-bba9c4834f4c tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Calling method '>' {{(pid=128729) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 15:49:28.144366 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.compute.api [None req-c6a3ab6c-593e-4222-9578-bba9c4834f4c tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] [instance: 7c21adbe-7a79-46cf-aa7c-9b2a6548c767] Fetching instance by UUID {{(pid=128729) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 15:49:28.157612 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-c6a3ab6c-593e-4222-9578-bba9c4834f4c tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:49:28.160914 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-c6a3ab6c-593e-4222-9578-bba9c4834f4c tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:49:28.161790 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-c6a3ab6c-593e-4222-9578-bba9c4834f4c tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:49:28.162301 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-c6a3ab6c-593e-4222-9578-bba9c4834f4c tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:49:28.261687 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.policy [None req-c6a3ab6c-593e-4222-9578-bba9c4834f4c tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b896317d96a40d6a137db0dcf5f98f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d2517d5440a4d30949f3dd36a46d813', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128729) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:49:28.268963 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: INFO nova.api.openstack.requestlog [None req-c6a3ab6c-593e-4222-9578-bba9c4834f4c tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] 10.222.0.61 "GET /compute/v2.1/servers/7c21adbe-7a79-46cf-aa7c-9b2a6548c767" status: 200 len: 1296 microversion: 2.1 time: 0.133507 May 14 15:49:28.269537 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: [pid: 128729|app: 0|req: 237/488] 10.222.0.61 () {58 vars in 1235 bytes} [Sat May 14 15:49:28 2022] GET /compute/v2.1/servers/7c21adbe-7a79-46cf-aa7c-9b2a6548c767 => generated 1296 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 15:49:28.359561 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.policy [None req-50030c89-dd97-4cb6-b206-6517d410a612 tempest-TestMinimumBasicScenario-1817438735 tempest-TestMinimumBasicScenario-1817438735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d5f259e0b98457ea6b6b88d886c813d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fba11e8ade54d388361c4c936a43372', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128728) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:49:28.367651 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: INFO nova.api.openstack.requestlog [None req-50030c89-dd97-4cb6-b206-6517d410a612 tempest-TestMinimumBasicScenario-1817438735 tempest-TestMinimumBasicScenario-1817438735-project] 10.222.0.61 "GET /compute/v2.1/servers/ef63d04a-87e5-4202-a672-d45a2a877c68" status: 200 len: 1357 microversion: 2.1 time: 0.248701 May 14 15:49:28.368200 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: [pid: 128728|app: 0|req: 252/489] 10.222.0.61 () {58 vars in 1235 bytes} [Sat May 14 15:49:28 2022] GET /compute/v2.1/servers/ef63d04a-87e5-4202-a672-d45a2a877c68 => generated 1357 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 15:49:28.456211 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi [None req-848ee141-29ac-4f02-844e-4a5d15e385bd tempest-VolumesNegativeTest-1107689494 tempest-VolumesNegativeTest-1107689494-project] Calling method '>' {{(pid=128729) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 15:49:28.456843 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.compute.api [None req-848ee141-29ac-4f02-844e-4a5d15e385bd tempest-VolumesNegativeTest-1107689494 tempest-VolumesNegativeTest-1107689494-project] [instance: ea1f238d-3bae-4ce8-b328-d07fc2f7f272] Fetching instance by UUID {{(pid=128729) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 15:49:28.464194 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-848ee141-29ac-4f02-844e-4a5d15e385bd tempest-VolumesNegativeTest-1107689494 tempest-VolumesNegativeTest-1107689494-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:49:28.464656 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-848ee141-29ac-4f02-844e-4a5d15e385bd tempest-VolumesNegativeTest-1107689494 tempest-VolumesNegativeTest-1107689494-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:49:28.465439 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-848ee141-29ac-4f02-844e-4a5d15e385bd tempest-VolumesNegativeTest-1107689494 tempest-VolumesNegativeTest-1107689494-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:49:28.465880 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-848ee141-29ac-4f02-844e-4a5d15e385bd tempest-VolumesNegativeTest-1107689494 tempest-VolumesNegativeTest-1107689494-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:49:28.524608 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi [None req-5156c3d4-62b9-4992-a554-8f6d74a8e3d9 tempest-VolumesActionsTest-1534566879 tempest-VolumesActionsTest-1534566879-project] Calling method '>' {{(pid=128728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 15:49:28.525224 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.compute.api [None req-5156c3d4-62b9-4992-a554-8f6d74a8e3d9 tempest-VolumesActionsTest-1534566879 tempest-VolumesActionsTest-1534566879-project] [instance: 656dffc0-256e-40ba-b670-f08e247a0d95] Fetching instance by UUID {{(pid=128728) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 15:49:28.532202 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-5156c3d4-62b9-4992-a554-8f6d74a8e3d9 tempest-VolumesActionsTest-1534566879 tempest-VolumesActionsTest-1534566879-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:49:28.532657 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-5156c3d4-62b9-4992-a554-8f6d74a8e3d9 tempest-VolumesActionsTest-1534566879 tempest-VolumesActionsTest-1534566879-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:49:28.533622 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-5156c3d4-62b9-4992-a554-8f6d74a8e3d9 tempest-VolumesActionsTest-1534566879 tempest-VolumesActionsTest-1534566879-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:49:28.534078 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-5156c3d4-62b9-4992-a554-8f6d74a8e3d9 tempest-VolumesActionsTest-1534566879 tempest-VolumesActionsTest-1534566879-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:49:28.649645 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.policy [None req-848ee141-29ac-4f02-844e-4a5d15e385bd tempest-VolumesNegativeTest-1107689494 tempest-VolumesNegativeTest-1107689494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e8303a1f1584ae2aae774eaf31481f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1e7c6697dfc4562b4c1d46ee21964a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128729) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:49:28.657836 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: INFO nova.api.openstack.requestlog [None req-848ee141-29ac-4f02-844e-4a5d15e385bd tempest-VolumesNegativeTest-1107689494 tempest-VolumesNegativeTest-1107689494-project] 10.222.0.61 "GET /compute/v2.1/servers/ea1f238d-3bae-4ce8-b328-d07fc2f7f272" status: 200 len: 1315 microversion: 2.1 time: 0.205424 May 14 15:49:28.662232 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: [pid: 128729|app: 0|req: 238/490] 10.222.0.61 () {58 vars in 1235 bytes} [Sat May 14 15:49:28 2022] GET /compute/v2.1/servers/ea1f238d-3bae-4ce8-b328-d07fc2f7f272 => generated 1315 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 15:49:28.728712 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.policy [None req-5156c3d4-62b9-4992-a554-8f6d74a8e3d9 tempest-VolumesActionsTest-1534566879 tempest-VolumesActionsTest-1534566879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0156ed87a5b4efca7ef5056429db1a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71b09f9f20b340b5a615b24e05312703', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128728) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:49:28.737891 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: INFO nova.api.openstack.requestlog [None req-5156c3d4-62b9-4992-a554-8f6d74a8e3d9 tempest-VolumesActionsTest-1534566879 tempest-VolumesActionsTest-1534566879-project] 10.222.0.61 "GET /compute/v2.1/servers/656dffc0-256e-40ba-b670-f08e247a0d95" status: 200 len: 1314 microversion: 2.1 time: 0.216568 May 14 15:49:28.746757 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: [pid: 128728|app: 0|req: 253/491] 10.222.0.61 () {58 vars in 1235 bytes} [Sat May 14 15:49:28 2022] GET /compute/v2.1/servers/656dffc0-256e-40ba-b670-f08e247a0d95 => generated 1314 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 15:49:29.286131 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi [None req-b2385fad-a720-40b0-ab5b-80643b37b227 tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Calling method '>' {{(pid=128729) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 15:49:29.286767 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.compute.api [None req-b2385fad-a720-40b0-ab5b-80643b37b227 tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] [instance: 7c21adbe-7a79-46cf-aa7c-9b2a6548c767] Fetching instance by UUID {{(pid=128729) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 15:49:29.293720 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-b2385fad-a720-40b0-ab5b-80643b37b227 tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:49:29.294430 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-b2385fad-a720-40b0-ab5b-80643b37b227 tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:49:29.295200 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-b2385fad-a720-40b0-ab5b-80643b37b227 tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:49:29.295634 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-b2385fad-a720-40b0-ab5b-80643b37b227 tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:49:29.358281 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.policy [None req-b2385fad-a720-40b0-ab5b-80643b37b227 tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b896317d96a40d6a137db0dcf5f98f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d2517d5440a4d30949f3dd36a46d813', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128729) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:49:29.365767 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: INFO nova.api.openstack.requestlog [None req-b2385fad-a720-40b0-ab5b-80643b37b227 tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] 10.222.0.61 "GET /compute/v2.1/servers/7c21adbe-7a79-46cf-aa7c-9b2a6548c767" status: 200 len: 1296 microversion: 2.1 time: 0.083474 May 14 15:49:29.366379 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: [pid: 128729|app: 0|req: 239/492] 10.222.0.61 () {58 vars in 1235 bytes} [Sat May 14 15:49:29 2022] GET /compute/v2.1/servers/7c21adbe-7a79-46cf-aa7c-9b2a6548c767 => generated 1296 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 15:49:29.384776 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi [None req-164ea3f0-ceff-4f6b-842f-0f77e8e4ed07 tempest-TestMinimumBasicScenario-1817438735 tempest-TestMinimumBasicScenario-1817438735-project] Calling method '>' {{(pid=128728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 15:49:29.386673 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.compute.api [None req-164ea3f0-ceff-4f6b-842f-0f77e8e4ed07 tempest-TestMinimumBasicScenario-1817438735 tempest-TestMinimumBasicScenario-1817438735-project] [instance: ef63d04a-87e5-4202-a672-d45a2a877c68] Fetching instance by UUID {{(pid=128728) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 15:49:29.392464 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-164ea3f0-ceff-4f6b-842f-0f77e8e4ed07 tempest-TestMinimumBasicScenario-1817438735 tempest-TestMinimumBasicScenario-1817438735-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:49:29.392918 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-164ea3f0-ceff-4f6b-842f-0f77e8e4ed07 tempest-TestMinimumBasicScenario-1817438735 tempest-TestMinimumBasicScenario-1817438735-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:49:29.393696 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-164ea3f0-ceff-4f6b-842f-0f77e8e4ed07 tempest-TestMinimumBasicScenario-1817438735 tempest-TestMinimumBasicScenario-1817438735-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:49:29.394137 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-164ea3f0-ceff-4f6b-842f-0f77e8e4ed07 tempest-TestMinimumBasicScenario-1817438735 tempest-TestMinimumBasicScenario-1817438735-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:49:29.523668 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.policy [None req-164ea3f0-ceff-4f6b-842f-0f77e8e4ed07 tempest-TestMinimumBasicScenario-1817438735 tempest-TestMinimumBasicScenario-1817438735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d5f259e0b98457ea6b6b88d886c813d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fba11e8ade54d388361c4c936a43372', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128728) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:49:29.532135 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: INFO nova.api.openstack.requestlog [None req-164ea3f0-ceff-4f6b-842f-0f77e8e4ed07 tempest-TestMinimumBasicScenario-1817438735 tempest-TestMinimumBasicScenario-1817438735-project] 10.222.0.61 "GET /compute/v2.1/servers/ef63d04a-87e5-4202-a672-d45a2a877c68" status: 200 len: 1357 microversion: 2.1 time: 0.151449 May 14 15:49:29.532776 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: [pid: 128728|app: 0|req: 254/493] 10.222.0.61 () {58 vars in 1235 bytes} [Sat May 14 15:49:29 2022] GET /compute/v2.1/servers/ef63d04a-87e5-4202-a672-d45a2a877c68 => generated 1357 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 15:49:29.678814 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi [None req-9b73fe49-659b-4bca-afe3-a825daad0ca2 tempest-VolumesNegativeTest-1107689494 tempest-VolumesNegativeTest-1107689494-project] Calling method '>' {{(pid=128729) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 15:49:29.679427 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.compute.api [None req-9b73fe49-659b-4bca-afe3-a825daad0ca2 tempest-VolumesNegativeTest-1107689494 tempest-VolumesNegativeTest-1107689494-project] [instance: ea1f238d-3bae-4ce8-b328-d07fc2f7f272] Fetching instance by UUID {{(pid=128729) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 15:49:29.685229 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-9b73fe49-659b-4bca-afe3-a825daad0ca2 tempest-VolumesNegativeTest-1107689494 tempest-VolumesNegativeTest-1107689494-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:49:29.685680 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-9b73fe49-659b-4bca-afe3-a825daad0ca2 tempest-VolumesNegativeTest-1107689494 tempest-VolumesNegativeTest-1107689494-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:49:29.686510 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-9b73fe49-659b-4bca-afe3-a825daad0ca2 tempest-VolumesNegativeTest-1107689494 tempest-VolumesNegativeTest-1107689494-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:49:29.686950 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-9b73fe49-659b-4bca-afe3-a825daad0ca2 tempest-VolumesNegativeTest-1107689494 tempest-VolumesNegativeTest-1107689494-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:49:29.755852 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi [None req-9ad28a53-80df-4dae-99f3-acf6dcd4e085 tempest-VolumesActionsTest-1534566879 tempest-VolumesActionsTest-1534566879-project] Calling method '>' {{(pid=128728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 15:49:29.756588 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.compute.api [None req-9ad28a53-80df-4dae-99f3-acf6dcd4e085 tempest-VolumesActionsTest-1534566879 tempest-VolumesActionsTest-1534566879-project] [instance: 656dffc0-256e-40ba-b670-f08e247a0d95] Fetching instance by UUID {{(pid=128728) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 15:49:29.763918 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-9ad28a53-80df-4dae-99f3-acf6dcd4e085 tempest-VolumesActionsTest-1534566879 tempest-VolumesActionsTest-1534566879-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:49:29.764447 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-9ad28a53-80df-4dae-99f3-acf6dcd4e085 tempest-VolumesActionsTest-1534566879 tempest-VolumesActionsTest-1534566879-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:49:29.765475 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-9ad28a53-80df-4dae-99f3-acf6dcd4e085 tempest-VolumesActionsTest-1534566879 tempest-VolumesActionsTest-1534566879-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:49:29.765911 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-9ad28a53-80df-4dae-99f3-acf6dcd4e085 tempest-VolumesActionsTest-1534566879 tempest-VolumesActionsTest-1534566879-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:49:29.859068 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.policy [None req-9b73fe49-659b-4bca-afe3-a825daad0ca2 tempest-VolumesNegativeTest-1107689494 tempest-VolumesNegativeTest-1107689494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e8303a1f1584ae2aae774eaf31481f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1e7c6697dfc4562b4c1d46ee21964a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128729) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:49:29.867215 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: INFO nova.api.openstack.requestlog [None req-9b73fe49-659b-4bca-afe3-a825daad0ca2 tempest-VolumesNegativeTest-1107689494 tempest-VolumesNegativeTest-1107689494-project] 10.222.0.61 "GET /compute/v2.1/servers/ea1f238d-3bae-4ce8-b328-d07fc2f7f272" status: 200 len: 1315 microversion: 2.1 time: 0.192324 May 14 15:49:29.871270 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: [pid: 128729|app: 0|req: 240/494] 10.222.0.61 () {58 vars in 1235 bytes} [Sat May 14 15:49:29 2022] GET /compute/v2.1/servers/ea1f238d-3bae-4ce8-b328-d07fc2f7f272 => generated 1315 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 15:49:29.919931 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.policy [None req-9ad28a53-80df-4dae-99f3-acf6dcd4e085 tempest-VolumesActionsTest-1534566879 tempest-VolumesActionsTest-1534566879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0156ed87a5b4efca7ef5056429db1a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71b09f9f20b340b5a615b24e05312703', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128728) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:49:29.927518 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: INFO nova.api.openstack.requestlog [None req-9ad28a53-80df-4dae-99f3-acf6dcd4e085 tempest-VolumesActionsTest-1534566879 tempest-VolumesActionsTest-1534566879-project] 10.222.0.61 "GET /compute/v2.1/servers/656dffc0-256e-40ba-b670-f08e247a0d95" status: 200 len: 1314 microversion: 2.1 time: 0.175470 May 14 15:49:29.928171 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: [pid: 128728|app: 0|req: 255/495] 10.222.0.61 () {58 vars in 1235 bytes} [Sat May 14 15:49:29 2022] GET /compute/v2.1/servers/656dffc0-256e-40ba-b670-f08e247a0d95 => generated 1314 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 15:49:30.263110 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi [req-b22a44e1-9cfa-4366-9c8c-3dbd0a187106 req-9ff76326-7336-4027-8b86-0a95cddb00f5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ea1f238d-3bae-4ce8-b328-d07fc2f7f272", "name": "network-vif-plugged", "status": "completed", "tag": "e4c131d9-3887-4760-96f8-18f3e257f1f7"}]} {{(pid=128729) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 15:49:30.273616 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [req-b22a44e1-9cfa-4366-9c8c-3dbd0a187106 req-9ff76326-7336-4027-8b86-0a95cddb00f5 service nova] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:49:30.274135 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [req-b22a44e1-9cfa-4366-9c8c-3dbd0a187106 req-9ff76326-7336-4027-8b86-0a95cddb00f5 service nova] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:49:30.287309 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: INFO nova.api.openstack.compute.server_external_events [req-b22a44e1-9cfa-4366-9c8c-3dbd0a187106 req-9ff76326-7336-4027-8b86-0a95cddb00f5 service nova] Creating event network-vif-plugged:e4c131d9-3887-4760-96f8-18f3e257f1f7 for instance ea1f238d-3bae-4ce8-b328-d07fc2f7f272 on hv-cinder-83979 May 14 15:49:30.292948 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: INFO nova.api.openstack.requestlog [req-b22a44e1-9cfa-4366-9c8c-3dbd0a187106 req-9ff76326-7336-4027-8b86-0a95cddb00f5 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034242 May 14 15:49:30.293545 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: [pid: 128729|app: 0|req: 241/496] 10.222.0.61 () {64 vars in 1317 bytes} [Sat May 14 15:49:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 14 15:49:30.383077 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi [None req-97a0f1ab-e377-4568-8bc9-126d43174466 tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Calling method '>' {{(pid=128728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 15:49:30.384002 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.compute.api [None req-97a0f1ab-e377-4568-8bc9-126d43174466 tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] [instance: 7c21adbe-7a79-46cf-aa7c-9b2a6548c767] Fetching instance by UUID {{(pid=128728) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 15:49:30.391536 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-97a0f1ab-e377-4568-8bc9-126d43174466 tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:49:30.392086 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-97a0f1ab-e377-4568-8bc9-126d43174466 tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:49:30.392771 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-97a0f1ab-e377-4568-8bc9-126d43174466 tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:49:30.393224 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-97a0f1ab-e377-4568-8bc9-126d43174466 tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:49:30.464702 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.policy [None req-97a0f1ab-e377-4568-8bc9-126d43174466 tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b896317d96a40d6a137db0dcf5f98f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d2517d5440a4d30949f3dd36a46d813', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128728) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:49:30.473034 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: INFO nova.api.openstack.requestlog [None req-97a0f1ab-e377-4568-8bc9-126d43174466 tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] 10.222.0.61 "GET /compute/v2.1/servers/7c21adbe-7a79-46cf-aa7c-9b2a6548c767" status: 200 len: 1296 microversion: 2.1 time: 0.093740 May 14 15:49:30.473717 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: [pid: 128728|app: 0|req: 256/497] 10.222.0.61 () {58 vars in 1235 bytes} [Sat May 14 15:49:30 2022] GET /compute/v2.1/servers/7c21adbe-7a79-46cf-aa7c-9b2a6548c767 => generated 1296 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 15:49:30.550625 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi [None req-9fa09090-0e52-45e6-89be-feb6fdcfb59e tempest-TestMinimumBasicScenario-1817438735 tempest-TestMinimumBasicScenario-1817438735-project] Calling method '>' {{(pid=128729) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 15:49:30.551447 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.compute.api [None req-9fa09090-0e52-45e6-89be-feb6fdcfb59e tempest-TestMinimumBasicScenario-1817438735 tempest-TestMinimumBasicScenario-1817438735-project] [instance: ef63d04a-87e5-4202-a672-d45a2a877c68] Fetching instance by UUID {{(pid=128729) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 15:49:30.559079 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-9fa09090-0e52-45e6-89be-feb6fdcfb59e tempest-TestMinimumBasicScenario-1817438735 tempest-TestMinimumBasicScenario-1817438735-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:49:30.559425 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-9fa09090-0e52-45e6-89be-feb6fdcfb59e tempest-TestMinimumBasicScenario-1817438735 tempest-TestMinimumBasicScenario-1817438735-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:49:30.560219 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-9fa09090-0e52-45e6-89be-feb6fdcfb59e tempest-TestMinimumBasicScenario-1817438735 tempest-TestMinimumBasicScenario-1817438735-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:49:30.560676 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-9fa09090-0e52-45e6-89be-feb6fdcfb59e tempest-TestMinimumBasicScenario-1817438735 tempest-TestMinimumBasicScenario-1817438735-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:49:30.723204 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.policy [None req-9fa09090-0e52-45e6-89be-feb6fdcfb59e tempest-TestMinimumBasicScenario-1817438735 tempest-TestMinimumBasicScenario-1817438735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d5f259e0b98457ea6b6b88d886c813d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fba11e8ade54d388361c4c936a43372', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128729) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:49:30.729435 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: INFO nova.api.openstack.requestlog [None req-9fa09090-0e52-45e6-89be-feb6fdcfb59e tempest-TestMinimumBasicScenario-1817438735 tempest-TestMinimumBasicScenario-1817438735-project] 10.222.0.61 "GET /compute/v2.1/servers/ef63d04a-87e5-4202-a672-d45a2a877c68" status: 200 len: 1357 microversion: 2.1 time: 0.183568 May 14 15:49:30.729995 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: [pid: 128729|app: 0|req: 242/498] 10.222.0.61 () {58 vars in 1235 bytes} [Sat May 14 15:49:30 2022] GET /compute/v2.1/servers/ef63d04a-87e5-4202-a672-d45a2a877c68 => generated 1357 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 15:49:30.884087 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi [None req-825ecac6-b102-4282-911e-393d0646335d tempest-VolumesNegativeTest-1107689494 tempest-VolumesNegativeTest-1107689494-project] Calling method '>' {{(pid=128728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 15:49:30.884813 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.compute.api [None req-825ecac6-b102-4282-911e-393d0646335d tempest-VolumesNegativeTest-1107689494 tempest-VolumesNegativeTest-1107689494-project] [instance: ea1f238d-3bae-4ce8-b328-d07fc2f7f272] Fetching instance by UUID {{(pid=128728) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 15:49:30.892068 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-825ecac6-b102-4282-911e-393d0646335d tempest-VolumesNegativeTest-1107689494 tempest-VolumesNegativeTest-1107689494-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:49:30.892552 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-825ecac6-b102-4282-911e-393d0646335d tempest-VolumesNegativeTest-1107689494 tempest-VolumesNegativeTest-1107689494-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:49:30.893331 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-825ecac6-b102-4282-911e-393d0646335d tempest-VolumesNegativeTest-1107689494 tempest-VolumesNegativeTest-1107689494-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:49:30.893771 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-825ecac6-b102-4282-911e-393d0646335d tempest-VolumesNegativeTest-1107689494 tempest-VolumesNegativeTest-1107689494-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:49:30.944296 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi [None req-14cf3172-c5e7-4661-abba-1afa9f1b80f8 tempest-VolumesActionsTest-1534566879 tempest-VolumesActionsTest-1534566879-project] Calling method '>' {{(pid=128729) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 15:49:30.944905 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.compute.api [None req-14cf3172-c5e7-4661-abba-1afa9f1b80f8 tempest-VolumesActionsTest-1534566879 tempest-VolumesActionsTest-1534566879-project] [instance: 656dffc0-256e-40ba-b670-f08e247a0d95] Fetching instance by UUID {{(pid=128729) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 15:49:30.952509 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-14cf3172-c5e7-4661-abba-1afa9f1b80f8 tempest-VolumesActionsTest-1534566879 tempest-VolumesActionsTest-1534566879-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:49:30.953251 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-14cf3172-c5e7-4661-abba-1afa9f1b80f8 tempest-VolumesActionsTest-1534566879 tempest-VolumesActionsTest-1534566879-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:49:30.954447 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-14cf3172-c5e7-4661-abba-1afa9f1b80f8 tempest-VolumesActionsTest-1534566879 tempest-VolumesActionsTest-1534566879-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:49:30.955413 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-14cf3172-c5e7-4661-abba-1afa9f1b80f8 tempest-VolumesActionsTest-1534566879 tempest-VolumesActionsTest-1534566879-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:49:31.116255 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.policy [None req-825ecac6-b102-4282-911e-393d0646335d tempest-VolumesNegativeTest-1107689494 tempest-VolumesNegativeTest-1107689494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e8303a1f1584ae2aae774eaf31481f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1e7c6697dfc4562b4c1d46ee21964a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128728) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:49:31.124513 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: INFO nova.api.openstack.requestlog [None req-825ecac6-b102-4282-911e-393d0646335d tempest-VolumesNegativeTest-1107689494 tempest-VolumesNegativeTest-1107689494-project] 10.222.0.61 "GET /compute/v2.1/servers/ea1f238d-3bae-4ce8-b328-d07fc2f7f272" status: 200 len: 1315 microversion: 2.1 time: 0.244334 May 14 15:49:31.125196 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: [pid: 128728|app: 0|req: 257/499] 10.222.0.61 () {58 vars in 1235 bytes} [Sat May 14 15:49:30 2022] GET /compute/v2.1/servers/ea1f238d-3bae-4ce8-b328-d07fc2f7f272 => generated 1315 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 15:49:31.145550 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.policy [None req-14cf3172-c5e7-4661-abba-1afa9f1b80f8 tempest-VolumesActionsTest-1534566879 tempest-VolumesActionsTest-1534566879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0156ed87a5b4efca7ef5056429db1a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71b09f9f20b340b5a615b24e05312703', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128729) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:49:31.152874 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: INFO nova.api.openstack.requestlog [None req-14cf3172-c5e7-4661-abba-1afa9f1b80f8 tempest-VolumesActionsTest-1534566879 tempest-VolumesActionsTest-1534566879-project] 10.222.0.61 "GET /compute/v2.1/servers/656dffc0-256e-40ba-b670-f08e247a0d95" status: 200 len: 1314 microversion: 2.1 time: 0.212470 May 14 15:49:31.153443 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: [pid: 128729|app: 0|req: 243/500] 10.222.0.61 () {58 vars in 1235 bytes} [Sat May 14 15:49:30 2022] GET /compute/v2.1/servers/656dffc0-256e-40ba-b670-f08e247a0d95 => generated 1314 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 15:49:31.491310 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi [None req-06eb0991-b1a6-46fc-9aee-942a03343d32 tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Calling method '>' {{(pid=128728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 15:49:31.491849 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.compute.api [None req-06eb0991-b1a6-46fc-9aee-942a03343d32 tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] [instance: 7c21adbe-7a79-46cf-aa7c-9b2a6548c767] Fetching instance by UUID {{(pid=128728) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 15:49:31.497903 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-06eb0991-b1a6-46fc-9aee-942a03343d32 tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:49:31.498378 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-06eb0991-b1a6-46fc-9aee-942a03343d32 tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:49:31.499150 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-06eb0991-b1a6-46fc-9aee-942a03343d32 tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:49:31.499583 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-06eb0991-b1a6-46fc-9aee-942a03343d32 tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:49:31.565295 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.policy [None req-06eb0991-b1a6-46fc-9aee-942a03343d32 tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b896317d96a40d6a137db0dcf5f98f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d2517d5440a4d30949f3dd36a46d813', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128728) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:49:31.572417 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: INFO nova.api.openstack.requestlog [None req-06eb0991-b1a6-46fc-9aee-942a03343d32 tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] 10.222.0.61 "GET /compute/v2.1/servers/7c21adbe-7a79-46cf-aa7c-9b2a6548c767" status: 200 len: 1304 microversion: 2.1 time: 0.085582 May 14 15:49:31.573643 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: [pid: 128728|app: 0|req: 258/501] 10.222.0.61 () {58 vars in 1235 bytes} [Sat May 14 15:49:31 2022] GET /compute/v2.1/servers/7c21adbe-7a79-46cf-aa7c-9b2a6548c767 => generated 1304 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 15:49:31.746700 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi [None req-a47c2ef1-f820-42b1-8ab8-eae3f15fb235 tempest-TestMinimumBasicScenario-1817438735 tempest-TestMinimumBasicScenario-1817438735-project] Calling method '>' {{(pid=128729) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 15:49:31.747348 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.compute.api [None req-a47c2ef1-f820-42b1-8ab8-eae3f15fb235 tempest-TestMinimumBasicScenario-1817438735 tempest-TestMinimumBasicScenario-1817438735-project] [instance: ef63d04a-87e5-4202-a672-d45a2a877c68] Fetching instance by UUID {{(pid=128729) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 15:49:31.754009 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-a47c2ef1-f820-42b1-8ab8-eae3f15fb235 tempest-TestMinimumBasicScenario-1817438735 tempest-TestMinimumBasicScenario-1817438735-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:49:31.754565 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-a47c2ef1-f820-42b1-8ab8-eae3f15fb235 tempest-TestMinimumBasicScenario-1817438735 tempest-TestMinimumBasicScenario-1817438735-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:49:31.755454 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-a47c2ef1-f820-42b1-8ab8-eae3f15fb235 tempest-TestMinimumBasicScenario-1817438735 tempest-TestMinimumBasicScenario-1817438735-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:49:31.755962 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-a47c2ef1-f820-42b1-8ab8-eae3f15fb235 tempest-TestMinimumBasicScenario-1817438735 tempest-TestMinimumBasicScenario-1817438735-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:49:31.975822 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.policy [None req-a47c2ef1-f820-42b1-8ab8-eae3f15fb235 tempest-TestMinimumBasicScenario-1817438735 tempest-TestMinimumBasicScenario-1817438735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d5f259e0b98457ea6b6b88d886c813d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fba11e8ade54d388361c4c936a43372', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128729) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:49:31.986063 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: INFO nova.api.openstack.requestlog [None req-a47c2ef1-f820-42b1-8ab8-eae3f15fb235 tempest-TestMinimumBasicScenario-1817438735 tempest-TestMinimumBasicScenario-1817438735-project] 10.222.0.61 "GET /compute/v2.1/servers/ef63d04a-87e5-4202-a672-d45a2a877c68" status: 200 len: 1546 microversion: 2.1 time: 0.243946 May 14 15:49:31.987591 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: [pid: 128729|app: 0|req: 244/502] 10.222.0.61 () {58 vars in 1235 bytes} [Sat May 14 15:49:31 2022] GET /compute/v2.1/servers/ef63d04a-87e5-4202-a672-d45a2a877c68 => generated 1546 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 15:49:32.004849 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi [None req-faa516c0-f11b-4411-864b-5bc2ba3deb90 tempest-TestMinimumBasicScenario-1817438735 tempest-TestMinimumBasicScenario-1817438735-project] Calling method '>' {{(pid=128728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 15:49:32.006860 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.compute.api [None req-faa516c0-f11b-4411-864b-5bc2ba3deb90 tempest-TestMinimumBasicScenario-1817438735 tempest-TestMinimumBasicScenario-1817438735-project] [instance: ef63d04a-87e5-4202-a672-d45a2a877c68] Fetching instance by UUID {{(pid=128728) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 15:49:32.015419 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-faa516c0-f11b-4411-864b-5bc2ba3deb90 tempest-TestMinimumBasicScenario-1817438735 tempest-TestMinimumBasicScenario-1817438735-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:49:32.015873 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-faa516c0-f11b-4411-864b-5bc2ba3deb90 tempest-TestMinimumBasicScenario-1817438735 tempest-TestMinimumBasicScenario-1817438735-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:49:32.016654 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-faa516c0-f11b-4411-864b-5bc2ba3deb90 tempest-TestMinimumBasicScenario-1817438735 tempest-TestMinimumBasicScenario-1817438735-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:49:32.017163 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-faa516c0-f11b-4411-864b-5bc2ba3deb90 tempest-TestMinimumBasicScenario-1817438735 tempest-TestMinimumBasicScenario-1817438735-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:49:32.141047 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi [None req-12d9aec1-e5d0-4aea-97a1-927f0e0fc834 tempest-VolumesNegativeTest-1107689494 tempest-VolumesNegativeTest-1107689494-project] Calling method '>' {{(pid=128729) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 15:49:32.141977 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.compute.api [None req-12d9aec1-e5d0-4aea-97a1-927f0e0fc834 tempest-VolumesNegativeTest-1107689494 tempest-VolumesNegativeTest-1107689494-project] [instance: ea1f238d-3bae-4ce8-b328-d07fc2f7f272] Fetching instance by UUID {{(pid=128729) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 15:49:32.148111 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-12d9aec1-e5d0-4aea-97a1-927f0e0fc834 tempest-VolumesNegativeTest-1107689494 tempest-VolumesNegativeTest-1107689494-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:49:32.148815 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-12d9aec1-e5d0-4aea-97a1-927f0e0fc834 tempest-VolumesNegativeTest-1107689494 tempest-VolumesNegativeTest-1107689494-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:49:32.149952 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-12d9aec1-e5d0-4aea-97a1-927f0e0fc834 tempest-VolumesNegativeTest-1107689494 tempest-VolumesNegativeTest-1107689494-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:49:32.150574 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-12d9aec1-e5d0-4aea-97a1-927f0e0fc834 tempest-VolumesNegativeTest-1107689494 tempest-VolumesNegativeTest-1107689494-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:49:32.182885 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.policy [None req-faa516c0-f11b-4411-864b-5bc2ba3deb90 tempest-TestMinimumBasicScenario-1817438735 tempest-TestMinimumBasicScenario-1817438735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d5f259e0b98457ea6b6b88d886c813d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fba11e8ade54d388361c4c936a43372', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128728) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:49:32.190571 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: INFO nova.api.openstack.requestlog [None req-faa516c0-f11b-4411-864b-5bc2ba3deb90 tempest-TestMinimumBasicScenario-1817438735 tempest-TestMinimumBasicScenario-1817438735-project] 10.222.0.61 "GET /compute/v2.1/servers/ef63d04a-87e5-4202-a672-d45a2a877c68" status: 200 len: 1546 microversion: 2.1 time: 0.189902 May 14 15:49:32.191488 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: [pid: 128728|app: 0|req: 259/503] 10.222.0.61 () {58 vars in 1235 bytes} [Sat May 14 15:49:31 2022] GET /compute/v2.1/servers/ef63d04a-87e5-4202-a672-d45a2a877c68 => generated 1546 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 15:49:32.196453 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi [None req-3eb7e7c2-920e-45e7-9e87-346582b0c339 tempest-VolumesActionsTest-1534566879 tempest-VolumesActionsTest-1534566879-project] Calling method '>' {{(pid=128728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 15:49:32.197327 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.compute.api [None req-3eb7e7c2-920e-45e7-9e87-346582b0c339 tempest-VolumesActionsTest-1534566879 tempest-VolumesActionsTest-1534566879-project] [instance: 656dffc0-256e-40ba-b670-f08e247a0d95] Fetching instance by UUID {{(pid=128728) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 15:49:32.207222 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-3eb7e7c2-920e-45e7-9e87-346582b0c339 tempest-VolumesActionsTest-1534566879 tempest-VolumesActionsTest-1534566879-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:49:32.207926 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-3eb7e7c2-920e-45e7-9e87-346582b0c339 tempest-VolumesActionsTest-1534566879 tempest-VolumesActionsTest-1534566879-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:49:32.209283 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-3eb7e7c2-920e-45e7-9e87-346582b0c339 tempest-VolumesActionsTest-1534566879 tempest-VolumesActionsTest-1534566879-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:49:32.209925 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-3eb7e7c2-920e-45e7-9e87-346582b0c339 tempest-VolumesActionsTest-1534566879 tempest-VolumesActionsTest-1534566879-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:49:32.356473 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.policy [None req-12d9aec1-e5d0-4aea-97a1-927f0e0fc834 tempest-VolumesNegativeTest-1107689494 tempest-VolumesNegativeTest-1107689494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e8303a1f1584ae2aae774eaf31481f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1e7c6697dfc4562b4c1d46ee21964a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128729) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:49:32.367974 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: INFO nova.api.openstack.requestlog [None req-12d9aec1-e5d0-4aea-97a1-927f0e0fc834 tempest-VolumesNegativeTest-1107689494 tempest-VolumesNegativeTest-1107689494-project] 10.222.0.61 "GET /compute/v2.1/servers/ea1f238d-3bae-4ce8-b328-d07fc2f7f272" status: 200 len: 1315 microversion: 2.1 time: 0.229813 May 14 15:49:32.370707 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: [pid: 128729|app: 0|req: 245/504] 10.222.0.61 () {58 vars in 1235 bytes} [Sat May 14 15:49:32 2022] GET /compute/v2.1/servers/ea1f238d-3bae-4ce8-b328-d07fc2f7f272 => generated 1315 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 15:49:32.375448 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi [None req-0003fd17-36be-4657-947c-5072f05160c2 tempest-TestMinimumBasicScenario-1817438735 tempest-TestMinimumBasicScenario-1817438735-project] Calling method '>' {{(pid=128729) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 15:49:32.379257 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.policy [None req-0003fd17-36be-4657-947c-5072f05160c2 tempest-TestMinimumBasicScenario-1817438735 tempest-TestMinimumBasicScenario-1817438735-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '6d5f259e0b98457ea6b6b88d886c813d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fba11e8ade54d388361c4c936a43372', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128729) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:49:32.380028 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.compute.api [None req-0003fd17-36be-4657-947c-5072f05160c2 tempest-TestMinimumBasicScenario-1817438735 tempest-TestMinimumBasicScenario-1817438735-project] Searching by: {'deleted': False, 'project_id': '5fba11e8ade54d388361c4c936a43372'} {{(pid=128729) get_all /opt/stack/nova/nova/compute/api.py:2962}} May 14 15:49:32.388161 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-0003fd17-36be-4657-947c-5072f05160c2 tempest-TestMinimumBasicScenario-1817438735 tempest-TestMinimumBasicScenario-1817438735-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:49:32.388866 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-0003fd17-36be-4657-947c-5072f05160c2 tempest-TestMinimumBasicScenario-1817438735 tempest-TestMinimumBasicScenario-1817438735-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:49:32.390185 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-0003fd17-36be-4657-947c-5072f05160c2 tempest-TestMinimumBasicScenario-1817438735 tempest-TestMinimumBasicScenario-1817438735-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:49:32.390820 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-0003fd17-36be-4657-947c-5072f05160c2 tempest-TestMinimumBasicScenario-1817438735 tempest-TestMinimumBasicScenario-1817438735-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:49:32.400852 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.policy [None req-3eb7e7c2-920e-45e7-9e87-346582b0c339 tempest-VolumesActionsTest-1534566879 tempest-VolumesActionsTest-1534566879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0156ed87a5b4efca7ef5056429db1a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71b09f9f20b340b5a615b24e05312703', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128728) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:49:32.409060 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: INFO nova.api.openstack.requestlog [None req-3eb7e7c2-920e-45e7-9e87-346582b0c339 tempest-VolumesActionsTest-1534566879 tempest-VolumesActionsTest-1534566879-project] 10.222.0.61 "GET /compute/v2.1/servers/656dffc0-256e-40ba-b670-f08e247a0d95" status: 200 len: 1314 microversion: 2.1 time: 0.215943 May 14 15:49:32.409770 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: [pid: 128728|app: 0|req: 260/505] 10.222.0.61 () {58 vars in 1235 bytes} [Sat May 14 15:49:32 2022] GET /compute/v2.1/servers/656dffc0-256e-40ba-b670-f08e247a0d95 => generated 1314 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 15:49:32.487727 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.compute.multi_cell_list [None req-0003fd17-36be-4657-947c-5072f05160c2 tempest-TestMinimumBasicScenario-1817438735 tempest-TestMinimumBasicScenario-1817438735-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=128729) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} May 14 15:49:32.580927 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: INFO nova.api.openstack.requestlog [None req-0003fd17-36be-4657-947c-5072f05160c2 tempest-TestMinimumBasicScenario-1817438735 tempest-TestMinimumBasicScenario-1817438735-project] 10.222.0.61 "GET /compute/v2.1/servers" status: 200 len: 342 microversion: 2.1 time: 0.209114 May 14 15:49:32.581507 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: [pid: 128729|app: 0|req: 246/506] 10.222.0.61 () {58 vars in 1124 bytes} [Sat May 14 15:49:32 2022] GET /compute/v2.1/servers => generated 342 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 14 15:49:32.588842 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi [None req-e2fe3328-7072-4a33-947e-bbdf2118ec82 tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Calling method '>' {{(pid=128728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 15:49:32.589792 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.compute.api [None req-e2fe3328-7072-4a33-947e-bbdf2118ec82 tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] [instance: 7c21adbe-7a79-46cf-aa7c-9b2a6548c767] Fetching instance by UUID {{(pid=128728) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 15:49:32.591584 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi [None req-97a43d6a-7fcf-4aa5-a024-f92d7ba2e24b tempest-TestMinimumBasicScenario-1817438735 tempest-TestMinimumBasicScenario-1817438735-project] Calling method '>' {{(pid=128729) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 15:49:32.592195 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.compute.api [None req-97a43d6a-7fcf-4aa5-a024-f92d7ba2e24b tempest-TestMinimumBasicScenario-1817438735 tempest-TestMinimumBasicScenario-1817438735-project] [instance: ef63d04a-87e5-4202-a672-d45a2a877c68] Fetching instance by UUID {{(pid=128729) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 15:49:32.595311 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-e2fe3328-7072-4a33-947e-bbdf2118ec82 tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:49:32.595760 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-e2fe3328-7072-4a33-947e-bbdf2118ec82 tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:49:32.596541 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-e2fe3328-7072-4a33-947e-bbdf2118ec82 tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:49:32.596980 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-e2fe3328-7072-4a33-947e-bbdf2118ec82 tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:49:32.599616 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-97a43d6a-7fcf-4aa5-a024-f92d7ba2e24b tempest-TestMinimumBasicScenario-1817438735 tempest-TestMinimumBasicScenario-1817438735-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:49:32.599616 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-97a43d6a-7fcf-4aa5-a024-f92d7ba2e24b tempest-TestMinimumBasicScenario-1817438735 tempest-TestMinimumBasicScenario-1817438735-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:49:32.599616 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-97a43d6a-7fcf-4aa5-a024-f92d7ba2e24b tempest-TestMinimumBasicScenario-1817438735 tempest-TestMinimumBasicScenario-1817438735-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:49:32.600079 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-97a43d6a-7fcf-4aa5-a024-f92d7ba2e24b tempest-TestMinimumBasicScenario-1817438735 tempest-TestMinimumBasicScenario-1817438735-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:49:32.688384 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.policy [None req-e2fe3328-7072-4a33-947e-bbdf2118ec82 tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b896317d96a40d6a137db0dcf5f98f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d2517d5440a4d30949f3dd36a46d813', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128728) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:49:32.702380 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: INFO nova.api.openstack.requestlog [None req-e2fe3328-7072-4a33-947e-bbdf2118ec82 tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] 10.222.0.61 "GET /compute/v2.1/servers/7c21adbe-7a79-46cf-aa7c-9b2a6548c767" status: 200 len: 1302 microversion: 2.1 time: 0.117316 May 14 15:49:32.712216 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: [pid: 128728|app: 0|req: 261/507] 10.222.0.61 () {58 vars in 1235 bytes} [Sat May 14 15:49:32 2022] GET /compute/v2.1/servers/7c21adbe-7a79-46cf-aa7c-9b2a6548c767 => generated 1302 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 15:49:32.786955 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.policy [None req-97a43d6a-7fcf-4aa5-a024-f92d7ba2e24b tempest-TestMinimumBasicScenario-1817438735 tempest-TestMinimumBasicScenario-1817438735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d5f259e0b98457ea6b6b88d886c813d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fba11e8ade54d388361c4c936a43372', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128729) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:49:32.795803 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: INFO nova.api.openstack.requestlog [None req-97a43d6a-7fcf-4aa5-a024-f92d7ba2e24b tempest-TestMinimumBasicScenario-1817438735 tempest-TestMinimumBasicScenario-1817438735-project] 10.222.0.61 "GET /compute/v2.1/servers/ef63d04a-87e5-4202-a672-d45a2a877c68" status: 200 len: 1546 microversion: 2.1 time: 0.207891 May 14 15:49:32.796621 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: [pid: 128729|app: 0|req: 247/508] 10.222.0.61 () {58 vars in 1235 bytes} [Sat May 14 15:49:32 2022] GET /compute/v2.1/servers/ef63d04a-87e5-4202-a672-d45a2a877c68 => generated 1546 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 15:49:33.385999 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi [None req-eda05c33-b457-4cd6-a6e8-e50d7345cc29 tempest-VolumesNegativeTest-1107689494 tempest-VolumesNegativeTest-1107689494-project] Calling method '>' {{(pid=128728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 15:49:33.386957 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.compute.api [None req-eda05c33-b457-4cd6-a6e8-e50d7345cc29 tempest-VolumesNegativeTest-1107689494 tempest-VolumesNegativeTest-1107689494-project] [instance: ea1f238d-3bae-4ce8-b328-d07fc2f7f272] Fetching instance by UUID {{(pid=128728) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 15:49:33.393552 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-eda05c33-b457-4cd6-a6e8-e50d7345cc29 tempest-VolumesNegativeTest-1107689494 tempest-VolumesNegativeTest-1107689494-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:49:33.394020 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-eda05c33-b457-4cd6-a6e8-e50d7345cc29 tempest-VolumesNegativeTest-1107689494 tempest-VolumesNegativeTest-1107689494-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:49:33.394873 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-eda05c33-b457-4cd6-a6e8-e50d7345cc29 tempest-VolumesNegativeTest-1107689494 tempest-VolumesNegativeTest-1107689494-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:49:33.395352 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-eda05c33-b457-4cd6-a6e8-e50d7345cc29 tempest-VolumesNegativeTest-1107689494 tempest-VolumesNegativeTest-1107689494-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:49:33.430674 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi [None req-5e8ab9fd-9edf-4973-8df9-0b1e27843491 tempest-VolumesActionsTest-1534566879 tempest-VolumesActionsTest-1534566879-project] Calling method '>' {{(pid=128729) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 15:49:33.431780 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.compute.api [None req-5e8ab9fd-9edf-4973-8df9-0b1e27843491 tempest-VolumesActionsTest-1534566879 tempest-VolumesActionsTest-1534566879-project] [instance: 656dffc0-256e-40ba-b670-f08e247a0d95] Fetching instance by UUID {{(pid=128729) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 15:49:33.439821 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-5e8ab9fd-9edf-4973-8df9-0b1e27843491 tempest-VolumesActionsTest-1534566879 tempest-VolumesActionsTest-1534566879-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:49:33.440430 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-5e8ab9fd-9edf-4973-8df9-0b1e27843491 tempest-VolumesActionsTest-1534566879 tempest-VolumesActionsTest-1534566879-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:49:33.441393 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-5e8ab9fd-9edf-4973-8df9-0b1e27843491 tempest-VolumesActionsTest-1534566879 tempest-VolumesActionsTest-1534566879-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:49:33.442077 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-5e8ab9fd-9edf-4973-8df9-0b1e27843491 tempest-VolumesActionsTest-1534566879 tempest-VolumesActionsTest-1534566879-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:49:33.613912 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.policy [None req-eda05c33-b457-4cd6-a6e8-e50d7345cc29 tempest-VolumesNegativeTest-1107689494 tempest-VolumesNegativeTest-1107689494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e8303a1f1584ae2aae774eaf31481f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1e7c6697dfc4562b4c1d46ee21964a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128728) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:49:33.622535 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: INFO nova.api.openstack.requestlog [None req-eda05c33-b457-4cd6-a6e8-e50d7345cc29 tempest-VolumesNegativeTest-1107689494 tempest-VolumesNegativeTest-1107689494-project] 10.222.0.61 "GET /compute/v2.1/servers/ea1f238d-3bae-4ce8-b328-d07fc2f7f272" status: 200 len: 1315 microversion: 2.1 time: 0.240281 May 14 15:49:33.623178 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: [pid: 128728|app: 0|req: 262/509] 10.222.0.61 () {58 vars in 1235 bytes} [Sat May 14 15:49:33 2022] GET /compute/v2.1/servers/ea1f238d-3bae-4ce8-b328-d07fc2f7f272 => generated 1315 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 15:49:33.636960 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.policy [None req-5e8ab9fd-9edf-4973-8df9-0b1e27843491 tempest-VolumesActionsTest-1534566879 tempest-VolumesActionsTest-1534566879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0156ed87a5b4efca7ef5056429db1a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71b09f9f20b340b5a615b24e05312703', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128729) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:49:33.644167 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: INFO nova.api.openstack.requestlog [None req-5e8ab9fd-9edf-4973-8df9-0b1e27843491 tempest-VolumesActionsTest-1534566879 tempest-VolumesActionsTest-1534566879-project] 10.222.0.61 "GET /compute/v2.1/servers/656dffc0-256e-40ba-b670-f08e247a0d95" status: 200 len: 1314 microversion: 2.1 time: 0.221705 May 14 15:49:33.644726 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: [pid: 128729|app: 0|req: 248/510] 10.222.0.61 () {58 vars in 1235 bytes} [Sat May 14 15:49:33 2022] GET /compute/v2.1/servers/656dffc0-256e-40ba-b670-f08e247a0d95 => generated 1314 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 15:49:33.719402 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi [None req-c66877db-6b22-4504-b195-835d7debb8ba tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Calling method '>' {{(pid=128728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 15:49:33.720098 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.compute.api [None req-c66877db-6b22-4504-b195-835d7debb8ba tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] [instance: 7c21adbe-7a79-46cf-aa7c-9b2a6548c767] Fetching instance by UUID {{(pid=128728) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 15:49:33.726006 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-c66877db-6b22-4504-b195-835d7debb8ba tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:49:33.726498 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-c66877db-6b22-4504-b195-835d7debb8ba tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:49:33.727272 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-c66877db-6b22-4504-b195-835d7debb8ba tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:49:33.727747 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-c66877db-6b22-4504-b195-835d7debb8ba tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:49:33.868826 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.policy [None req-c66877db-6b22-4504-b195-835d7debb8ba tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b896317d96a40d6a137db0dcf5f98f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d2517d5440a4d30949f3dd36a46d813', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128728) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:49:33.877110 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: INFO nova.api.openstack.requestlog [None req-c66877db-6b22-4504-b195-835d7debb8ba tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] 10.222.0.61 "GET /compute/v2.1/servers/7c21adbe-7a79-46cf-aa7c-9b2a6548c767" status: 200 len: 1370 microversion: 2.1 time: 0.161484 May 14 15:49:33.877684 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: [pid: 128728|app: 0|req: 263/511] 10.222.0.61 () {58 vars in 1235 bytes} [Sat May 14 15:49:33 2022] GET /compute/v2.1/servers/7c21adbe-7a79-46cf-aa7c-9b2a6548c767 => generated 1370 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 15:49:34.451350 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi [None req-dafb383b-66e4-4ac8-9092-536b97dcd8a4 tempest-TestMinimumBasicScenario-1817438735 tempest-TestMinimumBasicScenario-1817438735-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "d946c5a0-5d65-4883-b9b2-c5943fa056fa"}} {{(pid=128729) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 15:49:34.453816 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.compute.api [None req-dafb383b-66e4-4ac8-9092-536b97dcd8a4 tempest-TestMinimumBasicScenario-1817438735 tempest-TestMinimumBasicScenario-1817438735-project] [instance: ef63d04a-87e5-4202-a672-d45a2a877c68] Fetching instance by UUID {{(pid=128729) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 15:49:34.461786 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-dafb383b-66e4-4ac8-9092-536b97dcd8a4 tempest-TestMinimumBasicScenario-1817438735 tempest-TestMinimumBasicScenario-1817438735-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:49:34.462246 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-dafb383b-66e4-4ac8-9092-536b97dcd8a4 tempest-TestMinimumBasicScenario-1817438735 tempest-TestMinimumBasicScenario-1817438735-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:49:34.463951 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-dafb383b-66e4-4ac8-9092-536b97dcd8a4 tempest-TestMinimumBasicScenario-1817438735 tempest-TestMinimumBasicScenario-1817438735-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:49:34.464538 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-dafb383b-66e4-4ac8-9092-536b97dcd8a4 tempest-TestMinimumBasicScenario-1817438735 tempest-TestMinimumBasicScenario-1817438735-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:49:34.535514 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi [req-239dfcf1-77ce-440e-944d-b946971704ec req-0d9e9ce8-d8b7-4830-b0eb-3183bc176ebb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7c21adbe-7a79-46cf-aa7c-9b2a6548c767", "tag": "5c35b70b-002b-48c3-9446-1ba3b1605c2b"}]} {{(pid=128728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 15:49:34.548741 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [req-239dfcf1-77ce-440e-944d-b946971704ec req-0d9e9ce8-d8b7-4830-b0eb-3183bc176ebb service nova] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:49:34.549838 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [req-239dfcf1-77ce-440e-944d-b946971704ec req-0d9e9ce8-d8b7-4830-b0eb-3183bc176ebb service nova] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:49:34.564647 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: INFO nova.api.openstack.compute.server_external_events [req-239dfcf1-77ce-440e-944d-b946971704ec req-0d9e9ce8-d8b7-4830-b0eb-3183bc176ebb service nova] Creating event network-changed:5c35b70b-002b-48c3-9446-1ba3b1605c2b for instance 7c21adbe-7a79-46cf-aa7c-9b2a6548c767 on hv-cinder-83979 May 14 15:49:34.572365 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: INFO nova.api.openstack.requestlog [req-239dfcf1-77ce-440e-944d-b946971704ec req-0d9e9ce8-d8b7-4830-b0eb-3183bc176ebb service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040847 May 14 15:49:34.576775 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: [pid: 128728|app: 0|req: 264/512] 10.222.0.61 () {64 vars in 1317 bytes} [Sat May 14 15:49:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 14 15:49:34.615326 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi [req-fa94ccee-f33c-4d0f-9e10-384e0a0bd43b req-4d2e30df-3a38-49ee-af65-4b3eb10a1421 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "656dffc0-256e-40ba-b670-f08e247a0d95", "name": "network-vif-plugged", "status": "completed", "tag": "9d525f2e-84e9-4747-99b0-489de117e060"}]} {{(pid=128728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 15:49:34.626742 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [req-fa94ccee-f33c-4d0f-9e10-384e0a0bd43b req-4d2e30df-3a38-49ee-af65-4b3eb10a1421 service nova] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:49:34.627196 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [req-fa94ccee-f33c-4d0f-9e10-384e0a0bd43b req-4d2e30df-3a38-49ee-af65-4b3eb10a1421 service nova] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:49:34.639669 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: INFO nova.api.openstack.compute.server_external_events [req-fa94ccee-f33c-4d0f-9e10-384e0a0bd43b req-4d2e30df-3a38-49ee-af65-4b3eb10a1421 service nova] Creating event network-vif-plugged:9d525f2e-84e9-4747-99b0-489de117e060 for instance 656dffc0-256e-40ba-b670-f08e247a0d95 on hv-cinder-83979 May 14 15:49:34.644735 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: INFO nova.api.openstack.requestlog [req-fa94ccee-f33c-4d0f-9e10-384e0a0bd43b req-4d2e30df-3a38-49ee-af65-4b3eb10a1421 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033568 May 14 15:49:34.645337 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: [pid: 128728|app: 0|req: 265/513] 10.222.0.61 () {64 vars in 1317 bytes} [Sat May 14 15:49:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 14 15:49:34.650374 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi [None req-53b8805d-4713-48d2-b204-91d4091dbfb8 tempest-VolumesNegativeTest-1107689494 tempest-VolumesNegativeTest-1107689494-project] Calling method '>' {{(pid=128728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 15:49:34.651097 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.compute.api [None req-53b8805d-4713-48d2-b204-91d4091dbfb8 tempest-VolumesNegativeTest-1107689494 tempest-VolumesNegativeTest-1107689494-project] [instance: ea1f238d-3bae-4ce8-b328-d07fc2f7f272] Fetching instance by UUID {{(pid=128728) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 15:49:34.657400 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-53b8805d-4713-48d2-b204-91d4091dbfb8 tempest-VolumesNegativeTest-1107689494 tempest-VolumesNegativeTest-1107689494-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:49:34.657853 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-53b8805d-4713-48d2-b204-91d4091dbfb8 tempest-VolumesNegativeTest-1107689494 tempest-VolumesNegativeTest-1107689494-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:49:34.658655 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-53b8805d-4713-48d2-b204-91d4091dbfb8 tempest-VolumesNegativeTest-1107689494 tempest-VolumesNegativeTest-1107689494-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:49:34.659250 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-53b8805d-4713-48d2-b204-91d4091dbfb8 tempest-VolumesNegativeTest-1107689494 tempest-VolumesNegativeTest-1107689494-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:49:34.792568 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.policy [None req-53b8805d-4713-48d2-b204-91d4091dbfb8 tempest-VolumesNegativeTest-1107689494 tempest-VolumesNegativeTest-1107689494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e8303a1f1584ae2aae774eaf31481f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1e7c6697dfc4562b4c1d46ee21964a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128728) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:49:34.799920 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: INFO nova.api.openstack.requestlog [None req-53b8805d-4713-48d2-b204-91d4091dbfb8 tempest-VolumesNegativeTest-1107689494 tempest-VolumesNegativeTest-1107689494-project] 10.222.0.61 "GET /compute/v2.1/servers/ea1f238d-3bae-4ce8-b328-d07fc2f7f272" status: 200 len: 1465 microversion: 2.1 time: 0.153477 May 14 15:49:34.800486 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: [pid: 128728|app: 0|req: 266/514] 10.222.0.61 () {58 vars in 1235 bytes} [Sat May 14 15:49:34 2022] GET /compute/v2.1/servers/ea1f238d-3bae-4ce8-b328-d07fc2f7f272 => generated 1465 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 15:49:34.804962 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi [None req-ebec2444-f7bb-4345-8008-204807b21f2a tempest-VolumesActionsTest-1534566879 tempest-VolumesActionsTest-1534566879-project] Calling method '>' {{(pid=128728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 15:49:34.805561 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.compute.api [None req-ebec2444-f7bb-4345-8008-204807b21f2a tempest-VolumesActionsTest-1534566879 tempest-VolumesActionsTest-1534566879-project] [instance: 656dffc0-256e-40ba-b670-f08e247a0d95] Fetching instance by UUID {{(pid=128728) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 15:49:34.817529 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-ebec2444-f7bb-4345-8008-204807b21f2a tempest-VolumesActionsTest-1534566879 tempest-VolumesActionsTest-1534566879-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:49:34.817982 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-ebec2444-f7bb-4345-8008-204807b21f2a tempest-VolumesActionsTest-1534566879 tempest-VolumesActionsTest-1534566879-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:49:34.818833 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-ebec2444-f7bb-4345-8008-204807b21f2a tempest-VolumesActionsTest-1534566879 tempest-VolumesActionsTest-1534566879-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:49:34.819268 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-ebec2444-f7bb-4345-8008-204807b21f2a tempest-VolumesActionsTest-1534566879 tempest-VolumesActionsTest-1534566879-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:49:34.956093 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.policy [None req-ebec2444-f7bb-4345-8008-204807b21f2a tempest-VolumesActionsTest-1534566879 tempest-VolumesActionsTest-1534566879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0156ed87a5b4efca7ef5056429db1a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71b09f9f20b340b5a615b24e05312703', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128728) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:49:34.964479 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: INFO nova.api.openstack.requestlog [None req-ebec2444-f7bb-4345-8008-204807b21f2a tempest-VolumesActionsTest-1534566879 tempest-VolumesActionsTest-1534566879-project] 10.222.0.61 "GET /compute/v2.1/servers/656dffc0-256e-40ba-b670-f08e247a0d95" status: 200 len: 1314 microversion: 2.1 time: 0.162855 May 14 15:49:34.965251 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: [pid: 128728|app: 0|req: 267/515] 10.222.0.61 () {58 vars in 1235 bytes} [Sat May 14 15:49:34 2022] GET /compute/v2.1/servers/656dffc0-256e-40ba-b670-f08e247a0d95 => generated 1314 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 15:49:34.969879 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi [None req-d0818d0d-608f-430d-b4c2-52e03ddd9bd1 tempest-VolumesNegativeTest-1107689494 tempest-VolumesNegativeTest-1107689494-project] Calling method '>' {{(pid=128728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 15:49:34.970414 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.compute.api [None req-d0818d0d-608f-430d-b4c2-52e03ddd9bd1 tempest-VolumesNegativeTest-1107689494 tempest-VolumesNegativeTest-1107689494-project] [instance: ea1f238d-3bae-4ce8-b328-d07fc2f7f272] Fetching instance by UUID {{(pid=128728) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 15:49:34.976202 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-d0818d0d-608f-430d-b4c2-52e03ddd9bd1 tempest-VolumesNegativeTest-1107689494 tempest-VolumesNegativeTest-1107689494-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:49:34.976655 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-d0818d0d-608f-430d-b4c2-52e03ddd9bd1 tempest-VolumesNegativeTest-1107689494 tempest-VolumesNegativeTest-1107689494-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:49:34.977424 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-d0818d0d-608f-430d-b4c2-52e03ddd9bd1 tempest-VolumesNegativeTest-1107689494 tempest-VolumesNegativeTest-1107689494-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:49:34.977862 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-d0818d0d-608f-430d-b4c2-52e03ddd9bd1 tempest-VolumesNegativeTest-1107689494 tempest-VolumesNegativeTest-1107689494-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:49:35.009760 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.compute.api [None req-d0818d0d-608f-430d-b4c2-52e03ddd9bd1 tempest-VolumesNegativeTest-1107689494 tempest-VolumesNegativeTest-1107689494-project] [instance: ea1f238d-3bae-4ce8-b328-d07fc2f7f272] Going to try to terminate instance {{(pid=128728) delete /opt/stack/nova/nova/compute/api.py:2664}} May 14 15:49:35.113398 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: INFO nova.api.openstack.requestlog [None req-d0818d0d-608f-430d-b4c2-52e03ddd9bd1 tempest-VolumesNegativeTest-1107689494 tempest-VolumesNegativeTest-1107689494-project] 10.222.0.61 "DELETE /compute/v2.1/servers/ea1f238d-3bae-4ce8-b328-d07fc2f7f272" status: 204 len: 0 microversion: 2.1 time: 0.145211 May 14 15:49:35.114183 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: [pid: 128728|app: 0|req: 268/516] 10.222.0.61 () {58 vars in 1238 bytes} [Sat May 14 15:49:34 2022] DELETE /compute/v2.1/servers/ea1f238d-3bae-4ce8-b328-d07fc2f7f272 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 14 15:49:35.124640 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi [None req-ae11c174-1816-444b-987d-b4e7b6ef5dd3 tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Calling method '>' {{(pid=128728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 15:49:35.125321 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.compute.api [None req-ae11c174-1816-444b-987d-b4e7b6ef5dd3 tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] [instance: 7c21adbe-7a79-46cf-aa7c-9b2a6548c767] Fetching instance by UUID {{(pid=128728) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 15:49:35.131448 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-ae11c174-1816-444b-987d-b4e7b6ef5dd3 tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:49:35.131908 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-ae11c174-1816-444b-987d-b4e7b6ef5dd3 tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:49:35.132694 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-ae11c174-1816-444b-987d-b4e7b6ef5dd3 tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:49:35.133130 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-ae11c174-1816-444b-987d-b4e7b6ef5dd3 tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:49:35.205025 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: INFO nova.api.openstack.requestlog [None req-dafb383b-66e4-4ac8-9092-536b97dcd8a4 tempest-TestMinimumBasicScenario-1817438735 tempest-TestMinimumBasicScenario-1817438735-project] 10.222.0.61 "POST /compute/v2.1/servers/ef63d04a-87e5-4202-a672-d45a2a877c68/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.760025 May 14 15:49:35.205824 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: [pid: 128729|app: 0|req: 249/517] 10.222.0.61 () {60 vars in 1322 bytes} [Sat May 14 15:49:34 2022] POST /compute/v2.1/servers/ef63d04a-87e5-4202-a672-d45a2a877c68/os-volume_attachments => generated 194 bytes in 762 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 14 15:49:35.219666 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi [None req-026c0a6c-9f9d-4872-bfbf-06283407ce32 tempest-VolumesNegativeTest-1107689494 tempest-VolumesNegativeTest-1107689494-project] Calling method '>' {{(pid=128729) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 15:49:35.220376 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.compute.api [None req-026c0a6c-9f9d-4872-bfbf-06283407ce32 tempest-VolumesNegativeTest-1107689494 tempest-VolumesNegativeTest-1107689494-project] [instance: ea1f238d-3bae-4ce8-b328-d07fc2f7f272] Fetching instance by UUID {{(pid=128729) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 15:49:35.230079 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-026c0a6c-9f9d-4872-bfbf-06283407ce32 tempest-VolumesNegativeTest-1107689494 tempest-VolumesNegativeTest-1107689494-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:49:35.230740 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-026c0a6c-9f9d-4872-bfbf-06283407ce32 tempest-VolumesNegativeTest-1107689494 tempest-VolumesNegativeTest-1107689494-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:49:35.231696 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-026c0a6c-9f9d-4872-bfbf-06283407ce32 tempest-VolumesNegativeTest-1107689494 tempest-VolumesNegativeTest-1107689494-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:49:35.232132 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-026c0a6c-9f9d-4872-bfbf-06283407ce32 tempest-VolumesNegativeTest-1107689494 tempest-VolumesNegativeTest-1107689494-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:49:35.290795 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.policy [None req-ae11c174-1816-444b-987d-b4e7b6ef5dd3 tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b896317d96a40d6a137db0dcf5f98f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d2517d5440a4d30949f3dd36a46d813', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128728) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:49:35.298949 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: INFO nova.api.openstack.requestlog [None req-ae11c174-1816-444b-987d-b4e7b6ef5dd3 tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] 10.222.0.61 "GET /compute/v2.1/servers/7c21adbe-7a79-46cf-aa7c-9b2a6548c767" status: 200 len: 1370 microversion: 2.1 time: 0.183615 May 14 15:49:35.299579 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: [pid: 128728|app: 0|req: 269/518] 10.222.0.61 () {58 vars in 1235 bytes} [Sat May 14 15:49:35 2022] GET /compute/v2.1/servers/7c21adbe-7a79-46cf-aa7c-9b2a6548c767 => generated 1370 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 15:49:35.376322 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.policy [None req-026c0a6c-9f9d-4872-bfbf-06283407ce32 tempest-VolumesNegativeTest-1107689494 tempest-VolumesNegativeTest-1107689494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e8303a1f1584ae2aae774eaf31481f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1e7c6697dfc4562b4c1d46ee21964a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128729) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:49:35.384247 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: INFO nova.api.openstack.requestlog [None req-026c0a6c-9f9d-4872-bfbf-06283407ce32 tempest-VolumesNegativeTest-1107689494 tempest-VolumesNegativeTest-1107689494-project] 10.222.0.61 "GET /compute/v2.1/servers/ea1f238d-3bae-4ce8-b328-d07fc2f7f272" status: 200 len: 1471 microversion: 2.1 time: 0.177078 May 14 15:49:35.384828 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: [pid: 128729|app: 0|req: 250/519] 10.222.0.61 () {58 vars in 1235 bytes} [Sat May 14 15:49:35 2022] GET /compute/v2.1/servers/ea1f238d-3bae-4ce8-b328-d07fc2f7f272 => generated 1471 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 15:49:35.981494 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi [None req-18dbf72e-201e-4edb-ad7b-769a44438129 tempest-VolumesActionsTest-1534566879 tempest-VolumesActionsTest-1534566879-project] Calling method '>' {{(pid=128728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 15:49:35.982026 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.compute.api [None req-18dbf72e-201e-4edb-ad7b-769a44438129 tempest-VolumesActionsTest-1534566879 tempest-VolumesActionsTest-1534566879-project] [instance: 656dffc0-256e-40ba-b670-f08e247a0d95] Fetching instance by UUID {{(pid=128728) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 15:49:35.988200 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-18dbf72e-201e-4edb-ad7b-769a44438129 tempest-VolumesActionsTest-1534566879 tempest-VolumesActionsTest-1534566879-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:49:35.988647 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-18dbf72e-201e-4edb-ad7b-769a44438129 tempest-VolumesActionsTest-1534566879 tempest-VolumesActionsTest-1534566879-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:49:35.989401 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-18dbf72e-201e-4edb-ad7b-769a44438129 tempest-VolumesActionsTest-1534566879 tempest-VolumesActionsTest-1534566879-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:49:35.989832 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-18dbf72e-201e-4edb-ad7b-769a44438129 tempest-VolumesActionsTest-1534566879 tempest-VolumesActionsTest-1534566879-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:49:36.117832 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.policy [None req-18dbf72e-201e-4edb-ad7b-769a44438129 tempest-VolumesActionsTest-1534566879 tempest-VolumesActionsTest-1534566879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0156ed87a5b4efca7ef5056429db1a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71b09f9f20b340b5a615b24e05312703', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128728) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:49:36.125183 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: INFO nova.api.openstack.requestlog [None req-18dbf72e-201e-4edb-ad7b-769a44438129 tempest-VolumesActionsTest-1534566879 tempest-VolumesActionsTest-1534566879-project] 10.222.0.61 "GET /compute/v2.1/servers/656dffc0-256e-40ba-b670-f08e247a0d95" status: 200 len: 1314 microversion: 2.1 time: 0.148204 May 14 15:49:36.125743 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: [pid: 128728|app: 0|req: 270/520] 10.222.0.61 () {58 vars in 1235 bytes} [Sat May 14 15:49:35 2022] GET /compute/v2.1/servers/656dffc0-256e-40ba-b670-f08e247a0d95 => generated 1314 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 15:49:36.316570 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi [None req-44d248d0-0955-4ca2-80d0-e896eba71223 tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Calling method '>' {{(pid=128729) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 15:49:36.317187 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.compute.api [None req-44d248d0-0955-4ca2-80d0-e896eba71223 tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] [instance: 7c21adbe-7a79-46cf-aa7c-9b2a6548c767] Fetching instance by UUID {{(pid=128729) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 15:49:36.324854 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-44d248d0-0955-4ca2-80d0-e896eba71223 tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:49:36.325311 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-44d248d0-0955-4ca2-80d0-e896eba71223 tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:49:36.326085 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-44d248d0-0955-4ca2-80d0-e896eba71223 tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:49:36.326557 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-44d248d0-0955-4ca2-80d0-e896eba71223 tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:49:36.402043 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi [None req-e6bc44d6-b666-46ac-b407-48b6952ab03d tempest-VolumesNegativeTest-1107689494 tempest-VolumesNegativeTest-1107689494-project] Calling method '>' {{(pid=128728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 15:49:36.402685 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.compute.api [None req-e6bc44d6-b666-46ac-b407-48b6952ab03d tempest-VolumesNegativeTest-1107689494 tempest-VolumesNegativeTest-1107689494-project] [instance: ea1f238d-3bae-4ce8-b328-d07fc2f7f272] Fetching instance by UUID {{(pid=128728) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 15:49:36.408420 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-e6bc44d6-b666-46ac-b407-48b6952ab03d tempest-VolumesNegativeTest-1107689494 tempest-VolumesNegativeTest-1107689494-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:49:36.408876 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-e6bc44d6-b666-46ac-b407-48b6952ab03d tempest-VolumesNegativeTest-1107689494 tempest-VolumesNegativeTest-1107689494-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:49:36.409650 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-e6bc44d6-b666-46ac-b407-48b6952ab03d tempest-VolumesNegativeTest-1107689494 tempest-VolumesNegativeTest-1107689494-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:49:36.410189 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-e6bc44d6-b666-46ac-b407-48b6952ab03d tempest-VolumesNegativeTest-1107689494 tempest-VolumesNegativeTest-1107689494-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:49:36.801962 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.policy [None req-44d248d0-0955-4ca2-80d0-e896eba71223 tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b896317d96a40d6a137db0dcf5f98f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d2517d5440a4d30949f3dd36a46d813', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128729) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:49:36.809612 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: INFO nova.api.openstack.requestlog [None req-44d248d0-0955-4ca2-80d0-e896eba71223 tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] 10.222.0.61 "GET /compute/v2.1/servers/7c21adbe-7a79-46cf-aa7c-9b2a6548c767" status: 200 len: 1370 microversion: 2.1 time: 0.496854 May 14 15:49:36.810522 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: [pid: 128729|app: 0|req: 251/521] 10.222.0.61 () {58 vars in 1235 bytes} [Sat May 14 15:49:36 2022] GET /compute/v2.1/servers/7c21adbe-7a79-46cf-aa7c-9b2a6548c767 => generated 1370 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 15:49:36.851776 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.policy [None req-e6bc44d6-b666-46ac-b407-48b6952ab03d tempest-VolumesNegativeTest-1107689494 tempest-VolumesNegativeTest-1107689494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e8303a1f1584ae2aae774eaf31481f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1e7c6697dfc4562b4c1d46ee21964a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128728) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:49:36.860203 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: INFO nova.api.openstack.requestlog [None req-e6bc44d6-b666-46ac-b407-48b6952ab03d tempest-VolumesNegativeTest-1107689494 tempest-VolumesNegativeTest-1107689494-project] 10.222.0.61 "GET /compute/v2.1/servers/ea1f238d-3bae-4ce8-b328-d07fc2f7f272" status: 200 len: 1471 microversion: 2.1 time: 0.462511 May 14 15:49:36.861020 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: [pid: 128728|app: 0|req: 271/522] 10.222.0.61 () {58 vars in 1235 bytes} [Sat May 14 15:49:36 2022] GET /compute/v2.1/servers/ea1f238d-3bae-4ce8-b328-d07fc2f7f272 => generated 1471 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 15:49:37.142567 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi [None req-7611f35c-b318-4c87-93be-ffaa23711fc8 tempest-VolumesActionsTest-1534566879 tempest-VolumesActionsTest-1534566879-project] Calling method '>' {{(pid=128729) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 15:49:37.143251 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.compute.api [None req-7611f35c-b318-4c87-93be-ffaa23711fc8 tempest-VolumesActionsTest-1534566879 tempest-VolumesActionsTest-1534566879-project] [instance: 656dffc0-256e-40ba-b670-f08e247a0d95] Fetching instance by UUID {{(pid=128729) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 15:49:37.150180 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-7611f35c-b318-4c87-93be-ffaa23711fc8 tempest-VolumesActionsTest-1534566879 tempest-VolumesActionsTest-1534566879-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:49:37.150737 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-7611f35c-b318-4c87-93be-ffaa23711fc8 tempest-VolumesActionsTest-1534566879 tempest-VolumesActionsTest-1534566879-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:49:37.154291 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-7611f35c-b318-4c87-93be-ffaa23711fc8 tempest-VolumesActionsTest-1534566879 tempest-VolumesActionsTest-1534566879-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:49:37.154764 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-7611f35c-b318-4c87-93be-ffaa23711fc8 tempest-VolumesActionsTest-1534566879 tempest-VolumesActionsTest-1534566879-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:49:37.287545 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.policy [None req-7611f35c-b318-4c87-93be-ffaa23711fc8 tempest-VolumesActionsTest-1534566879 tempest-VolumesActionsTest-1534566879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0156ed87a5b4efca7ef5056429db1a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71b09f9f20b340b5a615b24e05312703', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128729) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:49:37.296712 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: INFO nova.api.openstack.requestlog [None req-7611f35c-b318-4c87-93be-ffaa23711fc8 tempest-VolumesActionsTest-1534566879 tempest-VolumesActionsTest-1534566879-project] 10.222.0.61 "GET /compute/v2.1/servers/656dffc0-256e-40ba-b670-f08e247a0d95" status: 200 len: 1314 microversion: 2.1 time: 0.158397 May 14 15:49:37.297286 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: [pid: 128729|app: 0|req: 252/523] 10.222.0.61 () {58 vars in 1235 bytes} [Sat May 14 15:49:37 2022] GET /compute/v2.1/servers/656dffc0-256e-40ba-b670-f08e247a0d95 => generated 1314 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 15:49:37.827365 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi [None req-e85f9eaf-8a9c-4bb0-8f6f-2925ca878a67 tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Calling method '>' {{(pid=128728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 15:49:37.827950 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.compute.api [None req-e85f9eaf-8a9c-4bb0-8f6f-2925ca878a67 tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] [instance: 7c21adbe-7a79-46cf-aa7c-9b2a6548c767] Fetching instance by UUID {{(pid=128728) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 15:49:37.833688 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-e85f9eaf-8a9c-4bb0-8f6f-2925ca878a67 tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:49:37.834141 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-e85f9eaf-8a9c-4bb0-8f6f-2925ca878a67 tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:49:37.834955 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-e85f9eaf-8a9c-4bb0-8f6f-2925ca878a67 tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:49:37.835394 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-e85f9eaf-8a9c-4bb0-8f6f-2925ca878a67 tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:49:37.877945 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi [None req-1420a064-84e4-42ed-9b94-29a8c8dfd0d0 tempest-VolumesNegativeTest-1107689494 tempest-VolumesNegativeTest-1107689494-project] Calling method '>' {{(pid=128729) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 15:49:37.879361 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.compute.api [None req-1420a064-84e4-42ed-9b94-29a8c8dfd0d0 tempest-VolumesNegativeTest-1107689494 tempest-VolumesNegativeTest-1107689494-project] [instance: ea1f238d-3bae-4ce8-b328-d07fc2f7f272] Fetching instance by UUID {{(pid=128729) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 15:49:37.886556 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-1420a064-84e4-42ed-9b94-29a8c8dfd0d0 tempest-VolumesNegativeTest-1107689494 tempest-VolumesNegativeTest-1107689494-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:49:37.887016 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-1420a064-84e4-42ed-9b94-29a8c8dfd0d0 tempest-VolumesNegativeTest-1107689494 tempest-VolumesNegativeTest-1107689494-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:49:37.887794 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-1420a064-84e4-42ed-9b94-29a8c8dfd0d0 tempest-VolumesNegativeTest-1107689494 tempest-VolumesNegativeTest-1107689494-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:49:37.888233 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-1420a064-84e4-42ed-9b94-29a8c8dfd0d0 tempest-VolumesNegativeTest-1107689494 tempest-VolumesNegativeTest-1107689494-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:49:38.053640 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.policy [None req-e85f9eaf-8a9c-4bb0-8f6f-2925ca878a67 tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b896317d96a40d6a137db0dcf5f98f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d2517d5440a4d30949f3dd36a46d813', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128728) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:49:38.062086 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: INFO nova.api.openstack.requestlog [None req-e85f9eaf-8a9c-4bb0-8f6f-2925ca878a67 tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] 10.222.0.61 "GET /compute/v2.1/servers/7c21adbe-7a79-46cf-aa7c-9b2a6548c767" status: 200 len: 1370 microversion: 2.1 time: 0.238502 May 14 15:49:38.062692 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: [pid: 128728|app: 0|req: 272/524] 10.222.0.61 () {58 vars in 1235 bytes} [Sat May 14 15:49:37 2022] GET /compute/v2.1/servers/7c21adbe-7a79-46cf-aa7c-9b2a6548c767 => generated 1370 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 15:49:38.117317 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.policy [None req-1420a064-84e4-42ed-9b94-29a8c8dfd0d0 tempest-VolumesNegativeTest-1107689494 tempest-VolumesNegativeTest-1107689494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e8303a1f1584ae2aae774eaf31481f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1e7c6697dfc4562b4c1d46ee21964a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128729) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:49:38.128390 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: INFO nova.api.openstack.requestlog [None req-1420a064-84e4-42ed-9b94-29a8c8dfd0d0 tempest-VolumesNegativeTest-1107689494 tempest-VolumesNegativeTest-1107689494-project] 10.222.0.61 "GET /compute/v2.1/servers/ea1f238d-3bae-4ce8-b328-d07fc2f7f272" status: 200 len: 1471 microversion: 2.1 time: 0.255021 May 14 15:49:38.139998 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: [pid: 128729|app: 0|req: 253/525] 10.222.0.61 () {58 vars in 1235 bytes} [Sat May 14 15:49:37 2022] GET /compute/v2.1/servers/ea1f238d-3bae-4ce8-b328-d07fc2f7f272 => generated 1471 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 15:49:38.315195 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi [None req-a35b31ab-91db-454f-a36c-0a2fce481228 tempest-VolumesActionsTest-1534566879 tempest-VolumesActionsTest-1534566879-project] Calling method '>' {{(pid=128728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 15:49:38.316225 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.compute.api [None req-a35b31ab-91db-454f-a36c-0a2fce481228 tempest-VolumesActionsTest-1534566879 tempest-VolumesActionsTest-1534566879-project] [instance: 656dffc0-256e-40ba-b670-f08e247a0d95] Fetching instance by UUID {{(pid=128728) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 15:49:38.342580 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-a35b31ab-91db-454f-a36c-0a2fce481228 tempest-VolumesActionsTest-1534566879 tempest-VolumesActionsTest-1534566879-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:49:38.343731 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-a35b31ab-91db-454f-a36c-0a2fce481228 tempest-VolumesActionsTest-1534566879 tempest-VolumesActionsTest-1534566879-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:49:38.345321 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-a35b31ab-91db-454f-a36c-0a2fce481228 tempest-VolumesActionsTest-1534566879 tempest-VolumesActionsTest-1534566879-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:49:38.346002 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-a35b31ab-91db-454f-a36c-0a2fce481228 tempest-VolumesActionsTest-1534566879 tempest-VolumesActionsTest-1534566879-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:49:38.607556 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.policy [None req-a35b31ab-91db-454f-a36c-0a2fce481228 tempest-VolumesActionsTest-1534566879 tempest-VolumesActionsTest-1534566879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0156ed87a5b4efca7ef5056429db1a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71b09f9f20b340b5a615b24e05312703', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128728) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:49:38.615014 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: INFO nova.api.openstack.requestlog [None req-a35b31ab-91db-454f-a36c-0a2fce481228 tempest-VolumesActionsTest-1534566879 tempest-VolumesActionsTest-1534566879-project] 10.222.0.61 "GET /compute/v2.1/servers/656dffc0-256e-40ba-b670-f08e247a0d95" status: 200 len: 1314 microversion: 2.1 time: 0.304818 May 14 15:49:38.615580 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: [pid: 128728|app: 0|req: 273/526] 10.222.0.61 () {58 vars in 1235 bytes} [Sat May 14 15:49:38 2022] GET /compute/v2.1/servers/656dffc0-256e-40ba-b670-f08e247a0d95 => generated 1314 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 15:49:38.756405 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi [req-532b3392-7fe3-4b69-9c39-b3fc2f7841a9 req-df38081f-2212-4728-b1c8-99f6db1e02d7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ea1f238d-3bae-4ce8-b328-d07fc2f7f272", "name": "network-vif-deleted", "tag": "e4c131d9-3887-4760-96f8-18f3e257f1f7"}]} {{(pid=128729) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 15:49:38.766533 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [req-532b3392-7fe3-4b69-9c39-b3fc2f7841a9 req-df38081f-2212-4728-b1c8-99f6db1e02d7 service nova] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:49:38.766973 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [req-532b3392-7fe3-4b69-9c39-b3fc2f7841a9 req-df38081f-2212-4728-b1c8-99f6db1e02d7 service nova] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:49:38.783695 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: INFO nova.api.openstack.compute.server_external_events [req-532b3392-7fe3-4b69-9c39-b3fc2f7841a9 req-df38081f-2212-4728-b1c8-99f6db1e02d7 service nova] Creating event network-vif-deleted:e4c131d9-3887-4760-96f8-18f3e257f1f7 for instance ea1f238d-3bae-4ce8-b328-d07fc2f7f272 on hv-cinder-83979 May 14 15:49:38.789855 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: INFO nova.api.openstack.requestlog [req-532b3392-7fe3-4b69-9c39-b3fc2f7841a9 req-df38081f-2212-4728-b1c8-99f6db1e02d7 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038037 May 14 15:49:38.790950 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: [pid: 128729|app: 0|req: 254/527] 10.222.0.61 () {64 vars in 1317 bytes} [Sat May 14 15:49:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 14 15:49:39.080430 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi [None req-018f6650-e213-4a0e-91ac-c5996ee0ac42 tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Calling method '>' {{(pid=128728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 15:49:39.081160 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.compute.api [None req-018f6650-e213-4a0e-91ac-c5996ee0ac42 tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] [instance: 7c21adbe-7a79-46cf-aa7c-9b2a6548c767] Fetching instance by UUID {{(pid=128728) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 15:49:39.088285 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-018f6650-e213-4a0e-91ac-c5996ee0ac42 tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:49:39.088778 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-018f6650-e213-4a0e-91ac-c5996ee0ac42 tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:49:39.089563 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-018f6650-e213-4a0e-91ac-c5996ee0ac42 tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:49:39.090003 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-018f6650-e213-4a0e-91ac-c5996ee0ac42 tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:49:39.147099 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi [None req-77a0f088-b4f4-4286-bc9c-9b34729bfc13 tempest-VolumesNegativeTest-1107689494 tempest-VolumesNegativeTest-1107689494-project] Calling method '>' {{(pid=128729) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 15:49:39.147700 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.compute.api [None req-77a0f088-b4f4-4286-bc9c-9b34729bfc13 tempest-VolumesNegativeTest-1107689494 tempest-VolumesNegativeTest-1107689494-project] [instance: ea1f238d-3bae-4ce8-b328-d07fc2f7f272] Fetching instance by UUID {{(pid=128729) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 15:49:39.154243 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-77a0f088-b4f4-4286-bc9c-9b34729bfc13 tempest-VolumesNegativeTest-1107689494 tempest-VolumesNegativeTest-1107689494-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:49:39.154918 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-77a0f088-b4f4-4286-bc9c-9b34729bfc13 tempest-VolumesNegativeTest-1107689494 tempest-VolumesNegativeTest-1107689494-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:49:39.155692 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-77a0f088-b4f4-4286-bc9c-9b34729bfc13 tempest-VolumesNegativeTest-1107689494 tempest-VolumesNegativeTest-1107689494-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:49:39.156128 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-77a0f088-b4f4-4286-bc9c-9b34729bfc13 tempest-VolumesNegativeTest-1107689494 tempest-VolumesNegativeTest-1107689494-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:49:39.185915 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-77a0f088-b4f4-4286-bc9c-9b34729bfc13 tempest-VolumesNegativeTest-1107689494 tempest-VolumesNegativeTest-1107689494-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:49:39.186397 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-77a0f088-b4f4-4286-bc9c-9b34729bfc13 tempest-VolumesNegativeTest-1107689494 tempest-VolumesNegativeTest-1107689494-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:49:39.186863 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.objects.instance [None req-77a0f088-b4f4-4286-bc9c-9b34729bfc13 tempest-VolumesNegativeTest-1107689494 tempest-VolumesNegativeTest-1107689494-project] Lazy-loading 'fault' on Instance uuid ea1f238d-3bae-4ce8-b328-d07fc2f7f272 {{(pid=128729) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 14 15:49:39.236917 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.policy [None req-77a0f088-b4f4-4286-bc9c-9b34729bfc13 tempest-VolumesNegativeTest-1107689494 tempest-VolumesNegativeTest-1107689494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e8303a1f1584ae2aae774eaf31481f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1e7c6697dfc4562b4c1d46ee21964a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128729) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:49:39.244067 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.policy [None req-018f6650-e213-4a0e-91ac-c5996ee0ac42 tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b896317d96a40d6a137db0dcf5f98f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d2517d5440a4d30949f3dd36a46d813', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128728) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:49:39.244758 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: INFO nova.api.openstack.requestlog [None req-77a0f088-b4f4-4286-bc9c-9b34729bfc13 tempest-VolumesNegativeTest-1107689494 tempest-VolumesNegativeTest-1107689494-project] 10.222.0.61 "GET /compute/v2.1/servers/ea1f238d-3bae-4ce8-b328-d07fc2f7f272" status: 200 len: 1305 microversion: 2.1 time: 0.101770 May 14 15:49:39.245497 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: [pid: 128729|app: 0|req: 255/528] 10.222.0.61 () {58 vars in 1235 bytes} [Sat May 14 15:49:39 2022] GET /compute/v2.1/servers/ea1f238d-3bae-4ce8-b328-d07fc2f7f272 => generated 1305 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 15:49:39.251906 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: INFO nova.api.openstack.requestlog [None req-018f6650-e213-4a0e-91ac-c5996ee0ac42 tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] 10.222.0.61 "GET /compute/v2.1/servers/7c21adbe-7a79-46cf-aa7c-9b2a6548c767" status: 200 len: 1370 microversion: 2.1 time: 0.176162 May 14 15:49:39.252597 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: [pid: 128728|app: 0|req: 274/529] 10.222.0.61 () {58 vars in 1235 bytes} [Sat May 14 15:49:39 2022] GET /compute/v2.1/servers/7c21adbe-7a79-46cf-aa7c-9b2a6548c767 => generated 1370 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 15:49:39.632243 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi [None req-7dd9d46a-9de9-4548-8416-22fb4255111a tempest-VolumesActionsTest-1534566879 tempest-VolumesActionsTest-1534566879-project] Calling method '>' {{(pid=128729) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 15:49:39.632846 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.compute.api [None req-7dd9d46a-9de9-4548-8416-22fb4255111a tempest-VolumesActionsTest-1534566879 tempest-VolumesActionsTest-1534566879-project] [instance: 656dffc0-256e-40ba-b670-f08e247a0d95] Fetching instance by UUID {{(pid=128729) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 15:49:39.639332 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-7dd9d46a-9de9-4548-8416-22fb4255111a tempest-VolumesActionsTest-1534566879 tempest-VolumesActionsTest-1534566879-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:49:39.639775 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-7dd9d46a-9de9-4548-8416-22fb4255111a tempest-VolumesActionsTest-1534566879 tempest-VolumesActionsTest-1534566879-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:49:39.640534 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-7dd9d46a-9de9-4548-8416-22fb4255111a tempest-VolumesActionsTest-1534566879 tempest-VolumesActionsTest-1534566879-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:49:39.640961 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-7dd9d46a-9de9-4548-8416-22fb4255111a tempest-VolumesActionsTest-1534566879 tempest-VolumesActionsTest-1534566879-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:49:39.767713 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.policy [None req-7dd9d46a-9de9-4548-8416-22fb4255111a tempest-VolumesActionsTest-1534566879 tempest-VolumesActionsTest-1534566879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0156ed87a5b4efca7ef5056429db1a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71b09f9f20b340b5a615b24e05312703', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128729) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:49:39.775086 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: INFO nova.api.openstack.requestlog [None req-7dd9d46a-9de9-4548-8416-22fb4255111a tempest-VolumesActionsTest-1534566879 tempest-VolumesActionsTest-1534566879-project] 10.222.0.61 "GET /compute/v2.1/servers/656dffc0-256e-40ba-b670-f08e247a0d95" status: 200 len: 1498 microversion: 2.1 time: 0.146617 May 14 15:49:39.775866 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: [pid: 128729|app: 0|req: 256/530] 10.222.0.61 () {58 vars in 1235 bytes} [Sat May 14 15:49:39 2022] GET /compute/v2.1/servers/656dffc0-256e-40ba-b670-f08e247a0d95 => generated 1498 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 15:49:40.262239 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi [None req-5c8f5e8a-fef1-465c-b9c5-27a9f56e2c94 tempest-VolumesNegativeTest-1107689494 tempest-VolumesNegativeTest-1107689494-project] Calling method '>' {{(pid=128728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 15:49:40.264181 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.compute.api [None req-5c8f5e8a-fef1-465c-b9c5-27a9f56e2c94 tempest-VolumesNegativeTest-1107689494 tempest-VolumesNegativeTest-1107689494-project] [instance: ea1f238d-3bae-4ce8-b328-d07fc2f7f272] Fetching instance by UUID {{(pid=128728) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 15:49:40.268696 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi [None req-e45265ad-9172-4dfa-84f0-6e2e928b731b tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Calling method '>' {{(pid=128729) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 15:49:40.269300 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.compute.api [None req-e45265ad-9172-4dfa-84f0-6e2e928b731b tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] [instance: 7c21adbe-7a79-46cf-aa7c-9b2a6548c767] Fetching instance by UUID {{(pid=128729) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 15:49:40.269622 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-5c8f5e8a-fef1-465c-b9c5-27a9f56e2c94 tempest-VolumesNegativeTest-1107689494 tempest-VolumesNegativeTest-1107689494-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:49:40.270413 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-5c8f5e8a-fef1-465c-b9c5-27a9f56e2c94 tempest-VolumesNegativeTest-1107689494 tempest-VolumesNegativeTest-1107689494-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:49:40.271362 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-5c8f5e8a-fef1-465c-b9c5-27a9f56e2c94 tempest-VolumesNegativeTest-1107689494 tempest-VolumesNegativeTest-1107689494-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:49:40.271951 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-5c8f5e8a-fef1-465c-b9c5-27a9f56e2c94 tempest-VolumesNegativeTest-1107689494 tempest-VolumesNegativeTest-1107689494-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:49:40.276565 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-e45265ad-9172-4dfa-84f0-6e2e928b731b tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:49:40.277012 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-e45265ad-9172-4dfa-84f0-6e2e928b731b tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:49:40.277984 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-e45265ad-9172-4dfa-84f0-6e2e928b731b tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:49:40.278500 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-e45265ad-9172-4dfa-84f0-6e2e928b731b tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:49:40.312154 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-5c8f5e8a-fef1-465c-b9c5-27a9f56e2c94 tempest-VolumesNegativeTest-1107689494 tempest-VolumesNegativeTest-1107689494-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:49:40.312710 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-5c8f5e8a-fef1-465c-b9c5-27a9f56e2c94 tempest-VolumesNegativeTest-1107689494 tempest-VolumesNegativeTest-1107689494-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:49:40.313429 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.objects.instance [None req-5c8f5e8a-fef1-465c-b9c5-27a9f56e2c94 tempest-VolumesNegativeTest-1107689494 tempest-VolumesNegativeTest-1107689494-project] Lazy-loading 'fault' on Instance uuid ea1f238d-3bae-4ce8-b328-d07fc2f7f272 {{(pid=128728) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 14 15:49:40.387620 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.policy [None req-5c8f5e8a-fef1-465c-b9c5-27a9f56e2c94 tempest-VolumesNegativeTest-1107689494 tempest-VolumesNegativeTest-1107689494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e8303a1f1584ae2aae774eaf31481f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1e7c6697dfc4562b4c1d46ee21964a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128728) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:49:40.399479 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: INFO nova.api.openstack.requestlog [None req-5c8f5e8a-fef1-465c-b9c5-27a9f56e2c94 tempest-VolumesNegativeTest-1107689494 tempest-VolumesNegativeTest-1107689494-project] 10.222.0.61 "GET /compute/v2.1/servers/ea1f238d-3bae-4ce8-b328-d07fc2f7f272" status: 200 len: 1305 microversion: 2.1 time: 0.141496 May 14 15:49:40.400053 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: [pid: 128728|app: 0|req: 275/531] 10.222.0.61 () {58 vars in 1235 bytes} [Sat May 14 15:49:40 2022] GET /compute/v2.1/servers/ea1f238d-3bae-4ce8-b328-d07fc2f7f272 => generated 1305 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 15:49:40.412322 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi [None req-b8b3f9eb-8c78-4281-a96d-ce34a50fd0cb tempest-VolumesActionsTest-1534566879 tempest-VolumesActionsTest-1534566879-project] Calling method '>' {{(pid=128728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 15:49:40.412912 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.compute.api [None req-b8b3f9eb-8c78-4281-a96d-ce34a50fd0cb tempest-VolumesActionsTest-1534566879 tempest-VolumesActionsTest-1534566879-project] [instance: 656dffc0-256e-40ba-b670-f08e247a0d95] Fetching instance by UUID {{(pid=128728) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 15:49:40.420547 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-b8b3f9eb-8c78-4281-a96d-ce34a50fd0cb tempest-VolumesActionsTest-1534566879 tempest-VolumesActionsTest-1534566879-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:49:40.420889 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-b8b3f9eb-8c78-4281-a96d-ce34a50fd0cb tempest-VolumesActionsTest-1534566879 tempest-VolumesActionsTest-1534566879-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:49:40.421860 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-b8b3f9eb-8c78-4281-a96d-ce34a50fd0cb tempest-VolumesActionsTest-1534566879 tempest-VolumesActionsTest-1534566879-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:49:40.422493 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-b8b3f9eb-8c78-4281-a96d-ce34a50fd0cb tempest-VolumesActionsTest-1534566879 tempest-VolumesActionsTest-1534566879-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:49:40.456607 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.policy [None req-e45265ad-9172-4dfa-84f0-6e2e928b731b tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b896317d96a40d6a137db0dcf5f98f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d2517d5440a4d30949f3dd36a46d813', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128729) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:49:40.462217 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.compute.api [None req-b8b3f9eb-8c78-4281-a96d-ce34a50fd0cb tempest-VolumesActionsTest-1534566879 tempest-VolumesActionsTest-1534566879-project] [instance: 656dffc0-256e-40ba-b670-f08e247a0d95] Going to try to terminate instance {{(pid=128728) delete /opt/stack/nova/nova/compute/api.py:2664}} May 14 15:49:40.464920 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: INFO nova.api.openstack.requestlog [None req-e45265ad-9172-4dfa-84f0-6e2e928b731b tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] 10.222.0.61 "GET /compute/v2.1/servers/7c21adbe-7a79-46cf-aa7c-9b2a6548c767" status: 200 len: 1370 microversion: 2.1 time: 0.199939 May 14 15:49:40.474456 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: [pid: 128729|app: 0|req: 257/532] 10.222.0.61 () {58 vars in 1235 bytes} [Sat May 14 15:49:40 2022] GET /compute/v2.1/servers/7c21adbe-7a79-46cf-aa7c-9b2a6548c767 => generated 1370 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 15:49:40.539660 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: INFO nova.api.openstack.requestlog [None req-b8b3f9eb-8c78-4281-a96d-ce34a50fd0cb tempest-VolumesActionsTest-1534566879 tempest-VolumesActionsTest-1534566879-project] 10.222.0.61 "DELETE /compute/v2.1/servers/656dffc0-256e-40ba-b670-f08e247a0d95" status: 204 len: 0 microversion: 2.1 time: 0.137862 May 14 15:49:40.540267 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: [pid: 128728|app: 0|req: 276/533] 10.222.0.61 () {58 vars in 1238 bytes} [Sat May 14 15:49:40 2022] DELETE /compute/v2.1/servers/656dffc0-256e-40ba-b670-f08e247a0d95 => generated 0 bytes in 139 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 14 15:49:40.549735 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi [None req-1dd7fe3d-d508-4901-a234-c79e22ad76ba tempest-VolumesActionsTest-1534566879 tempest-VolumesActionsTest-1534566879-project] Calling method '>' {{(pid=128729) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 15:49:40.550668 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.compute.api [None req-1dd7fe3d-d508-4901-a234-c79e22ad76ba tempest-VolumesActionsTest-1534566879 tempest-VolumesActionsTest-1534566879-project] [instance: 656dffc0-256e-40ba-b670-f08e247a0d95] Fetching instance by UUID {{(pid=128729) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 15:49:40.556419 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-1dd7fe3d-d508-4901-a234-c79e22ad76ba tempest-VolumesActionsTest-1534566879 tempest-VolumesActionsTest-1534566879-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:49:40.557495 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-1dd7fe3d-d508-4901-a234-c79e22ad76ba tempest-VolumesActionsTest-1534566879 tempest-VolumesActionsTest-1534566879-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:49:40.558469 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-1dd7fe3d-d508-4901-a234-c79e22ad76ba tempest-VolumesActionsTest-1534566879 tempest-VolumesActionsTest-1534566879-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:49:40.558897 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-1dd7fe3d-d508-4901-a234-c79e22ad76ba tempest-VolumesActionsTest-1534566879 tempest-VolumesActionsTest-1534566879-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:49:40.689580 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.policy [None req-1dd7fe3d-d508-4901-a234-c79e22ad76ba tempest-VolumesActionsTest-1534566879 tempest-VolumesActionsTest-1534566879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0156ed87a5b4efca7ef5056429db1a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71b09f9f20b340b5a615b24e05312703', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128729) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:49:40.696782 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: INFO nova.api.openstack.requestlog [None req-1dd7fe3d-d508-4901-a234-c79e22ad76ba tempest-VolumesActionsTest-1534566879 tempest-VolumesActionsTest-1534566879-project] 10.222.0.61 "GET /compute/v2.1/servers/656dffc0-256e-40ba-b670-f08e247a0d95" status: 200 len: 1504 microversion: 2.1 time: 0.150984 May 14 15:49:40.697355 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: [pid: 128729|app: 0|req: 258/534] 10.222.0.61 () {58 vars in 1235 bytes} [Sat May 14 15:49:40 2022] GET /compute/v2.1/servers/656dffc0-256e-40ba-b670-f08e247a0d95 => generated 1504 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 15:49:41.416839 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi [None req-50948bfd-f3d4-402e-bdae-a4b1230c3a18 tempest-VolumesNegativeTest-1107689494 tempest-VolumesNegativeTest-1107689494-project] Calling method '>' {{(pid=128728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 15:49:41.417552 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.compute.api [None req-50948bfd-f3d4-402e-bdae-a4b1230c3a18 tempest-VolumesNegativeTest-1107689494 tempest-VolumesNegativeTest-1107689494-project] [instance: ea1f238d-3bae-4ce8-b328-d07fc2f7f272] Fetching instance by UUID {{(pid=128728) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 15:49:41.423605 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-50948bfd-f3d4-402e-bdae-a4b1230c3a18 tempest-VolumesNegativeTest-1107689494 tempest-VolumesNegativeTest-1107689494-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:49:41.424053 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-50948bfd-f3d4-402e-bdae-a4b1230c3a18 tempest-VolumesNegativeTest-1107689494 tempest-VolumesNegativeTest-1107689494-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:49:41.424818 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-50948bfd-f3d4-402e-bdae-a4b1230c3a18 tempest-VolumesNegativeTest-1107689494 tempest-VolumesNegativeTest-1107689494-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:49:41.425248 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-50948bfd-f3d4-402e-bdae-a4b1230c3a18 tempest-VolumesNegativeTest-1107689494 tempest-VolumesNegativeTest-1107689494-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:49:41.456373 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-50948bfd-f3d4-402e-bdae-a4b1230c3a18 tempest-VolumesNegativeTest-1107689494 tempest-VolumesNegativeTest-1107689494-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:49:41.456809 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-50948bfd-f3d4-402e-bdae-a4b1230c3a18 tempest-VolumesNegativeTest-1107689494 tempest-VolumesNegativeTest-1107689494-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:49:41.457245 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.objects.instance [None req-50948bfd-f3d4-402e-bdae-a4b1230c3a18 tempest-VolumesNegativeTest-1107689494 tempest-VolumesNegativeTest-1107689494-project] Lazy-loading 'fault' on Instance uuid ea1f238d-3bae-4ce8-b328-d07fc2f7f272 {{(pid=128728) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 14 15:49:41.481756 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi [None req-edf9440f-46fd-480b-a5fa-3658a2472e50 tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Calling method '>' {{(pid=128729) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 15:49:41.482369 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.compute.api [None req-edf9440f-46fd-480b-a5fa-3658a2472e50 tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] [instance: 7c21adbe-7a79-46cf-aa7c-9b2a6548c767] Fetching instance by UUID {{(pid=128729) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 15:49:41.495159 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-edf9440f-46fd-480b-a5fa-3658a2472e50 tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:49:41.495610 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-edf9440f-46fd-480b-a5fa-3658a2472e50 tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:49:41.496384 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-edf9440f-46fd-480b-a5fa-3658a2472e50 tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:49:41.496819 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-edf9440f-46fd-480b-a5fa-3658a2472e50 tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:49:41.501722 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.policy [None req-50948bfd-f3d4-402e-bdae-a4b1230c3a18 tempest-VolumesNegativeTest-1107689494 tempest-VolumesNegativeTest-1107689494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e8303a1f1584ae2aae774eaf31481f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1e7c6697dfc4562b4c1d46ee21964a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128728) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:49:41.508945 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: INFO nova.api.openstack.requestlog [None req-50948bfd-f3d4-402e-bdae-a4b1230c3a18 tempest-VolumesNegativeTest-1107689494 tempest-VolumesNegativeTest-1107689494-project] 10.222.0.61 "GET /compute/v2.1/servers/ea1f238d-3bae-4ce8-b328-d07fc2f7f272" status: 200 len: 1305 microversion: 2.1 time: 0.097053 May 14 15:49:41.509515 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: [pid: 128728|app: 0|req: 277/535] 10.222.0.61 () {58 vars in 1235 bytes} [Sat May 14 15:49:41 2022] GET /compute/v2.1/servers/ea1f238d-3bae-4ce8-b328-d07fc2f7f272 => generated 1305 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 15:49:41.632258 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.policy [None req-edf9440f-46fd-480b-a5fa-3658a2472e50 tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b896317d96a40d6a137db0dcf5f98f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d2517d5440a4d30949f3dd36a46d813', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128729) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:49:41.639685 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: INFO nova.api.openstack.requestlog [None req-edf9440f-46fd-480b-a5fa-3658a2472e50 tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] 10.222.0.61 "GET /compute/v2.1/servers/7c21adbe-7a79-46cf-aa7c-9b2a6548c767" status: 200 len: 1370 microversion: 2.1 time: 0.162363 May 14 15:49:41.640252 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: [pid: 128729|app: 0|req: 259/536] 10.222.0.61 () {58 vars in 1235 bytes} [Sat May 14 15:49:41 2022] GET /compute/v2.1/servers/7c21adbe-7a79-46cf-aa7c-9b2a6548c767 => generated 1370 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 15:49:41.712845 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi [None req-ce1f5018-7c89-437c-a34f-6553466924b5 tempest-VolumesActionsTest-1534566879 tempest-VolumesActionsTest-1534566879-project] Calling method '>' {{(pid=128728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 15:49:41.713570 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.compute.api [None req-ce1f5018-7c89-437c-a34f-6553466924b5 tempest-VolumesActionsTest-1534566879 tempest-VolumesActionsTest-1534566879-project] [instance: 656dffc0-256e-40ba-b670-f08e247a0d95] Fetching instance by UUID {{(pid=128728) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 15:49:41.719970 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-ce1f5018-7c89-437c-a34f-6553466924b5 tempest-VolumesActionsTest-1534566879 tempest-VolumesActionsTest-1534566879-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:49:41.720418 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-ce1f5018-7c89-437c-a34f-6553466924b5 tempest-VolumesActionsTest-1534566879 tempest-VolumesActionsTest-1534566879-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:49:41.721440 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-ce1f5018-7c89-437c-a34f-6553466924b5 tempest-VolumesActionsTest-1534566879 tempest-VolumesActionsTest-1534566879-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:49:41.721999 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-ce1f5018-7c89-437c-a34f-6553466924b5 tempest-VolumesActionsTest-1534566879 tempest-VolumesActionsTest-1534566879-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:49:41.851197 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.policy [None req-ce1f5018-7c89-437c-a34f-6553466924b5 tempest-VolumesActionsTest-1534566879 tempest-VolumesActionsTest-1534566879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0156ed87a5b4efca7ef5056429db1a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71b09f9f20b340b5a615b24e05312703', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128728) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:49:41.859045 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: INFO nova.api.openstack.requestlog [None req-ce1f5018-7c89-437c-a34f-6553466924b5 tempest-VolumesActionsTest-1534566879 tempest-VolumesActionsTest-1534566879-project] 10.222.0.61 "GET /compute/v2.1/servers/656dffc0-256e-40ba-b670-f08e247a0d95" status: 200 len: 1504 microversion: 2.1 time: 0.149941 May 14 15:49:41.859610 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: [pid: 128728|app: 0|req: 278/537] 10.222.0.61 () {58 vars in 1235 bytes} [Sat May 14 15:49:41 2022] GET /compute/v2.1/servers/656dffc0-256e-40ba-b670-f08e247a0d95 => generated 1504 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 15:49:42.528494 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi [None req-14412ec0-977b-48e6-af4e-1788cf6a3e31 tempest-VolumesNegativeTest-1107689494 tempest-VolumesNegativeTest-1107689494-project] Calling method '>' {{(pid=128729) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 15:49:42.529449 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.compute.api [None req-14412ec0-977b-48e6-af4e-1788cf6a3e31 tempest-VolumesNegativeTest-1107689494 tempest-VolumesNegativeTest-1107689494-project] [instance: ea1f238d-3bae-4ce8-b328-d07fc2f7f272] Fetching instance by UUID {{(pid=128729) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 15:49:42.535918 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-14412ec0-977b-48e6-af4e-1788cf6a3e31 tempest-VolumesNegativeTest-1107689494 tempest-VolumesNegativeTest-1107689494-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:49:42.536376 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-14412ec0-977b-48e6-af4e-1788cf6a3e31 tempest-VolumesNegativeTest-1107689494 tempest-VolumesNegativeTest-1107689494-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:49:42.537157 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-14412ec0-977b-48e6-af4e-1788cf6a3e31 tempest-VolumesNegativeTest-1107689494 tempest-VolumesNegativeTest-1107689494-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:49:42.537770 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-14412ec0-977b-48e6-af4e-1788cf6a3e31 tempest-VolumesNegativeTest-1107689494 tempest-VolumesNegativeTest-1107689494-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:49:42.569743 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-14412ec0-977b-48e6-af4e-1788cf6a3e31 tempest-VolumesNegativeTest-1107689494 tempest-VolumesNegativeTest-1107689494-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:49:42.570200 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-14412ec0-977b-48e6-af4e-1788cf6a3e31 tempest-VolumesNegativeTest-1107689494 tempest-VolumesNegativeTest-1107689494-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:49:42.570692 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.objects.instance [None req-14412ec0-977b-48e6-af4e-1788cf6a3e31 tempest-VolumesNegativeTest-1107689494 tempest-VolumesNegativeTest-1107689494-project] Lazy-loading 'fault' on Instance uuid ea1f238d-3bae-4ce8-b328-d07fc2f7f272 {{(pid=128729) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 14 15:49:42.620806 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.policy [None req-14412ec0-977b-48e6-af4e-1788cf6a3e31 tempest-VolumesNegativeTest-1107689494 tempest-VolumesNegativeTest-1107689494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e8303a1f1584ae2aae774eaf31481f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1e7c6697dfc4562b4c1d46ee21964a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128729) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:49:42.629010 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: INFO nova.api.openstack.requestlog [None req-14412ec0-977b-48e6-af4e-1788cf6a3e31 tempest-VolumesNegativeTest-1107689494 tempest-VolumesNegativeTest-1107689494-project] 10.222.0.61 "GET /compute/v2.1/servers/ea1f238d-3bae-4ce8-b328-d07fc2f7f272" status: 200 len: 1305 microversion: 2.1 time: 0.107445 May 14 15:49:42.642627 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: [pid: 128729|app: 0|req: 260/538] 10.222.0.61 () {58 vars in 1235 bytes} [Sat May 14 15:49:42 2022] GET /compute/v2.1/servers/ea1f238d-3bae-4ce8-b328-d07fc2f7f272 => generated 1305 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 15:49:42.656425 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi [None req-15c46456-f030-4ff8-85f8-74285dbac4d4 tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Calling method '>' {{(pid=128728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 15:49:42.657185 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.compute.api [None req-15c46456-f030-4ff8-85f8-74285dbac4d4 tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] [instance: 7c21adbe-7a79-46cf-aa7c-9b2a6548c767] Fetching instance by UUID {{(pid=128728) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 15:49:42.663280 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-15c46456-f030-4ff8-85f8-74285dbac4d4 tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:49:42.663735 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-15c46456-f030-4ff8-85f8-74285dbac4d4 tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:49:42.664509 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-15c46456-f030-4ff8-85f8-74285dbac4d4 tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:49:42.664951 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-15c46456-f030-4ff8-85f8-74285dbac4d4 tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:49:42.798263 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.policy [None req-15c46456-f030-4ff8-85f8-74285dbac4d4 tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b896317d96a40d6a137db0dcf5f98f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d2517d5440a4d30949f3dd36a46d813', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128728) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:49:42.805429 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: INFO nova.api.openstack.requestlog [None req-15c46456-f030-4ff8-85f8-74285dbac4d4 tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] 10.222.0.61 "GET /compute/v2.1/servers/7c21adbe-7a79-46cf-aa7c-9b2a6548c767" status: 200 len: 1370 microversion: 2.1 time: 0.152897 May 14 15:49:42.805998 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: [pid: 128728|app: 0|req: 279/539] 10.222.0.61 () {58 vars in 1235 bytes} [Sat May 14 15:49:42 2022] GET /compute/v2.1/servers/7c21adbe-7a79-46cf-aa7c-9b2a6548c767 => generated 1370 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 15:49:42.876571 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi [None req-3d413795-7d8f-4bb3-9723-0ea7b874e6ee tempest-VolumesActionsTest-1534566879 tempest-VolumesActionsTest-1534566879-project] Calling method '>' {{(pid=128729) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 15:49:42.877363 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.compute.api [None req-3d413795-7d8f-4bb3-9723-0ea7b874e6ee tempest-VolumesActionsTest-1534566879 tempest-VolumesActionsTest-1534566879-project] [instance: 656dffc0-256e-40ba-b670-f08e247a0d95] Fetching instance by UUID {{(pid=128729) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 15:49:42.883326 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-3d413795-7d8f-4bb3-9723-0ea7b874e6ee tempest-VolumesActionsTest-1534566879 tempest-VolumesActionsTest-1534566879-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:49:42.883858 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-3d413795-7d8f-4bb3-9723-0ea7b874e6ee tempest-VolumesActionsTest-1534566879 tempest-VolumesActionsTest-1534566879-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:49:42.884762 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-3d413795-7d8f-4bb3-9723-0ea7b874e6ee tempest-VolumesActionsTest-1534566879 tempest-VolumesActionsTest-1534566879-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:49:42.885326 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-3d413795-7d8f-4bb3-9723-0ea7b874e6ee tempest-VolumesActionsTest-1534566879 tempest-VolumesActionsTest-1534566879-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:49:43.014796 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.policy [None req-3d413795-7d8f-4bb3-9723-0ea7b874e6ee tempest-VolumesActionsTest-1534566879 tempest-VolumesActionsTest-1534566879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0156ed87a5b4efca7ef5056429db1a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71b09f9f20b340b5a615b24e05312703', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128729) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:49:43.021879 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: INFO nova.api.openstack.requestlog [None req-3d413795-7d8f-4bb3-9723-0ea7b874e6ee tempest-VolumesActionsTest-1534566879 tempest-VolumesActionsTest-1534566879-project] 10.222.0.61 "GET /compute/v2.1/servers/656dffc0-256e-40ba-b670-f08e247a0d95" status: 200 len: 1504 microversion: 2.1 time: 0.149180 May 14 15:49:43.022466 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: [pid: 128729|app: 0|req: 261/540] 10.222.0.61 () {58 vars in 1235 bytes} [Sat May 14 15:49:42 2022] GET /compute/v2.1/servers/656dffc0-256e-40ba-b670-f08e247a0d95 => generated 1504 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 15:49:43.649118 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi [None req-56e5e3b9-9a96-4015-9bcb-841ad7bbcf70 tempest-VolumesNegativeTest-1107689494 tempest-VolumesNegativeTest-1107689494-project] Calling method '>' {{(pid=128728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 15:49:43.649728 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.compute.api [None req-56e5e3b9-9a96-4015-9bcb-841ad7bbcf70 tempest-VolumesNegativeTest-1107689494 tempest-VolumesNegativeTest-1107689494-project] [instance: ea1f238d-3bae-4ce8-b328-d07fc2f7f272] Fetching instance by UUID {{(pid=128728) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 15:49:43.656453 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-56e5e3b9-9a96-4015-9bcb-841ad7bbcf70 tempest-VolumesNegativeTest-1107689494 tempest-VolumesNegativeTest-1107689494-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:49:43.657048 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-56e5e3b9-9a96-4015-9bcb-841ad7bbcf70 tempest-VolumesNegativeTest-1107689494 tempest-VolumesNegativeTest-1107689494-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:49:43.658094 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-56e5e3b9-9a96-4015-9bcb-841ad7bbcf70 tempest-VolumesNegativeTest-1107689494 tempest-VolumesNegativeTest-1107689494-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:49:43.658564 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-56e5e3b9-9a96-4015-9bcb-841ad7bbcf70 tempest-VolumesNegativeTest-1107689494 tempest-VolumesNegativeTest-1107689494-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:49:43.690742 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-56e5e3b9-9a96-4015-9bcb-841ad7bbcf70 tempest-VolumesNegativeTest-1107689494 tempest-VolumesNegativeTest-1107689494-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:49:43.690931 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-56e5e3b9-9a96-4015-9bcb-841ad7bbcf70 tempest-VolumesNegativeTest-1107689494 tempest-VolumesNegativeTest-1107689494-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:49:43.691635 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.objects.instance [None req-56e5e3b9-9a96-4015-9bcb-841ad7bbcf70 tempest-VolumesNegativeTest-1107689494 tempest-VolumesNegativeTest-1107689494-project] Lazy-loading 'fault' on Instance uuid ea1f238d-3bae-4ce8-b328-d07fc2f7f272 {{(pid=128728) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 14 15:49:43.736113 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.policy [None req-56e5e3b9-9a96-4015-9bcb-841ad7bbcf70 tempest-VolumesNegativeTest-1107689494 tempest-VolumesNegativeTest-1107689494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e8303a1f1584ae2aae774eaf31481f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1e7c6697dfc4562b4c1d46ee21964a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128728) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:49:43.743859 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: INFO nova.api.openstack.requestlog [None req-56e5e3b9-9a96-4015-9bcb-841ad7bbcf70 tempest-VolumesNegativeTest-1107689494 tempest-VolumesNegativeTest-1107689494-project] 10.222.0.61 "GET /compute/v2.1/servers/ea1f238d-3bae-4ce8-b328-d07fc2f7f272" status: 200 len: 1305 microversion: 2.1 time: 0.098536 May 14 15:49:43.744463 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: [pid: 128728|app: 0|req: 280/541] 10.222.0.61 () {58 vars in 1235 bytes} [Sat May 14 15:49:43 2022] GET /compute/v2.1/servers/ea1f238d-3bae-4ce8-b328-d07fc2f7f272 => generated 1305 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 15:49:43.823089 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi [None req-6521a2b5-9d3d-4327-8904-1e2db051ca26 tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Calling method '>' {{(pid=128729) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 15:49:43.823741 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.compute.api [None req-6521a2b5-9d3d-4327-8904-1e2db051ca26 tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] [instance: 7c21adbe-7a79-46cf-aa7c-9b2a6548c767] Fetching instance by UUID {{(pid=128729) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 15:49:43.829985 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-6521a2b5-9d3d-4327-8904-1e2db051ca26 tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:49:43.830510 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-6521a2b5-9d3d-4327-8904-1e2db051ca26 tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:49:43.831291 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-6521a2b5-9d3d-4327-8904-1e2db051ca26 tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:49:43.831728 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-6521a2b5-9d3d-4327-8904-1e2db051ca26 tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:49:43.957362 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.policy [None req-6521a2b5-9d3d-4327-8904-1e2db051ca26 tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b896317d96a40d6a137db0dcf5f98f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d2517d5440a4d30949f3dd36a46d813', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128729) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:49:43.965057 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: INFO nova.api.openstack.requestlog [None req-6521a2b5-9d3d-4327-8904-1e2db051ca26 tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] 10.222.0.61 "GET /compute/v2.1/servers/7c21adbe-7a79-46cf-aa7c-9b2a6548c767" status: 200 len: 1370 microversion: 2.1 time: 0.146271 May 14 15:49:43.965613 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: [pid: 128729|app: 0|req: 262/542] 10.222.0.61 () {58 vars in 1235 bytes} [Sat May 14 15:49:43 2022] GET /compute/v2.1/servers/7c21adbe-7a79-46cf-aa7c-9b2a6548c767 => generated 1370 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 15:49:44.038981 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi [None req-0dd648a7-f873-46b4-b02c-21ab9ed96635 tempest-VolumesActionsTest-1534566879 tempest-VolumesActionsTest-1534566879-project] Calling method '>' {{(pid=128728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 15:49:44.039594 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.compute.api [None req-0dd648a7-f873-46b4-b02c-21ab9ed96635 tempest-VolumesActionsTest-1534566879 tempest-VolumesActionsTest-1534566879-project] [instance: 656dffc0-256e-40ba-b670-f08e247a0d95] Fetching instance by UUID {{(pid=128728) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 15:49:44.045339 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-0dd648a7-f873-46b4-b02c-21ab9ed96635 tempest-VolumesActionsTest-1534566879 tempest-VolumesActionsTest-1534566879-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:49:44.045782 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-0dd648a7-f873-46b4-b02c-21ab9ed96635 tempest-VolumesActionsTest-1534566879 tempest-VolumesActionsTest-1534566879-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:49:44.046567 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-0dd648a7-f873-46b4-b02c-21ab9ed96635 tempest-VolumesActionsTest-1534566879 tempest-VolumesActionsTest-1534566879-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:49:44.047003 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-0dd648a7-f873-46b4-b02c-21ab9ed96635 tempest-VolumesActionsTest-1534566879 tempest-VolumesActionsTest-1534566879-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:49:44.175456 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.policy [None req-0dd648a7-f873-46b4-b02c-21ab9ed96635 tempest-VolumesActionsTest-1534566879 tempest-VolumesActionsTest-1534566879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0156ed87a5b4efca7ef5056429db1a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71b09f9f20b340b5a615b24e05312703', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128728) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:49:44.182977 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: INFO nova.api.openstack.requestlog [None req-0dd648a7-f873-46b4-b02c-21ab9ed96635 tempest-VolumesActionsTest-1534566879 tempest-VolumesActionsTest-1534566879-project] 10.222.0.61 "GET /compute/v2.1/servers/656dffc0-256e-40ba-b670-f08e247a0d95" status: 200 len: 1504 microversion: 2.1 time: 0.147798 May 14 15:49:44.183541 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: [pid: 128728|app: 0|req: 281/543] 10.222.0.61 () {58 vars in 1235 bytes} [Sat May 14 15:49:44 2022] GET /compute/v2.1/servers/656dffc0-256e-40ba-b670-f08e247a0d95 => generated 1504 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 15:49:44.710088 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi [req-6c769a2d-c775-4da9-bacb-8fb0895961e4 req-071702aa-44c3-4ae6-bd9e-639751372632 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7c21adbe-7a79-46cf-aa7c-9b2a6548c767", "name": "network-vif-plugged", "status": "completed", "tag": "5c35b70b-002b-48c3-9446-1ba3b1605c2b"}]} {{(pid=128729) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 15:49:44.723370 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [req-6c769a2d-c775-4da9-bacb-8fb0895961e4 req-071702aa-44c3-4ae6-bd9e-639751372632 service nova] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:49:44.724717 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [req-6c769a2d-c775-4da9-bacb-8fb0895961e4 req-071702aa-44c3-4ae6-bd9e-639751372632 service nova] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:49:44.745604 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: INFO nova.api.openstack.compute.server_external_events [req-6c769a2d-c775-4da9-bacb-8fb0895961e4 req-071702aa-44c3-4ae6-bd9e-639751372632 service nova] Creating event network-vif-plugged:5c35b70b-002b-48c3-9446-1ba3b1605c2b for instance 7c21adbe-7a79-46cf-aa7c-9b2a6548c767 on hv-cinder-83979 May 14 15:49:44.754213 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: INFO nova.api.openstack.requestlog [req-6c769a2d-c775-4da9-bacb-8fb0895961e4 req-071702aa-44c3-4ae6-bd9e-639751372632 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047701 May 14 15:49:44.756575 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: [pid: 128729|app: 0|req: 263/544] 10.222.0.61 () {64 vars in 1317 bytes} [Sat May 14 15:49:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 14 15:49:44.762123 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi [None req-d7381f16-b7ea-4939-8e2b-cde37a67fd20 tempest-VolumesNegativeTest-1107689494 tempest-VolumesNegativeTest-1107689494-project] Calling method '>' {{(pid=128728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 15:49:44.763409 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.compute.api [None req-d7381f16-b7ea-4939-8e2b-cde37a67fd20 tempest-VolumesNegativeTest-1107689494 tempest-VolumesNegativeTest-1107689494-project] [instance: ea1f238d-3bae-4ce8-b328-d07fc2f7f272] Fetching instance by UUID {{(pid=128728) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 15:49:44.770735 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-d7381f16-b7ea-4939-8e2b-cde37a67fd20 tempest-VolumesNegativeTest-1107689494 tempest-VolumesNegativeTest-1107689494-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:49:44.772264 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-d7381f16-b7ea-4939-8e2b-cde37a67fd20 tempest-VolumesNegativeTest-1107689494 tempest-VolumesNegativeTest-1107689494-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:49:44.773807 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-d7381f16-b7ea-4939-8e2b-cde37a67fd20 tempest-VolumesNegativeTest-1107689494 tempest-VolumesNegativeTest-1107689494-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:49:44.785728 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-d7381f16-b7ea-4939-8e2b-cde37a67fd20 tempest-VolumesNegativeTest-1107689494 tempest-VolumesNegativeTest-1107689494-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:49:44.823789 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-d7381f16-b7ea-4939-8e2b-cde37a67fd20 tempest-VolumesNegativeTest-1107689494 tempest-VolumesNegativeTest-1107689494-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:49:44.824385 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-d7381f16-b7ea-4939-8e2b-cde37a67fd20 tempest-VolumesNegativeTest-1107689494 tempest-VolumesNegativeTest-1107689494-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:49:44.824934 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.objects.instance [None req-d7381f16-b7ea-4939-8e2b-cde37a67fd20 tempest-VolumesNegativeTest-1107689494 tempest-VolumesNegativeTest-1107689494-project] Lazy-loading 'fault' on Instance uuid ea1f238d-3bae-4ce8-b328-d07fc2f7f272 {{(pid=128728) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 14 15:49:44.898079 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.policy [None req-d7381f16-b7ea-4939-8e2b-cde37a67fd20 tempest-VolumesNegativeTest-1107689494 tempest-VolumesNegativeTest-1107689494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e8303a1f1584ae2aae774eaf31481f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1e7c6697dfc4562b4c1d46ee21964a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128728) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:49:44.908444 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: INFO nova.api.openstack.requestlog [None req-d7381f16-b7ea-4939-8e2b-cde37a67fd20 tempest-VolumesNegativeTest-1107689494 tempest-VolumesNegativeTest-1107689494-project] 10.222.0.61 "GET /compute/v2.1/servers/ea1f238d-3bae-4ce8-b328-d07fc2f7f272" status: 200 len: 1305 microversion: 2.1 time: 0.151046 May 14 15:49:44.910184 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: [pid: 128728|app: 0|req: 282/545] 10.222.0.61 () {58 vars in 1235 bytes} [Sat May 14 15:49:44 2022] GET /compute/v2.1/servers/ea1f238d-3bae-4ce8-b328-d07fc2f7f272 => generated 1305 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 15:49:44.982707 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi [None req-30f68338-e6da-4eea-a269-5c9f47167d66 tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Calling method '>' {{(pid=128729) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 15:49:44.983501 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.compute.api [None req-30f68338-e6da-4eea-a269-5c9f47167d66 tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] [instance: 7c21adbe-7a79-46cf-aa7c-9b2a6548c767] Fetching instance by UUID {{(pid=128729) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 15:49:44.989826 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-30f68338-e6da-4eea-a269-5c9f47167d66 tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:49:44.990379 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-30f68338-e6da-4eea-a269-5c9f47167d66 tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:49:44.991151 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-30f68338-e6da-4eea-a269-5c9f47167d66 tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:49:44.991609 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-30f68338-e6da-4eea-a269-5c9f47167d66 tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:49:45.121305 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.policy [None req-30f68338-e6da-4eea-a269-5c9f47167d66 tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b896317d96a40d6a137db0dcf5f98f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d2517d5440a4d30949f3dd36a46d813', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128729) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:49:45.128598 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: INFO nova.api.openstack.requestlog [None req-30f68338-e6da-4eea-a269-5c9f47167d66 tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] 10.222.0.61 "GET /compute/v2.1/servers/7c21adbe-7a79-46cf-aa7c-9b2a6548c767" status: 200 len: 1370 microversion: 2.1 time: 0.151381 May 14 15:49:45.129167 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: [pid: 128729|app: 0|req: 264/546] 10.222.0.61 () {58 vars in 1235 bytes} [Sat May 14 15:49:44 2022] GET /compute/v2.1/servers/7c21adbe-7a79-46cf-aa7c-9b2a6548c767 => generated 1370 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 15:49:45.204718 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi [None req-9c1d63e0-2965-4e47-92d2-b5e97012e8b1 tempest-VolumesActionsTest-1534566879 tempest-VolumesActionsTest-1534566879-project] Calling method '>' {{(pid=128728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 15:49:45.205335 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.compute.api [None req-9c1d63e0-2965-4e47-92d2-b5e97012e8b1 tempest-VolumesActionsTest-1534566879 tempest-VolumesActionsTest-1534566879-project] [instance: 656dffc0-256e-40ba-b670-f08e247a0d95] Fetching instance by UUID {{(pid=128728) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 15:49:45.215038 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-9c1d63e0-2965-4e47-92d2-b5e97012e8b1 tempest-VolumesActionsTest-1534566879 tempest-VolumesActionsTest-1534566879-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:49:45.215719 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-9c1d63e0-2965-4e47-92d2-b5e97012e8b1 tempest-VolumesActionsTest-1534566879 tempest-VolumesActionsTest-1534566879-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:49:45.216502 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-9c1d63e0-2965-4e47-92d2-b5e97012e8b1 tempest-VolumesActionsTest-1534566879 tempest-VolumesActionsTest-1534566879-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:49:45.216936 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-9c1d63e0-2965-4e47-92d2-b5e97012e8b1 tempest-VolumesActionsTest-1534566879 tempest-VolumesActionsTest-1534566879-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:49:45.262439 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi [req-a1bb35b2-6154-44fb-8a02-089c1bd738fd req-6a4861d1-a8b7-4b3c-9c8e-eb29f7f236d0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "656dffc0-256e-40ba-b670-f08e247a0d95", "name": "network-vif-deleted", "tag": "9d525f2e-84e9-4747-99b0-489de117e060"}]} {{(pid=128729) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 15:49:45.270166 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [req-a1bb35b2-6154-44fb-8a02-089c1bd738fd req-6a4861d1-a8b7-4b3c-9c8e-eb29f7f236d0 service nova] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:49:45.270768 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [req-a1bb35b2-6154-44fb-8a02-089c1bd738fd req-6a4861d1-a8b7-4b3c-9c8e-eb29f7f236d0 service nova] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:49:45.280576 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.policy [None req-9c1d63e0-2965-4e47-92d2-b5e97012e8b1 tempest-VolumesActionsTest-1534566879 tempest-VolumesActionsTest-1534566879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0156ed87a5b4efca7ef5056429db1a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71b09f9f20b340b5a615b24e05312703', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128728) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:49:45.281446 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: INFO nova.api.openstack.compute.server_external_events [req-a1bb35b2-6154-44fb-8a02-089c1bd738fd req-6a4861d1-a8b7-4b3c-9c8e-eb29f7f236d0 service nova] Creating event network-vif-deleted:9d525f2e-84e9-4747-99b0-489de117e060 for instance 656dffc0-256e-40ba-b670-f08e247a0d95 on hv-cinder-83979 May 14 15:49:45.286177 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: INFO nova.api.openstack.requestlog [req-a1bb35b2-6154-44fb-8a02-089c1bd738fd req-6a4861d1-a8b7-4b3c-9c8e-eb29f7f236d0 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.027780 May 14 15:49:45.286803 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: [pid: 128729|app: 0|req: 265/547] 10.222.0.61 () {64 vars in 1317 bytes} [Sat May 14 15:49:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 14 15:49:45.289349 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: INFO nova.api.openstack.requestlog [None req-9c1d63e0-2965-4e47-92d2-b5e97012e8b1 tempest-VolumesActionsTest-1534566879 tempest-VolumesActionsTest-1534566879-project] 10.222.0.61 "GET /compute/v2.1/servers/656dffc0-256e-40ba-b670-f08e247a0d95" status: 200 len: 1462 microversion: 2.1 time: 0.093258 May 14 15:49:45.289913 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: [pid: 128728|app: 0|req: 283/548] 10.222.0.61 () {58 vars in 1235 bytes} [Sat May 14 15:49:45 2022] GET /compute/v2.1/servers/656dffc0-256e-40ba-b670-f08e247a0d95 => generated 1462 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 15:49:45.928258 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi [None req-a866836b-4d60-49eb-bf65-cce1e2868e72 tempest-VolumesNegativeTest-1107689494 tempest-VolumesNegativeTest-1107689494-project] Calling method '>' {{(pid=128729) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 15:49:45.929071 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.compute.api [None req-a866836b-4d60-49eb-bf65-cce1e2868e72 tempest-VolumesNegativeTest-1107689494 tempest-VolumesNegativeTest-1107689494-project] [instance: ea1f238d-3bae-4ce8-b328-d07fc2f7f272] Fetching instance by UUID {{(pid=128729) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 15:49:45.936510 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-a866836b-4d60-49eb-bf65-cce1e2868e72 tempest-VolumesNegativeTest-1107689494 tempest-VolumesNegativeTest-1107689494-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:49:45.937262 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-a866836b-4d60-49eb-bf65-cce1e2868e72 tempest-VolumesNegativeTest-1107689494 tempest-VolumesNegativeTest-1107689494-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:49:45.938442 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-a866836b-4d60-49eb-bf65-cce1e2868e72 tempest-VolumesNegativeTest-1107689494 tempest-VolumesNegativeTest-1107689494-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:49:45.939049 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-a866836b-4d60-49eb-bf65-cce1e2868e72 tempest-VolumesNegativeTest-1107689494 tempest-VolumesNegativeTest-1107689494-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:49:45.953165 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: INFO nova.api.openstack.wsgi [None req-a866836b-4d60-49eb-bf65-cce1e2868e72 tempest-VolumesNegativeTest-1107689494 tempest-VolumesNegativeTest-1107689494-project] HTTP exception thrown: Instance ea1f238d-3bae-4ce8-b328-d07fc2f7f272 could not be found. May 14 15:49:45.954865 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi [None req-a866836b-4d60-49eb-bf65-cce1e2868e72 tempest-VolumesNegativeTest-1107689494 tempest-VolumesNegativeTest-1107689494-project] Request method failure captured: May 14 15:49:45.954865 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: request: GET /compute/v2.1/servers/ea1f238d-3bae-4ce8-b328-d07fc2f7f272 HTTP/1.1 May 14 15:49:45.954865 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: Accept: application/json May 14 15:49:45.954865 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: Accept-Encoding: identity May 14 15:49:45.954865 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: Connection: close May 14 15:49:45.954865 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: Content-Length: 0 May 14 15:49:45.954865 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: Content-Type: application/json May 14 15:49:45.954865 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: Host: 10.222.0.61 May 14 15:49:45.954865 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: Openstack-System-Scope: None May 14 15:49:45.954865 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: User-Agent: python-urllib3/1.26.9 May 14 15:49:45.954865 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: X-Auth-Token: gAAAAABif89f6mjJQbzP85NuUqOnxCDEhh2S9D2kKUugwBNrboRK89T3T_FBjzO0PS25AusrPqQJzeCplTJL-v4ReUumUBe2VF0S1T6-Ty2U2XkzL_V7ZRKGMpzb5YsaWd1lc2AUrkYemVdz6F_ATaH6uou6GmdrQPlLEZSWYlsRqM4G2x9XWfc May 14 15:49:45.954865 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: X-Domain-Id: None May 14 15:49:45.954865 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: X-Domain-Name: None May 14 15:49:45.954865 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: X-Identity-Status: Confirmed May 14 15:49:45.954865 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: X-Is-Admin-Project: True May 14 15:49:45.954865 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: X-Project-Domain-Id: default May 14 15:49:45.954865 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: X-Project-Domain-Name: Default May 14 15:49:45.954865 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: X-Project-Id: c1e7c6697dfc4562b4c1d46ee21964a5 May 14 15:49:45.954865 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: X-Project-Name: tempest-VolumesNegativeTest-1107689494 May 14 15:49:45.954865 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: X-Role: reader,member May 14 15:49:45.954865 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: X-Roles: reader,member May 14 15:49:45.956151 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/c1e7c6697dfc4562b4c1d46ee21964a5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/c1e7c6697dfc4562b4c1d46ee21964a5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/c1e7c6697dfc4562b4c1d46ee21964a5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_c1e7c6697dfc4562b4c1d46ee21964a5"}]}] May 14 15:49:45.956151 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: X-Tenant: tempest-VolumesNegativeTest-1107689494 May 14 15:49:45.956151 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: X-Tenant-Id: c1e7c6697dfc4562b4c1d46ee21964a5 May 14 15:49:45.956151 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: X-Tenant-Name: tempest-VolumesNegativeTest-1107689494 May 14 15:49:45.956151 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: X-User: tempest-VolumesNegativeTest-1107689494-project May 14 15:49:45.956151 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: X-User-Domain-Id: default May 14 15:49:45.956151 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: X-User-Domain-Name: Default May 14 15:49:45.956151 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: X-User-Id: 1e8303a1f1584ae2aae774eaf31481f0 May 14 15:49:45.956151 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: X-User-Name: tempest-VolumesNegativeTest-1107689494-project May 14 15:49:45.956151 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: method: > May 14 15:49:45.956151 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: exception: Instance ea1f238d-3bae-4ce8-b328-d07fc2f7f272 could not be found. May 14 15:49:45.956151 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: action_args: {'id': 'ea1f238d-3bae-4ce8-b328-d07fc2f7f272'} May 14 15:49:45.957004 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: {{(pid=128729) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 14 15:49:45.957004 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 15:49:45.957004 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 14 15:49:45.957004 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 14 15:49:45.957004 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 14 15:49:45.957004 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 14 15:49:45.957004 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 14 15:49:45.957004 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 14 15:49:45.957004 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 14 15:49:45.957004 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 14 15:49:45.957004 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ea1f238d-3bae-4ce8-b328-d07fc2f7f272 could not be found. May 14 15:49:45.957004 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: ERROR nova.api.openstack.wsgi May 14 15:49:45.957004 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 14 15:49:45.957004 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: ERROR nova.api.openstack.wsgi May 14 15:49:45.957004 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 15:49:45.957004 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 14 15:49:45.957004 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 14 15:49:45.957004 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 14 15:49:45.957004 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 14 15:49:45.957004 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 14 15:49:45.958277 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 14 15:49:45.958277 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 14 15:49:45.958277 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 14 15:49:45.958277 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 14 15:49:45.958277 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 14 15:49:45.958277 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 14 15:49:45.958277 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 14 15:49:45.958277 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ea1f238d-3bae-4ce8-b328-d07fc2f7f272 could not be found. May 14 15:49:45.958277 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: ERROR nova.api.openstack.wsgi May 14 15:49:45.958277 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 14 15:49:45.958277 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: ERROR nova.api.openstack.wsgi May 14 15:49:45.958277 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 15:49:45.958277 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 14 15:49:45.958277 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 14 15:49:45.958277 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 14 15:49:45.958277 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 14 15:49:45.958277 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ea1f238d-3bae-4ce8-b328-d07fc2f7f272 could not be found. May 14 15:49:45.958277 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: ERROR nova.api.openstack.wsgi May 14 15:49:45.959572 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi [None req-a866836b-4d60-49eb-bf65-cce1e2868e72 tempest-VolumesNegativeTest-1107689494 tempest-VolumesNegativeTest-1107689494-project] Returning 404 to user: Instance ea1f238d-3bae-4ce8-b328-d07fc2f7f272 could not be found. {{(pid=128729) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 14 15:49:45.959572 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: INFO nova.api.openstack.requestlog [None req-a866836b-4d60-49eb-bf65-cce1e2868e72 tempest-VolumesNegativeTest-1107689494 tempest-VolumesNegativeTest-1107689494-project] 10.222.0.61 "GET /compute/v2.1/servers/ea1f238d-3bae-4ce8-b328-d07fc2f7f272" status: 404 len: 111 microversion: 2.1 time: 0.033100 May 14 15:49:45.959572 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: [pid: 128729|app: 0|req: 266/549] 10.222.0.61 () {58 vars in 1235 bytes} [Sat May 14 15:49:45 2022] GET /compute/v2.1/servers/ea1f238d-3bae-4ce8-b328-d07fc2f7f272 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 14 15:49:46.005110 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi [None req-4ad2dc59-d32b-42fe-81b9-d0f4b4126256 tempest-TestMinimumBasicScenario-1817438735 tempest-TestMinimumBasicScenario-1817438735-project] Calling method '>' {{(pid=128728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 15:49:46.005767 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.compute.api [None req-4ad2dc59-d32b-42fe-81b9-d0f4b4126256 tempest-TestMinimumBasicScenario-1817438735 tempest-TestMinimumBasicScenario-1817438735-project] [instance: ef63d04a-87e5-4202-a672-d45a2a877c68] Fetching instance by UUID {{(pid=128728) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 15:49:46.011951 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-4ad2dc59-d32b-42fe-81b9-d0f4b4126256 tempest-TestMinimumBasicScenario-1817438735 tempest-TestMinimumBasicScenario-1817438735-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:49:46.012341 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-4ad2dc59-d32b-42fe-81b9-d0f4b4126256 tempest-TestMinimumBasicScenario-1817438735 tempest-TestMinimumBasicScenario-1817438735-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:49:46.013124 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-4ad2dc59-d32b-42fe-81b9-d0f4b4126256 tempest-TestMinimumBasicScenario-1817438735 tempest-TestMinimumBasicScenario-1817438735-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:49:46.013564 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-4ad2dc59-d32b-42fe-81b9-d0f4b4126256 tempest-TestMinimumBasicScenario-1817438735 tempest-TestMinimumBasicScenario-1817438735-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:49:46.145196 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi [None req-91e7bedd-10bc-4012-90b1-93a79dea3133 tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Calling method '>' {{(pid=128729) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 15:49:46.145954 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.compute.api [None req-91e7bedd-10bc-4012-90b1-93a79dea3133 tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] [instance: 7c21adbe-7a79-46cf-aa7c-9b2a6548c767] Fetching instance by UUID {{(pid=128729) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 15:49:46.151772 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.policy [None req-4ad2dc59-d32b-42fe-81b9-d0f4b4126256 tempest-TestMinimumBasicScenario-1817438735 tempest-TestMinimumBasicScenario-1817438735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d5f259e0b98457ea6b6b88d886c813d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fba11e8ade54d388361c4c936a43372', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128728) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:49:46.153065 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-91e7bedd-10bc-4012-90b1-93a79dea3133 tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:49:46.153641 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-91e7bedd-10bc-4012-90b1-93a79dea3133 tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:49:46.154555 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-91e7bedd-10bc-4012-90b1-93a79dea3133 tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:49:46.155099 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-91e7bedd-10bc-4012-90b1-93a79dea3133 tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:49:46.160039 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: INFO nova.api.openstack.requestlog [None req-4ad2dc59-d32b-42fe-81b9-d0f4b4126256 tempest-TestMinimumBasicScenario-1817438735 tempest-TestMinimumBasicScenario-1817438735-project] 10.222.0.61 "GET /compute/v2.1/servers/ef63d04a-87e5-4202-a672-d45a2a877c68" status: 200 len: 1592 microversion: 2.1 time: 0.158942 May 14 15:49:46.160829 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: [pid: 128728|app: 0|req: 284/550] 10.222.0.61 () {58 vars in 1235 bytes} [Sat May 14 15:49:45 2022] GET /compute/v2.1/servers/ef63d04a-87e5-4202-a672-d45a2a877c68 => generated 1592 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 15:49:46.308085 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi [None req-a83d8dec-9185-44cc-be8f-2758103941fb tempest-VolumesActionsTest-1534566879 tempest-VolumesActionsTest-1534566879-project] Calling method '>' {{(pid=128728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 15:49:46.308955 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.compute.api [None req-a83d8dec-9185-44cc-be8f-2758103941fb tempest-VolumesActionsTest-1534566879 tempest-VolumesActionsTest-1534566879-project] [instance: 656dffc0-256e-40ba-b670-f08e247a0d95] Fetching instance by UUID {{(pid=128728) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 15:49:46.309346 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.policy [None req-91e7bedd-10bc-4012-90b1-93a79dea3133 tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b896317d96a40d6a137db0dcf5f98f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d2517d5440a4d30949f3dd36a46d813', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128729) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:49:46.317210 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-a83d8dec-9185-44cc-be8f-2758103941fb tempest-VolumesActionsTest-1534566879 tempest-VolumesActionsTest-1534566879-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:49:46.317844 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: INFO nova.api.openstack.requestlog [None req-91e7bedd-10bc-4012-90b1-93a79dea3133 tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] 10.222.0.61 "GET /compute/v2.1/servers/7c21adbe-7a79-46cf-aa7c-9b2a6548c767" status: 200 len: 1370 microversion: 2.1 time: 0.176301 May 14 15:49:46.318278 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-a83d8dec-9185-44cc-be8f-2758103941fb tempest-VolumesActionsTest-1534566879 tempest-VolumesActionsTest-1534566879-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:49:46.318428 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: [pid: 128729|app: 0|req: 267/551] 10.222.0.61 () {58 vars in 1235 bytes} [Sat May 14 15:49:46 2022] GET /compute/v2.1/servers/7c21adbe-7a79-46cf-aa7c-9b2a6548c767 => generated 1370 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 15:49:46.319788 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-a83d8dec-9185-44cc-be8f-2758103941fb tempest-VolumesActionsTest-1534566879 tempest-VolumesActionsTest-1534566879-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:49:46.320398 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-a83d8dec-9185-44cc-be8f-2758103941fb tempest-VolumesActionsTest-1534566879 tempest-VolumesActionsTest-1534566879-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:49:46.352285 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-a83d8dec-9185-44cc-be8f-2758103941fb tempest-VolumesActionsTest-1534566879 tempest-VolumesActionsTest-1534566879-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:49:46.352837 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-a83d8dec-9185-44cc-be8f-2758103941fb tempest-VolumesActionsTest-1534566879 tempest-VolumesActionsTest-1534566879-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:49:46.353364 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.objects.instance [None req-a83d8dec-9185-44cc-be8f-2758103941fb tempest-VolumesActionsTest-1534566879 tempest-VolumesActionsTest-1534566879-project] Lazy-loading 'fault' on Instance uuid 656dffc0-256e-40ba-b670-f08e247a0d95 {{(pid=128728) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 14 15:49:46.397226 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.policy [None req-a83d8dec-9185-44cc-be8f-2758103941fb tempest-VolumesActionsTest-1534566879 tempest-VolumesActionsTest-1534566879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0156ed87a5b4efca7ef5056429db1a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71b09f9f20b340b5a615b24e05312703', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128728) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:49:46.408134 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: INFO nova.api.openstack.requestlog [None req-a83d8dec-9185-44cc-be8f-2758103941fb tempest-VolumesActionsTest-1534566879 tempest-VolumesActionsTest-1534566879-project] 10.222.0.61 "GET /compute/v2.1/servers/656dffc0-256e-40ba-b670-f08e247a0d95" status: 200 len: 1304 microversion: 2.1 time: 0.104264 May 14 15:49:46.409192 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: [pid: 128728|app: 0|req: 285/552] 10.222.0.61 () {58 vars in 1235 bytes} [Sat May 14 15:49:46 2022] GET /compute/v2.1/servers/656dffc0-256e-40ba-b670-f08e247a0d95 => generated 1304 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 15:49:47.335448 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi [None req-04566cd1-a63c-4ecd-bb22-ccdd7c5c2fb7 tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Calling method '>' {{(pid=128729) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 15:49:47.336120 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.compute.api [None req-04566cd1-a63c-4ecd-bb22-ccdd7c5c2fb7 tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] [instance: 7c21adbe-7a79-46cf-aa7c-9b2a6548c767] Fetching instance by UUID {{(pid=128729) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 15:49:47.344588 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-04566cd1-a63c-4ecd-bb22-ccdd7c5c2fb7 tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:49:47.345056 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-04566cd1-a63c-4ecd-bb22-ccdd7c5c2fb7 tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:49:47.346533 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-04566cd1-a63c-4ecd-bb22-ccdd7c5c2fb7 tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:49:47.346533 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-04566cd1-a63c-4ecd-bb22-ccdd7c5c2fb7 tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:49:47.427853 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi [None req-384d52a4-7fae-41f9-a382-305bf5bb87c4 tempest-VolumesActionsTest-1534566879 tempest-VolumesActionsTest-1534566879-project] Calling method '>' {{(pid=128728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 15:49:47.428752 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.compute.api [None req-384d52a4-7fae-41f9-a382-305bf5bb87c4 tempest-VolumesActionsTest-1534566879 tempest-VolumesActionsTest-1534566879-project] [instance: 656dffc0-256e-40ba-b670-f08e247a0d95] Fetching instance by UUID {{(pid=128728) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 15:49:47.435169 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-384d52a4-7fae-41f9-a382-305bf5bb87c4 tempest-VolumesActionsTest-1534566879 tempest-VolumesActionsTest-1534566879-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:49:47.435630 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-384d52a4-7fae-41f9-a382-305bf5bb87c4 tempest-VolumesActionsTest-1534566879 tempest-VolumesActionsTest-1534566879-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:49:47.436447 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-384d52a4-7fae-41f9-a382-305bf5bb87c4 tempest-VolumesActionsTest-1534566879 tempest-VolumesActionsTest-1534566879-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:49:47.436894 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-384d52a4-7fae-41f9-a382-305bf5bb87c4 tempest-VolumesActionsTest-1534566879 tempest-VolumesActionsTest-1534566879-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:49:47.458301 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: INFO nova.api.openstack.wsgi [None req-384d52a4-7fae-41f9-a382-305bf5bb87c4 tempest-VolumesActionsTest-1534566879 tempest-VolumesActionsTest-1534566879-project] HTTP exception thrown: Instance 656dffc0-256e-40ba-b670-f08e247a0d95 could not be found. May 14 15:49:47.460507 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi [None req-384d52a4-7fae-41f9-a382-305bf5bb87c4 tempest-VolumesActionsTest-1534566879 tempest-VolumesActionsTest-1534566879-project] Request method failure captured: May 14 15:49:47.460507 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: request: GET /compute/v2.1/servers/656dffc0-256e-40ba-b670-f08e247a0d95 HTTP/1.1 May 14 15:49:47.460507 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: Accept: application/json May 14 15:49:47.460507 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: Accept-Encoding: identity May 14 15:49:47.460507 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: Connection: close May 14 15:49:47.460507 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: Content-Length: 0 May 14 15:49:47.460507 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: Content-Type: application/json May 14 15:49:47.460507 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: Host: 10.222.0.61 May 14 15:49:47.460507 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: Openstack-System-Scope: None May 14 15:49:47.460507 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: User-Agent: python-urllib3/1.26.9 May 14 15:49:47.460507 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: X-Auth-Token: gAAAAABif89jLxp4t1WVtjbJVjCia3bXXs3rPVzqUVsmY0CkIBqA3CW6M_yExmmMJI5S5_3EVfS5BcndNPdZB3duQ5YqkAV-eKThoG4n9GEQYYgIRRXWnWP9CwAQXsbZlPJWNpR3GWnZiVIK2_djw15twTc3OugScuYC__Px1V5Htv0uLPBIaPA May 14 15:49:47.460507 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: X-Domain-Id: None May 14 15:49:47.460507 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: X-Domain-Name: None May 14 15:49:47.460507 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: X-Identity-Status: Confirmed May 14 15:49:47.460507 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: X-Is-Admin-Project: True May 14 15:49:47.460507 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: X-Project-Domain-Id: default May 14 15:49:47.460507 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: X-Project-Domain-Name: Default May 14 15:49:47.460507 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: X-Project-Id: 71b09f9f20b340b5a615b24e05312703 May 14 15:49:47.460507 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: X-Project-Name: tempest-VolumesActionsTest-1534566879 May 14 15:49:47.460507 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: X-Role: reader,member May 14 15:49:47.460507 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: X-Roles: reader,member May 14 15:49:47.461757 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/71b09f9f20b340b5a615b24e05312703"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/71b09f9f20b340b5a615b24e05312703"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/71b09f9f20b340b5a615b24e05312703"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_71b09f9f20b340b5a615b24e05312703"}]}] May 14 15:49:47.461757 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: X-Tenant: tempest-VolumesActionsTest-1534566879 May 14 15:49:47.461757 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: X-Tenant-Id: 71b09f9f20b340b5a615b24e05312703 May 14 15:49:47.461757 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: X-Tenant-Name: tempest-VolumesActionsTest-1534566879 May 14 15:49:47.461757 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: X-User: tempest-VolumesActionsTest-1534566879-project May 14 15:49:47.461757 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: X-User-Domain-Id: default May 14 15:49:47.461757 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: X-User-Domain-Name: Default May 14 15:49:47.461757 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: X-User-Id: e0156ed87a5b4efca7ef5056429db1a0 May 14 15:49:47.461757 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: X-User-Name: tempest-VolumesActionsTest-1534566879-project May 14 15:49:47.461757 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: method: > May 14 15:49:47.461757 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: exception: Instance 656dffc0-256e-40ba-b670-f08e247a0d95 could not be found. May 14 15:49:47.461757 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: action_args: {'id': '656dffc0-256e-40ba-b670-f08e247a0d95'} May 14 15:49:47.462627 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: {{(pid=128728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 14 15:49:47.462627 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 15:49:47.462627 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 14 15:49:47.462627 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 14 15:49:47.462627 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 14 15:49:47.462627 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 14 15:49:47.462627 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 14 15:49:47.462627 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 14 15:49:47.462627 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 14 15:49:47.462627 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 14 15:49:47.462627 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 656dffc0-256e-40ba-b670-f08e247a0d95 could not be found. May 14 15:49:47.462627 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: ERROR nova.api.openstack.wsgi May 14 15:49:47.462627 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 14 15:49:47.462627 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: ERROR nova.api.openstack.wsgi May 14 15:49:47.462627 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 15:49:47.462627 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 14 15:49:47.462627 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 14 15:49:47.462627 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 14 15:49:47.462627 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 14 15:49:47.462627 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 14 15:49:47.464510 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 14 15:49:47.464510 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 14 15:49:47.464510 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 14 15:49:47.464510 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 14 15:49:47.464510 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 14 15:49:47.464510 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 14 15:49:47.464510 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 14 15:49:47.464510 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 656dffc0-256e-40ba-b670-f08e247a0d95 could not be found. May 14 15:49:47.464510 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: ERROR nova.api.openstack.wsgi May 14 15:49:47.464510 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 14 15:49:47.464510 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: ERROR nova.api.openstack.wsgi May 14 15:49:47.464510 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 15:49:47.464510 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 14 15:49:47.464510 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 14 15:49:47.464510 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 14 15:49:47.464510 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 14 15:49:47.464510 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 656dffc0-256e-40ba-b670-f08e247a0d95 could not be found. May 14 15:49:47.464510 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: ERROR nova.api.openstack.wsgi May 14 15:49:47.467447 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi [None req-384d52a4-7fae-41f9-a382-305bf5bb87c4 tempest-VolumesActionsTest-1534566879 tempest-VolumesActionsTest-1534566879-project] Returning 404 to user: Instance 656dffc0-256e-40ba-b670-f08e247a0d95 could not be found. {{(pid=128728) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 14 15:49:47.468694 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: INFO nova.api.openstack.requestlog [None req-384d52a4-7fae-41f9-a382-305bf5bb87c4 tempest-VolumesActionsTest-1534566879 tempest-VolumesActionsTest-1534566879-project] 10.222.0.61 "GET /compute/v2.1/servers/656dffc0-256e-40ba-b670-f08e247a0d95" status: 404 len: 111 microversion: 2.1 time: 0.045670 May 14 15:49:47.469917 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: [pid: 128728|app: 0|req: 286/553] 10.222.0.61 () {58 vars in 1235 bytes} [Sat May 14 15:49:47 2022] GET /compute/v2.1/servers/656dffc0-256e-40ba-b670-f08e247a0d95 => generated 111 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 14 15:49:47.504780 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.policy [None req-04566cd1-a63c-4ecd-bb22-ccdd7c5c2fb7 tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b896317d96a40d6a137db0dcf5f98f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d2517d5440a4d30949f3dd36a46d813', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128729) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:49:47.512884 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: INFO nova.api.openstack.requestlog [None req-04566cd1-a63c-4ecd-bb22-ccdd7c5c2fb7 tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] 10.222.0.61 "GET /compute/v2.1/servers/7c21adbe-7a79-46cf-aa7c-9b2a6548c767" status: 200 len: 1370 microversion: 2.1 time: 0.181356 May 14 15:49:47.513453 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: [pid: 128729|app: 0|req: 268/554] 10.222.0.61 () {58 vars in 1235 bytes} [Sat May 14 15:49:47 2022] GET /compute/v2.1/servers/7c21adbe-7a79-46cf-aa7c-9b2a6548c767 => generated 1370 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 15:49:47.604939 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi [None req-c05b4446-561d-491c-8c37-0a1cd4c1803a tempest-VolumesActionsTest-1534566879 tempest-VolumesActionsTest-1534566879-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-2041803660", "imageRef": "1381e3d5-fc27-4fa7-ab03-5d86278a0546", "flavorRef": "452", "networks": [{"uuid": "a8d27839-074b-4ab6-8eee-a26beda7dc34"}]}} {{(pid=128728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 15:49:47.668777 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.network.neutron [None req-c05b4446-561d-491c-8c37-0a1cd4c1803a tempest-VolumesActionsTest-1534566879 tempest-VolumesActionsTest-1534566879-project] validate_networks() for [('a8d27839-074b-4ab6-8eee-a26beda7dc34', None, None, None, None, None)] {{(pid=128728) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 14 15:49:48.085049 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.virt.hardware [None req-c05b4446-561d-491c-8c37-0a1cd4c1803a tempest-VolumesActionsTest-1534566879 tempest-VolumesActionsTest-1534566879-project] Flavor limits 0:0:0 {{(pid=128728) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 14 15:49:48.085546 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.virt.hardware [None req-c05b4446-561d-491c-8c37-0a1cd4c1803a tempest-VolumesActionsTest-1534566879 tempest-VolumesActionsTest-1534566879-project] Image limits 0:0:0 {{(pid=128728) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 14 15:49:48.086516 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.virt.hardware [None req-c05b4446-561d-491c-8c37-0a1cd4c1803a tempest-VolumesActionsTest-1534566879 tempest-VolumesActionsTest-1534566879-project] Flavor pref 0:0:0 {{(pid=128728) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 14 15:49:48.087124 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.virt.hardware [None req-c05b4446-561d-491c-8c37-0a1cd4c1803a tempest-VolumesActionsTest-1534566879 tempest-VolumesActionsTest-1534566879-project] Image pref 0:0:0 {{(pid=128728) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 14 15:49:48.088922 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.virt.hardware [None req-c05b4446-561d-491c-8c37-0a1cd4c1803a tempest-VolumesActionsTest-1534566879 tempest-VolumesActionsTest-1534566879-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128728) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 14 15:49:48.104480 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-c05b4446-561d-491c-8c37-0a1cd4c1803a tempest-VolumesActionsTest-1534566879 tempest-VolumesActionsTest-1534566879-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:49:48.105196 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-c05b4446-561d-491c-8c37-0a1cd4c1803a tempest-VolumesActionsTest-1534566879 tempest-VolumesActionsTest-1534566879-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:49:48.106648 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-c05b4446-561d-491c-8c37-0a1cd4c1803a tempest-VolumesActionsTest-1534566879 tempest-VolumesActionsTest-1534566879-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:49:48.107097 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-c05b4446-561d-491c-8c37-0a1cd4c1803a tempest-VolumesActionsTest-1534566879 tempest-VolumesActionsTest-1534566879-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:49:48.154396 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.quota [None req-c05b4446-561d-491c-8c37-0a1cd4c1803a tempest-VolumesActionsTest-1534566879 tempest-VolumesActionsTest-1534566879-project] Getting quotas for project 71b09f9f20b340b5a615b24e05312703. Resources: {'instances', 'cores', 'ram'} {{(pid=128728) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 14 15:49:48.159373 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.quota [None req-c05b4446-561d-491c-8c37-0a1cd4c1803a tempest-VolumesActionsTest-1534566879 tempest-VolumesActionsTest-1534566879-project] Getting quotas for user e0156ed87a5b4efca7ef5056429db1a0 and project 71b09f9f20b340b5a615b24e05312703. Resources: {'instances', 'cores', 'ram'} {{(pid=128728) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 14 15:49:48.174151 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.compute.api [None req-c05b4446-561d-491c-8c37-0a1cd4c1803a tempest-VolumesActionsTest-1534566879 tempest-VolumesActionsTest-1534566879-project] Going to run 1 instances... {{(pid=128728) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 14 15:49:48.176477 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.compute.api [None req-c05b4446-561d-491c-8c37-0a1cd4c1803a tempest-VolumesActionsTest-1534566879 tempest-VolumesActionsTest-1534566879-project] [instance: 59c281dd-b07e-4f45-b8dc-7021e826f06b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='1381e3d5-fc27-4fa7-ab03-5d86278a0546',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128728) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 14 15:49:48.227022 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: INFO nova.api.openstack.requestlog [None req-c05b4446-561d-491c-8c37-0a1cd4c1803a tempest-VolumesActionsTest-1534566879 tempest-VolumesActionsTest-1534566879-project] 10.222.0.61 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.625848 May 14 15:49:48.233128 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: [pid: 128728|app: 0|req: 287/555] 10.222.0.61 () {60 vars in 1146 bytes} [Sat May 14 15:49:47 2022] POST /compute/v2.1/servers => generated 380 bytes in 633 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 14 15:49:48.238870 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi [None req-9fbf3dcf-a08c-4db6-91f4-96189fd3e42b tempest-VolumesActionsTest-1534566879 tempest-VolumesActionsTest-1534566879-project] Calling method '>' {{(pid=128729) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 15:49:48.239728 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.compute.api [None req-9fbf3dcf-a08c-4db6-91f4-96189fd3e42b tempest-VolumesActionsTest-1534566879 tempest-VolumesActionsTest-1534566879-project] [instance: 59c281dd-b07e-4f45-b8dc-7021e826f06b] Fetching instance by UUID {{(pid=128729) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 15:49:48.368319 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.policy [None req-9fbf3dcf-a08c-4db6-91f4-96189fd3e42b tempest-VolumesActionsTest-1534566879 tempest-VolumesActionsTest-1534566879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0156ed87a5b4efca7ef5056429db1a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71b09f9f20b340b5a615b24e05312703', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128729) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:49:48.378167 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: INFO nova.api.openstack.requestlog [None req-9fbf3dcf-a08c-4db6-91f4-96189fd3e42b tempest-VolumesActionsTest-1534566879 tempest-VolumesActionsTest-1534566879-project] 10.222.0.61 "GET /compute/v2.1/servers/59c281dd-b07e-4f45-b8dc-7021e826f06b" status: 200 len: 1214 microversion: 2.1 time: 0.144136 May 14 15:49:48.381762 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: [pid: 128729|app: 0|req: 269/556] 10.222.0.61 () {58 vars in 1235 bytes} [Sat May 14 15:49:48 2022] GET /compute/v2.1/servers/59c281dd-b07e-4f45-b8dc-7021e826f06b => generated 1214 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 15:49:48.530193 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi [None req-0ac46287-839c-4d2d-ad7c-7115c9eba2f8 tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Calling method '>' {{(pid=128728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 15:49:48.530851 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.compute.api [None req-0ac46287-839c-4d2d-ad7c-7115c9eba2f8 tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] [instance: 7c21adbe-7a79-46cf-aa7c-9b2a6548c767] Fetching instance by UUID {{(pid=128728) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 15:49:48.544926 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-0ac46287-839c-4d2d-ad7c-7115c9eba2f8 tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:49:48.545386 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-0ac46287-839c-4d2d-ad7c-7115c9eba2f8 tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:49:48.546185 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-0ac46287-839c-4d2d-ad7c-7115c9eba2f8 tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:49:48.546662 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-0ac46287-839c-4d2d-ad7c-7115c9eba2f8 tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:49:48.804070 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi [req-f365deb4-c3ca-4cce-bd03-553000090b93 req-9deae345-eee7-4148-8e47-2e4adf8140dc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ef63d04a-87e5-4202-a672-d45a2a877c68", "tag": "61226c22-8028-48c9-8e04-0f0c0cf9fa30"}]} {{(pid=128729) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 15:49:48.821548 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [req-f365deb4-c3ca-4cce-bd03-553000090b93 req-9deae345-eee7-4148-8e47-2e4adf8140dc service nova] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:49:48.823045 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [req-f365deb4-c3ca-4cce-bd03-553000090b93 req-9deae345-eee7-4148-8e47-2e4adf8140dc service nova] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:49:48.853063 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: INFO nova.api.openstack.compute.server_external_events [req-f365deb4-c3ca-4cce-bd03-553000090b93 req-9deae345-eee7-4148-8e47-2e4adf8140dc service nova] Creating event network-changed:61226c22-8028-48c9-8e04-0f0c0cf9fa30 for instance ef63d04a-87e5-4202-a672-d45a2a877c68 on hv-cinder-83979 May 14 15:49:48.861279 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: INFO nova.api.openstack.requestlog [req-f365deb4-c3ca-4cce-bd03-553000090b93 req-9deae345-eee7-4148-8e47-2e4adf8140dc service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.062351 May 14 15:49:48.863033 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.policy [None req-0ac46287-839c-4d2d-ad7c-7115c9eba2f8 tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b896317d96a40d6a137db0dcf5f98f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d2517d5440a4d30949f3dd36a46d813', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128728) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:49:48.864343 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: [pid: 128729|app: 0|req: 270/557] 10.222.0.61 () {64 vars in 1317 bytes} [Sat May 14 15:49:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 14 15:49:48.876959 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: INFO nova.api.openstack.requestlog [None req-0ac46287-839c-4d2d-ad7c-7115c9eba2f8 tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] 10.222.0.61 "GET /compute/v2.1/servers/7c21adbe-7a79-46cf-aa7c-9b2a6548c767" status: 200 len: 1564 microversion: 2.1 time: 0.351423 May 14 15:49:48.879716 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: [pid: 128728|app: 0|req: 288/558] 10.222.0.61 () {58 vars in 1235 bytes} [Sat May 14 15:49:48 2022] GET /compute/v2.1/servers/7c21adbe-7a79-46cf-aa7c-9b2a6548c767 => generated 1564 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 15:49:48.901755 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi [None req-cf167a4e-b2f1-4ddd-b71f-08b3103eb521 tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Calling method '>' {{(pid=128729) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 15:49:48.903071 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.compute.api [None req-cf167a4e-b2f1-4ddd-b71f-08b3103eb521 tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] [instance: 7c21adbe-7a79-46cf-aa7c-9b2a6548c767] Fetching instance by UUID {{(pid=128729) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 15:49:48.910526 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-cf167a4e-b2f1-4ddd-b71f-08b3103eb521 tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:49:48.911917 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-cf167a4e-b2f1-4ddd-b71f-08b3103eb521 tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:49:48.913330 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-cf167a4e-b2f1-4ddd-b71f-08b3103eb521 tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:49:48.914072 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-cf167a4e-b2f1-4ddd-b71f-08b3103eb521 tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:49:49.023677 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: INFO nova.api.openstack.requestlog [None req-cf167a4e-b2f1-4ddd-b71f-08b3103eb521 tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] 10.222.0.61 "GET /compute/v2.1/servers/7c21adbe-7a79-46cf-aa7c-9b2a6548c767/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.130330 May 14 15:49:49.024515 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: [pid: 128729|app: 0|req: 271/559] 10.222.0.61 () {58 vars in 1274 bytes} [Sat May 14 15:49:48 2022] GET /compute/v2.1/servers/7c21adbe-7a79-46cf-aa7c-9b2a6548c767/os-interface => generated 284 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 14 15:49:49.398730 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi [None req-28420a65-7331-40f0-8cb9-e9465eac9ec9 tempest-VolumesActionsTest-1534566879 tempest-VolumesActionsTest-1534566879-project] Calling method '>' {{(pid=128728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 15:49:49.399905 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.compute.api [None req-28420a65-7331-40f0-8cb9-e9465eac9ec9 tempest-VolumesActionsTest-1534566879 tempest-VolumesActionsTest-1534566879-project] [instance: 59c281dd-b07e-4f45-b8dc-7021e826f06b] Fetching instance by UUID {{(pid=128728) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 15:49:49.407175 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-28420a65-7331-40f0-8cb9-e9465eac9ec9 tempest-VolumesActionsTest-1534566879 tempest-VolumesActionsTest-1534566879-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:49:49.408046 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-28420a65-7331-40f0-8cb9-e9465eac9ec9 tempest-VolumesActionsTest-1534566879 tempest-VolumesActionsTest-1534566879-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:49:49.409225 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-28420a65-7331-40f0-8cb9-e9465eac9ec9 tempest-VolumesActionsTest-1534566879 tempest-VolumesActionsTest-1534566879-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:49:49.409731 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-28420a65-7331-40f0-8cb9-e9465eac9ec9 tempest-VolumesActionsTest-1534566879 tempest-VolumesActionsTest-1534566879-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:49:49.513346 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.policy [None req-28420a65-7331-40f0-8cb9-e9465eac9ec9 tempest-VolumesActionsTest-1534566879 tempest-VolumesActionsTest-1534566879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0156ed87a5b4efca7ef5056429db1a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71b09f9f20b340b5a615b24e05312703', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128728) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:49:49.520863 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: INFO nova.api.openstack.requestlog [None req-28420a65-7331-40f0-8cb9-e9465eac9ec9 tempest-VolumesActionsTest-1534566879 tempest-VolumesActionsTest-1534566879-project] 10.222.0.61 "GET /compute/v2.1/servers/59c281dd-b07e-4f45-b8dc-7021e826f06b" status: 200 len: 1266 microversion: 2.1 time: 0.127223 May 14 15:49:49.521440 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: [pid: 128728|app: 0|req: 289/560] 10.222.0.61 () {58 vars in 1235 bytes} [Sat May 14 15:49:49 2022] GET /compute/v2.1/servers/59c281dd-b07e-4f45-b8dc-7021e826f06b => generated 1266 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 15:49:50.538606 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi [None req-38803f87-b6a1-4ec3-8ea0-a369fc6764c2 tempest-VolumesActionsTest-1534566879 tempest-VolumesActionsTest-1534566879-project] Calling method '>' {{(pid=128729) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 15:49:50.539553 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.compute.api [None req-38803f87-b6a1-4ec3-8ea0-a369fc6764c2 tempest-VolumesActionsTest-1534566879 tempest-VolumesActionsTest-1534566879-project] [instance: 59c281dd-b07e-4f45-b8dc-7021e826f06b] Fetching instance by UUID {{(pid=128729) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 15:49:50.547402 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-38803f87-b6a1-4ec3-8ea0-a369fc6764c2 tempest-VolumesActionsTest-1534566879 tempest-VolumesActionsTest-1534566879-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:49:50.548106 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-38803f87-b6a1-4ec3-8ea0-a369fc6764c2 tempest-VolumesActionsTest-1534566879 tempest-VolumesActionsTest-1534566879-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:49:50.549184 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-38803f87-b6a1-4ec3-8ea0-a369fc6764c2 tempest-VolumesActionsTest-1534566879 tempest-VolumesActionsTest-1534566879-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:49:50.549608 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-38803f87-b6a1-4ec3-8ea0-a369fc6764c2 tempest-VolumesActionsTest-1534566879 tempest-VolumesActionsTest-1534566879-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:49:50.661203 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.policy [None req-38803f87-b6a1-4ec3-8ea0-a369fc6764c2 tempest-VolumesActionsTest-1534566879 tempest-VolumesActionsTest-1534566879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0156ed87a5b4efca7ef5056429db1a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71b09f9f20b340b5a615b24e05312703', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128729) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:49:50.669701 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: INFO nova.api.openstack.requestlog [None req-38803f87-b6a1-4ec3-8ea0-a369fc6764c2 tempest-VolumesActionsTest-1534566879 tempest-VolumesActionsTest-1534566879-project] 10.222.0.61 "GET /compute/v2.1/servers/59c281dd-b07e-4f45-b8dc-7021e826f06b" status: 200 len: 1272 microversion: 2.1 time: 0.135716 May 14 15:49:50.670856 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: [pid: 128729|app: 0|req: 272/561] 10.222.0.61 () {58 vars in 1235 bytes} [Sat May 14 15:49:50 2022] GET /compute/v2.1/servers/59c281dd-b07e-4f45-b8dc-7021e826f06b => generated 1272 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 15:49:51.269467 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi [None req-9db99332-2029-4e9a-b1fe-889514a97d81 tempest-TestMinimumBasicScenario-1817438735 tempest-TestMinimumBasicScenario-1817438735-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-669680809"}} {{(pid=128728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 15:49:51.270065 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.compute.api [None req-9db99332-2029-4e9a-b1fe-889514a97d81 tempest-TestMinimumBasicScenario-1817438735 tempest-TestMinimumBasicScenario-1817438735-project] [instance: ef63d04a-87e5-4202-a672-d45a2a877c68] Fetching instance by UUID {{(pid=128728) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 15:49:51.305921 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-9db99332-2029-4e9a-b1fe-889514a97d81 tempest-TestMinimumBasicScenario-1817438735 tempest-TestMinimumBasicScenario-1817438735-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:49:51.308029 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-9db99332-2029-4e9a-b1fe-889514a97d81 tempest-TestMinimumBasicScenario-1817438735 tempest-TestMinimumBasicScenario-1817438735-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:49:51.310013 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-9db99332-2029-4e9a-b1fe-889514a97d81 tempest-TestMinimumBasicScenario-1817438735 tempest-TestMinimumBasicScenario-1817438735-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:49:51.312067 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-9db99332-2029-4e9a-b1fe-889514a97d81 tempest-TestMinimumBasicScenario-1817438735 tempest-TestMinimumBasicScenario-1817438735-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:49:51.445609 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi [req-0de7a0ef-29d1-459d-885a-bb9b195cf7c3 req-04a169c2-f4ff-4493-a6ab-6eae0438caa5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7c21adbe-7a79-46cf-aa7c-9b2a6548c767", "tag": "5c35b70b-002b-48c3-9446-1ba3b1605c2b"}]} {{(pid=128729) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 15:49:51.460743 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [req-0de7a0ef-29d1-459d-885a-bb9b195cf7c3 req-04a169c2-f4ff-4493-a6ab-6eae0438caa5 service nova] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:49:51.461889 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [req-0de7a0ef-29d1-459d-885a-bb9b195cf7c3 req-04a169c2-f4ff-4493-a6ab-6eae0438caa5 service nova] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:49:51.479635 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: INFO nova.api.openstack.compute.server_external_events [req-0de7a0ef-29d1-459d-885a-bb9b195cf7c3 req-04a169c2-f4ff-4493-a6ab-6eae0438caa5 service nova] Creating event network-changed:5c35b70b-002b-48c3-9446-1ba3b1605c2b for instance 7c21adbe-7a79-46cf-aa7c-9b2a6548c767 on hv-cinder-83979 May 14 15:49:51.489595 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: INFO nova.api.openstack.requestlog [req-0de7a0ef-29d1-459d-885a-bb9b195cf7c3 req-04a169c2-f4ff-4493-a6ab-6eae0438caa5 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049401 May 14 15:49:51.490849 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: [pid: 128729|app: 0|req: 273/562] 10.222.0.61 () {64 vars in 1317 bytes} [Sat May 14 15:49:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 14 15:49:51.557772 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: INFO nova.network.security_group_api [None req-9db99332-2029-4e9a-b1fe-889514a97d81 tempest-TestMinimumBasicScenario-1817438735 tempest-TestMinimumBasicScenario-1817438735-project] Adding security group 0696e348-67b8-4f1a-858d-e461527b614c to port 61226c22-8028-48c9-8e04-0f0c0cf9fa30 May 14 15:49:51.688306 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi [None req-7a645424-7f14-4ad5-bebf-8ce5f6a736af tempest-VolumesActionsTest-1534566879 tempest-VolumesActionsTest-1534566879-project] Calling method '>' {{(pid=128729) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 15:49:51.689703 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.compute.api [None req-7a645424-7f14-4ad5-bebf-8ce5f6a736af tempest-VolumesActionsTest-1534566879 tempest-VolumesActionsTest-1534566879-project] [instance: 59c281dd-b07e-4f45-b8dc-7021e826f06b] Fetching instance by UUID {{(pid=128729) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 15:49:51.706615 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-7a645424-7f14-4ad5-bebf-8ce5f6a736af tempest-VolumesActionsTest-1534566879 tempest-VolumesActionsTest-1534566879-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:49:51.707669 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-7a645424-7f14-4ad5-bebf-8ce5f6a736af tempest-VolumesActionsTest-1534566879 tempest-VolumesActionsTest-1534566879-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:49:51.709234 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-7a645424-7f14-4ad5-bebf-8ce5f6a736af tempest-VolumesActionsTest-1534566879 tempest-VolumesActionsTest-1534566879-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:49:51.709920 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-7a645424-7f14-4ad5-bebf-8ce5f6a736af tempest-VolumesActionsTest-1534566879 tempest-VolumesActionsTest-1534566879-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:49:51.973286 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.policy [None req-7a645424-7f14-4ad5-bebf-8ce5f6a736af tempest-VolumesActionsTest-1534566879 tempest-VolumesActionsTest-1534566879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0156ed87a5b4efca7ef5056429db1a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71b09f9f20b340b5a615b24e05312703', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128729) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:49:51.985008 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: INFO nova.api.openstack.requestlog [None req-7a645424-7f14-4ad5-bebf-8ce5f6a736af tempest-VolumesActionsTest-1534566879 tempest-VolumesActionsTest-1534566879-project] 10.222.0.61 "GET /compute/v2.1/servers/59c281dd-b07e-4f45-b8dc-7021e826f06b" status: 200 len: 1314 microversion: 2.1 time: 0.301646 May 14 15:49:51.986172 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: [pid: 128729|app: 0|req: 274/563] 10.222.0.61 () {58 vars in 1235 bytes} [Sat May 14 15:49:51 2022] GET /compute/v2.1/servers/59c281dd-b07e-4f45-b8dc-7021e826f06b => generated 1314 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 15:49:52.182323 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: INFO nova.api.openstack.requestlog [None req-9db99332-2029-4e9a-b1fe-889514a97d81 tempest-TestMinimumBasicScenario-1817438735 tempest-TestMinimumBasicScenario-1817438735-project] 10.222.0.61 "POST /compute/v2.1/servers/ef63d04a-87e5-4202-a672-d45a2a877c68/action" status: 202 len: 0 microversion: 2.1 time: 0.916617 May 14 15:49:52.183281 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: [pid: 128728|app: 0|req: 290/564] 10.222.0.61 () {60 vars in 1277 bytes} [Sat May 14 15:49:51 2022] POST /compute/v2.1/servers/ef63d04a-87e5-4202-a672-d45a2a877c68/action => generated 0 bytes in 918 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 14 15:49:52.191157 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi [None req-5c40995c-9218-49aa-b080-c35c30babd82 tempest-TestMinimumBasicScenario-1817438735 tempest-TestMinimumBasicScenario-1817438735-project] Calling method '>' {{(pid=128729) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 15:49:52.194973 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.compute.api [None req-5c40995c-9218-49aa-b080-c35c30babd82 tempest-TestMinimumBasicScenario-1817438735 tempest-TestMinimumBasicScenario-1817438735-project] [instance: ef63d04a-87e5-4202-a672-d45a2a877c68] Fetching instance by UUID {{(pid=128729) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 15:49:52.202321 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-5c40995c-9218-49aa-b080-c35c30babd82 tempest-TestMinimumBasicScenario-1817438735 tempest-TestMinimumBasicScenario-1817438735-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:49:52.202983 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-5c40995c-9218-49aa-b080-c35c30babd82 tempest-TestMinimumBasicScenario-1817438735 tempest-TestMinimumBasicScenario-1817438735-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:49:52.203945 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-5c40995c-9218-49aa-b080-c35c30babd82 tempest-TestMinimumBasicScenario-1817438735 tempest-TestMinimumBasicScenario-1817438735-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:49:52.207421 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-5c40995c-9218-49aa-b080-c35c30babd82 tempest-TestMinimumBasicScenario-1817438735 tempest-TestMinimumBasicScenario-1817438735-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:49:52.435862 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.policy [None req-5c40995c-9218-49aa-b080-c35c30babd82 tempest-TestMinimumBasicScenario-1817438735 tempest-TestMinimumBasicScenario-1817438735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d5f259e0b98457ea6b6b88d886c813d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fba11e8ade54d388361c4c936a43372', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128729) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:49:52.444083 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: INFO nova.api.openstack.requestlog [None req-5c40995c-9218-49aa-b080-c35c30babd82 tempest-TestMinimumBasicScenario-1817438735 tempest-TestMinimumBasicScenario-1817438735-project] 10.222.0.61 "GET /compute/v2.1/servers/ef63d04a-87e5-4202-a672-d45a2a877c68" status: 200 len: 1757 microversion: 2.1 time: 0.256640 May 14 15:49:52.445026 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: [pid: 128729|app: 0|req: 275/565] 10.222.0.61 () {58 vars in 1235 bytes} [Sat May 14 15:49:52 2022] GET /compute/v2.1/servers/ef63d04a-87e5-4202-a672-d45a2a877c68 => generated 1757 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 15:49:53.002892 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi [None req-b52ab6b1-86a1-4ad8-b842-af1ea4aab50f tempest-VolumesActionsTest-1534566879 tempest-VolumesActionsTest-1534566879-project] Calling method '>' {{(pid=128728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 15:49:53.004120 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.compute.api [None req-b52ab6b1-86a1-4ad8-b842-af1ea4aab50f tempest-VolumesActionsTest-1534566879 tempest-VolumesActionsTest-1534566879-project] [instance: 59c281dd-b07e-4f45-b8dc-7021e826f06b] Fetching instance by UUID {{(pid=128728) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 15:49:53.011185 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-b52ab6b1-86a1-4ad8-b842-af1ea4aab50f tempest-VolumesActionsTest-1534566879 tempest-VolumesActionsTest-1534566879-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:49:53.011881 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-b52ab6b1-86a1-4ad8-b842-af1ea4aab50f tempest-VolumesActionsTest-1534566879 tempest-VolumesActionsTest-1534566879-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:49:53.012817 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-b52ab6b1-86a1-4ad8-b842-af1ea4aab50f tempest-VolumesActionsTest-1534566879 tempest-VolumesActionsTest-1534566879-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:49:53.013410 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-b52ab6b1-86a1-4ad8-b842-af1ea4aab50f tempest-VolumesActionsTest-1534566879 tempest-VolumesActionsTest-1534566879-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:49:53.252477 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.policy [None req-b52ab6b1-86a1-4ad8-b842-af1ea4aab50f tempest-VolumesActionsTest-1534566879 tempest-VolumesActionsTest-1534566879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0156ed87a5b4efca7ef5056429db1a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71b09f9f20b340b5a615b24e05312703', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128728) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:49:53.261303 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: INFO nova.api.openstack.requestlog [None req-b52ab6b1-86a1-4ad8-b842-af1ea4aab50f tempest-VolumesActionsTest-1534566879 tempest-VolumesActionsTest-1534566879-project] 10.222.0.61 "GET /compute/v2.1/servers/59c281dd-b07e-4f45-b8dc-7021e826f06b" status: 200 len: 1314 microversion: 2.1 time: 0.262505 May 14 15:49:53.261917 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: [pid: 128728|app: 0|req: 291/566] 10.222.0.61 () {58 vars in 1235 bytes} [Sat May 14 15:49:52 2022] GET /compute/v2.1/servers/59c281dd-b07e-4f45-b8dc-7021e826f06b => generated 1314 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 15:49:53.517033 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi [req-76900fa5-9a01-4ccd-8f91-41e8c88d971b req-1bf4212f-b2b0-4ccf-b6d9-dcd8123ee2e9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ef63d04a-87e5-4202-a672-d45a2a877c68", "tag": "61226c22-8028-48c9-8e04-0f0c0cf9fa30"}]} {{(pid=128729) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 15:49:53.528896 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [req-76900fa5-9a01-4ccd-8f91-41e8c88d971b req-1bf4212f-b2b0-4ccf-b6d9-dcd8123ee2e9 service nova] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:49:53.529593 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [req-76900fa5-9a01-4ccd-8f91-41e8c88d971b req-1bf4212f-b2b0-4ccf-b6d9-dcd8123ee2e9 service nova] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:49:53.543665 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: INFO nova.api.openstack.compute.server_external_events [req-76900fa5-9a01-4ccd-8f91-41e8c88d971b req-1bf4212f-b2b0-4ccf-b6d9-dcd8123ee2e9 service nova] Creating event network-changed:61226c22-8028-48c9-8e04-0f0c0cf9fa30 for instance ef63d04a-87e5-4202-a672-d45a2a877c68 on hv-cinder-83979 May 14 15:49:53.551284 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: INFO nova.api.openstack.requestlog [req-76900fa5-9a01-4ccd-8f91-41e8c88d971b req-1bf4212f-b2b0-4ccf-b6d9-dcd8123ee2e9 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043543 May 14 15:49:53.551905 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: [pid: 128729|app: 0|req: 276/567] 10.222.0.61 () {64 vars in 1317 bytes} [Sat May 14 15:49:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 14 15:49:54.279514 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi [None req-eba640b5-67f2-4c48-b2ba-349ee207bd84 tempest-VolumesActionsTest-1534566879 tempest-VolumesActionsTest-1534566879-project] Calling method '>' {{(pid=128728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 15:49:54.280125 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.compute.api [None req-eba640b5-67f2-4c48-b2ba-349ee207bd84 tempest-VolumesActionsTest-1534566879 tempest-VolumesActionsTest-1534566879-project] [instance: 59c281dd-b07e-4f45-b8dc-7021e826f06b] Fetching instance by UUID {{(pid=128728) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 15:49:54.286790 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-eba640b5-67f2-4c48-b2ba-349ee207bd84 tempest-VolumesActionsTest-1534566879 tempest-VolumesActionsTest-1534566879-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:49:54.287275 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-eba640b5-67f2-4c48-b2ba-349ee207bd84 tempest-VolumesActionsTest-1534566879 tempest-VolumesActionsTest-1534566879-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:49:54.288228 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-eba640b5-67f2-4c48-b2ba-349ee207bd84 tempest-VolumesActionsTest-1534566879 tempest-VolumesActionsTest-1534566879-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:49:54.288671 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-eba640b5-67f2-4c48-b2ba-349ee207bd84 tempest-VolumesActionsTest-1534566879 tempest-VolumesActionsTest-1534566879-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:49:54.484455 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.policy [None req-eba640b5-67f2-4c48-b2ba-349ee207bd84 tempest-VolumesActionsTest-1534566879 tempest-VolumesActionsTest-1534566879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0156ed87a5b4efca7ef5056429db1a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71b09f9f20b340b5a615b24e05312703', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128728) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:49:54.498356 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: INFO nova.api.openstack.requestlog [None req-eba640b5-67f2-4c48-b2ba-349ee207bd84 tempest-VolumesActionsTest-1534566879 tempest-VolumesActionsTest-1534566879-project] 10.222.0.61 "GET /compute/v2.1/servers/59c281dd-b07e-4f45-b8dc-7021e826f06b" status: 200 len: 1314 microversion: 2.1 time: 0.222966 May 14 15:49:54.500751 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: [pid: 128728|app: 0|req: 292/568] 10.222.0.61 () {58 vars in 1235 bytes} [Sat May 14 15:49:54 2022] GET /compute/v2.1/servers/59c281dd-b07e-4f45-b8dc-7021e826f06b => generated 1314 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 15:49:55.517959 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi [None req-c9e60849-5c87-4281-9fd6-0d397b0ca0b2 tempest-VolumesActionsTest-1534566879 tempest-VolumesActionsTest-1534566879-project] Calling method '>' {{(pid=128729) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 15:49:55.519998 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.compute.api [None req-c9e60849-5c87-4281-9fd6-0d397b0ca0b2 tempest-VolumesActionsTest-1534566879 tempest-VolumesActionsTest-1534566879-project] [instance: 59c281dd-b07e-4f45-b8dc-7021e826f06b] Fetching instance by UUID {{(pid=128729) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 15:49:55.539183 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-c9e60849-5c87-4281-9fd6-0d397b0ca0b2 tempest-VolumesActionsTest-1534566879 tempest-VolumesActionsTest-1534566879-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:49:55.550628 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-c9e60849-5c87-4281-9fd6-0d397b0ca0b2 tempest-VolumesActionsTest-1534566879 tempest-VolumesActionsTest-1534566879-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:49:55.552707 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-c9e60849-5c87-4281-9fd6-0d397b0ca0b2 tempest-VolumesActionsTest-1534566879 tempest-VolumesActionsTest-1534566879-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:49:55.553416 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-c9e60849-5c87-4281-9fd6-0d397b0ca0b2 tempest-VolumesActionsTest-1534566879 tempest-VolumesActionsTest-1534566879-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:49:55.919366 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.policy [None req-c9e60849-5c87-4281-9fd6-0d397b0ca0b2 tempest-VolumesActionsTest-1534566879 tempest-VolumesActionsTest-1534566879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0156ed87a5b4efca7ef5056429db1a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71b09f9f20b340b5a615b24e05312703', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128729) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:49:55.933668 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: INFO nova.api.openstack.requestlog [None req-c9e60849-5c87-4281-9fd6-0d397b0ca0b2 tempest-VolumesActionsTest-1534566879 tempest-VolumesActionsTest-1534566879-project] 10.222.0.61 "GET /compute/v2.1/servers/59c281dd-b07e-4f45-b8dc-7021e826f06b" status: 200 len: 1314 microversion: 2.1 time: 0.420598 May 14 15:49:55.934265 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: [pid: 128729|app: 0|req: 277/569] 10.222.0.61 () {58 vars in 1235 bytes} [Sat May 14 15:49:55 2022] GET /compute/v2.1/servers/59c281dd-b07e-4f45-b8dc-7021e826f06b => generated 1314 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 15:49:56.403280 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi [req-53e0a54b-c10b-43d0-b719-26263a161f60 req-a12504c8-cc75-4c13-b608-c0ad7abaaa4d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "59c281dd-b07e-4f45-b8dc-7021e826f06b", "tag": "b29a17c4-2b40-425d-85cf-0498169b2b00"}]} {{(pid=128728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 15:49:56.422376 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [req-53e0a54b-c10b-43d0-b719-26263a161f60 req-a12504c8-cc75-4c13-b608-c0ad7abaaa4d service nova] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:49:56.422376 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [req-53e0a54b-c10b-43d0-b719-26263a161f60 req-a12504c8-cc75-4c13-b608-c0ad7abaaa4d service nova] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:49:56.434535 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: INFO nova.api.openstack.compute.server_external_events [req-53e0a54b-c10b-43d0-b719-26263a161f60 req-a12504c8-cc75-4c13-b608-c0ad7abaaa4d service nova] Creating event network-changed:b29a17c4-2b40-425d-85cf-0498169b2b00 for instance 59c281dd-b07e-4f45-b8dc-7021e826f06b on hv-cinder-83979 May 14 15:49:56.439394 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: INFO nova.api.openstack.requestlog [req-53e0a54b-c10b-43d0-b719-26263a161f60 req-a12504c8-cc75-4c13-b608-c0ad7abaaa4d service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042425 May 14 15:49:56.440076 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: [pid: 128728|app: 0|req: 293/570] 10.222.0.61 () {64 vars in 1317 bytes} [Sat May 14 15:49:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 14 15:49:56.951216 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi [None req-09271cc2-ef88-4ff6-b320-f8e416ed0b00 tempest-VolumesActionsTest-1534566879 tempest-VolumesActionsTest-1534566879-project] Calling method '>' {{(pid=128729) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 15:49:56.953872 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.compute.api [None req-09271cc2-ef88-4ff6-b320-f8e416ed0b00 tempest-VolumesActionsTest-1534566879 tempest-VolumesActionsTest-1534566879-project] [instance: 59c281dd-b07e-4f45-b8dc-7021e826f06b] Fetching instance by UUID {{(pid=128729) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 15:49:56.982088 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-09271cc2-ef88-4ff6-b320-f8e416ed0b00 tempest-VolumesActionsTest-1534566879 tempest-VolumesActionsTest-1534566879-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:49:56.984546 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-09271cc2-ef88-4ff6-b320-f8e416ed0b00 tempest-VolumesActionsTest-1534566879 tempest-VolumesActionsTest-1534566879-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:49:56.986237 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-09271cc2-ef88-4ff6-b320-f8e416ed0b00 tempest-VolumesActionsTest-1534566879 tempest-VolumesActionsTest-1534566879-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:49:56.991411 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-09271cc2-ef88-4ff6-b320-f8e416ed0b00 tempest-VolumesActionsTest-1534566879 tempest-VolumesActionsTest-1534566879-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:49:57.543217 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.policy [None req-09271cc2-ef88-4ff6-b320-f8e416ed0b00 tempest-VolumesActionsTest-1534566879 tempest-VolumesActionsTest-1534566879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0156ed87a5b4efca7ef5056429db1a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71b09f9f20b340b5a615b24e05312703', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128729) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:49:57.550630 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: INFO nova.api.openstack.requestlog [None req-09271cc2-ef88-4ff6-b320-f8e416ed0b00 tempest-VolumesActionsTest-1534566879 tempest-VolumesActionsTest-1534566879-project] 10.222.0.61 "GET /compute/v2.1/servers/59c281dd-b07e-4f45-b8dc-7021e826f06b" status: 200 len: 1314 microversion: 2.1 time: 0.604272 May 14 15:49:57.551204 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: [pid: 128729|app: 0|req: 278/571] 10.222.0.61 () {58 vars in 1235 bytes} [Sat May 14 15:49:56 2022] GET /compute/v2.1/servers/59c281dd-b07e-4f45-b8dc-7021e826f06b => generated 1314 bytes in 606 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 15:49:58.569239 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 14 15:49:58.570146 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: Sat May 14 15:49:58 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/59c281dd-b07e-4f45-b8dc-7021e826f06b (ip 10.222.0.61) !!! May 14 15:49:58.575949 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi [None req-cb1f3e6d-326a-4184-9d3e-3a711ead0d4f tempest-VolumesActionsTest-1534566879 tempest-VolumesActionsTest-1534566879-project] Calling method '>' {{(pid=128728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 15:49:58.577856 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.compute.api [None req-cb1f3e6d-326a-4184-9d3e-3a711ead0d4f tempest-VolumesActionsTest-1534566879 tempest-VolumesActionsTest-1534566879-project] [instance: 59c281dd-b07e-4f45-b8dc-7021e826f06b] Fetching instance by UUID {{(pid=128728) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 15:49:58.590756 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-cb1f3e6d-326a-4184-9d3e-3a711ead0d4f tempest-VolumesActionsTest-1534566879 tempest-VolumesActionsTest-1534566879-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:49:58.591235 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-cb1f3e6d-326a-4184-9d3e-3a711ead0d4f tempest-VolumesActionsTest-1534566879 tempest-VolumesActionsTest-1534566879-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:49:58.592160 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-cb1f3e6d-326a-4184-9d3e-3a711ead0d4f tempest-VolumesActionsTest-1534566879 tempest-VolumesActionsTest-1534566879-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:49:58.592813 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-cb1f3e6d-326a-4184-9d3e-3a711ead0d4f tempest-VolumesActionsTest-1534566879 tempest-VolumesActionsTest-1534566879-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:49:58.806108 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.policy [None req-cb1f3e6d-326a-4184-9d3e-3a711ead0d4f tempest-VolumesActionsTest-1534566879 tempest-VolumesActionsTest-1534566879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0156ed87a5b4efca7ef5056429db1a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71b09f9f20b340b5a615b24e05312703', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128728) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:49:58.818019 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: INFO nova.api.openstack.requestlog [None req-cb1f3e6d-326a-4184-9d3e-3a711ead0d4f tempest-VolumesActionsTest-1534566879 tempest-VolumesActionsTest-1534566879-project] 10.222.0.61 "GET /compute/v2.1/servers/59c281dd-b07e-4f45-b8dc-7021e826f06b" status: 200 len: 1314 microversion: 2.1 time: 0.251862 May 14 15:49:58.818874 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: [pid: 128728|app: 0|req: 294/572] 10.222.0.61 () {58 vars in 1235 bytes} [Sat May 14 15:49:58 2022] GET /compute/v2.1/servers/59c281dd-b07e-4f45-b8dc-7021e826f06b => generated 1314 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 15:49:59.835869 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi [None req-019e295a-0fa6-407c-b39f-5d822f9446a0 tempest-VolumesActionsTest-1534566879 tempest-VolumesActionsTest-1534566879-project] Calling method '>' {{(pid=128729) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 15:49:59.838477 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.compute.api [None req-019e295a-0fa6-407c-b39f-5d822f9446a0 tempest-VolumesActionsTest-1534566879 tempest-VolumesActionsTest-1534566879-project] [instance: 59c281dd-b07e-4f45-b8dc-7021e826f06b] Fetching instance by UUID {{(pid=128729) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 15:49:59.848166 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-019e295a-0fa6-407c-b39f-5d822f9446a0 tempest-VolumesActionsTest-1534566879 tempest-VolumesActionsTest-1534566879-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:49:59.849021 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-019e295a-0fa6-407c-b39f-5d822f9446a0 tempest-VolumesActionsTest-1534566879 tempest-VolumesActionsTest-1534566879-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:49:59.849910 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-019e295a-0fa6-407c-b39f-5d822f9446a0 tempest-VolumesActionsTest-1534566879 tempest-VolumesActionsTest-1534566879-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:49:59.850590 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-019e295a-0fa6-407c-b39f-5d822f9446a0 tempest-VolumesActionsTest-1534566879 tempest-VolumesActionsTest-1534566879-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:50:00.140724 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.policy [None req-019e295a-0fa6-407c-b39f-5d822f9446a0 tempest-VolumesActionsTest-1534566879 tempest-VolumesActionsTest-1534566879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0156ed87a5b4efca7ef5056429db1a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71b09f9f20b340b5a615b24e05312703', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128729) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:50:00.150890 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: INFO nova.api.openstack.requestlog [None req-019e295a-0fa6-407c-b39f-5d822f9446a0 tempest-VolumesActionsTest-1534566879 tempest-VolumesActionsTest-1534566879-project] 10.222.0.61 "GET /compute/v2.1/servers/59c281dd-b07e-4f45-b8dc-7021e826f06b" status: 200 len: 1314 microversion: 2.1 time: 0.318579 May 14 15:50:00.151622 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: [pid: 128729|app: 0|req: 279/573] 10.222.0.61 () {58 vars in 1235 bytes} [Sat May 14 15:49:59 2022] GET /compute/v2.1/servers/59c281dd-b07e-4f45-b8dc-7021e826f06b => generated 1314 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 15:50:01.169291 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi [None req-7cedddaf-5618-40ec-be8f-a7eff9a525db tempest-VolumesActionsTest-1534566879 tempest-VolumesActionsTest-1534566879-project] Calling method '>' {{(pid=128728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 15:50:01.170071 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.compute.api [None req-7cedddaf-5618-40ec-be8f-a7eff9a525db tempest-VolumesActionsTest-1534566879 tempest-VolumesActionsTest-1534566879-project] [instance: 59c281dd-b07e-4f45-b8dc-7021e826f06b] Fetching instance by UUID {{(pid=128728) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 15:50:01.180812 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-7cedddaf-5618-40ec-be8f-a7eff9a525db tempest-VolumesActionsTest-1534566879 tempest-VolumesActionsTest-1534566879-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:50:01.181916 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-7cedddaf-5618-40ec-be8f-a7eff9a525db tempest-VolumesActionsTest-1534566879 tempest-VolumesActionsTest-1534566879-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:50:01.182669 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-7cedddaf-5618-40ec-be8f-a7eff9a525db tempest-VolumesActionsTest-1534566879 tempest-VolumesActionsTest-1534566879-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:50:01.186848 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-7cedddaf-5618-40ec-be8f-a7eff9a525db tempest-VolumesActionsTest-1534566879 tempest-VolumesActionsTest-1534566879-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:50:01.639026 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.policy [None req-7cedddaf-5618-40ec-be8f-a7eff9a525db tempest-VolumesActionsTest-1534566879 tempest-VolumesActionsTest-1534566879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0156ed87a5b4efca7ef5056429db1a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71b09f9f20b340b5a615b24e05312703', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128728) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:50:01.655267 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: INFO nova.api.openstack.requestlog [None req-7cedddaf-5618-40ec-be8f-a7eff9a525db tempest-VolumesActionsTest-1534566879 tempest-VolumesActionsTest-1534566879-project] 10.222.0.61 "GET /compute/v2.1/servers/59c281dd-b07e-4f45-b8dc-7021e826f06b" status: 200 len: 1314 microversion: 2.1 time: 0.490857 May 14 15:50:01.656045 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: [pid: 128728|app: 0|req: 295/574] 10.222.0.61 () {58 vars in 1235 bytes} [Sat May 14 15:50:01 2022] GET /compute/v2.1/servers/59c281dd-b07e-4f45-b8dc-7021e826f06b => generated 1314 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 15:50:02.673066 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi [None req-f5a767a5-e2eb-482a-9b70-88fde184bbc4 tempest-VolumesActionsTest-1534566879 tempest-VolumesActionsTest-1534566879-project] Calling method '>' {{(pid=128729) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 15:50:02.673673 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.compute.api [None req-f5a767a5-e2eb-482a-9b70-88fde184bbc4 tempest-VolumesActionsTest-1534566879 tempest-VolumesActionsTest-1534566879-project] [instance: 59c281dd-b07e-4f45-b8dc-7021e826f06b] Fetching instance by UUID {{(pid=128729) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 15:50:02.682898 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-f5a767a5-e2eb-482a-9b70-88fde184bbc4 tempest-VolumesActionsTest-1534566879 tempest-VolumesActionsTest-1534566879-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:50:02.685252 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-f5a767a5-e2eb-482a-9b70-88fde184bbc4 tempest-VolumesActionsTest-1534566879 tempest-VolumesActionsTest-1534566879-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:50:02.686241 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-f5a767a5-e2eb-482a-9b70-88fde184bbc4 tempest-VolumesActionsTest-1534566879 tempest-VolumesActionsTest-1534566879-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:50:02.686891 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-f5a767a5-e2eb-482a-9b70-88fde184bbc4 tempest-VolumesActionsTest-1534566879 tempest-VolumesActionsTest-1534566879-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:50:02.910979 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.policy [None req-f5a767a5-e2eb-482a-9b70-88fde184bbc4 tempest-VolumesActionsTest-1534566879 tempest-VolumesActionsTest-1534566879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0156ed87a5b4efca7ef5056429db1a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71b09f9f20b340b5a615b24e05312703', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128729) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:50:02.923202 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: INFO nova.api.openstack.requestlog [None req-f5a767a5-e2eb-482a-9b70-88fde184bbc4 tempest-VolumesActionsTest-1534566879 tempest-VolumesActionsTest-1534566879-project] 10.222.0.61 "GET /compute/v2.1/servers/59c281dd-b07e-4f45-b8dc-7021e826f06b" status: 200 len: 1314 microversion: 2.1 time: 0.254127 May 14 15:50:02.937451 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: [pid: 128729|app: 0|req: 280/575] 10.222.0.61 () {58 vars in 1235 bytes} [Sat May 14 15:50:02 2022] GET /compute/v2.1/servers/59c281dd-b07e-4f45-b8dc-7021e826f06b => generated 1314 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 15:50:03.888384 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi [req-56bb0dd4-ad51-4dd9-ad46-88f92f2b31f0 req-8b74f84d-6387-4488-b0cf-9175d09c5782 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "59c281dd-b07e-4f45-b8dc-7021e826f06b", "name": "network-vif-plugged", "status": "completed", "tag": "b29a17c4-2b40-425d-85cf-0498169b2b00"}]} {{(pid=128728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 15:50:03.896785 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [req-56bb0dd4-ad51-4dd9-ad46-88f92f2b31f0 req-8b74f84d-6387-4488-b0cf-9175d09c5782 service nova] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:50:03.897386 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [req-56bb0dd4-ad51-4dd9-ad46-88f92f2b31f0 req-8b74f84d-6387-4488-b0cf-9175d09c5782 service nova] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:50:03.911538 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: INFO nova.api.openstack.compute.server_external_events [req-56bb0dd4-ad51-4dd9-ad46-88f92f2b31f0 req-8b74f84d-6387-4488-b0cf-9175d09c5782 service nova] Creating event network-vif-plugged:b29a17c4-2b40-425d-85cf-0498169b2b00 for instance 59c281dd-b07e-4f45-b8dc-7021e826f06b on hv-cinder-83979 May 14 15:50:03.920664 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: INFO nova.api.openstack.requestlog [req-56bb0dd4-ad51-4dd9-ad46-88f92f2b31f0 req-8b74f84d-6387-4488-b0cf-9175d09c5782 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036320 May 14 15:50:03.922122 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: [pid: 128728|app: 0|req: 296/576] 10.222.0.61 () {64 vars in 1317 bytes} [Sat May 14 15:50:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 14 15:50:03.941518 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi [None req-f58ed4c5-b797-4d97-8916-71c5f77a93ef tempest-VolumesActionsTest-1534566879 tempest-VolumesActionsTest-1534566879-project] Calling method '>' {{(pid=128729) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 15:50:03.942955 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.compute.api [None req-f58ed4c5-b797-4d97-8916-71c5f77a93ef tempest-VolumesActionsTest-1534566879 tempest-VolumesActionsTest-1534566879-project] [instance: 59c281dd-b07e-4f45-b8dc-7021e826f06b] Fetching instance by UUID {{(pid=128729) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 15:50:03.951259 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-f58ed4c5-b797-4d97-8916-71c5f77a93ef tempest-VolumesActionsTest-1534566879 tempest-VolumesActionsTest-1534566879-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:50:03.952026 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-f58ed4c5-b797-4d97-8916-71c5f77a93ef tempest-VolumesActionsTest-1534566879 tempest-VolumesActionsTest-1534566879-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:50:03.953087 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-f58ed4c5-b797-4d97-8916-71c5f77a93ef tempest-VolumesActionsTest-1534566879 tempest-VolumesActionsTest-1534566879-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:50:03.953991 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-f58ed4c5-b797-4d97-8916-71c5f77a93ef tempest-VolumesActionsTest-1534566879 tempest-VolumesActionsTest-1534566879-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:50:04.135725 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.policy [None req-f58ed4c5-b797-4d97-8916-71c5f77a93ef tempest-VolumesActionsTest-1534566879 tempest-VolumesActionsTest-1534566879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0156ed87a5b4efca7ef5056429db1a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71b09f9f20b340b5a615b24e05312703', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128729) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:50:04.145043 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: INFO nova.api.openstack.requestlog [None req-f58ed4c5-b797-4d97-8916-71c5f77a93ef tempest-VolumesActionsTest-1534566879 tempest-VolumesActionsTest-1534566879-project] 10.222.0.61 "GET /compute/v2.1/servers/59c281dd-b07e-4f45-b8dc-7021e826f06b" status: 200 len: 1314 microversion: 2.1 time: 0.207444 May 14 15:50:04.145603 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: [pid: 128729|app: 0|req: 281/577] 10.222.0.61 () {58 vars in 1235 bytes} [Sat May 14 15:50:03 2022] GET /compute/v2.1/servers/59c281dd-b07e-4f45-b8dc-7021e826f06b => generated 1314 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 15:50:04.267600 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi [None req-dba2fc5a-3eb3-48cd-9603-5d5f15af6108 tempest-TestVolumeBootPattern-2062489882 tempest-TestVolumeBootPattern-2062489882-project] Action: 'create', calling method: .version_select at 0x7f77cb7d1310>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-1553604469", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGyndxUkbpHruIOWj9BCKwn3ZO80cDYHwxqf8T4cRSewYFkzxB7D3+0myEGRvjMoeI5p0WyNiseZ4ymaXDoKOHUXpiT6HGbpLX6wQhy/IGp0GzDzyXzdG/PUNDUa1+dxig=="}} {{(pid=128728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 15:50:04.283322 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.quota [None req-dba2fc5a-3eb3-48cd-9603-5d5f15af6108 tempest-TestVolumeBootPattern-2062489882 tempest-TestVolumeBootPattern-2062489882-project] Getting quotas for project 7a3a2b5dee7a404a8445c8aa434b5a43. Resources: {'key_pairs'} {{(pid=128728) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 14 15:50:04.287458 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.quota [None req-dba2fc5a-3eb3-48cd-9603-5d5f15af6108 tempest-TestVolumeBootPattern-2062489882 tempest-TestVolumeBootPattern-2062489882-project] Getting quotas for user 568f6783dd4d43398a70a9ffa58ff660 and project 7a3a2b5dee7a404a8445c8aa434b5a43. Resources: {'key_pairs'} {{(pid=128728) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 14 15:50:04.311734 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: INFO nova.api.openstack.requestlog [None req-dba2fc5a-3eb3-48cd-9603-5d5f15af6108 tempest-TestVolumeBootPattern-2062489882 tempest-TestVolumeBootPattern-2062489882-project] 10.222.0.61 "POST /compute/v2.1/os-keypairs" status: 200 len: 400 microversion: 2.1 time: 0.274021 May 14 15:50:04.312619 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: [pid: 128728|app: 0|req: 297/578] 10.222.0.61 () {60 vars in 1158 bytes} [Sat May 14 15:50:04 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 14 15:50:05.163287 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi [None req-27e68646-5c38-4120-ac3f-608321238e33 tempest-VolumesActionsTest-1534566879 tempest-VolumesActionsTest-1534566879-project] Calling method '>' {{(pid=128729) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 15:50:05.164715 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.compute.api [None req-27e68646-5c38-4120-ac3f-608321238e33 tempest-VolumesActionsTest-1534566879 tempest-VolumesActionsTest-1534566879-project] [instance: 59c281dd-b07e-4f45-b8dc-7021e826f06b] Fetching instance by UUID {{(pid=128729) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 15:50:05.172700 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-27e68646-5c38-4120-ac3f-608321238e33 tempest-VolumesActionsTest-1534566879 tempest-VolumesActionsTest-1534566879-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:50:05.173298 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-27e68646-5c38-4120-ac3f-608321238e33 tempest-VolumesActionsTest-1534566879 tempest-VolumesActionsTest-1534566879-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:50:05.174225 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-27e68646-5c38-4120-ac3f-608321238e33 tempest-VolumesActionsTest-1534566879 tempest-VolumesActionsTest-1534566879-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:50:05.174910 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-27e68646-5c38-4120-ac3f-608321238e33 tempest-VolumesActionsTest-1534566879 tempest-VolumesActionsTest-1534566879-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:50:05.376747 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.policy [None req-27e68646-5c38-4120-ac3f-608321238e33 tempest-VolumesActionsTest-1534566879 tempest-VolumesActionsTest-1534566879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0156ed87a5b4efca7ef5056429db1a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71b09f9f20b340b5a615b24e05312703', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128729) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:50:05.388735 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: INFO nova.api.openstack.requestlog [None req-27e68646-5c38-4120-ac3f-608321238e33 tempest-VolumesActionsTest-1534566879 tempest-VolumesActionsTest-1534566879-project] 10.222.0.61 "GET /compute/v2.1/servers/59c281dd-b07e-4f45-b8dc-7021e826f06b" status: 200 len: 1314 microversion: 2.1 time: 0.229618 May 14 15:50:05.389593 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: [pid: 128729|app: 0|req: 282/579] 10.222.0.61 () {58 vars in 1235 bytes} [Sat May 14 15:50:05 2022] GET /compute/v2.1/servers/59c281dd-b07e-4f45-b8dc-7021e826f06b => generated 1314 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 15:50:06.409860 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi [None req-e431f4a9-9e82-4b0f-8611-2a01b83c4348 tempest-VolumesActionsTest-1534566879 tempest-VolumesActionsTest-1534566879-project] Calling method '>' {{(pid=128728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 15:50:06.411817 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.compute.api [None req-e431f4a9-9e82-4b0f-8611-2a01b83c4348 tempest-VolumesActionsTest-1534566879 tempest-VolumesActionsTest-1534566879-project] [instance: 59c281dd-b07e-4f45-b8dc-7021e826f06b] Fetching instance by UUID {{(pid=128728) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 15:50:06.419143 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-e431f4a9-9e82-4b0f-8611-2a01b83c4348 tempest-VolumesActionsTest-1534566879 tempest-VolumesActionsTest-1534566879-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:50:06.419598 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-e431f4a9-9e82-4b0f-8611-2a01b83c4348 tempest-VolumesActionsTest-1534566879 tempest-VolumesActionsTest-1534566879-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:50:06.420390 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-e431f4a9-9e82-4b0f-8611-2a01b83c4348 tempest-VolumesActionsTest-1534566879 tempest-VolumesActionsTest-1534566879-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:50:06.420865 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-e431f4a9-9e82-4b0f-8611-2a01b83c4348 tempest-VolumesActionsTest-1534566879 tempest-VolumesActionsTest-1534566879-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:50:06.569789 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.policy [None req-e431f4a9-9e82-4b0f-8611-2a01b83c4348 tempest-VolumesActionsTest-1534566879 tempest-VolumesActionsTest-1534566879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0156ed87a5b4efca7ef5056429db1a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71b09f9f20b340b5a615b24e05312703', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128728) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:50:06.578288 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: INFO nova.api.openstack.requestlog [None req-e431f4a9-9e82-4b0f-8611-2a01b83c4348 tempest-VolumesActionsTest-1534566879 tempest-VolumesActionsTest-1534566879-project] 10.222.0.61 "GET /compute/v2.1/servers/59c281dd-b07e-4f45-b8dc-7021e826f06b" status: 200 len: 1314 microversion: 2.1 time: 0.176557 May 14 15:50:06.579015 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: [pid: 128728|app: 0|req: 298/580] 10.222.0.61 () {58 vars in 1235 bytes} [Sat May 14 15:50:06 2022] GET /compute/v2.1/servers/59c281dd-b07e-4f45-b8dc-7021e826f06b => generated 1314 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 15:50:07.597261 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi [None req-a0693f9f-2cab-4f24-9eb9-af2855a6d97b tempest-VolumesActionsTest-1534566879 tempest-VolumesActionsTest-1534566879-project] Calling method '>' {{(pid=128729) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 15:50:07.597985 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.compute.api [None req-a0693f9f-2cab-4f24-9eb9-af2855a6d97b tempest-VolumesActionsTest-1534566879 tempest-VolumesActionsTest-1534566879-project] [instance: 59c281dd-b07e-4f45-b8dc-7021e826f06b] Fetching instance by UUID {{(pid=128729) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 15:50:07.605389 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-a0693f9f-2cab-4f24-9eb9-af2855a6d97b tempest-VolumesActionsTest-1534566879 tempest-VolumesActionsTest-1534566879-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:50:07.605838 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-a0693f9f-2cab-4f24-9eb9-af2855a6d97b tempest-VolumesActionsTest-1534566879 tempest-VolumesActionsTest-1534566879-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:50:07.606642 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-a0693f9f-2cab-4f24-9eb9-af2855a6d97b tempest-VolumesActionsTest-1534566879 tempest-VolumesActionsTest-1534566879-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:50:07.607077 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-a0693f9f-2cab-4f24-9eb9-af2855a6d97b tempest-VolumesActionsTest-1534566879 tempest-VolumesActionsTest-1534566879-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:50:07.746654 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.policy [None req-a0693f9f-2cab-4f24-9eb9-af2855a6d97b tempest-VolumesActionsTest-1534566879 tempest-VolumesActionsTest-1534566879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0156ed87a5b4efca7ef5056429db1a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71b09f9f20b340b5a615b24e05312703', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128729) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:50:07.754429 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: INFO nova.api.openstack.requestlog [None req-a0693f9f-2cab-4f24-9eb9-af2855a6d97b tempest-VolumesActionsTest-1534566879 tempest-VolumesActionsTest-1534566879-project] 10.222.0.61 "GET /compute/v2.1/servers/59c281dd-b07e-4f45-b8dc-7021e826f06b" status: 200 len: 1497 microversion: 2.1 time: 0.161769 May 14 15:50:07.766366 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: [pid: 128729|app: 0|req: 283/581] 10.222.0.61 () {58 vars in 1235 bytes} [Sat May 14 15:50:07 2022] GET /compute/v2.1/servers/59c281dd-b07e-4f45-b8dc-7021e826f06b => generated 1497 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 15:50:08.335106 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi [None req-efd5297c-632b-40f7-94dd-13f5f7c9d195 tempest-VolumesActionsTest-1534566879 tempest-VolumesActionsTest-1534566879-project] Calling method '>' {{(pid=128728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 15:50:08.335765 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.compute.api [None req-efd5297c-632b-40f7-94dd-13f5f7c9d195 tempest-VolumesActionsTest-1534566879 tempest-VolumesActionsTest-1534566879-project] [instance: 59c281dd-b07e-4f45-b8dc-7021e826f06b] Fetching instance by UUID {{(pid=128728) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 15:50:08.342338 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-efd5297c-632b-40f7-94dd-13f5f7c9d195 tempest-VolumesActionsTest-1534566879 tempest-VolumesActionsTest-1534566879-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:50:08.343611 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-efd5297c-632b-40f7-94dd-13f5f7c9d195 tempest-VolumesActionsTest-1534566879 tempest-VolumesActionsTest-1534566879-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:50:08.344536 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-efd5297c-632b-40f7-94dd-13f5f7c9d195 tempest-VolumesActionsTest-1534566879 tempest-VolumesActionsTest-1534566879-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:50:08.345080 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-efd5297c-632b-40f7-94dd-13f5f7c9d195 tempest-VolumesActionsTest-1534566879 tempest-VolumesActionsTest-1534566879-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:50:08.375879 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.compute.api [None req-efd5297c-632b-40f7-94dd-13f5f7c9d195 tempest-VolumesActionsTest-1534566879 tempest-VolumesActionsTest-1534566879-project] [instance: 59c281dd-b07e-4f45-b8dc-7021e826f06b] Going to try to terminate instance {{(pid=128728) delete /opt/stack/nova/nova/compute/api.py:2664}} May 14 15:50:08.451007 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: INFO nova.api.openstack.requestlog [None req-efd5297c-632b-40f7-94dd-13f5f7c9d195 tempest-VolumesActionsTest-1534566879 tempest-VolumesActionsTest-1534566879-project] 10.222.0.61 "DELETE /compute/v2.1/servers/59c281dd-b07e-4f45-b8dc-7021e826f06b" status: 204 len: 0 microversion: 2.1 time: 0.119568 May 14 15:50:08.451707 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: [pid: 128728|app: 0|req: 299/582] 10.222.0.61 () {58 vars in 1238 bytes} [Sat May 14 15:50:08 2022] DELETE /compute/v2.1/servers/59c281dd-b07e-4f45-b8dc-7021e826f06b => generated 0 bytes in 121 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 14 15:50:08.459793 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi [None req-39eeba3b-65c9-48ce-89e1-0bd2493df06a tempest-VolumesActionsTest-1534566879 tempest-VolumesActionsTest-1534566879-project] Calling method '>' {{(pid=128729) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 15:50:08.460546 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.compute.api [None req-39eeba3b-65c9-48ce-89e1-0bd2493df06a tempest-VolumesActionsTest-1534566879 tempest-VolumesActionsTest-1534566879-project] [instance: 59c281dd-b07e-4f45-b8dc-7021e826f06b] Fetching instance by UUID {{(pid=128729) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 15:50:08.466859 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-39eeba3b-65c9-48ce-89e1-0bd2493df06a tempest-VolumesActionsTest-1534566879 tempest-VolumesActionsTest-1534566879-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:50:08.467327 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-39eeba3b-65c9-48ce-89e1-0bd2493df06a tempest-VolumesActionsTest-1534566879 tempest-VolumesActionsTest-1534566879-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:50:08.468089 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-39eeba3b-65c9-48ce-89e1-0bd2493df06a tempest-VolumesActionsTest-1534566879 tempest-VolumesActionsTest-1534566879-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:50:08.468525 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-39eeba3b-65c9-48ce-89e1-0bd2493df06a tempest-VolumesActionsTest-1534566879 tempest-VolumesActionsTest-1534566879-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:50:08.599900 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.policy [None req-39eeba3b-65c9-48ce-89e1-0bd2493df06a tempest-VolumesActionsTest-1534566879 tempest-VolumesActionsTest-1534566879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0156ed87a5b4efca7ef5056429db1a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71b09f9f20b340b5a615b24e05312703', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128729) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:50:08.608062 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: INFO nova.api.openstack.requestlog [None req-39eeba3b-65c9-48ce-89e1-0bd2493df06a tempest-VolumesActionsTest-1534566879 tempest-VolumesActionsTest-1534566879-project] 10.222.0.61 "GET /compute/v2.1/servers/59c281dd-b07e-4f45-b8dc-7021e826f06b" status: 200 len: 1503 microversion: 2.1 time: 0.152169 May 14 15:50:08.608622 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: [pid: 128729|app: 0|req: 284/583] 10.222.0.61 () {58 vars in 1235 bytes} [Sat May 14 15:50:08 2022] GET /compute/v2.1/servers/59c281dd-b07e-4f45-b8dc-7021e826f06b => generated 1503 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 15:50:09.350071 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi [None req-ccbaf6d1-574c-46b1-88f2-2d86a7e07b2c tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] Calling method '>' {{(pid=128728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 15:50:09.350680 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.compute.api [None req-ccbaf6d1-574c-46b1-88f2-2d86a7e07b2c tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] [instance: 113f6b52-519c-45f4-9bc2-37168d644e15] Fetching instance by UUID {{(pid=128728) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 15:50:09.357269 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-ccbaf6d1-574c-46b1-88f2-2d86a7e07b2c tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:50:09.357759 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-ccbaf6d1-574c-46b1-88f2-2d86a7e07b2c tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:50:09.358565 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-ccbaf6d1-574c-46b1-88f2-2d86a7e07b2c tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:50:09.359011 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-ccbaf6d1-574c-46b1-88f2-2d86a7e07b2c tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:50:09.381681 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: INFO nova.api.openstack.requestlog [None req-ccbaf6d1-574c-46b1-88f2-2d86a7e07b2c tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] 10.222.0.61 "GET /compute/v2.1/servers/113f6b52-519c-45f4-9bc2-37168d644e15/ips" status: 200 len: 149 microversion: 2.1 time: 0.035810 May 14 15:50:09.382269 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: [pid: 128728|app: 0|req: 300/584] 10.222.0.61 () {58 vars in 1247 bytes} [Sat May 14 15:50:09 2022] GET /compute/v2.1/servers/113f6b52-519c-45f4-9bc2-37168d644e15/ips => generated 149 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 14 15:50:09.630010 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi [None req-b6a5e8b5-d1dc-4369-9843-7b142faa51e9 tempest-VolumesActionsTest-1534566879 tempest-VolumesActionsTest-1534566879-project] Calling method '>' {{(pid=128729) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 15:50:09.630618 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.compute.api [None req-b6a5e8b5-d1dc-4369-9843-7b142faa51e9 tempest-VolumesActionsTest-1534566879 tempest-VolumesActionsTest-1534566879-project] [instance: 59c281dd-b07e-4f45-b8dc-7021e826f06b] Fetching instance by UUID {{(pid=128729) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 15:50:09.639530 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-b6a5e8b5-d1dc-4369-9843-7b142faa51e9 tempest-VolumesActionsTest-1534566879 tempest-VolumesActionsTest-1534566879-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:50:09.640244 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-b6a5e8b5-d1dc-4369-9843-7b142faa51e9 tempest-VolumesActionsTest-1534566879 tempest-VolumesActionsTest-1534566879-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:50:09.640749 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-b6a5e8b5-d1dc-4369-9843-7b142faa51e9 tempest-VolumesActionsTest-1534566879 tempest-VolumesActionsTest-1534566879-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:50:09.641208 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-b6a5e8b5-d1dc-4369-9843-7b142faa51e9 tempest-VolumesActionsTest-1534566879 tempest-VolumesActionsTest-1534566879-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:50:09.774050 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.policy [None req-b6a5e8b5-d1dc-4369-9843-7b142faa51e9 tempest-VolumesActionsTest-1534566879 tempest-VolumesActionsTest-1534566879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0156ed87a5b4efca7ef5056429db1a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71b09f9f20b340b5a615b24e05312703', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128729) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:50:09.781324 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: INFO nova.api.openstack.requestlog [None req-b6a5e8b5-d1dc-4369-9843-7b142faa51e9 tempest-VolumesActionsTest-1534566879 tempest-VolumesActionsTest-1534566879-project] 10.222.0.61 "GET /compute/v2.1/servers/59c281dd-b07e-4f45-b8dc-7021e826f06b" status: 200 len: 1503 microversion: 2.1 time: 0.155573 May 14 15:50:09.781894 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: [pid: 128729|app: 0|req: 285/585] 10.222.0.61 () {58 vars in 1235 bytes} [Sat May 14 15:50:09 2022] GET /compute/v2.1/servers/59c281dd-b07e-4f45-b8dc-7021e826f06b => generated 1503 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 15:50:10.741259 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi [None req-d7d1b3d0-7b62-4f8e-97c5-15c5da095bba tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "0f2837f5-3eb0-4224-9cec-829916a28792"}} {{(pid=128728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 15:50:10.742540 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.compute.api [None req-d7d1b3d0-7b62-4f8e-97c5-15c5da095bba tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] [instance: 113f6b52-519c-45f4-9bc2-37168d644e15] Fetching instance by UUID {{(pid=128728) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 15:50:10.749107 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-d7d1b3d0-7b62-4f8e-97c5-15c5da095bba tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:50:10.749555 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-d7d1b3d0-7b62-4f8e-97c5-15c5da095bba tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:50:10.750356 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-d7d1b3d0-7b62-4f8e-97c5-15c5da095bba tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:50:10.750822 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-d7d1b3d0-7b62-4f8e-97c5-15c5da095bba tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:50:10.798491 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi [None req-411bbc8c-e0d1-4e98-bb35-0b0e85ddad25 tempest-VolumesActionsTest-1534566879 tempest-VolumesActionsTest-1534566879-project] Calling method '>' {{(pid=128729) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 15:50:10.799378 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.compute.api [None req-411bbc8c-e0d1-4e98-bb35-0b0e85ddad25 tempest-VolumesActionsTest-1534566879 tempest-VolumesActionsTest-1534566879-project] [instance: 59c281dd-b07e-4f45-b8dc-7021e826f06b] Fetching instance by UUID {{(pid=128729) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 15:50:10.805875 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-411bbc8c-e0d1-4e98-bb35-0b0e85ddad25 tempest-VolumesActionsTest-1534566879 tempest-VolumesActionsTest-1534566879-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:50:10.806417 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-411bbc8c-e0d1-4e98-bb35-0b0e85ddad25 tempest-VolumesActionsTest-1534566879 tempest-VolumesActionsTest-1534566879-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:50:10.807242 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-411bbc8c-e0d1-4e98-bb35-0b0e85ddad25 tempest-VolumesActionsTest-1534566879 tempest-VolumesActionsTest-1534566879-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:50:10.807713 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-411bbc8c-e0d1-4e98-bb35-0b0e85ddad25 tempest-VolumesActionsTest-1534566879 tempest-VolumesActionsTest-1534566879-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:50:11.092841 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: INFO nova.api.openstack.requestlog [None req-d7d1b3d0-7b62-4f8e-97c5-15c5da095bba tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] 10.222.0.61 "POST /compute/v2.1/servers/113f6b52-519c-45f4-9bc2-37168d644e15/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.355702 May 14 15:50:11.094126 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: [pid: 128728|app: 0|req: 301/586] 10.222.0.61 () {60 vars in 1322 bytes} [Sat May 14 15:50:10 2022] POST /compute/v2.1/servers/113f6b52-519c-45f4-9bc2-37168d644e15/os-volume_attachments => generated 194 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 14 15:50:11.150785 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.policy [None req-411bbc8c-e0d1-4e98-bb35-0b0e85ddad25 tempest-VolumesActionsTest-1534566879 tempest-VolumesActionsTest-1534566879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0156ed87a5b4efca7ef5056429db1a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71b09f9f20b340b5a615b24e05312703', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128729) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:50:11.160559 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: INFO nova.api.openstack.requestlog [None req-411bbc8c-e0d1-4e98-bb35-0b0e85ddad25 tempest-VolumesActionsTest-1534566879 tempest-VolumesActionsTest-1534566879-project] 10.222.0.61 "GET /compute/v2.1/servers/59c281dd-b07e-4f45-b8dc-7021e826f06b" status: 200 len: 1503 microversion: 2.1 time: 0.365410 May 14 15:50:11.170730 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: [pid: 128729|app: 0|req: 286/587] 10.222.0.61 () {58 vars in 1235 bytes} [Sat May 14 15:50:10 2022] GET /compute/v2.1/servers/59c281dd-b07e-4f45-b8dc-7021e826f06b => generated 1503 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 15:50:11.411721 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi [req-0156c4d6-e864-42b5-838f-a536b31c38ce req-e5a5b7ae-ebe9-43c5-88ee-2d86a44277db service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "59c281dd-b07e-4f45-b8dc-7021e826f06b", "name": "network-vif-deleted", "tag": "b29a17c4-2b40-425d-85cf-0498169b2b00"}]} {{(pid=128728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 15:50:11.421825 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [req-0156c4d6-e864-42b5-838f-a536b31c38ce req-e5a5b7ae-ebe9-43c5-88ee-2d86a44277db service nova] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:50:11.422450 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [req-0156c4d6-e864-42b5-838f-a536b31c38ce req-e5a5b7ae-ebe9-43c5-88ee-2d86a44277db service nova] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:50:11.433704 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: INFO nova.api.openstack.compute.server_external_events [req-0156c4d6-e864-42b5-838f-a536b31c38ce req-e5a5b7ae-ebe9-43c5-88ee-2d86a44277db service nova] Creating event network-vif-deleted:b29a17c4-2b40-425d-85cf-0498169b2b00 for instance 59c281dd-b07e-4f45-b8dc-7021e826f06b on hv-cinder-83979 May 14 15:50:11.438730 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: INFO nova.api.openstack.requestlog [req-0156c4d6-e864-42b5-838f-a536b31c38ce req-e5a5b7ae-ebe9-43c5-88ee-2d86a44277db service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031442 May 14 15:50:11.442283 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: [pid: 128728|app: 0|req: 302/588] 10.222.0.61 () {64 vars in 1317 bytes} [Sat May 14 15:50:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 14 15:50:12.178906 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi [None req-5a4fd21a-4df0-4829-bfd2-c69d5c00b6b0 tempest-VolumesActionsTest-1534566879 tempest-VolumesActionsTest-1534566879-project] Calling method '>' {{(pid=128729) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 15:50:12.179613 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.compute.api [None req-5a4fd21a-4df0-4829-bfd2-c69d5c00b6b0 tempest-VolumesActionsTest-1534566879 tempest-VolumesActionsTest-1534566879-project] [instance: 59c281dd-b07e-4f45-b8dc-7021e826f06b] Fetching instance by UUID {{(pid=128729) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 15:50:12.189496 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-5a4fd21a-4df0-4829-bfd2-c69d5c00b6b0 tempest-VolumesActionsTest-1534566879 tempest-VolumesActionsTest-1534566879-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:50:12.190042 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-5a4fd21a-4df0-4829-bfd2-c69d5c00b6b0 tempest-VolumesActionsTest-1534566879 tempest-VolumesActionsTest-1534566879-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:50:12.191103 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-5a4fd21a-4df0-4829-bfd2-c69d5c00b6b0 tempest-VolumesActionsTest-1534566879 tempest-VolumesActionsTest-1534566879-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:50:12.192080 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-5a4fd21a-4df0-4829-bfd2-c69d5c00b6b0 tempest-VolumesActionsTest-1534566879 tempest-VolumesActionsTest-1534566879-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:50:12.209621 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: INFO nova.api.openstack.wsgi [None req-5a4fd21a-4df0-4829-bfd2-c69d5c00b6b0 tempest-VolumesActionsTest-1534566879 tempest-VolumesActionsTest-1534566879-project] HTTP exception thrown: Instance 59c281dd-b07e-4f45-b8dc-7021e826f06b could not be found. May 14 15:50:12.211359 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi [None req-5a4fd21a-4df0-4829-bfd2-c69d5c00b6b0 tempest-VolumesActionsTest-1534566879 tempest-VolumesActionsTest-1534566879-project] Request method failure captured: May 14 15:50:12.211359 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: request: GET /compute/v2.1/servers/59c281dd-b07e-4f45-b8dc-7021e826f06b HTTP/1.1 May 14 15:50:12.211359 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: Accept: application/json May 14 15:50:12.211359 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: Accept-Encoding: identity May 14 15:50:12.211359 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: Connection: close May 14 15:50:12.211359 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: Content-Length: 0 May 14 15:50:12.211359 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: Content-Type: application/json May 14 15:50:12.211359 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: Host: 10.222.0.61 May 14 15:50:12.211359 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: Openstack-System-Scope: None May 14 15:50:12.211359 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: User-Agent: python-urllib3/1.26.9 May 14 15:50:12.211359 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: X-Auth-Token: gAAAAABif89jLxp4t1WVtjbJVjCia3bXXs3rPVzqUVsmY0CkIBqA3CW6M_yExmmMJI5S5_3EVfS5BcndNPdZB3duQ5YqkAV-eKThoG4n9GEQYYgIRRXWnWP9CwAQXsbZlPJWNpR3GWnZiVIK2_djw15twTc3OugScuYC__Px1V5Htv0uLPBIaPA May 14 15:50:12.211359 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: X-Domain-Id: None May 14 15:50:12.211359 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: X-Domain-Name: None May 14 15:50:12.211359 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: X-Identity-Status: Confirmed May 14 15:50:12.211359 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: X-Is-Admin-Project: True May 14 15:50:12.211359 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: X-Project-Domain-Id: default May 14 15:50:12.211359 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: X-Project-Domain-Name: Default May 14 15:50:12.211359 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: X-Project-Id: 71b09f9f20b340b5a615b24e05312703 May 14 15:50:12.211359 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: X-Project-Name: tempest-VolumesActionsTest-1534566879 May 14 15:50:12.211359 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: X-Role: reader,member May 14 15:50:12.211359 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: X-Roles: reader,member May 14 15:50:12.212849 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/71b09f9f20b340b5a615b24e05312703"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/71b09f9f20b340b5a615b24e05312703"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/71b09f9f20b340b5a615b24e05312703"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_71b09f9f20b340b5a615b24e05312703"}]}] May 14 15:50:12.212849 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: X-Tenant: tempest-VolumesActionsTest-1534566879 May 14 15:50:12.212849 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: X-Tenant-Id: 71b09f9f20b340b5a615b24e05312703 May 14 15:50:12.212849 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: X-Tenant-Name: tempest-VolumesActionsTest-1534566879 May 14 15:50:12.212849 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: X-User: tempest-VolumesActionsTest-1534566879-project May 14 15:50:12.212849 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: X-User-Domain-Id: default May 14 15:50:12.212849 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: X-User-Domain-Name: Default May 14 15:50:12.212849 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: X-User-Id: e0156ed87a5b4efca7ef5056429db1a0 May 14 15:50:12.212849 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: X-User-Name: tempest-VolumesActionsTest-1534566879-project May 14 15:50:12.212849 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: method: > May 14 15:50:12.212849 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: exception: Instance 59c281dd-b07e-4f45-b8dc-7021e826f06b could not be found. May 14 15:50:12.212849 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: action_args: {'id': '59c281dd-b07e-4f45-b8dc-7021e826f06b'} May 14 15:50:12.213754 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: {{(pid=128729) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 14 15:50:12.213754 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 15:50:12.213754 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 14 15:50:12.213754 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 14 15:50:12.213754 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 14 15:50:12.213754 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 14 15:50:12.213754 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 14 15:50:12.213754 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 14 15:50:12.213754 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 14 15:50:12.213754 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 14 15:50:12.213754 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 59c281dd-b07e-4f45-b8dc-7021e826f06b could not be found. May 14 15:50:12.213754 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: ERROR nova.api.openstack.wsgi May 14 15:50:12.213754 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 14 15:50:12.213754 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: ERROR nova.api.openstack.wsgi May 14 15:50:12.213754 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 15:50:12.213754 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 14 15:50:12.213754 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 14 15:50:12.213754 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 14 15:50:12.213754 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 14 15:50:12.213754 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 14 15:50:12.215169 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 14 15:50:12.215169 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 14 15:50:12.215169 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 14 15:50:12.215169 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 14 15:50:12.215169 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 14 15:50:12.215169 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 14 15:50:12.215169 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 14 15:50:12.215169 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 59c281dd-b07e-4f45-b8dc-7021e826f06b could not be found. May 14 15:50:12.215169 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: ERROR nova.api.openstack.wsgi May 14 15:50:12.215169 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 14 15:50:12.215169 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: ERROR nova.api.openstack.wsgi May 14 15:50:12.215169 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 15:50:12.215169 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 14 15:50:12.215169 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 14 15:50:12.215169 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 14 15:50:12.215169 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 14 15:50:12.215169 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 59c281dd-b07e-4f45-b8dc-7021e826f06b could not be found. May 14 15:50:12.215169 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: ERROR nova.api.openstack.wsgi May 14 15:50:12.216245 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi [None req-5a4fd21a-4df0-4829-bfd2-c69d5c00b6b0 tempest-VolumesActionsTest-1534566879 tempest-VolumesActionsTest-1534566879-project] Returning 404 to user: Instance 59c281dd-b07e-4f45-b8dc-7021e826f06b could not be found. {{(pid=128729) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 14 15:50:12.216245 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: INFO nova.api.openstack.requestlog [None req-5a4fd21a-4df0-4829-bfd2-c69d5c00b6b0 tempest-VolumesActionsTest-1534566879 tempest-VolumesActionsTest-1534566879-project] 10.222.0.61 "GET /compute/v2.1/servers/59c281dd-b07e-4f45-b8dc-7021e826f06b" status: 404 len: 111 microversion: 2.1 time: 0.038488 May 14 15:50:12.216245 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: [pid: 128729|app: 0|req: 287/589] 10.222.0.61 () {58 vars in 1235 bytes} [Sat May 14 15:50:12 2022] GET /compute/v2.1/servers/59c281dd-b07e-4f45-b8dc-7021e826f06b => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 14 15:50:12.737205 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi [None req-f0ce4d8b-58d4-4855-99c2-9226386b4645 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Calling method '>' {{(pid=128728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 15:50:12.738061 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.compute.api [None req-f0ce4d8b-58d4-4855-99c2-9226386b4645 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] [instance: e33e9970-bfb7-46f3-8d40-782dbfa3d21c] Fetching instance by UUID {{(pid=128728) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 15:50:12.744375 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-f0ce4d8b-58d4-4855-99c2-9226386b4645 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:50:12.745387 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-f0ce4d8b-58d4-4855-99c2-9226386b4645 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:50:12.746268 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-f0ce4d8b-58d4-4855-99c2-9226386b4645 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:50:12.746731 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-f0ce4d8b-58d4-4855-99c2-9226386b4645 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:50:12.773488 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: INFO nova.api.openstack.requestlog [None req-f0ce4d8b-58d4-4855-99c2-9226386b4645 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] 10.222.0.61 "GET /compute/v2.1/servers/e33e9970-bfb7-46f3-8d40-782dbfa3d21c/ips" status: 200 len: 151 microversion: 2.20 time: 0.040919 May 14 15:50:12.774204 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: [pid: 128728|app: 0|req: 303/590] 10.222.0.61 () {60 vars in 1288 bytes} [Sat May 14 15:50:12 2022] GET /compute/v2.1/servers/e33e9970-bfb7-46f3-8d40-782dbfa3d21c/ips => generated 151 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 14 15:50:16.452254 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi [None req-4098bb96-1e78-433b-8c4d-9100ad6415f2 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=128729) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 15:50:16.452867 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.compute.api [None req-4098bb96-1e78-433b-8c4d-9100ad6415f2 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] [instance: e33e9970-bfb7-46f3-8d40-782dbfa3d21c] Fetching instance by UUID {{(pid=128729) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 15:50:16.459324 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-4098bb96-1e78-433b-8c4d-9100ad6415f2 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:50:16.459780 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-4098bb96-1e78-433b-8c4d-9100ad6415f2 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:50:16.460553 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-4098bb96-1e78-433b-8c4d-9100ad6415f2 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:50:16.460999 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-4098bb96-1e78-433b-8c4d-9100ad6415f2 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:50:16.484587 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.objects.instance [None req-4098bb96-1e78-433b-8c4d-9100ad6415f2 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Lazy-loading 'flavor' on Instance uuid e33e9970-bfb7-46f3-8d40-782dbfa3d21c {{(pid=128729) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 14 15:50:19.528751 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: INFO nova.api.openstack.requestlog [None req-4098bb96-1e78-433b-8c4d-9100ad6415f2 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] 10.222.0.61 "POST /compute/v2.1/servers/e33e9970-bfb7-46f3-8d40-782dbfa3d21c/action" status: 202 len: 0 microversion: 2.20 time: 3.081174 May 14 15:50:19.530201 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: [pid: 128729|app: 0|req: 288/591] 10.222.0.61 () {62 vars in 1318 bytes} [Sat May 14 15:50:16 2022] POST /compute/v2.1/servers/e33e9970-bfb7-46f3-8d40-782dbfa3d21c/action => generated 0 bytes in 3083 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) May 14 15:50:19.538003 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi [None req-baacd7e9-a582-45c8-bcb2-cf27376033fc tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Calling method '>' {{(pid=128728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 15:50:19.538638 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.compute.api [None req-baacd7e9-a582-45c8-bcb2-cf27376033fc tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] [instance: e33e9970-bfb7-46f3-8d40-782dbfa3d21c] Fetching instance by UUID {{(pid=128728) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 15:50:19.545542 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-baacd7e9-a582-45c8-bcb2-cf27376033fc tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:50:19.546066 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-baacd7e9-a582-45c8-bcb2-cf27376033fc tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:50:19.546840 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-baacd7e9-a582-45c8-bcb2-cf27376033fc tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:50:19.547283 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-baacd7e9-a582-45c8-bcb2-cf27376033fc tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:50:19.692258 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.policy [None req-baacd7e9-a582-45c8-bcb2-cf27376033fc tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58bfb7417bc94583963401ae0fe9d39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0672be3fa3f7414da1c1a5b7300abbe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128728) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:50:19.693378 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi [None req-3f348c9e-7e22-426e-a8c8-06e5cf4b62ec tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] Action: 'create', calling method: .version_select at 0x7f77dcf69af0>, body: {"keypair": {"name": "tempest-keypair-886674356", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAuiKhUJ5Pg1Fuc+l6eilP7WZbAHJGBIbUYH3Tt7D0KluDZmdDEBN0de/7dBczU+lT0DYjQfL/peagg+yymbwaJQOJEPGaVBoy6fN3xH4d8WzTHhcYH++Y1rPgtedHPINQ=="}} {{(pid=128729) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 15:50:19.700171 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.policy [None req-baacd7e9-a582-45c8-bcb2-cf27376033fc tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58bfb7417bc94583963401ae0fe9d39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0672be3fa3f7414da1c1a5b7300abbe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128728) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:50:19.701713 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.policy [None req-baacd7e9-a582-45c8-bcb2-cf27376033fc tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58bfb7417bc94583963401ae0fe9d39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0672be3fa3f7414da1c1a5b7300abbe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128728) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:50:19.703120 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: INFO nova.api.openstack.requestlog [None req-baacd7e9-a582-45c8-bcb2-cf27376033fc tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] 10.222.0.61 "GET /compute/v2.1/servers/e33e9970-bfb7-46f3-8d40-782dbfa3d21c" status: 200 len: 1722 microversion: 2.20 time: 0.169041 May 14 15:50:19.703840 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: [pid: 128728|app: 0|req: 304/592] 10.222.0.61 () {60 vars in 1276 bytes} [Sat May 14 15:50:19 2022] GET /compute/v2.1/servers/e33e9970-bfb7-46f3-8d40-782dbfa3d21c => generated 1722 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 14 15:50:19.708548 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.quota [None req-3f348c9e-7e22-426e-a8c8-06e5cf4b62ec tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] Getting quotas for project 7905689c95d44a5c9169249c70f7de57. Resources: {'key_pairs'} {{(pid=128729) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 14 15:50:19.712357 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.quota [None req-3f348c9e-7e22-426e-a8c8-06e5cf4b62ec tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] Getting quotas for user dc43895177134e9c9c030a9d87f94aaa and project 7905689c95d44a5c9169249c70f7de57. Resources: {'key_pairs'} {{(pid=128729) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 14 15:50:19.734666 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: INFO nova.api.openstack.requestlog [None req-3f348c9e-7e22-426e-a8c8-06e5cf4b62ec tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] 10.222.0.61 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.045546 May 14 15:50:19.735256 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: [pid: 128729|app: 0|req: 289/593] 10.222.0.61 () {60 vars in 1158 bytes} [Sat May 14 15:50:19 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 14 15:50:20.724137 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi [None req-d2a5b656-4630-4239-bf39-6a8ed6c52123 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Calling method '>' {{(pid=128728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 15:50:20.724966 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.compute.api [None req-d2a5b656-4630-4239-bf39-6a8ed6c52123 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] [instance: e33e9970-bfb7-46f3-8d40-782dbfa3d21c] Fetching instance by UUID {{(pid=128728) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 15:50:20.731469 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-d2a5b656-4630-4239-bf39-6a8ed6c52123 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:50:20.731914 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-d2a5b656-4630-4239-bf39-6a8ed6c52123 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:50:20.732692 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-d2a5b656-4630-4239-bf39-6a8ed6c52123 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:50:20.733121 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-d2a5b656-4630-4239-bf39-6a8ed6c52123 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:50:20.873379 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.policy [None req-d2a5b656-4630-4239-bf39-6a8ed6c52123 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58bfb7417bc94583963401ae0fe9d39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0672be3fa3f7414da1c1a5b7300abbe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128728) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:50:20.881356 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.policy [None req-d2a5b656-4630-4239-bf39-6a8ed6c52123 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58bfb7417bc94583963401ae0fe9d39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0672be3fa3f7414da1c1a5b7300abbe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128728) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:50:20.882980 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.policy [None req-d2a5b656-4630-4239-bf39-6a8ed6c52123 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58bfb7417bc94583963401ae0fe9d39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0672be3fa3f7414da1c1a5b7300abbe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128728) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:50:20.884081 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: INFO nova.api.openstack.requestlog [None req-d2a5b656-4630-4239-bf39-6a8ed6c52123 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] 10.222.0.61 "GET /compute/v2.1/servers/e33e9970-bfb7-46f3-8d40-782dbfa3d21c" status: 200 len: 1722 microversion: 2.20 time: 0.163985 May 14 15:50:20.884643 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: [pid: 128728|app: 0|req: 305/594] 10.222.0.61 () {60 vars in 1276 bytes} [Sat May 14 15:50:20 2022] GET /compute/v2.1/servers/e33e9970-bfb7-46f3-8d40-782dbfa3d21c => generated 1722 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 14 15:50:21.012332 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi [None req-f32c6fbd-e0a3-457f-b56e-455efe9cb2a1 tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1461395832", "imageRef": "1381e3d5-fc27-4fa7-ab03-5d86278a0546", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "722d2578-8e0a-4535-bc1b-444c13327ab8"}], "security_groups": [{"name": "tempest-securitygroup--1477440700"}], "key_name": "tempest-keypair-886674356", "user_data": "}} {{(pid=128729) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 15:50:21.111562 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.network.neutron [None req-f32c6fbd-e0a3-457f-b56e-455efe9cb2a1 tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] validate_networks() for [('722d2578-8e0a-4535-bc1b-444c13327ab8', None, None, None, None, None)] {{(pid=128729) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 14 15:50:21.470463 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.virt.hardware [None req-f32c6fbd-e0a3-457f-b56e-455efe9cb2a1 tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] Flavor limits 0:0:0 {{(pid=128729) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 14 15:50:21.470877 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.virt.hardware [None req-f32c6fbd-e0a3-457f-b56e-455efe9cb2a1 tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] Image limits 0:0:0 {{(pid=128729) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 14 15:50:21.471367 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.virt.hardware [None req-f32c6fbd-e0a3-457f-b56e-455efe9cb2a1 tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] Flavor pref 0:0:0 {{(pid=128729) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 14 15:50:21.471764 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.virt.hardware [None req-f32c6fbd-e0a3-457f-b56e-455efe9cb2a1 tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] Image pref 0:0:0 {{(pid=128729) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 14 15:50:21.472165 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.virt.hardware [None req-f32c6fbd-e0a3-457f-b56e-455efe9cb2a1 tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128729) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 14 15:50:21.481141 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-f32c6fbd-e0a3-457f-b56e-455efe9cb2a1 tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:50:21.481566 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-f32c6fbd-e0a3-457f-b56e-455efe9cb2a1 tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:50:21.482384 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-f32c6fbd-e0a3-457f-b56e-455efe9cb2a1 tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:50:21.482821 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-f32c6fbd-e0a3-457f-b56e-455efe9cb2a1 tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:50:21.499192 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.quota [None req-f32c6fbd-e0a3-457f-b56e-455efe9cb2a1 tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] Getting quotas for project 7905689c95d44a5c9169249c70f7de57. Resources: {'instances', 'cores', 'ram'} {{(pid=128729) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 14 15:50:21.503475 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.quota [None req-f32c6fbd-e0a3-457f-b56e-455efe9cb2a1 tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] Getting quotas for user dc43895177134e9c9c030a9d87f94aaa and project 7905689c95d44a5c9169249c70f7de57. Resources: {'instances', 'cores', 'ram'} {{(pid=128729) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 14 15:50:21.514831 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.compute.api [None req-f32c6fbd-e0a3-457f-b56e-455efe9cb2a1 tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] Going to run 1 instances... {{(pid=128729) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 14 15:50:21.517192 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.compute.api [None req-f32c6fbd-e0a3-457f-b56e-455efe9cb2a1 tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] [instance: 567fb38a-9c00-4de9-8a01-8070792cde75] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='1381e3d5-fc27-4fa7-ab03-5d86278a0546',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128729) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 14 15:50:21.565131 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: INFO nova.api.openstack.requestlog [None req-f32c6fbd-e0a3-457f-b56e-455efe9cb2a1 tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] 10.222.0.61 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.557704 May 14 15:50:21.565777 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: [pid: 128729|app: 0|req: 290/595] 10.222.0.61 () {60 vars in 1146 bytes} [Sat May 14 15:50:21 2022] POST /compute/v2.1/servers => generated 402 bytes in 559 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 14 15:50:21.576291 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi [None req-4b1ef616-0ef0-4bcd-b252-570dadb47a2d tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] Calling method '>' {{(pid=128728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 15:50:21.576906 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.compute.api [None req-4b1ef616-0ef0-4bcd-b252-570dadb47a2d tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] [instance: 567fb38a-9c00-4de9-8a01-8070792cde75] Fetching instance by UUID {{(pid=128728) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 15:50:21.638602 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.policy [None req-4b1ef616-0ef0-4bcd-b252-570dadb47a2d tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc43895177134e9c9c030a9d87f94aaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7905689c95d44a5c9169249c70f7de57', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128728) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:50:21.645242 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: INFO nova.api.openstack.requestlog [None req-4b1ef616-0ef0-4bcd-b252-570dadb47a2d tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] 10.222.0.61 "GET /compute/v2.1/servers/567fb38a-9c00-4de9-8a01-8070792cde75" status: 200 len: 1241 microversion: 2.1 time: 0.073248 May 14 15:50:21.646037 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: [pid: 128728|app: 0|req: 306/596] 10.222.0.61 () {58 vars in 1235 bytes} [Sat May 14 15:50:21 2022] GET /compute/v2.1/servers/567fb38a-9c00-4de9-8a01-8070792cde75 => generated 1241 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 15:50:21.903660 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi [None req-812325b6-40b1-4937-b99d-a5f4c95d8eed tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Calling method '>' {{(pid=128729) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 15:50:21.904361 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.compute.api [None req-812325b6-40b1-4937-b99d-a5f4c95d8eed tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] [instance: e33e9970-bfb7-46f3-8d40-782dbfa3d21c] Fetching instance by UUID {{(pid=128729) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 15:50:21.911249 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-812325b6-40b1-4937-b99d-a5f4c95d8eed tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:50:21.911859 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-812325b6-40b1-4937-b99d-a5f4c95d8eed tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:50:21.912629 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-812325b6-40b1-4937-b99d-a5f4c95d8eed tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:50:21.913056 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-812325b6-40b1-4937-b99d-a5f4c95d8eed tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:50:22.040131 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.policy [None req-812325b6-40b1-4937-b99d-a5f4c95d8eed tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58bfb7417bc94583963401ae0fe9d39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0672be3fa3f7414da1c1a5b7300abbe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128729) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:50:22.047919 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.policy [None req-812325b6-40b1-4937-b99d-a5f4c95d8eed tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58bfb7417bc94583963401ae0fe9d39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0672be3fa3f7414da1c1a5b7300abbe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128729) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:50:22.049426 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.policy [None req-812325b6-40b1-4937-b99d-a5f4c95d8eed tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58bfb7417bc94583963401ae0fe9d39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0672be3fa3f7414da1c1a5b7300abbe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128729) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:50:22.050607 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: INFO nova.api.openstack.requestlog [None req-812325b6-40b1-4937-b99d-a5f4c95d8eed tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] 10.222.0.61 "GET /compute/v2.1/servers/e33e9970-bfb7-46f3-8d40-782dbfa3d21c" status: 200 len: 1722 microversion: 2.20 time: 0.151613 May 14 15:50:22.051160 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: [pid: 128729|app: 0|req: 291/597] 10.222.0.61 () {60 vars in 1276 bytes} [Sat May 14 15:50:21 2022] GET /compute/v2.1/servers/e33e9970-bfb7-46f3-8d40-782dbfa3d21c => generated 1722 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 14 15:50:22.663326 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi [None req-17513d1b-15cd-432e-8f6d-71f441c5dadc tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] Calling method '>' {{(pid=128728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 15:50:22.663938 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.compute.api [None req-17513d1b-15cd-432e-8f6d-71f441c5dadc tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] [instance: 567fb38a-9c00-4de9-8a01-8070792cde75] Fetching instance by UUID {{(pid=128728) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 15:50:22.670719 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-17513d1b-15cd-432e-8f6d-71f441c5dadc tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:50:22.671171 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-17513d1b-15cd-432e-8f6d-71f441c5dadc tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:50:22.671977 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-17513d1b-15cd-432e-8f6d-71f441c5dadc tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:50:22.672417 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-17513d1b-15cd-432e-8f6d-71f441c5dadc tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:50:22.734500 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.policy [None req-17513d1b-15cd-432e-8f6d-71f441c5dadc tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc43895177134e9c9c030a9d87f94aaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7905689c95d44a5c9169249c70f7de57', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128728) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:50:22.741823 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: INFO nova.api.openstack.requestlog [None req-17513d1b-15cd-432e-8f6d-71f441c5dadc tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] 10.222.0.61 "GET /compute/v2.1/servers/567fb38a-9c00-4de9-8a01-8070792cde75" status: 200 len: 1245 microversion: 2.1 time: 0.082258 May 14 15:50:22.742403 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: [pid: 128728|app: 0|req: 307/598] 10.222.0.61 () {58 vars in 1235 bytes} [Sat May 14 15:50:22 2022] GET /compute/v2.1/servers/567fb38a-9c00-4de9-8a01-8070792cde75 => generated 1245 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 15:50:23.068865 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi [None req-bffe680a-2a77-4879-b8f3-e0d4658fa679 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Calling method '>' {{(pid=128729) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 15:50:23.069472 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.compute.api [None req-bffe680a-2a77-4879-b8f3-e0d4658fa679 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] [instance: e33e9970-bfb7-46f3-8d40-782dbfa3d21c] Fetching instance by UUID {{(pid=128729) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 15:50:23.077693 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-bffe680a-2a77-4879-b8f3-e0d4658fa679 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:50:23.078145 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-bffe680a-2a77-4879-b8f3-e0d4658fa679 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:50:23.078945 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-bffe680a-2a77-4879-b8f3-e0d4658fa679 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:50:23.079507 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-bffe680a-2a77-4879-b8f3-e0d4658fa679 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:50:23.210453 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.policy [None req-bffe680a-2a77-4879-b8f3-e0d4658fa679 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58bfb7417bc94583963401ae0fe9d39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0672be3fa3f7414da1c1a5b7300abbe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128729) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:50:23.218759 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.policy [None req-bffe680a-2a77-4879-b8f3-e0d4658fa679 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58bfb7417bc94583963401ae0fe9d39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0672be3fa3f7414da1c1a5b7300abbe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128729) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:50:23.220254 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.policy [None req-bffe680a-2a77-4879-b8f3-e0d4658fa679 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58bfb7417bc94583963401ae0fe9d39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0672be3fa3f7414da1c1a5b7300abbe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128729) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:50:23.221393 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: INFO nova.api.openstack.requestlog [None req-bffe680a-2a77-4879-b8f3-e0d4658fa679 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] 10.222.0.61 "GET /compute/v2.1/servers/e33e9970-bfb7-46f3-8d40-782dbfa3d21c" status: 200 len: 1722 microversion: 2.20 time: 0.156451 May 14 15:50:23.221953 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: [pid: 128729|app: 0|req: 292/599] 10.222.0.61 () {60 vars in 1276 bytes} [Sat May 14 15:50:23 2022] GET /compute/v2.1/servers/e33e9970-bfb7-46f3-8d40-782dbfa3d21c => generated 1722 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 14 15:50:23.759178 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi [None req-e5450629-ba28-43ee-955f-72afbca50e80 tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] Calling method '>' {{(pid=128728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 15:50:23.759713 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.compute.api [None req-e5450629-ba28-43ee-955f-72afbca50e80 tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] [instance: 567fb38a-9c00-4de9-8a01-8070792cde75] Fetching instance by UUID {{(pid=128728) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 15:50:23.766709 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-e5450629-ba28-43ee-955f-72afbca50e80 tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:50:23.767159 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-e5450629-ba28-43ee-955f-72afbca50e80 tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:50:23.767927 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-e5450629-ba28-43ee-955f-72afbca50e80 tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:50:23.768396 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-e5450629-ba28-43ee-955f-72afbca50e80 tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:50:23.828398 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.policy [None req-e5450629-ba28-43ee-955f-72afbca50e80 tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc43895177134e9c9c030a9d87f94aaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7905689c95d44a5c9169249c70f7de57', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128728) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:50:23.835668 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: INFO nova.api.openstack.requestlog [None req-e5450629-ba28-43ee-955f-72afbca50e80 tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] 10.222.0.61 "GET /compute/v2.1/servers/567fb38a-9c00-4de9-8a01-8070792cde75" status: 200 len: 1245 microversion: 2.1 time: 0.080297 May 14 15:50:23.836238 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: [pid: 128728|app: 0|req: 308/600] 10.222.0.61 () {58 vars in 1235 bytes} [Sat May 14 15:50:23 2022] GET /compute/v2.1/servers/567fb38a-9c00-4de9-8a01-8070792cde75 => generated 1245 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 15:50:24.240614 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi [None req-30907ed3-ce8c-4fa6-9961-9b4e981a65d0 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Calling method '>' {{(pid=128729) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 15:50:24.241215 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.compute.api [None req-30907ed3-ce8c-4fa6-9961-9b4e981a65d0 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] [instance: e33e9970-bfb7-46f3-8d40-782dbfa3d21c] Fetching instance by UUID {{(pid=128729) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 15:50:24.248064 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-30907ed3-ce8c-4fa6-9961-9b4e981a65d0 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:50:24.248508 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-30907ed3-ce8c-4fa6-9961-9b4e981a65d0 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:50:24.249264 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-30907ed3-ce8c-4fa6-9961-9b4e981a65d0 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:50:24.249689 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-30907ed3-ce8c-4fa6-9961-9b4e981a65d0 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:50:24.374675 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.policy [None req-30907ed3-ce8c-4fa6-9961-9b4e981a65d0 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58bfb7417bc94583963401ae0fe9d39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0672be3fa3f7414da1c1a5b7300abbe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128729) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:50:24.382336 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.policy [None req-30907ed3-ce8c-4fa6-9961-9b4e981a65d0 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58bfb7417bc94583963401ae0fe9d39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0672be3fa3f7414da1c1a5b7300abbe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128729) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:50:24.383833 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.policy [None req-30907ed3-ce8c-4fa6-9961-9b4e981a65d0 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58bfb7417bc94583963401ae0fe9d39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0672be3fa3f7414da1c1a5b7300abbe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128729) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:50:24.384969 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: INFO nova.api.openstack.requestlog [None req-30907ed3-ce8c-4fa6-9961-9b4e981a65d0 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] 10.222.0.61 "GET /compute/v2.1/servers/e33e9970-bfb7-46f3-8d40-782dbfa3d21c" status: 200 len: 1722 microversion: 2.20 time: 0.148535 May 14 15:50:24.385519 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: [pid: 128729|app: 0|req: 293/601] 10.222.0.61 () {60 vars in 1276 bytes} [Sat May 14 15:50:24 2022] GET /compute/v2.1/servers/e33e9970-bfb7-46f3-8d40-782dbfa3d21c => generated 1722 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 14 15:50:24.852474 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi [None req-9341664f-4755-4070-b800-1e492c09bcad tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] Calling method '>' {{(pid=128728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 15:50:24.853088 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.compute.api [None req-9341664f-4755-4070-b800-1e492c09bcad tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] [instance: 567fb38a-9c00-4de9-8a01-8070792cde75] Fetching instance by UUID {{(pid=128728) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 15:50:24.859580 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-9341664f-4755-4070-b800-1e492c09bcad tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:50:24.860022 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-9341664f-4755-4070-b800-1e492c09bcad tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:50:24.860779 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-9341664f-4755-4070-b800-1e492c09bcad tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:50:24.861212 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-9341664f-4755-4070-b800-1e492c09bcad tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:50:24.924961 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.policy [None req-9341664f-4755-4070-b800-1e492c09bcad tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc43895177134e9c9c030a9d87f94aaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7905689c95d44a5c9169249c70f7de57', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128728) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:50:24.932153 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: INFO nova.api.openstack.requestlog [None req-9341664f-4755-4070-b800-1e492c09bcad tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] 10.222.0.61 "GET /compute/v2.1/servers/567fb38a-9c00-4de9-8a01-8070792cde75" status: 200 len: 1245 microversion: 2.1 time: 0.083540 May 14 15:50:24.932712 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: [pid: 128728|app: 0|req: 309/602] 10.222.0.61 () {58 vars in 1235 bytes} [Sat May 14 15:50:24 2022] GET /compute/v2.1/servers/567fb38a-9c00-4de9-8a01-8070792cde75 => generated 1245 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 15:50:25.403128 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi [None req-f18b1cd9-447f-4612-9f93-824a2a80f0e8 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Calling method '>' {{(pid=128729) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 15:50:25.403739 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.compute.api [None req-f18b1cd9-447f-4612-9f93-824a2a80f0e8 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] [instance: e33e9970-bfb7-46f3-8d40-782dbfa3d21c] Fetching instance by UUID {{(pid=128729) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 15:50:25.409984 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-f18b1cd9-447f-4612-9f93-824a2a80f0e8 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:50:25.410464 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-f18b1cd9-447f-4612-9f93-824a2a80f0e8 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:50:25.411224 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-f18b1cd9-447f-4612-9f93-824a2a80f0e8 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:50:25.411653 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-f18b1cd9-447f-4612-9f93-824a2a80f0e8 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:50:25.543769 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.policy [None req-f18b1cd9-447f-4612-9f93-824a2a80f0e8 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58bfb7417bc94583963401ae0fe9d39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0672be3fa3f7414da1c1a5b7300abbe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128729) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:50:25.551317 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.policy [None req-f18b1cd9-447f-4612-9f93-824a2a80f0e8 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58bfb7417bc94583963401ae0fe9d39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0672be3fa3f7414da1c1a5b7300abbe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128729) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:50:25.552811 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.policy [None req-f18b1cd9-447f-4612-9f93-824a2a80f0e8 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58bfb7417bc94583963401ae0fe9d39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0672be3fa3f7414da1c1a5b7300abbe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128729) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:50:25.553945 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: INFO nova.api.openstack.requestlog [None req-f18b1cd9-447f-4612-9f93-824a2a80f0e8 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] 10.222.0.61 "GET /compute/v2.1/servers/e33e9970-bfb7-46f3-8d40-782dbfa3d21c" status: 200 len: 1722 microversion: 2.20 time: 0.154758 May 14 15:50:25.554518 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: [pid: 128729|app: 0|req: 294/603] 10.222.0.61 () {60 vars in 1276 bytes} [Sat May 14 15:50:25 2022] GET /compute/v2.1/servers/e33e9970-bfb7-46f3-8d40-782dbfa3d21c => generated 1722 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 14 15:50:25.948289 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi [None req-e9a8df71-22c5-4441-91ca-d073b5908c83 tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] Calling method '>' {{(pid=128728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 15:50:25.948956 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.compute.api [None req-e9a8df71-22c5-4441-91ca-d073b5908c83 tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] [instance: 567fb38a-9c00-4de9-8a01-8070792cde75] Fetching instance by UUID {{(pid=128728) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 15:50:25.955386 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-e9a8df71-22c5-4441-91ca-d073b5908c83 tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:50:25.955833 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-e9a8df71-22c5-4441-91ca-d073b5908c83 tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:50:25.956618 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-e9a8df71-22c5-4441-91ca-d073b5908c83 tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:50:25.957049 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-e9a8df71-22c5-4441-91ca-d073b5908c83 tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:50:26.017365 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.policy [None req-e9a8df71-22c5-4441-91ca-d073b5908c83 tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc43895177134e9c9c030a9d87f94aaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7905689c95d44a5c9169249c70f7de57', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128728) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:50:26.024535 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: INFO nova.api.openstack.requestlog [None req-e9a8df71-22c5-4441-91ca-d073b5908c83 tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] 10.222.0.61 "GET /compute/v2.1/servers/567fb38a-9c00-4de9-8a01-8070792cde75" status: 200 len: 1245 microversion: 2.1 time: 0.080181 May 14 15:50:26.025101 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: [pid: 128728|app: 0|req: 310/604] 10.222.0.61 () {58 vars in 1235 bytes} [Sat May 14 15:50:25 2022] GET /compute/v2.1/servers/567fb38a-9c00-4de9-8a01-8070792cde75 => generated 1245 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 15:50:26.572235 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi [None req-3bf7b722-dabd-494d-9198-3df0afbffc25 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Calling method '>' {{(pid=128729) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 15:50:26.572840 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.compute.api [None req-3bf7b722-dabd-494d-9198-3df0afbffc25 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] [instance: e33e9970-bfb7-46f3-8d40-782dbfa3d21c] Fetching instance by UUID {{(pid=128729) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 15:50:26.580020 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-3bf7b722-dabd-494d-9198-3df0afbffc25 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:50:26.580481 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-3bf7b722-dabd-494d-9198-3df0afbffc25 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:50:26.581353 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-3bf7b722-dabd-494d-9198-3df0afbffc25 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:50:26.581802 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-3bf7b722-dabd-494d-9198-3df0afbffc25 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:50:26.712726 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.policy [None req-3bf7b722-dabd-494d-9198-3df0afbffc25 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58bfb7417bc94583963401ae0fe9d39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0672be3fa3f7414da1c1a5b7300abbe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128729) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:50:26.720563 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.policy [None req-3bf7b722-dabd-494d-9198-3df0afbffc25 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58bfb7417bc94583963401ae0fe9d39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0672be3fa3f7414da1c1a5b7300abbe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128729) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:50:26.722053 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.policy [None req-3bf7b722-dabd-494d-9198-3df0afbffc25 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58bfb7417bc94583963401ae0fe9d39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0672be3fa3f7414da1c1a5b7300abbe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128729) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:50:26.723213 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: INFO nova.api.openstack.requestlog [None req-3bf7b722-dabd-494d-9198-3df0afbffc25 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] 10.222.0.61 "GET /compute/v2.1/servers/e33e9970-bfb7-46f3-8d40-782dbfa3d21c" status: 200 len: 1722 microversion: 2.20 time: 0.154960 May 14 15:50:26.723766 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: [pid: 128729|app: 0|req: 295/605] 10.222.0.61 () {60 vars in 1276 bytes} [Sat May 14 15:50:26 2022] GET /compute/v2.1/servers/e33e9970-bfb7-46f3-8d40-782dbfa3d21c => generated 1722 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 14 15:50:27.041704 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi [None req-4fceb3d8-58dc-4119-8de0-c32e708cb6c6 tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] Calling method '>' {{(pid=128728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 15:50:27.042817 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.compute.api [None req-4fceb3d8-58dc-4119-8de0-c32e708cb6c6 tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] [instance: 567fb38a-9c00-4de9-8a01-8070792cde75] Fetching instance by UUID {{(pid=128728) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 15:50:27.049094 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-4fceb3d8-58dc-4119-8de0-c32e708cb6c6 tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:50:27.049538 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-4fceb3d8-58dc-4119-8de0-c32e708cb6c6 tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:50:27.050298 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-4fceb3d8-58dc-4119-8de0-c32e708cb6c6 tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:50:27.050754 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-4fceb3d8-58dc-4119-8de0-c32e708cb6c6 tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:50:27.113432 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.policy [None req-4fceb3d8-58dc-4119-8de0-c32e708cb6c6 tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc43895177134e9c9c030a9d87f94aaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7905689c95d44a5c9169249c70f7de57', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128728) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:50:27.121437 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: INFO nova.api.openstack.requestlog [None req-4fceb3d8-58dc-4119-8de0-c32e708cb6c6 tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] 10.222.0.61 "GET /compute/v2.1/servers/567fb38a-9c00-4de9-8a01-8070792cde75" status: 200 len: 1245 microversion: 2.1 time: 0.082900 May 14 15:50:27.121991 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: [pid: 128728|app: 0|req: 311/606] 10.222.0.61 () {58 vars in 1235 bytes} [Sat May 14 15:50:27 2022] GET /compute/v2.1/servers/567fb38a-9c00-4de9-8a01-8070792cde75 => generated 1245 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 15:50:27.740964 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi [None req-de288eaa-7893-49e6-a8f4-f7656dcfac8c tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Calling method '>' {{(pid=128729) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 15:50:27.741576 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.compute.api [None req-de288eaa-7893-49e6-a8f4-f7656dcfac8c tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] [instance: e33e9970-bfb7-46f3-8d40-782dbfa3d21c] Fetching instance by UUID {{(pid=128729) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 15:50:27.747947 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-de288eaa-7893-49e6-a8f4-f7656dcfac8c tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:50:27.748391 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-de288eaa-7893-49e6-a8f4-f7656dcfac8c tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:50:27.749156 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-de288eaa-7893-49e6-a8f4-f7656dcfac8c tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:50:27.749591 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-de288eaa-7893-49e6-a8f4-f7656dcfac8c tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:50:27.876190 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.policy [None req-de288eaa-7893-49e6-a8f4-f7656dcfac8c tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58bfb7417bc94583963401ae0fe9d39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0672be3fa3f7414da1c1a5b7300abbe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128729) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:50:27.884144 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.policy [None req-de288eaa-7893-49e6-a8f4-f7656dcfac8c tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58bfb7417bc94583963401ae0fe9d39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0672be3fa3f7414da1c1a5b7300abbe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128729) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:50:27.885640 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.policy [None req-de288eaa-7893-49e6-a8f4-f7656dcfac8c tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58bfb7417bc94583963401ae0fe9d39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0672be3fa3f7414da1c1a5b7300abbe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128729) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:50:27.886811 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: INFO nova.api.openstack.requestlog [None req-de288eaa-7893-49e6-a8f4-f7656dcfac8c tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] 10.222.0.61 "GET /compute/v2.1/servers/e33e9970-bfb7-46f3-8d40-782dbfa3d21c" status: 200 len: 1722 microversion: 2.20 time: 0.149915 May 14 15:50:27.887936 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: [pid: 128729|app: 0|req: 296/607] 10.222.0.61 () {60 vars in 1276 bytes} [Sat May 14 15:50:27 2022] GET /compute/v2.1/servers/e33e9970-bfb7-46f3-8d40-782dbfa3d21c => generated 1722 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 14 15:50:28.138910 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi [None req-2ad20c6e-664d-46f0-b5d1-8362a9aca07c tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] Calling method '>' {{(pid=128728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 15:50:28.139490 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.compute.api [None req-2ad20c6e-664d-46f0-b5d1-8362a9aca07c tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] [instance: 567fb38a-9c00-4de9-8a01-8070792cde75] Fetching instance by UUID {{(pid=128728) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 15:50:28.145698 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-2ad20c6e-664d-46f0-b5d1-8362a9aca07c tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:50:28.146145 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-2ad20c6e-664d-46f0-b5d1-8362a9aca07c tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:50:28.146944 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-2ad20c6e-664d-46f0-b5d1-8362a9aca07c tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:50:28.147379 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-2ad20c6e-664d-46f0-b5d1-8362a9aca07c tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:50:28.213567 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.policy [None req-2ad20c6e-664d-46f0-b5d1-8362a9aca07c tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc43895177134e9c9c030a9d87f94aaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7905689c95d44a5c9169249c70f7de57', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128728) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:50:28.220765 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: INFO nova.api.openstack.requestlog [None req-2ad20c6e-664d-46f0-b5d1-8362a9aca07c tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] 10.222.0.61 "GET /compute/v2.1/servers/567fb38a-9c00-4de9-8a01-8070792cde75" status: 200 len: 1245 microversion: 2.1 time: 0.086512 May 14 15:50:28.221332 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: [pid: 128728|app: 0|req: 312/608] 10.222.0.61 () {58 vars in 1235 bytes} [Sat May 14 15:50:28 2022] GET /compute/v2.1/servers/567fb38a-9c00-4de9-8a01-8070792cde75 => generated 1245 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 15:50:28.905477 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi [None req-73b44aa4-18af-4f41-8cb5-adbe82cbd7cd tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Calling method '>' {{(pid=128729) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 15:50:28.906020 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.compute.api [None req-73b44aa4-18af-4f41-8cb5-adbe82cbd7cd tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] [instance: e33e9970-bfb7-46f3-8d40-782dbfa3d21c] Fetching instance by UUID {{(pid=128729) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 15:50:28.912353 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-73b44aa4-18af-4f41-8cb5-adbe82cbd7cd tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:50:28.912814 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-73b44aa4-18af-4f41-8cb5-adbe82cbd7cd tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:50:28.913582 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-73b44aa4-18af-4f41-8cb5-adbe82cbd7cd tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:50:28.914026 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-73b44aa4-18af-4f41-8cb5-adbe82cbd7cd tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:50:29.038859 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.policy [None req-73b44aa4-18af-4f41-8cb5-adbe82cbd7cd tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58bfb7417bc94583963401ae0fe9d39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0672be3fa3f7414da1c1a5b7300abbe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128729) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:50:29.047194 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.policy [None req-73b44aa4-18af-4f41-8cb5-adbe82cbd7cd tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58bfb7417bc94583963401ae0fe9d39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0672be3fa3f7414da1c1a5b7300abbe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128729) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:50:29.048727 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.policy [None req-73b44aa4-18af-4f41-8cb5-adbe82cbd7cd tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58bfb7417bc94583963401ae0fe9d39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0672be3fa3f7414da1c1a5b7300abbe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128729) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:50:29.049860 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: INFO nova.api.openstack.requestlog [None req-73b44aa4-18af-4f41-8cb5-adbe82cbd7cd tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] 10.222.0.61 "GET /compute/v2.1/servers/e33e9970-bfb7-46f3-8d40-782dbfa3d21c" status: 200 len: 1722 microversion: 2.20 time: 0.148875 May 14 15:50:29.050450 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: [pid: 128729|app: 0|req: 297/609] 10.222.0.61 () {60 vars in 1276 bytes} [Sat May 14 15:50:28 2022] GET /compute/v2.1/servers/e33e9970-bfb7-46f3-8d40-782dbfa3d21c => generated 1722 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 14 15:50:29.238475 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi [None req-7ee3ec50-df75-42e5-a377-627133d3d08f tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] Calling method '>' {{(pid=128728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 15:50:29.239027 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.compute.api [None req-7ee3ec50-df75-42e5-a377-627133d3d08f tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] [instance: 567fb38a-9c00-4de9-8a01-8070792cde75] Fetching instance by UUID {{(pid=128728) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 15:50:29.245871 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-7ee3ec50-df75-42e5-a377-627133d3d08f tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:50:29.246438 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-7ee3ec50-df75-42e5-a377-627133d3d08f tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:50:29.247475 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-7ee3ec50-df75-42e5-a377-627133d3d08f tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:50:29.247937 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-7ee3ec50-df75-42e5-a377-627133d3d08f tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:50:29.308223 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.policy [None req-7ee3ec50-df75-42e5-a377-627133d3d08f tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc43895177134e9c9c030a9d87f94aaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7905689c95d44a5c9169249c70f7de57', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128728) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:50:29.315549 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: INFO nova.api.openstack.requestlog [None req-7ee3ec50-df75-42e5-a377-627133d3d08f tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] 10.222.0.61 "GET /compute/v2.1/servers/567fb38a-9c00-4de9-8a01-8070792cde75" status: 200 len: 1245 microversion: 2.1 time: 0.081280 May 14 15:50:29.316109 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: [pid: 128728|app: 0|req: 313/610] 10.222.0.61 () {58 vars in 1235 bytes} [Sat May 14 15:50:29 2022] GET /compute/v2.1/servers/567fb38a-9c00-4de9-8a01-8070792cde75 => generated 1245 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 15:50:30.067304 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi [None req-61a93f01-e2e7-4063-bcb9-0ab8053a3ce5 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Calling method '>' {{(pid=128729) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 15:50:30.067904 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.compute.api [None req-61a93f01-e2e7-4063-bcb9-0ab8053a3ce5 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] [instance: e33e9970-bfb7-46f3-8d40-782dbfa3d21c] Fetching instance by UUID {{(pid=128729) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 15:50:30.074158 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-61a93f01-e2e7-4063-bcb9-0ab8053a3ce5 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:50:30.074643 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-61a93f01-e2e7-4063-bcb9-0ab8053a3ce5 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:50:30.075896 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-61a93f01-e2e7-4063-bcb9-0ab8053a3ce5 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:50:30.076324 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-61a93f01-e2e7-4063-bcb9-0ab8053a3ce5 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:50:30.206380 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.policy [None req-61a93f01-e2e7-4063-bcb9-0ab8053a3ce5 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58bfb7417bc94583963401ae0fe9d39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0672be3fa3f7414da1c1a5b7300abbe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128729) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:50:30.213879 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.policy [None req-61a93f01-e2e7-4063-bcb9-0ab8053a3ce5 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58bfb7417bc94583963401ae0fe9d39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0672be3fa3f7414da1c1a5b7300abbe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128729) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:50:30.215394 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.policy [None req-61a93f01-e2e7-4063-bcb9-0ab8053a3ce5 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58bfb7417bc94583963401ae0fe9d39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0672be3fa3f7414da1c1a5b7300abbe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128729) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:50:30.217205 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: INFO nova.api.openstack.requestlog [None req-61a93f01-e2e7-4063-bcb9-0ab8053a3ce5 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] 10.222.0.61 "GET /compute/v2.1/servers/e33e9970-bfb7-46f3-8d40-782dbfa3d21c" status: 200 len: 1722 microversion: 2.20 time: 0.153740 May 14 15:50:30.217757 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: [pid: 128729|app: 0|req: 298/611] 10.222.0.61 () {60 vars in 1276 bytes} [Sat May 14 15:50:30 2022] GET /compute/v2.1/servers/e33e9970-bfb7-46f3-8d40-782dbfa3d21c => generated 1722 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 14 15:50:30.332885 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi [None req-3cebf4d7-b7e1-4a86-ac8b-2e2c73128a7c tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] Calling method '>' {{(pid=128728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 15:50:30.333492 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.compute.api [None req-3cebf4d7-b7e1-4a86-ac8b-2e2c73128a7c tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] [instance: 567fb38a-9c00-4de9-8a01-8070792cde75] Fetching instance by UUID {{(pid=128728) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 15:50:30.339845 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-3cebf4d7-b7e1-4a86-ac8b-2e2c73128a7c tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:50:30.340296 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-3cebf4d7-b7e1-4a86-ac8b-2e2c73128a7c tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:50:30.341651 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-3cebf4d7-b7e1-4a86-ac8b-2e2c73128a7c tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:50:30.342091 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-3cebf4d7-b7e1-4a86-ac8b-2e2c73128a7c tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:50:30.404571 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.policy [None req-3cebf4d7-b7e1-4a86-ac8b-2e2c73128a7c tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc43895177134e9c9c030a9d87f94aaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7905689c95d44a5c9169249c70f7de57', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128728) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:50:30.411677 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: INFO nova.api.openstack.requestlog [None req-3cebf4d7-b7e1-4a86-ac8b-2e2c73128a7c tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] 10.222.0.61 "GET /compute/v2.1/servers/567fb38a-9c00-4de9-8a01-8070792cde75" status: 200 len: 1245 microversion: 2.1 time: 0.082622 May 14 15:50:30.412230 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: [pid: 128728|app: 0|req: 314/612] 10.222.0.61 () {58 vars in 1235 bytes} [Sat May 14 15:50:30 2022] GET /compute/v2.1/servers/567fb38a-9c00-4de9-8a01-8070792cde75 => generated 1245 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 15:50:31.235674 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi [None req-831669d6-1add-4c76-853f-bb351825e35c tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Calling method '>' {{(pid=128729) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 15:50:31.236266 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.compute.api [None req-831669d6-1add-4c76-853f-bb351825e35c tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] [instance: e33e9970-bfb7-46f3-8d40-782dbfa3d21c] Fetching instance by UUID {{(pid=128729) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 15:50:31.243173 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-831669d6-1add-4c76-853f-bb351825e35c tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:50:31.243622 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-831669d6-1add-4c76-853f-bb351825e35c tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:50:31.244402 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-831669d6-1add-4c76-853f-bb351825e35c tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:50:31.244837 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-831669d6-1add-4c76-853f-bb351825e35c tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:50:31.380854 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.policy [None req-831669d6-1add-4c76-853f-bb351825e35c tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58bfb7417bc94583963401ae0fe9d39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0672be3fa3f7414da1c1a5b7300abbe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128729) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:50:31.389581 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.policy [None req-831669d6-1add-4c76-853f-bb351825e35c tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58bfb7417bc94583963401ae0fe9d39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0672be3fa3f7414da1c1a5b7300abbe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128729) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:50:31.391156 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.policy [None req-831669d6-1add-4c76-853f-bb351825e35c tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58bfb7417bc94583963401ae0fe9d39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0672be3fa3f7414da1c1a5b7300abbe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128729) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:50:31.392325 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: INFO nova.api.openstack.requestlog [None req-831669d6-1add-4c76-853f-bb351825e35c tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] 10.222.0.61 "GET /compute/v2.1/servers/e33e9970-bfb7-46f3-8d40-782dbfa3d21c" status: 200 len: 1722 microversion: 2.20 time: 0.161087 May 14 15:50:31.392886 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: [pid: 128729|app: 0|req: 299/613] 10.222.0.61 () {60 vars in 1276 bytes} [Sat May 14 15:50:31 2022] GET /compute/v2.1/servers/e33e9970-bfb7-46f3-8d40-782dbfa3d21c => generated 1722 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 14 15:50:31.429456 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi [None req-02ac804a-6345-4328-bc4f-d2519c216ad0 tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] Calling method '>' {{(pid=128728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 15:50:31.431124 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.compute.api [None req-02ac804a-6345-4328-bc4f-d2519c216ad0 tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] [instance: 567fb38a-9c00-4de9-8a01-8070792cde75] Fetching instance by UUID {{(pid=128728) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 15:50:31.437890 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-02ac804a-6345-4328-bc4f-d2519c216ad0 tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:50:31.438367 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-02ac804a-6345-4328-bc4f-d2519c216ad0 tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:50:31.439153 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-02ac804a-6345-4328-bc4f-d2519c216ad0 tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:50:31.439599 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-02ac804a-6345-4328-bc4f-d2519c216ad0 tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:50:31.509521 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.policy [None req-02ac804a-6345-4328-bc4f-d2519c216ad0 tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc43895177134e9c9c030a9d87f94aaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7905689c95d44a5c9169249c70f7de57', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128728) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:50:31.517695 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: INFO nova.api.openstack.requestlog [None req-02ac804a-6345-4328-bc4f-d2519c216ad0 tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] 10.222.0.61 "GET /compute/v2.1/servers/567fb38a-9c00-4de9-8a01-8070792cde75" status: 200 len: 1245 microversion: 2.1 time: 0.092543 May 14 15:50:31.518392 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: [pid: 128728|app: 0|req: 315/614] 10.222.0.61 () {58 vars in 1235 bytes} [Sat May 14 15:50:31 2022] GET /compute/v2.1/servers/567fb38a-9c00-4de9-8a01-8070792cde75 => generated 1245 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 15:50:32.411373 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi [None req-fc9b6b5c-1ff5-4dd6-b1b1-57d552761ca2 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Calling method '>' {{(pid=128729) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 15:50:32.411885 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.compute.api [None req-fc9b6b5c-1ff5-4dd6-b1b1-57d552761ca2 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] [instance: e33e9970-bfb7-46f3-8d40-782dbfa3d21c] Fetching instance by UUID {{(pid=128729) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 15:50:32.418177 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-fc9b6b5c-1ff5-4dd6-b1b1-57d552761ca2 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:50:32.418868 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-fc9b6b5c-1ff5-4dd6-b1b1-57d552761ca2 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:50:32.419642 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-fc9b6b5c-1ff5-4dd6-b1b1-57d552761ca2 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:50:32.420084 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-fc9b6b5c-1ff5-4dd6-b1b1-57d552761ca2 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:50:32.535174 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi [None req-30a3f177-3d63-4fae-99f9-13d4c2cb976d tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] Calling method '>' {{(pid=128728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 15:50:32.535818 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.compute.api [None req-30a3f177-3d63-4fae-99f9-13d4c2cb976d tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] [instance: 567fb38a-9c00-4de9-8a01-8070792cde75] Fetching instance by UUID {{(pid=128728) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 15:50:32.542010 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-30a3f177-3d63-4fae-99f9-13d4c2cb976d tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:50:32.542622 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-30a3f177-3d63-4fae-99f9-13d4c2cb976d tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:50:32.543402 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-30a3f177-3d63-4fae-99f9-13d4c2cb976d tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:50:32.544042 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.policy [None req-fc9b6b5c-1ff5-4dd6-b1b1-57d552761ca2 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58bfb7417bc94583963401ae0fe9d39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0672be3fa3f7414da1c1a5b7300abbe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128729) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:50:32.544178 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-30a3f177-3d63-4fae-99f9-13d4c2cb976d tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:50:32.551867 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.policy [None req-fc9b6b5c-1ff5-4dd6-b1b1-57d552761ca2 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58bfb7417bc94583963401ae0fe9d39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0672be3fa3f7414da1c1a5b7300abbe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128729) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:50:32.553386 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.policy [None req-fc9b6b5c-1ff5-4dd6-b1b1-57d552761ca2 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58bfb7417bc94583963401ae0fe9d39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0672be3fa3f7414da1c1a5b7300abbe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128729) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:50:32.554580 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: INFO nova.api.openstack.requestlog [None req-fc9b6b5c-1ff5-4dd6-b1b1-57d552761ca2 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] 10.222.0.61 "GET /compute/v2.1/servers/e33e9970-bfb7-46f3-8d40-782dbfa3d21c" status: 200 len: 1722 microversion: 2.20 time: 0.147148 May 14 15:50:32.555141 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: [pid: 128729|app: 0|req: 300/615] 10.222.0.61 () {60 vars in 1276 bytes} [Sat May 14 15:50:32 2022] GET /compute/v2.1/servers/e33e9970-bfb7-46f3-8d40-782dbfa3d21c => generated 1722 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 14 15:50:32.603308 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.policy [None req-30a3f177-3d63-4fae-99f9-13d4c2cb976d tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc43895177134e9c9c030a9d87f94aaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7905689c95d44a5c9169249c70f7de57', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128728) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:50:32.610517 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: INFO nova.api.openstack.requestlog [None req-30a3f177-3d63-4fae-99f9-13d4c2cb976d tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] 10.222.0.61 "GET /compute/v2.1/servers/567fb38a-9c00-4de9-8a01-8070792cde75" status: 200 len: 1245 microversion: 2.1 time: 0.079172 May 14 15:50:32.611078 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: [pid: 128728|app: 0|req: 316/616] 10.222.0.61 () {58 vars in 1235 bytes} [Sat May 14 15:50:32 2022] GET /compute/v2.1/servers/567fb38a-9c00-4de9-8a01-8070792cde75 => generated 1245 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 15:50:33.572934 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi [None req-bce68ba4-19ce-4ae5-a4ce-45522403b741 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Calling method '>' {{(pid=128729) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 15:50:33.573534 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.compute.api [None req-bce68ba4-19ce-4ae5-a4ce-45522403b741 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] [instance: e33e9970-bfb7-46f3-8d40-782dbfa3d21c] Fetching instance by UUID {{(pid=128729) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 15:50:33.579895 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-bce68ba4-19ce-4ae5-a4ce-45522403b741 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:50:33.580343 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-bce68ba4-19ce-4ae5-a4ce-45522403b741 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:50:33.581166 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-bce68ba4-19ce-4ae5-a4ce-45522403b741 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:50:33.581604 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-bce68ba4-19ce-4ae5-a4ce-45522403b741 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:50:33.627600 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi [None req-5bcefbb6-371c-41bc-9eb7-3d489263c9a1 tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] Calling method '>' {{(pid=128728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 15:50:33.628352 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.compute.api [None req-5bcefbb6-371c-41bc-9eb7-3d489263c9a1 tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] [instance: 567fb38a-9c00-4de9-8a01-8070792cde75] Fetching instance by UUID {{(pid=128728) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 15:50:33.634706 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-5bcefbb6-371c-41bc-9eb7-3d489263c9a1 tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:50:33.635153 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-5bcefbb6-371c-41bc-9eb7-3d489263c9a1 tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:50:33.635920 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-5bcefbb6-371c-41bc-9eb7-3d489263c9a1 tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:50:33.636356 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-5bcefbb6-371c-41bc-9eb7-3d489263c9a1 tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:50:33.727455 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.policy [None req-5bcefbb6-371c-41bc-9eb7-3d489263c9a1 tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc43895177134e9c9c030a9d87f94aaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7905689c95d44a5c9169249c70f7de57', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128728) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:50:33.760695 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: INFO nova.api.openstack.requestlog [None req-5bcefbb6-371c-41bc-9eb7-3d489263c9a1 tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] 10.222.0.61 "GET /compute/v2.1/servers/567fb38a-9c00-4de9-8a01-8070792cde75" status: 200 len: 1293 microversion: 2.1 time: 0.137362 May 14 15:50:33.765208 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: [pid: 128728|app: 0|req: 317/617] 10.222.0.61 () {58 vars in 1235 bytes} [Sat May 14 15:50:33 2022] GET /compute/v2.1/servers/567fb38a-9c00-4de9-8a01-8070792cde75 => generated 1293 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 15:50:33.839344 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.policy [None req-bce68ba4-19ce-4ae5-a4ce-45522403b741 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58bfb7417bc94583963401ae0fe9d39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0672be3fa3f7414da1c1a5b7300abbe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128729) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:50:33.848548 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.policy [None req-bce68ba4-19ce-4ae5-a4ce-45522403b741 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58bfb7417bc94583963401ae0fe9d39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0672be3fa3f7414da1c1a5b7300abbe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128729) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:50:33.851915 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.policy [None req-bce68ba4-19ce-4ae5-a4ce-45522403b741 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58bfb7417bc94583963401ae0fe9d39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0672be3fa3f7414da1c1a5b7300abbe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128729) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:50:33.853451 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: INFO nova.api.openstack.requestlog [None req-bce68ba4-19ce-4ae5-a4ce-45522403b741 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] 10.222.0.61 "GET /compute/v2.1/servers/e33e9970-bfb7-46f3-8d40-782dbfa3d21c" status: 200 len: 1722 microversion: 2.20 time: 0.284401 May 14 15:50:33.862852 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: [pid: 128729|app: 0|req: 301/618] 10.222.0.61 () {60 vars in 1276 bytes} [Sat May 14 15:50:33 2022] GET /compute/v2.1/servers/e33e9970-bfb7-46f3-8d40-782dbfa3d21c => generated 1722 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 14 15:50:34.782742 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi [None req-8783a3e7-50ba-4d7c-bc7c-1bd7166ddf04 tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] Calling method '>' {{(pid=128728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 15:50:34.783353 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.compute.api [None req-8783a3e7-50ba-4d7c-bc7c-1bd7166ddf04 tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] [instance: 567fb38a-9c00-4de9-8a01-8070792cde75] Fetching instance by UUID {{(pid=128728) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 15:50:34.795115 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-8783a3e7-50ba-4d7c-bc7c-1bd7166ddf04 tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:50:34.795656 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-8783a3e7-50ba-4d7c-bc7c-1bd7166ddf04 tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:50:34.796446 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-8783a3e7-50ba-4d7c-bc7c-1bd7166ddf04 tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:50:34.796874 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-8783a3e7-50ba-4d7c-bc7c-1bd7166ddf04 tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:50:34.879427 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi [None req-17f2d52e-c35e-4f5b-8a13-0541f399f094 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Calling method '>' {{(pid=128729) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 15:50:34.880331 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.compute.api [None req-17f2d52e-c35e-4f5b-8a13-0541f399f094 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] [instance: e33e9970-bfb7-46f3-8d40-782dbfa3d21c] Fetching instance by UUID {{(pid=128729) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 15:50:34.887582 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-17f2d52e-c35e-4f5b-8a13-0541f399f094 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:50:34.888026 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-17f2d52e-c35e-4f5b-8a13-0541f399f094 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:50:34.888797 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-17f2d52e-c35e-4f5b-8a13-0541f399f094 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:50:34.893014 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-17f2d52e-c35e-4f5b-8a13-0541f399f094 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:50:35.028347 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.policy [None req-8783a3e7-50ba-4d7c-bc7c-1bd7166ddf04 tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc43895177134e9c9c030a9d87f94aaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7905689c95d44a5c9169249c70f7de57', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128728) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:50:35.041471 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: INFO nova.api.openstack.requestlog [None req-8783a3e7-50ba-4d7c-bc7c-1bd7166ddf04 tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] 10.222.0.61 "GET /compute/v2.1/servers/567fb38a-9c00-4de9-8a01-8070792cde75" status: 200 len: 1367 microversion: 2.1 time: 0.264081 May 14 15:50:35.053278 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: [pid: 128728|app: 0|req: 318/619] 10.222.0.61 () {58 vars in 1235 bytes} [Sat May 14 15:50:34 2022] GET /compute/v2.1/servers/567fb38a-9c00-4de9-8a01-8070792cde75 => generated 1367 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 15:50:35.097393 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.policy [None req-17f2d52e-c35e-4f5b-8a13-0541f399f094 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58bfb7417bc94583963401ae0fe9d39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0672be3fa3f7414da1c1a5b7300abbe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128729) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:50:35.106360 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.policy [None req-17f2d52e-c35e-4f5b-8a13-0541f399f094 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58bfb7417bc94583963401ae0fe9d39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0672be3fa3f7414da1c1a5b7300abbe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128729) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:50:35.108677 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.policy [None req-17f2d52e-c35e-4f5b-8a13-0541f399f094 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58bfb7417bc94583963401ae0fe9d39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0672be3fa3f7414da1c1a5b7300abbe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128729) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:50:35.109845 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: INFO nova.api.openstack.requestlog [None req-17f2d52e-c35e-4f5b-8a13-0541f399f094 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] 10.222.0.61 "GET /compute/v2.1/servers/e33e9970-bfb7-46f3-8d40-782dbfa3d21c" status: 200 len: 1722 microversion: 2.20 time: 0.238515 May 14 15:50:35.110414 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: [pid: 128729|app: 0|req: 302/620] 10.222.0.61 () {60 vars in 1276 bytes} [Sat May 14 15:50:34 2022] GET /compute/v2.1/servers/e33e9970-bfb7-46f3-8d40-782dbfa3d21c => generated 1722 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 14 15:50:35.552902 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi [req-3d163c02-8c28-49ff-8dbf-e913dd38687b req-7db56cfc-49fe-4777-83a1-30f379aafe73 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "567fb38a-9c00-4de9-8a01-8070792cde75", "tag": "8fdc20f7-107b-43f1-810d-31e0e55a918f"}]} {{(pid=128728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 15:50:35.562226 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [req-3d163c02-8c28-49ff-8dbf-e913dd38687b req-7db56cfc-49fe-4777-83a1-30f379aafe73 service nova] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:50:35.562796 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [req-3d163c02-8c28-49ff-8dbf-e913dd38687b req-7db56cfc-49fe-4777-83a1-30f379aafe73 service nova] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:50:35.577744 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: INFO nova.api.openstack.compute.server_external_events [req-3d163c02-8c28-49ff-8dbf-e913dd38687b req-7db56cfc-49fe-4777-83a1-30f379aafe73 service nova] Creating event network-changed:8fdc20f7-107b-43f1-810d-31e0e55a918f for instance 567fb38a-9c00-4de9-8a01-8070792cde75 on hv-cinder-83979 May 14 15:50:35.582830 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: INFO nova.api.openstack.requestlog [req-3d163c02-8c28-49ff-8dbf-e913dd38687b req-7db56cfc-49fe-4777-83a1-30f379aafe73 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034841 May 14 15:50:35.583426 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: [pid: 128728|app: 0|req: 319/621] 10.222.0.61 () {64 vars in 1317 bytes} [Sat May 14 15:50:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 14 15:50:36.060071 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi [None req-e97d1690-442b-4022-ad21-ad546742b228 tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] Calling method '>' {{(pid=128729) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 15:50:36.060588 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.compute.api [None req-e97d1690-442b-4022-ad21-ad546742b228 tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] [instance: 567fb38a-9c00-4de9-8a01-8070792cde75] Fetching instance by UUID {{(pid=128729) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 15:50:36.067077 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-e97d1690-442b-4022-ad21-ad546742b228 tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:50:36.067527 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-e97d1690-442b-4022-ad21-ad546742b228 tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:50:36.068299 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-e97d1690-442b-4022-ad21-ad546742b228 tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:50:36.068742 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-e97d1690-442b-4022-ad21-ad546742b228 tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:50:36.129373 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi [None req-e379e625-e36f-41ba-9043-82c1cf61c36a tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Calling method '>' {{(pid=128728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 15:50:36.130163 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.compute.api [None req-e379e625-e36f-41ba-9043-82c1cf61c36a tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] [instance: e33e9970-bfb7-46f3-8d40-782dbfa3d21c] Fetching instance by UUID {{(pid=128728) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 15:50:36.143032 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-e379e625-e36f-41ba-9043-82c1cf61c36a tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:50:36.143032 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-e379e625-e36f-41ba-9043-82c1cf61c36a tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:50:36.143032 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-e379e625-e36f-41ba-9043-82c1cf61c36a tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:50:36.143032 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-e379e625-e36f-41ba-9043-82c1cf61c36a tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:50:36.241896 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.policy [None req-e97d1690-442b-4022-ad21-ad546742b228 tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc43895177134e9c9c030a9d87f94aaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7905689c95d44a5c9169249c70f7de57', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128729) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:50:36.255319 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: INFO nova.api.openstack.requestlog [None req-e97d1690-442b-4022-ad21-ad546742b228 tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] 10.222.0.61 "GET /compute/v2.1/servers/567fb38a-9c00-4de9-8a01-8070792cde75" status: 200 len: 1367 microversion: 2.1 time: 0.199116 May 14 15:50:36.255914 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: [pid: 128729|app: 0|req: 303/622] 10.222.0.61 () {58 vars in 1235 bytes} [Sat May 14 15:50:36 2022] GET /compute/v2.1/servers/567fb38a-9c00-4de9-8a01-8070792cde75 => generated 1367 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 15:50:36.289891 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.policy [None req-e379e625-e36f-41ba-9043-82c1cf61c36a tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58bfb7417bc94583963401ae0fe9d39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0672be3fa3f7414da1c1a5b7300abbe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128728) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:50:36.298491 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.policy [None req-e379e625-e36f-41ba-9043-82c1cf61c36a tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58bfb7417bc94583963401ae0fe9d39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0672be3fa3f7414da1c1a5b7300abbe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128728) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:50:36.300015 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.policy [None req-e379e625-e36f-41ba-9043-82c1cf61c36a tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58bfb7417bc94583963401ae0fe9d39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0672be3fa3f7414da1c1a5b7300abbe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128728) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:50:36.301168 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: INFO nova.api.openstack.requestlog [None req-e379e625-e36f-41ba-9043-82c1cf61c36a tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] 10.222.0.61 "GET /compute/v2.1/servers/e33e9970-bfb7-46f3-8d40-782dbfa3d21c" status: 200 len: 1722 microversion: 2.20 time: 0.176669 May 14 15:50:36.301749 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: [pid: 128728|app: 0|req: 320/623] 10.222.0.61 () {60 vars in 1276 bytes} [Sat May 14 15:50:36 2022] GET /compute/v2.1/servers/e33e9970-bfb7-46f3-8d40-782dbfa3d21c => generated 1722 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 14 15:50:37.273068 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi [None req-96dc5f65-1c46-4c00-aa77-48370988d6b9 tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] Calling method '>' {{(pid=128729) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 15:50:37.273696 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.compute.api [None req-96dc5f65-1c46-4c00-aa77-48370988d6b9 tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] [instance: 567fb38a-9c00-4de9-8a01-8070792cde75] Fetching instance by UUID {{(pid=128729) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 15:50:37.281067 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-96dc5f65-1c46-4c00-aa77-48370988d6b9 tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:50:37.281533 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-96dc5f65-1c46-4c00-aa77-48370988d6b9 tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:50:37.282600 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-96dc5f65-1c46-4c00-aa77-48370988d6b9 tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:50:37.283196 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-96dc5f65-1c46-4c00-aa77-48370988d6b9 tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:50:37.322248 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi [None req-bc202948-0f7c-473c-b8da-db4def771479 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Calling method '>' {{(pid=128728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 15:50:37.323895 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.compute.api [None req-bc202948-0f7c-473c-b8da-db4def771479 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] [instance: e33e9970-bfb7-46f3-8d40-782dbfa3d21c] Fetching instance by UUID {{(pid=128728) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 15:50:37.332502 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-bc202948-0f7c-473c-b8da-db4def771479 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:50:37.333391 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-bc202948-0f7c-473c-b8da-db4def771479 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:50:37.334427 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-bc202948-0f7c-473c-b8da-db4def771479 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:50:37.335074 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-bc202948-0f7c-473c-b8da-db4def771479 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:50:37.497813 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.policy [None req-96dc5f65-1c46-4c00-aa77-48370988d6b9 tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc43895177134e9c9c030a9d87f94aaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7905689c95d44a5c9169249c70f7de57', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128729) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:50:37.521801 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: INFO nova.api.openstack.requestlog [None req-96dc5f65-1c46-4c00-aa77-48370988d6b9 tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] 10.222.0.61 "GET /compute/v2.1/servers/567fb38a-9c00-4de9-8a01-8070792cde75" status: 200 len: 1367 microversion: 2.1 time: 0.249311 May 14 15:50:37.523581 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: [pid: 128729|app: 0|req: 304/624] 10.222.0.61 () {58 vars in 1235 bytes} [Sat May 14 15:50:37 2022] GET /compute/v2.1/servers/567fb38a-9c00-4de9-8a01-8070792cde75 => generated 1367 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 15:50:37.568730 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.policy [None req-bc202948-0f7c-473c-b8da-db4def771479 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58bfb7417bc94583963401ae0fe9d39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0672be3fa3f7414da1c1a5b7300abbe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128728) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:50:37.580149 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.policy [None req-bc202948-0f7c-473c-b8da-db4def771479 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58bfb7417bc94583963401ae0fe9d39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0672be3fa3f7414da1c1a5b7300abbe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128728) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:50:37.582191 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.policy [None req-bc202948-0f7c-473c-b8da-db4def771479 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58bfb7417bc94583963401ae0fe9d39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0672be3fa3f7414da1c1a5b7300abbe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128728) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:50:37.583738 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: INFO nova.api.openstack.requestlog [None req-bc202948-0f7c-473c-b8da-db4def771479 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] 10.222.0.61 "GET /compute/v2.1/servers/e33e9970-bfb7-46f3-8d40-782dbfa3d21c" status: 200 len: 1722 microversion: 2.20 time: 0.267719 May 14 15:50:37.594452 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: [pid: 128728|app: 0|req: 321/625] 10.222.0.61 () {60 vars in 1276 bytes} [Sat May 14 15:50:37 2022] GET /compute/v2.1/servers/e33e9970-bfb7-46f3-8d40-782dbfa3d21c => generated 1722 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 14 15:50:38.540614 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi [None req-c650e356-b223-4ae2-9260-c7018c72b77a tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] Calling method '>' {{(pid=128729) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 15:50:38.541235 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.compute.api [None req-c650e356-b223-4ae2-9260-c7018c72b77a tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] [instance: 567fb38a-9c00-4de9-8a01-8070792cde75] Fetching instance by UUID {{(pid=128729) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 15:50:38.548397 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-c650e356-b223-4ae2-9260-c7018c72b77a tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:50:38.548841 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-c650e356-b223-4ae2-9260-c7018c72b77a tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:50:38.549613 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-c650e356-b223-4ae2-9260-c7018c72b77a tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:50:38.550238 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-c650e356-b223-4ae2-9260-c7018c72b77a tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:50:38.609458 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi [None req-6f94dc12-067c-4f0f-aa47-9f4a327399f8 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Calling method '>' {{(pid=128728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 15:50:38.611432 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.compute.api [None req-6f94dc12-067c-4f0f-aa47-9f4a327399f8 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] [instance: e33e9970-bfb7-46f3-8d40-782dbfa3d21c] Fetching instance by UUID {{(pid=128728) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 15:50:38.619351 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-6f94dc12-067c-4f0f-aa47-9f4a327399f8 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:50:38.620288 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-6f94dc12-067c-4f0f-aa47-9f4a327399f8 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:50:38.621333 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-6f94dc12-067c-4f0f-aa47-9f4a327399f8 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:50:38.622481 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-6f94dc12-067c-4f0f-aa47-9f4a327399f8 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:50:38.729947 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.policy [None req-c650e356-b223-4ae2-9260-c7018c72b77a tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc43895177134e9c9c030a9d87f94aaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7905689c95d44a5c9169249c70f7de57', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128729) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:50:38.738642 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: INFO nova.api.openstack.requestlog [None req-c650e356-b223-4ae2-9260-c7018c72b77a tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] 10.222.0.61 "GET /compute/v2.1/servers/567fb38a-9c00-4de9-8a01-8070792cde75" status: 200 len: 1367 microversion: 2.1 time: 0.201703 May 14 15:50:38.739390 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: [pid: 128729|app: 0|req: 305/626] 10.222.0.61 () {58 vars in 1235 bytes} [Sat May 14 15:50:38 2022] GET /compute/v2.1/servers/567fb38a-9c00-4de9-8a01-8070792cde75 => generated 1367 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 15:50:38.801740 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.policy [None req-6f94dc12-067c-4f0f-aa47-9f4a327399f8 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58bfb7417bc94583963401ae0fe9d39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0672be3fa3f7414da1c1a5b7300abbe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128728) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:50:38.810122 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.policy [None req-6f94dc12-067c-4f0f-aa47-9f4a327399f8 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58bfb7417bc94583963401ae0fe9d39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0672be3fa3f7414da1c1a5b7300abbe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128728) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:50:38.812498 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.policy [None req-6f94dc12-067c-4f0f-aa47-9f4a327399f8 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58bfb7417bc94583963401ae0fe9d39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0672be3fa3f7414da1c1a5b7300abbe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128728) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:50:38.813640 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: INFO nova.api.openstack.requestlog [None req-6f94dc12-067c-4f0f-aa47-9f4a327399f8 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] 10.222.0.61 "GET /compute/v2.1/servers/e33e9970-bfb7-46f3-8d40-782dbfa3d21c" status: 200 len: 1722 microversion: 2.20 time: 0.209165 May 14 15:50:38.815667 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: [pid: 128728|app: 0|req: 322/627] 10.222.0.61 () {60 vars in 1276 bytes} [Sat May 14 15:50:38 2022] GET /compute/v2.1/servers/e33e9970-bfb7-46f3-8d40-782dbfa3d21c => generated 1722 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 14 15:50:39.759018 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi [None req-473c7a52-fee5-40e2-8fa1-29577857cf88 tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] Calling method '>' {{(pid=128729) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 15:50:39.761098 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.compute.api [None req-473c7a52-fee5-40e2-8fa1-29577857cf88 tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] [instance: 567fb38a-9c00-4de9-8a01-8070792cde75] Fetching instance by UUID {{(pid=128729) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 15:50:39.770347 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-473c7a52-fee5-40e2-8fa1-29577857cf88 tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:50:39.770901 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-473c7a52-fee5-40e2-8fa1-29577857cf88 tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:50:39.772243 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-473c7a52-fee5-40e2-8fa1-29577857cf88 tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:50:39.773019 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-473c7a52-fee5-40e2-8fa1-29577857cf88 tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:50:39.845620 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi [None req-7e738e7f-e4c1-46ef-81f8-fc84f0a26ccb tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Calling method '>' {{(pid=128728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 15:50:39.846808 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.compute.api [None req-7e738e7f-e4c1-46ef-81f8-fc84f0a26ccb tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] [instance: e33e9970-bfb7-46f3-8d40-782dbfa3d21c] Fetching instance by UUID {{(pid=128728) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 15:50:39.868541 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-7e738e7f-e4c1-46ef-81f8-fc84f0a26ccb tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:50:39.869386 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-7e738e7f-e4c1-46ef-81f8-fc84f0a26ccb tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:50:39.872058 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-7e738e7f-e4c1-46ef-81f8-fc84f0a26ccb tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:50:39.872741 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-7e738e7f-e4c1-46ef-81f8-fc84f0a26ccb tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:50:40.016482 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.policy [None req-473c7a52-fee5-40e2-8fa1-29577857cf88 tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc43895177134e9c9c030a9d87f94aaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7905689c95d44a5c9169249c70f7de57', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128729) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:50:40.027081 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: INFO nova.api.openstack.requestlog [None req-473c7a52-fee5-40e2-8fa1-29577857cf88 tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] 10.222.0.61 "GET /compute/v2.1/servers/567fb38a-9c00-4de9-8a01-8070792cde75" status: 200 len: 1367 microversion: 2.1 time: 0.274079 May 14 15:50:40.036140 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: [pid: 128729|app: 0|req: 306/628] 10.222.0.61 () {58 vars in 1235 bytes} [Sat May 14 15:50:39 2022] GET /compute/v2.1/servers/567fb38a-9c00-4de9-8a01-8070792cde75 => generated 1367 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 15:50:40.055500 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.policy [None req-7e738e7f-e4c1-46ef-81f8-fc84f0a26ccb tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58bfb7417bc94583963401ae0fe9d39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0672be3fa3f7414da1c1a5b7300abbe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128728) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:50:40.068143 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.policy [None req-7e738e7f-e4c1-46ef-81f8-fc84f0a26ccb tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58bfb7417bc94583963401ae0fe9d39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0672be3fa3f7414da1c1a5b7300abbe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128728) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:50:40.069892 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.policy [None req-7e738e7f-e4c1-46ef-81f8-fc84f0a26ccb tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58bfb7417bc94583963401ae0fe9d39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0672be3fa3f7414da1c1a5b7300abbe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128728) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:50:40.071218 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: INFO nova.api.openstack.requestlog [None req-7e738e7f-e4c1-46ef-81f8-fc84f0a26ccb tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] 10.222.0.61 "GET /compute/v2.1/servers/e33e9970-bfb7-46f3-8d40-782dbfa3d21c" status: 200 len: 1722 microversion: 2.20 time: 0.241960 May 14 15:50:40.072198 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: [pid: 128728|app: 0|req: 323/629] 10.222.0.61 () {60 vars in 1276 bytes} [Sat May 14 15:50:39 2022] GET /compute/v2.1/servers/e33e9970-bfb7-46f3-8d40-782dbfa3d21c => generated 1722 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 14 15:50:41.043963 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi [None req-288dcd5a-695d-4e2f-b6b5-28bd27d9cc58 tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] Calling method '>' {{(pid=128729) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 15:50:41.044492 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.compute.api [None req-288dcd5a-695d-4e2f-b6b5-28bd27d9cc58 tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] [instance: 567fb38a-9c00-4de9-8a01-8070792cde75] Fetching instance by UUID {{(pid=128729) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 15:50:41.051168 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-288dcd5a-695d-4e2f-b6b5-28bd27d9cc58 tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:50:41.051861 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-288dcd5a-695d-4e2f-b6b5-28bd27d9cc58 tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:50:41.052635 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-288dcd5a-695d-4e2f-b6b5-28bd27d9cc58 tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:50:41.053076 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-288dcd5a-695d-4e2f-b6b5-28bd27d9cc58 tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:50:41.089926 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi [None req-8badcbe0-e21e-4847-bfcf-5764febefe25 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Calling method '>' {{(pid=128728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 15:50:41.092294 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.compute.api [None req-8badcbe0-e21e-4847-bfcf-5764febefe25 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] [instance: e33e9970-bfb7-46f3-8d40-782dbfa3d21c] Fetching instance by UUID {{(pid=128728) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 15:50:41.100682 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-8badcbe0-e21e-4847-bfcf-5764febefe25 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:50:41.101137 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-8badcbe0-e21e-4847-bfcf-5764febefe25 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:50:41.101929 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-8badcbe0-e21e-4847-bfcf-5764febefe25 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:50:41.102422 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-8badcbe0-e21e-4847-bfcf-5764febefe25 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:50:41.297548 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.policy [None req-288dcd5a-695d-4e2f-b6b5-28bd27d9cc58 tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc43895177134e9c9c030a9d87f94aaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7905689c95d44a5c9169249c70f7de57', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128729) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:50:41.314293 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.policy [None req-8badcbe0-e21e-4847-bfcf-5764febefe25 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58bfb7417bc94583963401ae0fe9d39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0672be3fa3f7414da1c1a5b7300abbe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128728) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:50:41.317125 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: INFO nova.api.openstack.requestlog [None req-288dcd5a-695d-4e2f-b6b5-28bd27d9cc58 tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] 10.222.0.61 "GET /compute/v2.1/servers/567fb38a-9c00-4de9-8a01-8070792cde75" status: 200 len: 1367 microversion: 2.1 time: 0.277098 May 14 15:50:41.318218 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: [pid: 128729|app: 0|req: 307/630] 10.222.0.61 () {58 vars in 1235 bytes} [Sat May 14 15:50:41 2022] GET /compute/v2.1/servers/567fb38a-9c00-4de9-8a01-8070792cde75 => generated 1367 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 15:50:41.327111 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.policy [None req-8badcbe0-e21e-4847-bfcf-5764febefe25 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58bfb7417bc94583963401ae0fe9d39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0672be3fa3f7414da1c1a5b7300abbe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128728) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:50:41.329260 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.policy [None req-8badcbe0-e21e-4847-bfcf-5764febefe25 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58bfb7417bc94583963401ae0fe9d39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0672be3fa3f7414da1c1a5b7300abbe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128728) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:50:41.330714 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: INFO nova.api.openstack.requestlog [None req-8badcbe0-e21e-4847-bfcf-5764febefe25 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] 10.222.0.61 "GET /compute/v2.1/servers/e33e9970-bfb7-46f3-8d40-782dbfa3d21c" status: 200 len: 1722 microversion: 2.20 time: 0.245054 May 14 15:50:41.331805 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: [pid: 128728|app: 0|req: 324/631] 10.222.0.61 () {60 vars in 1276 bytes} [Sat May 14 15:50:41 2022] GET /compute/v2.1/servers/e33e9970-bfb7-46f3-8d40-782dbfa3d21c => generated 1722 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 14 15:50:42.335215 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi [None req-3cd664b2-3c3e-4d22-9c37-49c521b6f64b tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] Calling method '>' {{(pid=128729) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 15:50:42.337035 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.compute.api [None req-3cd664b2-3c3e-4d22-9c37-49c521b6f64b tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] [instance: 567fb38a-9c00-4de9-8a01-8070792cde75] Fetching instance by UUID {{(pid=128729) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 15:50:42.344558 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-3cd664b2-3c3e-4d22-9c37-49c521b6f64b tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:50:42.345633 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-3cd664b2-3c3e-4d22-9c37-49c521b6f64b tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:50:42.346525 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-3cd664b2-3c3e-4d22-9c37-49c521b6f64b tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:50:42.347195 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-3cd664b2-3c3e-4d22-9c37-49c521b6f64b tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:50:42.350574 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi [None req-839de55e-6a11-47a8-af64-01bdb7919832 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Calling method '>' {{(pid=128728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 15:50:42.352184 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.compute.api [None req-839de55e-6a11-47a8-af64-01bdb7919832 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] [instance: e33e9970-bfb7-46f3-8d40-782dbfa3d21c] Fetching instance by UUID {{(pid=128728) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 15:50:42.360554 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-839de55e-6a11-47a8-af64-01bdb7919832 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:50:42.361353 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-839de55e-6a11-47a8-af64-01bdb7919832 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:50:42.364624 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-839de55e-6a11-47a8-af64-01bdb7919832 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:50:42.364624 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-839de55e-6a11-47a8-af64-01bdb7919832 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:50:42.539659 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.policy [None req-3cd664b2-3c3e-4d22-9c37-49c521b6f64b tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc43895177134e9c9c030a9d87f94aaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7905689c95d44a5c9169249c70f7de57', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128729) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:50:42.552267 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: INFO nova.api.openstack.requestlog [None req-3cd664b2-3c3e-4d22-9c37-49c521b6f64b tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] 10.222.0.61 "GET /compute/v2.1/servers/567fb38a-9c00-4de9-8a01-8070792cde75" status: 200 len: 1367 microversion: 2.1 time: 0.220986 May 14 15:50:42.553251 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: [pid: 128729|app: 0|req: 308/632] 10.222.0.61 () {58 vars in 1235 bytes} [Sat May 14 15:50:42 2022] GET /compute/v2.1/servers/567fb38a-9c00-4de9-8a01-8070792cde75 => generated 1367 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 15:50:42.571068 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.policy [None req-839de55e-6a11-47a8-af64-01bdb7919832 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58bfb7417bc94583963401ae0fe9d39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0672be3fa3f7414da1c1a5b7300abbe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128728) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:50:42.579377 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.policy [None req-839de55e-6a11-47a8-af64-01bdb7919832 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58bfb7417bc94583963401ae0fe9d39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0672be3fa3f7414da1c1a5b7300abbe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128728) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:50:42.581153 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.policy [None req-839de55e-6a11-47a8-af64-01bdb7919832 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58bfb7417bc94583963401ae0fe9d39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0672be3fa3f7414da1c1a5b7300abbe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128728) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:50:42.582581 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: INFO nova.api.openstack.requestlog [None req-839de55e-6a11-47a8-af64-01bdb7919832 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] 10.222.0.61 "GET /compute/v2.1/servers/e33e9970-bfb7-46f3-8d40-782dbfa3d21c" status: 200 len: 1722 microversion: 2.20 time: 0.236025 May 14 15:50:42.583761 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: [pid: 128728|app: 0|req: 325/633] 10.222.0.61 () {60 vars in 1276 bytes} [Sat May 14 15:50:42 2022] GET /compute/v2.1/servers/e33e9970-bfb7-46f3-8d40-782dbfa3d21c => generated 1722 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 14 15:50:43.351628 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi [req-c648ae10-f70c-4532-b21c-a50b51cfb6af req-7265588d-4867-41bf-b346-d6b1dc20fb6c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "567fb38a-9c00-4de9-8a01-8070792cde75", "name": "network-vif-plugged", "status": "completed", "tag": "8fdc20f7-107b-43f1-810d-31e0e55a918f"}]} {{(pid=128729) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 15:50:43.366289 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [req-c648ae10-f70c-4532-b21c-a50b51cfb6af req-7265588d-4867-41bf-b346-d6b1dc20fb6c service nova] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:50:43.367065 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [req-c648ae10-f70c-4532-b21c-a50b51cfb6af req-7265588d-4867-41bf-b346-d6b1dc20fb6c service nova] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:50:43.388389 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: INFO nova.api.openstack.compute.server_external_events [req-c648ae10-f70c-4532-b21c-a50b51cfb6af req-7265588d-4867-41bf-b346-d6b1dc20fb6c service nova] Creating event network-vif-plugged:8fdc20f7-107b-43f1-810d-31e0e55a918f for instance 567fb38a-9c00-4de9-8a01-8070792cde75 on hv-cinder-83979 May 14 15:50:43.396686 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: INFO nova.api.openstack.requestlog [req-c648ae10-f70c-4532-b21c-a50b51cfb6af req-7265588d-4867-41bf-b346-d6b1dc20fb6c service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.051329 May 14 15:50:43.397808 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: [pid: 128729|app: 0|req: 309/634] 10.222.0.61 () {64 vars in 1317 bytes} [Sat May 14 15:50:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 14 15:50:43.572802 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi [None req-9caa48ef-7f45-4adf-afca-ae621e283a2b tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] Calling method '>' {{(pid=128728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 15:50:43.573341 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.compute.api [None req-9caa48ef-7f45-4adf-afca-ae621e283a2b tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] [instance: 567fb38a-9c00-4de9-8a01-8070792cde75] Fetching instance by UUID {{(pid=128728) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 15:50:43.583116 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-9caa48ef-7f45-4adf-afca-ae621e283a2b tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:50:43.583572 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-9caa48ef-7f45-4adf-afca-ae621e283a2b tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:50:43.584362 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-9caa48ef-7f45-4adf-afca-ae621e283a2b tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:50:43.589341 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-9caa48ef-7f45-4adf-afca-ae621e283a2b tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:50:43.615209 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi [None req-d1d4a5d0-713e-4bf7-ab17-14d9bd3b89ac tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Calling method '>' {{(pid=128729) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 15:50:43.616293 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.compute.api [None req-d1d4a5d0-713e-4bf7-ab17-14d9bd3b89ac tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] [instance: e33e9970-bfb7-46f3-8d40-782dbfa3d21c] Fetching instance by UUID {{(pid=128729) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 15:50:43.627031 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-d1d4a5d0-713e-4bf7-ab17-14d9bd3b89ac tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:50:43.635087 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-d1d4a5d0-713e-4bf7-ab17-14d9bd3b89ac tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:50:43.636203 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-d1d4a5d0-713e-4bf7-ab17-14d9bd3b89ac tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:50:43.636811 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-d1d4a5d0-713e-4bf7-ab17-14d9bd3b89ac tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:50:43.899428 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.policy [None req-9caa48ef-7f45-4adf-afca-ae621e283a2b tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc43895177134e9c9c030a9d87f94aaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7905689c95d44a5c9169249c70f7de57', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128728) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:50:43.907000 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: INFO nova.api.openstack.requestlog [None req-9caa48ef-7f45-4adf-afca-ae621e283a2b tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] 10.222.0.61 "GET /compute/v2.1/servers/567fb38a-9c00-4de9-8a01-8070792cde75" status: 200 len: 1367 microversion: 2.1 time: 0.339971 May 14 15:50:43.916947 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: [pid: 128728|app: 0|req: 326/635] 10.222.0.61 () {58 vars in 1235 bytes} [Sat May 14 15:50:43 2022] GET /compute/v2.1/servers/567fb38a-9c00-4de9-8a01-8070792cde75 => generated 1367 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 15:50:43.926850 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.policy [None req-d1d4a5d0-713e-4bf7-ab17-14d9bd3b89ac tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58bfb7417bc94583963401ae0fe9d39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0672be3fa3f7414da1c1a5b7300abbe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128729) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:50:43.936938 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.policy [None req-d1d4a5d0-713e-4bf7-ab17-14d9bd3b89ac tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58bfb7417bc94583963401ae0fe9d39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0672be3fa3f7414da1c1a5b7300abbe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128729) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:50:43.938719 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.policy [None req-d1d4a5d0-713e-4bf7-ab17-14d9bd3b89ac tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58bfb7417bc94583963401ae0fe9d39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0672be3fa3f7414da1c1a5b7300abbe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128729) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:50:43.939870 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: INFO nova.api.openstack.requestlog [None req-d1d4a5d0-713e-4bf7-ab17-14d9bd3b89ac tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] 10.222.0.61 "GET /compute/v2.1/servers/e33e9970-bfb7-46f3-8d40-782dbfa3d21c" status: 200 len: 1722 microversion: 2.20 time: 0.330455 May 14 15:50:43.940414 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: [pid: 128729|app: 0|req: 310/636] 10.222.0.61 () {60 vars in 1276 bytes} [Sat May 14 15:50:43 2022] GET /compute/v2.1/servers/e33e9970-bfb7-46f3-8d40-782dbfa3d21c => generated 1722 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 14 15:50:44.924230 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi [None req-e5355a65-f2d7-463d-a30f-8d8d478fd821 tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] Calling method '>' {{(pid=128728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 15:50:44.924838 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.compute.api [None req-e5355a65-f2d7-463d-a30f-8d8d478fd821 tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] [instance: 567fb38a-9c00-4de9-8a01-8070792cde75] Fetching instance by UUID {{(pid=128728) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 15:50:44.934248 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-e5355a65-f2d7-463d-a30f-8d8d478fd821 tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:50:44.934835 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-e5355a65-f2d7-463d-a30f-8d8d478fd821 tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:50:44.936584 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-e5355a65-f2d7-463d-a30f-8d8d478fd821 tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:50:44.937197 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-e5355a65-f2d7-463d-a30f-8d8d478fd821 tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:50:44.962527 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi [None req-1bbfa90a-3090-4867-98d8-2930edf71a74 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Calling method '>' {{(pid=128729) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 15:50:44.963442 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.compute.api [None req-1bbfa90a-3090-4867-98d8-2930edf71a74 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] [instance: e33e9970-bfb7-46f3-8d40-782dbfa3d21c] Fetching instance by UUID {{(pid=128729) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 15:50:44.970199 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-1bbfa90a-3090-4867-98d8-2930edf71a74 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:50:44.970982 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-1bbfa90a-3090-4867-98d8-2930edf71a74 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:50:44.972009 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-1bbfa90a-3090-4867-98d8-2930edf71a74 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:50:44.972684 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-1bbfa90a-3090-4867-98d8-2930edf71a74 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:50:45.135055 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.policy [None req-e5355a65-f2d7-463d-a30f-8d8d478fd821 tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc43895177134e9c9c030a9d87f94aaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7905689c95d44a5c9169249c70f7de57', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128728) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:50:45.143835 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: INFO nova.api.openstack.requestlog [None req-e5355a65-f2d7-463d-a30f-8d8d478fd821 tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] 10.222.0.61 "GET /compute/v2.1/servers/567fb38a-9c00-4de9-8a01-8070792cde75" status: 200 len: 1367 microversion: 2.1 time: 0.223818 May 14 15:50:45.145139 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: [pid: 128728|app: 0|req: 327/637] 10.222.0.61 () {58 vars in 1235 bytes} [Sat May 14 15:50:44 2022] GET /compute/v2.1/servers/567fb38a-9c00-4de9-8a01-8070792cde75 => generated 1367 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 15:50:45.182534 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.policy [None req-1bbfa90a-3090-4867-98d8-2930edf71a74 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58bfb7417bc94583963401ae0fe9d39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0672be3fa3f7414da1c1a5b7300abbe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128729) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:50:45.193931 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.policy [None req-1bbfa90a-3090-4867-98d8-2930edf71a74 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58bfb7417bc94583963401ae0fe9d39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0672be3fa3f7414da1c1a5b7300abbe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128729) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:50:45.195567 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.policy [None req-1bbfa90a-3090-4867-98d8-2930edf71a74 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58bfb7417bc94583963401ae0fe9d39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0672be3fa3f7414da1c1a5b7300abbe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128729) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:50:45.196790 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: INFO nova.api.openstack.requestlog [None req-1bbfa90a-3090-4867-98d8-2930edf71a74 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] 10.222.0.61 "GET /compute/v2.1/servers/e33e9970-bfb7-46f3-8d40-782dbfa3d21c" status: 200 len: 1722 microversion: 2.20 time: 0.238596 May 14 15:50:45.197414 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: [pid: 128729|app: 0|req: 311/638] 10.222.0.61 () {60 vars in 1276 bytes} [Sat May 14 15:50:44 2022] GET /compute/v2.1/servers/e33e9970-bfb7-46f3-8d40-782dbfa3d21c => generated 1722 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 14 15:50:46.161003 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi [None req-04551ab2-134b-4c22-81f8-85a356d95b9a tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] Calling method '>' {{(pid=128728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 15:50:46.161656 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.compute.api [None req-04551ab2-134b-4c22-81f8-85a356d95b9a tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] [instance: 567fb38a-9c00-4de9-8a01-8070792cde75] Fetching instance by UUID {{(pid=128728) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 15:50:46.167839 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-04551ab2-134b-4c22-81f8-85a356d95b9a tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:50:46.168326 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-04551ab2-134b-4c22-81f8-85a356d95b9a tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:50:46.169127 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-04551ab2-134b-4c22-81f8-85a356d95b9a tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:50:46.169528 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-04551ab2-134b-4c22-81f8-85a356d95b9a tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:50:46.215309 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi [None req-389fb926-b038-4248-a1a1-1b957a9203fb tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Calling method '>' {{(pid=128729) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 15:50:46.215936 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.compute.api [None req-389fb926-b038-4248-a1a1-1b957a9203fb tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] [instance: e33e9970-bfb7-46f3-8d40-782dbfa3d21c] Fetching instance by UUID {{(pid=128729) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 15:50:46.222770 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-389fb926-b038-4248-a1a1-1b957a9203fb tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:50:46.223221 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-389fb926-b038-4248-a1a1-1b957a9203fb tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:50:46.224006 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-389fb926-b038-4248-a1a1-1b957a9203fb tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:50:46.224696 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-389fb926-b038-4248-a1a1-1b957a9203fb tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:50:46.417532 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.policy [None req-389fb926-b038-4248-a1a1-1b957a9203fb tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58bfb7417bc94583963401ae0fe9d39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0672be3fa3f7414da1c1a5b7300abbe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128729) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:50:46.425823 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.policy [None req-389fb926-b038-4248-a1a1-1b957a9203fb tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58bfb7417bc94583963401ae0fe9d39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0672be3fa3f7414da1c1a5b7300abbe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128729) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:50:46.428442 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.policy [None req-389fb926-b038-4248-a1a1-1b957a9203fb tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58bfb7417bc94583963401ae0fe9d39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0672be3fa3f7414da1c1a5b7300abbe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128729) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:50:46.428617 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: INFO nova.api.openstack.requestlog [None req-389fb926-b038-4248-a1a1-1b957a9203fb tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] 10.222.0.61 "GET /compute/v2.1/servers/e33e9970-bfb7-46f3-8d40-782dbfa3d21c" status: 200 len: 1722 microversion: 2.20 time: 0.217146 May 14 15:50:46.438493 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: [pid: 128729|app: 0|req: 312/639] 10.222.0.61 () {60 vars in 1276 bytes} [Sat May 14 15:50:46 2022] GET /compute/v2.1/servers/e33e9970-bfb7-46f3-8d40-782dbfa3d21c => generated 1722 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 14 15:50:46.455746 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.policy [None req-04551ab2-134b-4c22-81f8-85a356d95b9a tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc43895177134e9c9c030a9d87f94aaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7905689c95d44a5c9169249c70f7de57', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128728) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:50:46.463368 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: INFO nova.api.openstack.requestlog [None req-04551ab2-134b-4c22-81f8-85a356d95b9a tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] 10.222.0.61 "GET /compute/v2.1/servers/567fb38a-9c00-4de9-8a01-8070792cde75" status: 200 len: 1367 microversion: 2.1 time: 0.306171 May 14 15:50:46.464225 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: [pid: 128728|app: 0|req: 328/640] 10.222.0.61 () {58 vars in 1235 bytes} [Sat May 14 15:50:46 2022] GET /compute/v2.1/servers/567fb38a-9c00-4de9-8a01-8070792cde75 => generated 1367 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 15:50:47.452660 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi [None req-062fa28b-0c21-4dd4-9f18-33cdffacaabe tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Calling method '>' {{(pid=128729) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 15:50:47.455268 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.compute.api [None req-062fa28b-0c21-4dd4-9f18-33cdffacaabe tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] [instance: e33e9970-bfb7-46f3-8d40-782dbfa3d21c] Fetching instance by UUID {{(pid=128729) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 15:50:47.460697 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-062fa28b-0c21-4dd4-9f18-33cdffacaabe tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:50:47.460697 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-062fa28b-0c21-4dd4-9f18-33cdffacaabe tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:50:47.461638 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-062fa28b-0c21-4dd4-9f18-33cdffacaabe tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:50:47.462029 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-062fa28b-0c21-4dd4-9f18-33cdffacaabe tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:50:47.481376 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi [None req-d57946c1-dcae-435d-922f-a1a68d59cd03 tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] Calling method '>' {{(pid=128728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 15:50:47.483795 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.compute.api [None req-d57946c1-dcae-435d-922f-a1a68d59cd03 tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] [instance: 567fb38a-9c00-4de9-8a01-8070792cde75] Fetching instance by UUID {{(pid=128728) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 15:50:47.490678 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-d57946c1-dcae-435d-922f-a1a68d59cd03 tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:50:47.491125 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-d57946c1-dcae-435d-922f-a1a68d59cd03 tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:50:47.491897 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-d57946c1-dcae-435d-922f-a1a68d59cd03 tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:50:47.492330 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-d57946c1-dcae-435d-922f-a1a68d59cd03 tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:50:47.690339 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.policy [None req-062fa28b-0c21-4dd4-9f18-33cdffacaabe tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58bfb7417bc94583963401ae0fe9d39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0672be3fa3f7414da1c1a5b7300abbe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128729) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:50:47.706001 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.policy [None req-062fa28b-0c21-4dd4-9f18-33cdffacaabe tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58bfb7417bc94583963401ae0fe9d39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0672be3fa3f7414da1c1a5b7300abbe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128729) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:50:47.710980 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.policy [None req-062fa28b-0c21-4dd4-9f18-33cdffacaabe tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58bfb7417bc94583963401ae0fe9d39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0672be3fa3f7414da1c1a5b7300abbe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128729) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:50:47.712626 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: INFO nova.api.openstack.requestlog [None req-062fa28b-0c21-4dd4-9f18-33cdffacaabe tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] 10.222.0.61 "GET /compute/v2.1/servers/e33e9970-bfb7-46f3-8d40-782dbfa3d21c" status: 200 len: 1722 microversion: 2.20 time: 0.264851 May 14 15:50:47.726290 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: [pid: 128729|app: 0|req: 313/641] 10.222.0.61 () {60 vars in 1276 bytes} [Sat May 14 15:50:47 2022] GET /compute/v2.1/servers/e33e9970-bfb7-46f3-8d40-782dbfa3d21c => generated 1722 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 14 15:50:47.747488 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.policy [None req-d57946c1-dcae-435d-922f-a1a68d59cd03 tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc43895177134e9c9c030a9d87f94aaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7905689c95d44a5c9169249c70f7de57', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128728) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:50:47.755869 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: INFO nova.api.openstack.requestlog [None req-d57946c1-dcae-435d-922f-a1a68d59cd03 tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] 10.222.0.61 "GET /compute/v2.1/servers/567fb38a-9c00-4de9-8a01-8070792cde75" status: 200 len: 1557 microversion: 2.1 time: 0.278333 May 14 15:50:47.756445 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: [pid: 128728|app: 0|req: 329/642] 10.222.0.61 () {58 vars in 1235 bytes} [Sat May 14 15:50:47 2022] GET /compute/v2.1/servers/567fb38a-9c00-4de9-8a01-8070792cde75 => generated 1557 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 15:50:47.774421 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi [None req-dda227a4-52eb-4e5a-8912-5e4578cb6dcf tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] Calling method '>' {{(pid=128729) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 15:50:47.775046 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.compute.api [None req-dda227a4-52eb-4e5a-8912-5e4578cb6dcf tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] [instance: 567fb38a-9c00-4de9-8a01-8070792cde75] Fetching instance by UUID {{(pid=128729) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 15:50:47.782672 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-dda227a4-52eb-4e5a-8912-5e4578cb6dcf tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:50:47.783125 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-dda227a4-52eb-4e5a-8912-5e4578cb6dcf tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:50:47.784086 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-dda227a4-52eb-4e5a-8912-5e4578cb6dcf tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:50:47.784527 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-dda227a4-52eb-4e5a-8912-5e4578cb6dcf tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:50:47.885856 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: INFO nova.api.openstack.requestlog [None req-dda227a4-52eb-4e5a-8912-5e4578cb6dcf tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] 10.222.0.61 "GET /compute/v2.1/servers/567fb38a-9c00-4de9-8a01-8070792cde75/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.116651 May 14 15:50:47.886829 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: [pid: 128729|app: 0|req: 314/643] 10.222.0.61 () {58 vars in 1274 bytes} [Sat May 14 15:50:47 2022] GET /compute/v2.1/servers/567fb38a-9c00-4de9-8a01-8070792cde75/os-interface => generated 285 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 14 15:50:48.734287 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi [None req-5d0c8971-4a81-4895-87ce-31441b8f636b tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Calling method '>' {{(pid=128728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 15:50:48.735803 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.compute.api [None req-5d0c8971-4a81-4895-87ce-31441b8f636b tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] [instance: e33e9970-bfb7-46f3-8d40-782dbfa3d21c] Fetching instance by UUID {{(pid=128728) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 15:50:48.743673 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-5d0c8971-4a81-4895-87ce-31441b8f636b tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:50:48.744478 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-5d0c8971-4a81-4895-87ce-31441b8f636b tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:50:48.746296 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-5d0c8971-4a81-4895-87ce-31441b8f636b tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:50:48.747032 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-5d0c8971-4a81-4895-87ce-31441b8f636b tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:50:48.980496 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.policy [None req-5d0c8971-4a81-4895-87ce-31441b8f636b tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58bfb7417bc94583963401ae0fe9d39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0672be3fa3f7414da1c1a5b7300abbe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128728) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:50:48.991904 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.policy [None req-5d0c8971-4a81-4895-87ce-31441b8f636b tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58bfb7417bc94583963401ae0fe9d39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0672be3fa3f7414da1c1a5b7300abbe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128728) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:50:48.994191 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.policy [None req-5d0c8971-4a81-4895-87ce-31441b8f636b tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58bfb7417bc94583963401ae0fe9d39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0672be3fa3f7414da1c1a5b7300abbe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128728) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:50:48.995589 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: INFO nova.api.openstack.requestlog [None req-5d0c8971-4a81-4895-87ce-31441b8f636b tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] 10.222.0.61 "GET /compute/v2.1/servers/e33e9970-bfb7-46f3-8d40-782dbfa3d21c" status: 200 len: 1722 microversion: 2.20 time: 0.266312 May 14 15:50:48.996632 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: [pid: 128728|app: 0|req: 330/644] 10.222.0.61 () {60 vars in 1276 bytes} [Sat May 14 15:50:48 2022] GET /compute/v2.1/servers/e33e9970-bfb7-46f3-8d40-782dbfa3d21c => generated 1722 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 14 15:50:49.393963 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi [req-660676aa-2312-4571-bb10-3ac088465e2c req-8a9101a8-2f0a-4c6c-a489-33bd92809b87 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "567fb38a-9c00-4de9-8a01-8070792cde75", "tag": "8fdc20f7-107b-43f1-810d-31e0e55a918f"}]} {{(pid=128729) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 15:50:49.407160 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [req-660676aa-2312-4571-bb10-3ac088465e2c req-8a9101a8-2f0a-4c6c-a489-33bd92809b87 service nova] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:50:49.408134 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [req-660676aa-2312-4571-bb10-3ac088465e2c req-8a9101a8-2f0a-4c6c-a489-33bd92809b87 service nova] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:50:49.426399 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: INFO nova.api.openstack.compute.server_external_events [req-660676aa-2312-4571-bb10-3ac088465e2c req-8a9101a8-2f0a-4c6c-a489-33bd92809b87 service nova] Creating event network-changed:8fdc20f7-107b-43f1-810d-31e0e55a918f for instance 567fb38a-9c00-4de9-8a01-8070792cde75 on hv-cinder-83979 May 14 15:50:49.434958 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: INFO nova.api.openstack.requestlog [req-660676aa-2312-4571-bb10-3ac088465e2c req-8a9101a8-2f0a-4c6c-a489-33bd92809b87 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047283 May 14 15:50:49.436474 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: [pid: 128729|app: 0|req: 315/645] 10.222.0.61 () {64 vars in 1317 bytes} [Sat May 14 15:50:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 14 15:50:50.018779 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi [None req-237df33d-8daf-44aa-a42a-a7ce099e89e1 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Calling method '>' {{(pid=128728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 15:50:50.021394 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.compute.api [None req-237df33d-8daf-44aa-a42a-a7ce099e89e1 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] [instance: e33e9970-bfb7-46f3-8d40-782dbfa3d21c] Fetching instance by UUID {{(pid=128728) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 15:50:50.035284 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-237df33d-8daf-44aa-a42a-a7ce099e89e1 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:50:50.035602 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-237df33d-8daf-44aa-a42a-a7ce099e89e1 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:50:50.036398 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-237df33d-8daf-44aa-a42a-a7ce099e89e1 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:50:50.036838 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-237df33d-8daf-44aa-a42a-a7ce099e89e1 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:50:50.240821 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.policy [None req-237df33d-8daf-44aa-a42a-a7ce099e89e1 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58bfb7417bc94583963401ae0fe9d39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0672be3fa3f7414da1c1a5b7300abbe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128728) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:50:50.252454 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.policy [None req-237df33d-8daf-44aa-a42a-a7ce099e89e1 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58bfb7417bc94583963401ae0fe9d39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0672be3fa3f7414da1c1a5b7300abbe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128728) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:50:50.255256 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.policy [None req-237df33d-8daf-44aa-a42a-a7ce099e89e1 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58bfb7417bc94583963401ae0fe9d39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0672be3fa3f7414da1c1a5b7300abbe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128728) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:50:50.256882 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: INFO nova.api.openstack.requestlog [None req-237df33d-8daf-44aa-a42a-a7ce099e89e1 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] 10.222.0.61 "GET /compute/v2.1/servers/e33e9970-bfb7-46f3-8d40-782dbfa3d21c" status: 200 len: 1722 microversion: 2.20 time: 0.242216 May 14 15:50:50.267353 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: [pid: 128728|app: 0|req: 331/646] 10.222.0.61 () {60 vars in 1276 bytes} [Sat May 14 15:50:50 2022] GET /compute/v2.1/servers/e33e9970-bfb7-46f3-8d40-782dbfa3d21c => generated 1722 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 14 15:50:51.281322 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi [None req-45dfa161-df10-4f0c-b33b-3f07618d3914 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Calling method '>' {{(pid=128729) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 15:50:51.282106 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.compute.api [None req-45dfa161-df10-4f0c-b33b-3f07618d3914 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] [instance: e33e9970-bfb7-46f3-8d40-782dbfa3d21c] Fetching instance by UUID {{(pid=128729) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 15:50:51.288010 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-45dfa161-df10-4f0c-b33b-3f07618d3914 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:50:51.288456 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-45dfa161-df10-4f0c-b33b-3f07618d3914 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:50:51.289278 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-45dfa161-df10-4f0c-b33b-3f07618d3914 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:50:51.289890 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-45dfa161-df10-4f0c-b33b-3f07618d3914 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:50:51.422710 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.policy [None req-45dfa161-df10-4f0c-b33b-3f07618d3914 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58bfb7417bc94583963401ae0fe9d39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0672be3fa3f7414da1c1a5b7300abbe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128729) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:50:51.430385 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.policy [None req-45dfa161-df10-4f0c-b33b-3f07618d3914 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58bfb7417bc94583963401ae0fe9d39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0672be3fa3f7414da1c1a5b7300abbe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128729) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:50:51.431890 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.policy [None req-45dfa161-df10-4f0c-b33b-3f07618d3914 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58bfb7417bc94583963401ae0fe9d39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0672be3fa3f7414da1c1a5b7300abbe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128729) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:50:51.433040 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: INFO nova.api.openstack.requestlog [None req-45dfa161-df10-4f0c-b33b-3f07618d3914 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] 10.222.0.61 "GET /compute/v2.1/servers/e33e9970-bfb7-46f3-8d40-782dbfa3d21c" status: 200 len: 1722 microversion: 2.20 time: 0.156652 May 14 15:50:51.433599 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: [pid: 128729|app: 0|req: 316/647] 10.222.0.61 () {60 vars in 1276 bytes} [Sat May 14 15:50:51 2022] GET /compute/v2.1/servers/e33e9970-bfb7-46f3-8d40-782dbfa3d21c => generated 1722 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 14 15:50:52.453312 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi [None req-4031985b-3584-4742-9a85-87d857582173 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Calling method '>' {{(pid=128728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 15:50:52.453975 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.compute.api [None req-4031985b-3584-4742-9a85-87d857582173 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] [instance: e33e9970-bfb7-46f3-8d40-782dbfa3d21c] Fetching instance by UUID {{(pid=128728) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 15:50:52.460381 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-4031985b-3584-4742-9a85-87d857582173 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:50:52.460813 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-4031985b-3584-4742-9a85-87d857582173 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:50:52.461513 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-4031985b-3584-4742-9a85-87d857582173 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:50:52.462045 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-4031985b-3584-4742-9a85-87d857582173 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:50:52.601003 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.policy [None req-4031985b-3584-4742-9a85-87d857582173 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58bfb7417bc94583963401ae0fe9d39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0672be3fa3f7414da1c1a5b7300abbe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128728) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:50:52.609445 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.policy [None req-4031985b-3584-4742-9a85-87d857582173 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58bfb7417bc94583963401ae0fe9d39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0672be3fa3f7414da1c1a5b7300abbe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128728) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:50:52.611198 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.policy [None req-4031985b-3584-4742-9a85-87d857582173 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58bfb7417bc94583963401ae0fe9d39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0672be3fa3f7414da1c1a5b7300abbe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128728) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:50:52.612508 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: INFO nova.api.openstack.requestlog [None req-4031985b-3584-4742-9a85-87d857582173 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] 10.222.0.61 "GET /compute/v2.1/servers/e33e9970-bfb7-46f3-8d40-782dbfa3d21c" status: 200 len: 1743 microversion: 2.20 time: 0.164762 May 14 15:50:52.613070 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: [pid: 128728|app: 0|req: 332/648] 10.222.0.61 () {60 vars in 1276 bytes} [Sat May 14 15:50:52 2022] GET /compute/v2.1/servers/e33e9970-bfb7-46f3-8d40-782dbfa3d21c => generated 1743 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 14 15:50:53.500364 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi [None req-081b5425-11a8-4493-8e80-362bee63505b tempest-TestVolumeBootPattern-2062489882 tempest-TestVolumeBootPattern-2062489882-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-902442166", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1553604469", "security_groups": [{"name": "tempest-secgroup-smoke-1987363797"}], "block_device_mapping_v2": [{"uuid": "1daa7061-1ad2-4874-b43e-2d12308fbd9d", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "791585d6-2e4a-4237-ab00-9a26c50b495e"}]}} {{(pid=128729) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 15:50:53.628399 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.network.neutron [None req-081b5425-11a8-4493-8e80-362bee63505b tempest-TestVolumeBootPattern-2062489882 tempest-TestVolumeBootPattern-2062489882-project] validate_networks() for [('791585d6-2e4a-4237-ab00-9a26c50b495e', None, None, None, None, None)] {{(pid=128729) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 14 15:50:53.634658 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi [None req-0628db6c-3ae4-4e67-a32d-05beda729bd9 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Calling method '>' {{(pid=128728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 15:50:53.635434 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.compute.api [None req-0628db6c-3ae4-4e67-a32d-05beda729bd9 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] [instance: e33e9970-bfb7-46f3-8d40-782dbfa3d21c] Fetching instance by UUID {{(pid=128728) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 15:50:53.645227 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-0628db6c-3ae4-4e67-a32d-05beda729bd9 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:50:53.646058 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-0628db6c-3ae4-4e67-a32d-05beda729bd9 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:50:53.647056 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-0628db6c-3ae4-4e67-a32d-05beda729bd9 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:50:53.647492 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-0628db6c-3ae4-4e67-a32d-05beda729bd9 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:50:53.850778 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.policy [None req-0628db6c-3ae4-4e67-a32d-05beda729bd9 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58bfb7417bc94583963401ae0fe9d39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0672be3fa3f7414da1c1a5b7300abbe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128728) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:50:53.860799 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.policy [None req-0628db6c-3ae4-4e67-a32d-05beda729bd9 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58bfb7417bc94583963401ae0fe9d39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0672be3fa3f7414da1c1a5b7300abbe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128728) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:50:53.862833 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.policy [None req-0628db6c-3ae4-4e67-a32d-05beda729bd9 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58bfb7417bc94583963401ae0fe9d39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0672be3fa3f7414da1c1a5b7300abbe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128728) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:50:53.864733 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: INFO nova.api.openstack.requestlog [None req-0628db6c-3ae4-4e67-a32d-05beda729bd9 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] 10.222.0.61 "GET /compute/v2.1/servers/e33e9970-bfb7-46f3-8d40-782dbfa3d21c" status: 200 len: 1743 microversion: 2.20 time: 0.236420 May 14 15:50:53.865619 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: [pid: 128728|app: 0|req: 333/649] 10.222.0.61 () {60 vars in 1276 bytes} [Sat May 14 15:50:53 2022] GET /compute/v2.1/servers/e33e9970-bfb7-46f3-8d40-782dbfa3d21c => generated 1743 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 14 15:50:54.073518 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.virt.hardware [None req-081b5425-11a8-4493-8e80-362bee63505b tempest-TestVolumeBootPattern-2062489882 tempest-TestVolumeBootPattern-2062489882-project] Flavor limits 0:0:0 {{(pid=128729) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 14 15:50:54.073933 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.virt.hardware [None req-081b5425-11a8-4493-8e80-362bee63505b tempest-TestVolumeBootPattern-2062489882 tempest-TestVolumeBootPattern-2062489882-project] Image limits 0:0:0 {{(pid=128729) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 14 15:50:54.074428 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.virt.hardware [None req-081b5425-11a8-4493-8e80-362bee63505b tempest-TestVolumeBootPattern-2062489882 tempest-TestVolumeBootPattern-2062489882-project] Flavor pref 0:0:0 {{(pid=128729) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 14 15:50:54.074835 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.virt.hardware [None req-081b5425-11a8-4493-8e80-362bee63505b tempest-TestVolumeBootPattern-2062489882 tempest-TestVolumeBootPattern-2062489882-project] Image pref 0:0:0 {{(pid=128729) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 14 15:50:54.075239 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.virt.hardware [None req-081b5425-11a8-4493-8e80-362bee63505b tempest-TestVolumeBootPattern-2062489882 tempest-TestVolumeBootPattern-2062489882-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128729) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 14 15:50:54.084392 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-081b5425-11a8-4493-8e80-362bee63505b tempest-TestVolumeBootPattern-2062489882 tempest-TestVolumeBootPattern-2062489882-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:50:54.084835 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-081b5425-11a8-4493-8e80-362bee63505b tempest-TestVolumeBootPattern-2062489882 tempest-TestVolumeBootPattern-2062489882-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:50:54.085660 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-081b5425-11a8-4493-8e80-362bee63505b tempest-TestVolumeBootPattern-2062489882 tempest-TestVolumeBootPattern-2062489882-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:50:54.086095 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-081b5425-11a8-4493-8e80-362bee63505b tempest-TestVolumeBootPattern-2062489882 tempest-TestVolumeBootPattern-2062489882-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:50:54.103501 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.quota [None req-081b5425-11a8-4493-8e80-362bee63505b tempest-TestVolumeBootPattern-2062489882 tempest-TestVolumeBootPattern-2062489882-project] Getting quotas for project 7a3a2b5dee7a404a8445c8aa434b5a43. Resources: {'instances', 'cores', 'ram'} {{(pid=128729) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 14 15:50:54.107286 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.quota [None req-081b5425-11a8-4493-8e80-362bee63505b tempest-TestVolumeBootPattern-2062489882 tempest-TestVolumeBootPattern-2062489882-project] Getting quotas for user 568f6783dd4d43398a70a9ffa58ff660 and project 7a3a2b5dee7a404a8445c8aa434b5a43. Resources: {'instances', 'cores', 'ram'} {{(pid=128729) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 14 15:50:54.162813 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.compute.api [None req-081b5425-11a8-4493-8e80-362bee63505b tempest-TestVolumeBootPattern-2062489882 tempest-TestVolumeBootPattern-2062489882-project] Going to run 1 instances... {{(pid=128729) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 14 15:50:54.164864 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.compute.api [None req-081b5425-11a8-4493-8e80-362bee63505b tempest-TestVolumeBootPattern-2062489882 tempest-TestVolumeBootPattern-2062489882-project] [instance: 7ee38041-8e54-4fdb-909d-585952a4f5bd] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='1daa7061-1ad2-4874-b43e-2d12308fbd9d',volume_size=None,volume_type=None)] {{(pid=128729) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 14 15:50:54.290034 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: INFO nova.api.openstack.requestlog [None req-081b5425-11a8-4493-8e80-362bee63505b tempest-TestVolumeBootPattern-2062489882 tempest-TestVolumeBootPattern-2062489882-project] 10.222.0.61 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.793679 May 14 15:50:54.296864 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: [pid: 128729|app: 0|req: 317/650] 10.222.0.61 () {60 vars in 1146 bytes} [Sat May 14 15:50:53 2022] POST /compute/v2.1/servers => generated 406 bytes in 801 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 14 15:50:54.305048 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi [None req-5761aaee-3541-4131-bc00-340c452ad638 tempest-TestVolumeBootPattern-2062489882 tempest-TestVolumeBootPattern-2062489882-project] Calling method '>' {{(pid=128728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 15:50:54.306099 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.compute.api [None req-5761aaee-3541-4131-bc00-340c452ad638 tempest-TestVolumeBootPattern-2062489882 tempest-TestVolumeBootPattern-2062489882-project] [instance: 7ee38041-8e54-4fdb-909d-585952a4f5bd] Fetching instance by UUID {{(pid=128728) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 15:50:54.363856 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.policy [None req-5761aaee-3541-4131-bc00-340c452ad638 tempest-TestVolumeBootPattern-2062489882 tempest-TestVolumeBootPattern-2062489882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '568f6783dd4d43398a70a9ffa58ff660', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a3a2b5dee7a404a8445c8aa434b5a43', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128728) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:50:54.370649 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: INFO nova.api.openstack.requestlog [None req-5761aaee-3541-4131-bc00-340c452ad638 tempest-TestVolumeBootPattern-2062489882 tempest-TestVolumeBootPattern-2062489882-project] 10.222.0.61 "GET /compute/v2.1/servers/7ee38041-8e54-4fdb-909d-585952a4f5bd" status: 200 len: 1094 microversion: 2.1 time: 0.072598 May 14 15:50:54.371276 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: [pid: 128728|app: 0|req: 334/651] 10.222.0.61 () {58 vars in 1235 bytes} [Sat May 14 15:50:54 2022] GET /compute/v2.1/servers/7ee38041-8e54-4fdb-909d-585952a4f5bd => generated 1094 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 15:50:54.884187 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi [None req-9cf6b6ee-3297-44b0-b4b0-b31d6295f76e tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Calling method '>' {{(pid=128729) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 15:50:54.884798 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.compute.api [None req-9cf6b6ee-3297-44b0-b4b0-b31d6295f76e tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] [instance: e33e9970-bfb7-46f3-8d40-782dbfa3d21c] Fetching instance by UUID {{(pid=128729) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 15:50:54.892266 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-9cf6b6ee-3297-44b0-b4b0-b31d6295f76e tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:50:54.892719 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-9cf6b6ee-3297-44b0-b4b0-b31d6295f76e tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:50:54.893503 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-9cf6b6ee-3297-44b0-b4b0-b31d6295f76e tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:50:54.893988 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-9cf6b6ee-3297-44b0-b4b0-b31d6295f76e tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:50:55.294663 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.policy [None req-9cf6b6ee-3297-44b0-b4b0-b31d6295f76e tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58bfb7417bc94583963401ae0fe9d39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0672be3fa3f7414da1c1a5b7300abbe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128729) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:50:55.303728 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.policy [None req-9cf6b6ee-3297-44b0-b4b0-b31d6295f76e tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58bfb7417bc94583963401ae0fe9d39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0672be3fa3f7414da1c1a5b7300abbe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128729) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:50:55.305582 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.policy [None req-9cf6b6ee-3297-44b0-b4b0-b31d6295f76e tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58bfb7417bc94583963401ae0fe9d39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0672be3fa3f7414da1c1a5b7300abbe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128729) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:50:55.307226 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: INFO nova.api.openstack.requestlog [None req-9cf6b6ee-3297-44b0-b4b0-b31d6295f76e tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] 10.222.0.61 "GET /compute/v2.1/servers/e33e9970-bfb7-46f3-8d40-782dbfa3d21c" status: 200 len: 1743 microversion: 2.20 time: 0.427679 May 14 15:50:55.307788 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: [pid: 128729|app: 0|req: 318/652] 10.222.0.61 () {60 vars in 1276 bytes} [Sat May 14 15:50:54 2022] GET /compute/v2.1/servers/e33e9970-bfb7-46f3-8d40-782dbfa3d21c => generated 1743 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 14 15:50:55.388764 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi [None req-8dd04def-3abf-4db3-b74c-fed0080eca2f tempest-TestVolumeBootPattern-2062489882 tempest-TestVolumeBootPattern-2062489882-project] Calling method '>' {{(pid=128728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 15:50:55.390253 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.compute.api [None req-8dd04def-3abf-4db3-b74c-fed0080eca2f tempest-TestVolumeBootPattern-2062489882 tempest-TestVolumeBootPattern-2062489882-project] [instance: 7ee38041-8e54-4fdb-909d-585952a4f5bd] Fetching instance by UUID {{(pid=128728) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 15:50:55.398023 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-8dd04def-3abf-4db3-b74c-fed0080eca2f tempest-TestVolumeBootPattern-2062489882 tempest-TestVolumeBootPattern-2062489882-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:50:55.398752 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-8dd04def-3abf-4db3-b74c-fed0080eca2f tempest-TestVolumeBootPattern-2062489882 tempest-TestVolumeBootPattern-2062489882-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:50:55.399775 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-8dd04def-3abf-4db3-b74c-fed0080eca2f tempest-TestVolumeBootPattern-2062489882 tempest-TestVolumeBootPattern-2062489882-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:50:55.400951 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-8dd04def-3abf-4db3-b74c-fed0080eca2f tempest-TestVolumeBootPattern-2062489882 tempest-TestVolumeBootPattern-2062489882-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:50:55.481173 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.policy [None req-8dd04def-3abf-4db3-b74c-fed0080eca2f tempest-TestVolumeBootPattern-2062489882 tempest-TestVolumeBootPattern-2062489882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '568f6783dd4d43398a70a9ffa58ff660', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a3a2b5dee7a404a8445c8aa434b5a43', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128728) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:50:55.499712 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: INFO nova.api.openstack.requestlog [None req-8dd04def-3abf-4db3-b74c-fed0080eca2f tempest-TestVolumeBootPattern-2062489882 tempest-TestVolumeBootPattern-2062489882-project] 10.222.0.61 "GET /compute/v2.1/servers/7ee38041-8e54-4fdb-909d-585952a4f5bd" status: 200 len: 1210 microversion: 2.1 time: 0.114673 May 14 15:50:55.509395 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: [pid: 128728|app: 0|req: 335/653] 10.222.0.61 () {58 vars in 1235 bytes} [Sat May 14 15:50:55 2022] GET /compute/v2.1/servers/7ee38041-8e54-4fdb-909d-585952a4f5bd => generated 1210 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 15:50:56.327461 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi [None req-c5051511-27d2-4876-9da1-50b63bd1c90e tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Calling method '>' {{(pid=128729) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 15:50:56.329263 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.compute.api [None req-c5051511-27d2-4876-9da1-50b63bd1c90e tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] [instance: e33e9970-bfb7-46f3-8d40-782dbfa3d21c] Fetching instance by UUID {{(pid=128729) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 15:50:56.340654 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-c5051511-27d2-4876-9da1-50b63bd1c90e tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:50:56.341109 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-c5051511-27d2-4876-9da1-50b63bd1c90e tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:50:56.342719 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-c5051511-27d2-4876-9da1-50b63bd1c90e tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:50:56.343368 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-c5051511-27d2-4876-9da1-50b63bd1c90e tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:50:56.479408 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.policy [None req-c5051511-27d2-4876-9da1-50b63bd1c90e tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58bfb7417bc94583963401ae0fe9d39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0672be3fa3f7414da1c1a5b7300abbe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128729) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:50:56.487643 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.policy [None req-c5051511-27d2-4876-9da1-50b63bd1c90e tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58bfb7417bc94583963401ae0fe9d39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0672be3fa3f7414da1c1a5b7300abbe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128729) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:50:56.489598 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.policy [None req-c5051511-27d2-4876-9da1-50b63bd1c90e tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58bfb7417bc94583963401ae0fe9d39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0672be3fa3f7414da1c1a5b7300abbe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128729) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:50:56.490790 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: INFO nova.api.openstack.requestlog [None req-c5051511-27d2-4876-9da1-50b63bd1c90e tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] 10.222.0.61 "GET /compute/v2.1/servers/e33e9970-bfb7-46f3-8d40-782dbfa3d21c" status: 200 len: 1743 microversion: 2.20 time: 0.169790 May 14 15:50:56.491524 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: [pid: 128729|app: 0|req: 319/654] 10.222.0.61 () {60 vars in 1276 bytes} [Sat May 14 15:50:56 2022] GET /compute/v2.1/servers/e33e9970-bfb7-46f3-8d40-782dbfa3d21c => generated 1743 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 14 15:50:56.517583 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi [None req-b9a0e453-e604-48fe-a2e9-9bf7833c4460 tempest-TestVolumeBootPattern-2062489882 tempest-TestVolumeBootPattern-2062489882-project] Calling method '>' {{(pid=128728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 15:50:56.518165 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.compute.api [None req-b9a0e453-e604-48fe-a2e9-9bf7833c4460 tempest-TestVolumeBootPattern-2062489882 tempest-TestVolumeBootPattern-2062489882-project] [instance: 7ee38041-8e54-4fdb-909d-585952a4f5bd] Fetching instance by UUID {{(pid=128728) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 15:50:56.524896 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-b9a0e453-e604-48fe-a2e9-9bf7833c4460 tempest-TestVolumeBootPattern-2062489882 tempest-TestVolumeBootPattern-2062489882-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:50:56.525363 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-b9a0e453-e604-48fe-a2e9-9bf7833c4460 tempest-TestVolumeBootPattern-2062489882 tempest-TestVolumeBootPattern-2062489882-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:50:56.526151 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-b9a0e453-e604-48fe-a2e9-9bf7833c4460 tempest-TestVolumeBootPattern-2062489882 tempest-TestVolumeBootPattern-2062489882-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:50:56.526768 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-b9a0e453-e604-48fe-a2e9-9bf7833c4460 tempest-TestVolumeBootPattern-2062489882 tempest-TestVolumeBootPattern-2062489882-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:50:56.666692 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.policy [None req-b9a0e453-e604-48fe-a2e9-9bf7833c4460 tempest-TestVolumeBootPattern-2062489882 tempest-TestVolumeBootPattern-2062489882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '568f6783dd4d43398a70a9ffa58ff660', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a3a2b5dee7a404a8445c8aa434b5a43', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128728) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:50:56.676465 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: INFO nova.api.openstack.requestlog [None req-b9a0e453-e604-48fe-a2e9-9bf7833c4460 tempest-TestVolumeBootPattern-2062489882 tempest-TestVolumeBootPattern-2062489882-project] 10.222.0.61 "GET /compute/v2.1/servers/7ee38041-8e54-4fdb-909d-585952a4f5bd" status: 200 len: 1266 microversion: 2.1 time: 0.163342 May 14 15:50:56.677046 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: [pid: 128728|app: 0|req: 336/655] 10.222.0.61 () {58 vars in 1235 bytes} [Sat May 14 15:50:56 2022] GET /compute/v2.1/servers/7ee38041-8e54-4fdb-909d-585952a4f5bd => generated 1266 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 15:50:56.909233 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi [req-a6ef30f3-dcd3-43be-b61c-02f654748938 req-e0b1c81d-be73-4d3d-b1b4-97e3aa50f745 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7ee38041-8e54-4fdb-909d-585952a4f5bd", "tag": "bcc0c44d-e45f-498d-aad0-498370ba2097"}]} {{(pid=128729) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 15:50:56.918831 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [req-a6ef30f3-dcd3-43be-b61c-02f654748938 req-e0b1c81d-be73-4d3d-b1b4-97e3aa50f745 service nova] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:50:56.919527 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [req-a6ef30f3-dcd3-43be-b61c-02f654748938 req-e0b1c81d-be73-4d3d-b1b4-97e3aa50f745 service nova] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:50:56.937915 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: INFO nova.api.openstack.compute.server_external_events [req-a6ef30f3-dcd3-43be-b61c-02f654748938 req-e0b1c81d-be73-4d3d-b1b4-97e3aa50f745 service nova] Creating event network-changed:bcc0c44d-e45f-498d-aad0-498370ba2097 for instance 7ee38041-8e54-4fdb-909d-585952a4f5bd on hv-cinder-83979 May 14 15:50:56.942890 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: INFO nova.api.openstack.requestlog [req-a6ef30f3-dcd3-43be-b61c-02f654748938 req-e0b1c81d-be73-4d3d-b1b4-97e3aa50f745 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038317 May 14 15:50:56.943797 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: [pid: 128729|app: 0|req: 320/656] 10.222.0.61 () {64 vars in 1317 bytes} [Sat May 14 15:50:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 14 15:50:57.410993 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi [req-93208b61-1069-4454-b32e-3ff2847d9df6 req-823c61dd-d454-47bd-9f58-43dc0d866eb3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e33e9970-bfb7-46f3-8d40-782dbfa3d21c", "name": "network-vif-plugged", "status": "completed", "tag": "759be0ca-daaf-4eba-97b6-a252b70cbb3b"}]} {{(pid=128728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 15:50:57.419286 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [req-93208b61-1069-4454-b32e-3ff2847d9df6 req-823c61dd-d454-47bd-9f58-43dc0d866eb3 service nova] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:50:57.419767 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [req-93208b61-1069-4454-b32e-3ff2847d9df6 req-823c61dd-d454-47bd-9f58-43dc0d866eb3 service nova] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:50:57.431444 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: INFO nova.api.openstack.compute.server_external_events [req-93208b61-1069-4454-b32e-3ff2847d9df6 req-823c61dd-d454-47bd-9f58-43dc0d866eb3 service nova] Creating event network-vif-plugged:759be0ca-daaf-4eba-97b6-a252b70cbb3b for instance e33e9970-bfb7-46f3-8d40-782dbfa3d21c on hv-cinder-83979 May 14 15:50:57.437153 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: INFO nova.api.openstack.requestlog [req-93208b61-1069-4454-b32e-3ff2847d9df6 req-823c61dd-d454-47bd-9f58-43dc0d866eb3 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033446 May 14 15:50:57.437757 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: [pid: 128728|app: 0|req: 337/657] 10.222.0.61 () {64 vars in 1317 bytes} [Sat May 14 15:50:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 14 15:50:57.509835 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi [None req-c3e51fbd-c04a-48bb-9875-cc035a4572eb tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Calling method '>' {{(pid=128729) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 15:50:57.510561 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.compute.api [None req-c3e51fbd-c04a-48bb-9875-cc035a4572eb tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] [instance: e33e9970-bfb7-46f3-8d40-782dbfa3d21c] Fetching instance by UUID {{(pid=128729) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 15:50:57.517571 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-c3e51fbd-c04a-48bb-9875-cc035a4572eb tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:50:57.517966 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-c3e51fbd-c04a-48bb-9875-cc035a4572eb tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:50:57.518771 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-c3e51fbd-c04a-48bb-9875-cc035a4572eb tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:50:57.519207 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-c3e51fbd-c04a-48bb-9875-cc035a4572eb tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:50:57.646699 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.policy [None req-c3e51fbd-c04a-48bb-9875-cc035a4572eb tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58bfb7417bc94583963401ae0fe9d39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0672be3fa3f7414da1c1a5b7300abbe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128729) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:50:57.654391 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.policy [None req-c3e51fbd-c04a-48bb-9875-cc035a4572eb tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58bfb7417bc94583963401ae0fe9d39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0672be3fa3f7414da1c1a5b7300abbe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128729) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:50:57.656087 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.policy [None req-c3e51fbd-c04a-48bb-9875-cc035a4572eb tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58bfb7417bc94583963401ae0fe9d39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0672be3fa3f7414da1c1a5b7300abbe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128729) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:50:57.657227 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: INFO nova.api.openstack.requestlog [None req-c3e51fbd-c04a-48bb-9875-cc035a4572eb tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] 10.222.0.61 "GET /compute/v2.1/servers/e33e9970-bfb7-46f3-8d40-782dbfa3d21c" status: 200 len: 1743 microversion: 2.20 time: 0.152230 May 14 15:50:57.657907 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: [pid: 128729|app: 0|req: 321/658] 10.222.0.61 () {60 vars in 1276 bytes} [Sat May 14 15:50:57 2022] GET /compute/v2.1/servers/e33e9970-bfb7-46f3-8d40-782dbfa3d21c => generated 1743 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 14 15:50:57.694819 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi [None req-b671ed04-11f9-4c1d-9030-b8d61c27253b tempest-TestVolumeBootPattern-2062489882 tempest-TestVolumeBootPattern-2062489882-project] Calling method '>' {{(pid=128728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 15:50:57.695652 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.compute.api [None req-b671ed04-11f9-4c1d-9030-b8d61c27253b tempest-TestVolumeBootPattern-2062489882 tempest-TestVolumeBootPattern-2062489882-project] [instance: 7ee38041-8e54-4fdb-909d-585952a4f5bd] Fetching instance by UUID {{(pid=128728) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 15:50:57.703263 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-b671ed04-11f9-4c1d-9030-b8d61c27253b tempest-TestVolumeBootPattern-2062489882 tempest-TestVolumeBootPattern-2062489882-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:50:57.703768 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-b671ed04-11f9-4c1d-9030-b8d61c27253b tempest-TestVolumeBootPattern-2062489882 tempest-TestVolumeBootPattern-2062489882-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:50:57.704666 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-b671ed04-11f9-4c1d-9030-b8d61c27253b tempest-TestVolumeBootPattern-2062489882 tempest-TestVolumeBootPattern-2062489882-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:50:57.705095 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-b671ed04-11f9-4c1d-9030-b8d61c27253b tempest-TestVolumeBootPattern-2062489882 tempest-TestVolumeBootPattern-2062489882-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:50:57.844432 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.policy [None req-b671ed04-11f9-4c1d-9030-b8d61c27253b tempest-TestVolumeBootPattern-2062489882 tempest-TestVolumeBootPattern-2062489882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '568f6783dd4d43398a70a9ffa58ff660', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a3a2b5dee7a404a8445c8aa434b5a43', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128728) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:50:57.851880 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: INFO nova.api.openstack.requestlog [None req-b671ed04-11f9-4c1d-9030-b8d61c27253b tempest-TestVolumeBootPattern-2062489882 tempest-TestVolumeBootPattern-2062489882-project] 10.222.0.61 "GET /compute/v2.1/servers/7ee38041-8e54-4fdb-909d-585952a4f5bd" status: 200 len: 1266 microversion: 2.1 time: 0.161914 May 14 15:50:57.852436 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: [pid: 128728|app: 0|req: 338/659] 10.222.0.61 () {58 vars in 1235 bytes} [Sat May 14 15:50:57 2022] GET /compute/v2.1/servers/7ee38041-8e54-4fdb-909d-585952a4f5bd => generated 1266 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 15:50:58.676931 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi [None req-4732cd93-11ea-463e-8304-cd9593984a4b tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Calling method '>' {{(pid=128729) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 15:50:58.677556 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.compute.api [None req-4732cd93-11ea-463e-8304-cd9593984a4b tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] [instance: e33e9970-bfb7-46f3-8d40-782dbfa3d21c] Fetching instance by UUID {{(pid=128729) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 15:50:58.683940 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-4732cd93-11ea-463e-8304-cd9593984a4b tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:50:58.684386 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-4732cd93-11ea-463e-8304-cd9593984a4b tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:50:58.685164 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-4732cd93-11ea-463e-8304-cd9593984a4b tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:50:58.686013 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-4732cd93-11ea-463e-8304-cd9593984a4b tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:50:58.819410 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.policy [None req-4732cd93-11ea-463e-8304-cd9593984a4b tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58bfb7417bc94583963401ae0fe9d39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0672be3fa3f7414da1c1a5b7300abbe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128729) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:50:58.828975 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.policy [None req-4732cd93-11ea-463e-8304-cd9593984a4b tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58bfb7417bc94583963401ae0fe9d39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0672be3fa3f7414da1c1a5b7300abbe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128729) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:50:58.830711 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.policy [None req-4732cd93-11ea-463e-8304-cd9593984a4b tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58bfb7417bc94583963401ae0fe9d39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0672be3fa3f7414da1c1a5b7300abbe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128729) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:50:58.832488 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: INFO nova.api.openstack.requestlog [None req-4732cd93-11ea-463e-8304-cd9593984a4b tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] 10.222.0.61 "GET /compute/v2.1/servers/e33e9970-bfb7-46f3-8d40-782dbfa3d21c" status: 200 len: 1743 microversion: 2.20 time: 0.159673 May 14 15:50:58.833052 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: [pid: 128729|app: 0|req: 322/660] 10.222.0.61 () {60 vars in 1276 bytes} [Sat May 14 15:50:58 2022] GET /compute/v2.1/servers/e33e9970-bfb7-46f3-8d40-782dbfa3d21c => generated 1743 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 14 15:50:58.871222 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi [None req-5bd6a3fe-bfc3-4290-9597-642997e7a2f7 tempest-TestVolumeBootPattern-2062489882 tempest-TestVolumeBootPattern-2062489882-project] Calling method '>' {{(pid=128728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 15:50:58.872494 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.compute.api [None req-5bd6a3fe-bfc3-4290-9597-642997e7a2f7 tempest-TestVolumeBootPattern-2062489882 tempest-TestVolumeBootPattern-2062489882-project] [instance: 7ee38041-8e54-4fdb-909d-585952a4f5bd] Fetching instance by UUID {{(pid=128728) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 15:50:58.879432 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-5bd6a3fe-bfc3-4290-9597-642997e7a2f7 tempest-TestVolumeBootPattern-2062489882 tempest-TestVolumeBootPattern-2062489882-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:50:58.879885 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-5bd6a3fe-bfc3-4290-9597-642997e7a2f7 tempest-TestVolumeBootPattern-2062489882 tempest-TestVolumeBootPattern-2062489882-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:50:58.880664 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-5bd6a3fe-bfc3-4290-9597-642997e7a2f7 tempest-TestVolumeBootPattern-2062489882 tempest-TestVolumeBootPattern-2062489882-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:50:58.881100 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-5bd6a3fe-bfc3-4290-9597-642997e7a2f7 tempest-TestVolumeBootPattern-2062489882 tempest-TestVolumeBootPattern-2062489882-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:50:59.018710 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.policy [None req-5bd6a3fe-bfc3-4290-9597-642997e7a2f7 tempest-TestVolumeBootPattern-2062489882 tempest-TestVolumeBootPattern-2062489882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '568f6783dd4d43398a70a9ffa58ff660', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a3a2b5dee7a404a8445c8aa434b5a43', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128728) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:50:59.026210 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: INFO nova.api.openstack.requestlog [None req-5bd6a3fe-bfc3-4290-9597-642997e7a2f7 tempest-TestVolumeBootPattern-2062489882 tempest-TestVolumeBootPattern-2062489882-project] 10.222.0.61 "GET /compute/v2.1/servers/7ee38041-8e54-4fdb-909d-585952a4f5bd" status: 200 len: 1266 microversion: 2.1 time: 0.160038 May 14 15:50:59.026816 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: [pid: 128728|app: 0|req: 339/661] 10.222.0.61 () {58 vars in 1235 bytes} [Sat May 14 15:50:58 2022] GET /compute/v2.1/servers/7ee38041-8e54-4fdb-909d-585952a4f5bd => generated 1266 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 15:50:59.851182 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi [None req-465102f2-41ba-439d-8e64-cee068c43fb3 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Calling method '>' {{(pid=128729) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 15:50:59.851854 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.compute.api [None req-465102f2-41ba-439d-8e64-cee068c43fb3 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] [instance: e33e9970-bfb7-46f3-8d40-782dbfa3d21c] Fetching instance by UUID {{(pid=128729) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 15:50:59.859189 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-465102f2-41ba-439d-8e64-cee068c43fb3 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:50:59.859641 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-465102f2-41ba-439d-8e64-cee068c43fb3 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:50:59.860420 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-465102f2-41ba-439d-8e64-cee068c43fb3 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:50:59.860861 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-465102f2-41ba-439d-8e64-cee068c43fb3 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:50:59.996310 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.policy [None req-465102f2-41ba-439d-8e64-cee068c43fb3 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58bfb7417bc94583963401ae0fe9d39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0672be3fa3f7414da1c1a5b7300abbe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128729) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:51:00.004498 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.policy [None req-465102f2-41ba-439d-8e64-cee068c43fb3 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58bfb7417bc94583963401ae0fe9d39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0672be3fa3f7414da1c1a5b7300abbe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128729) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:51:00.006000 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.policy [None req-465102f2-41ba-439d-8e64-cee068c43fb3 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58bfb7417bc94583963401ae0fe9d39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0672be3fa3f7414da1c1a5b7300abbe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128729) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:51:00.007176 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: INFO nova.api.openstack.requestlog [None req-465102f2-41ba-439d-8e64-cee068c43fb3 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] 10.222.0.61 "GET /compute/v2.1/servers/e33e9970-bfb7-46f3-8d40-782dbfa3d21c" status: 200 len: 1743 microversion: 2.20 time: 0.160007 May 14 15:51:00.007742 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: [pid: 128729|app: 0|req: 323/662] 10.222.0.61 () {60 vars in 1276 bytes} [Sat May 14 15:50:59 2022] GET /compute/v2.1/servers/e33e9970-bfb7-46f3-8d40-782dbfa3d21c => generated 1743 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 14 15:51:00.045197 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi [None req-f623e914-ab15-4e2d-ad1e-72d4408302bc tempest-TestVolumeBootPattern-2062489882 tempest-TestVolumeBootPattern-2062489882-project] Calling method '>' {{(pid=128728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 15:51:00.046620 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.compute.api [None req-f623e914-ab15-4e2d-ad1e-72d4408302bc tempest-TestVolumeBootPattern-2062489882 tempest-TestVolumeBootPattern-2062489882-project] [instance: 7ee38041-8e54-4fdb-909d-585952a4f5bd] Fetching instance by UUID {{(pid=128728) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 15:51:00.054741 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-f623e914-ab15-4e2d-ad1e-72d4408302bc tempest-TestVolumeBootPattern-2062489882 tempest-TestVolumeBootPattern-2062489882-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:51:00.055198 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-f623e914-ab15-4e2d-ad1e-72d4408302bc tempest-TestVolumeBootPattern-2062489882 tempest-TestVolumeBootPattern-2062489882-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:51:00.055986 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-f623e914-ab15-4e2d-ad1e-72d4408302bc tempest-TestVolumeBootPattern-2062489882 tempest-TestVolumeBootPattern-2062489882-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:51:00.056427 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-f623e914-ab15-4e2d-ad1e-72d4408302bc tempest-TestVolumeBootPattern-2062489882 tempest-TestVolumeBootPattern-2062489882-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:51:00.208072 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.policy [None req-f623e914-ab15-4e2d-ad1e-72d4408302bc tempest-TestVolumeBootPattern-2062489882 tempest-TestVolumeBootPattern-2062489882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '568f6783dd4d43398a70a9ffa58ff660', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a3a2b5dee7a404a8445c8aa434b5a43', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128728) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:51:00.215845 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: INFO nova.api.openstack.requestlog [None req-f623e914-ab15-4e2d-ad1e-72d4408302bc tempest-TestVolumeBootPattern-2062489882 tempest-TestVolumeBootPattern-2062489882-project] 10.222.0.61 "GET /compute/v2.1/servers/7ee38041-8e54-4fdb-909d-585952a4f5bd" status: 200 len: 1266 microversion: 2.1 time: 0.174929 May 14 15:51:00.216675 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: [pid: 128728|app: 0|req: 340/663] 10.222.0.61 () {58 vars in 1235 bytes} [Sat May 14 15:51:00 2022] GET /compute/v2.1/servers/7ee38041-8e54-4fdb-909d-585952a4f5bd => generated 1266 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 15:51:01.028694 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi [None req-496b64c6-c344-4734-a7d0-d36ebf049213 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Calling method '>' {{(pid=128729) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 15:51:01.029986 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.compute.api [None req-496b64c6-c344-4734-a7d0-d36ebf049213 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] [instance: e33e9970-bfb7-46f3-8d40-782dbfa3d21c] Fetching instance by UUID {{(pid=128729) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 15:51:01.036965 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-496b64c6-c344-4734-a7d0-d36ebf049213 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:51:01.037721 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-496b64c6-c344-4734-a7d0-d36ebf049213 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:51:01.039035 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-496b64c6-c344-4734-a7d0-d36ebf049213 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:51:01.039673 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-496b64c6-c344-4734-a7d0-d36ebf049213 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:51:01.199498 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.policy [None req-496b64c6-c344-4734-a7d0-d36ebf049213 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58bfb7417bc94583963401ae0fe9d39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0672be3fa3f7414da1c1a5b7300abbe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128729) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:51:01.209142 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.policy [None req-496b64c6-c344-4734-a7d0-d36ebf049213 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58bfb7417bc94583963401ae0fe9d39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0672be3fa3f7414da1c1a5b7300abbe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128729) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:51:01.211133 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.policy [None req-496b64c6-c344-4734-a7d0-d36ebf049213 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58bfb7417bc94583963401ae0fe9d39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0672be3fa3f7414da1c1a5b7300abbe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128729) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:51:01.212305 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: INFO nova.api.openstack.requestlog [None req-496b64c6-c344-4734-a7d0-d36ebf049213 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] 10.222.0.61 "GET /compute/v2.1/servers/e33e9970-bfb7-46f3-8d40-782dbfa3d21c" status: 200 len: 1738 microversion: 2.20 time: 0.189453 May 14 15:51:01.212850 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: [pid: 128729|app: 0|req: 324/664] 10.222.0.61 () {60 vars in 1276 bytes} [Sat May 14 15:51:01 2022] GET /compute/v2.1/servers/e33e9970-bfb7-46f3-8d40-782dbfa3d21c => generated 1738 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 14 15:51:01.233728 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi [None req-fee0d498-d90e-46e4-82c5-9a3adfb0029e tempest-TestVolumeBootPattern-2062489882 tempest-TestVolumeBootPattern-2062489882-project] Calling method '>' {{(pid=128728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 15:51:01.234808 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.compute.api [None req-fee0d498-d90e-46e4-82c5-9a3adfb0029e tempest-TestVolumeBootPattern-2062489882 tempest-TestVolumeBootPattern-2062489882-project] [instance: 7ee38041-8e54-4fdb-909d-585952a4f5bd] Fetching instance by UUID {{(pid=128728) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 15:51:01.243699 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-fee0d498-d90e-46e4-82c5-9a3adfb0029e tempest-TestVolumeBootPattern-2062489882 tempest-TestVolumeBootPattern-2062489882-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:51:01.244063 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-fee0d498-d90e-46e4-82c5-9a3adfb0029e tempest-TestVolumeBootPattern-2062489882 tempest-TestVolumeBootPattern-2062489882-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:51:01.245035 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-fee0d498-d90e-46e4-82c5-9a3adfb0029e tempest-TestVolumeBootPattern-2062489882 tempest-TestVolumeBootPattern-2062489882-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:51:01.245470 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-fee0d498-d90e-46e4-82c5-9a3adfb0029e tempest-TestVolumeBootPattern-2062489882 tempest-TestVolumeBootPattern-2062489882-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:51:01.459966 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.policy [None req-fee0d498-d90e-46e4-82c5-9a3adfb0029e tempest-TestVolumeBootPattern-2062489882 tempest-TestVolumeBootPattern-2062489882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '568f6783dd4d43398a70a9ffa58ff660', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a3a2b5dee7a404a8445c8aa434b5a43', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128728) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:51:01.469378 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: INFO nova.api.openstack.requestlog [None req-fee0d498-d90e-46e4-82c5-9a3adfb0029e tempest-TestVolumeBootPattern-2062489882 tempest-TestVolumeBootPattern-2062489882-project] 10.222.0.61 "GET /compute/v2.1/servers/7ee38041-8e54-4fdb-909d-585952a4f5bd" status: 200 len: 1266 microversion: 2.1 time: 0.240437 May 14 15:51:01.470551 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: [pid: 128728|app: 0|req: 341/665] 10.222.0.61 () {58 vars in 1235 bytes} [Sat May 14 15:51:01 2022] GET /compute/v2.1/servers/7ee38041-8e54-4fdb-909d-585952a4f5bd => generated 1266 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 15:51:02.235479 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi [None req-f3334c2a-421f-462b-92d5-98324da33916 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Calling method '>' {{(pid=128729) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 15:51:02.236121 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.compute.api [None req-f3334c2a-421f-462b-92d5-98324da33916 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] [instance: e33e9970-bfb7-46f3-8d40-782dbfa3d21c] Fetching instance by UUID {{(pid=128729) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 15:51:02.247227 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-f3334c2a-421f-462b-92d5-98324da33916 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:51:02.248250 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-f3334c2a-421f-462b-92d5-98324da33916 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:51:02.249336 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-f3334c2a-421f-462b-92d5-98324da33916 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:51:02.251567 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-f3334c2a-421f-462b-92d5-98324da33916 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:51:02.417163 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.policy [None req-f3334c2a-421f-462b-92d5-98324da33916 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58bfb7417bc94583963401ae0fe9d39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0672be3fa3f7414da1c1a5b7300abbe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128729) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:51:02.426493 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.policy [None req-f3334c2a-421f-462b-92d5-98324da33916 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58bfb7417bc94583963401ae0fe9d39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0672be3fa3f7414da1c1a5b7300abbe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128729) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:51:02.427845 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.policy [None req-f3334c2a-421f-462b-92d5-98324da33916 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58bfb7417bc94583963401ae0fe9d39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0672be3fa3f7414da1c1a5b7300abbe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128729) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:51:02.429047 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: INFO nova.api.openstack.requestlog [None req-f3334c2a-421f-462b-92d5-98324da33916 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] 10.222.0.61 "GET /compute/v2.1/servers/e33e9970-bfb7-46f3-8d40-782dbfa3d21c" status: 200 len: 1738 microversion: 2.20 time: 0.199966 May 14 15:51:02.440989 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: [pid: 128729|app: 0|req: 325/666] 10.222.0.61 () {60 vars in 1276 bytes} [Sat May 14 15:51:02 2022] GET /compute/v2.1/servers/e33e9970-bfb7-46f3-8d40-782dbfa3d21c => generated 1738 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 14 15:51:02.491315 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi [None req-56d5c869-a7f0-4752-a7c2-9cc5affbffe9 tempest-TestVolumeBootPattern-2062489882 tempest-TestVolumeBootPattern-2062489882-project] Calling method '>' {{(pid=128728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 15:51:02.493161 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.compute.api [None req-56d5c869-a7f0-4752-a7c2-9cc5affbffe9 tempest-TestVolumeBootPattern-2062489882 tempest-TestVolumeBootPattern-2062489882-project] [instance: 7ee38041-8e54-4fdb-909d-585952a4f5bd] Fetching instance by UUID {{(pid=128728) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 15:51:02.500938 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-56d5c869-a7f0-4752-a7c2-9cc5affbffe9 tempest-TestVolumeBootPattern-2062489882 tempest-TestVolumeBootPattern-2062489882-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:51:02.501390 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-56d5c869-a7f0-4752-a7c2-9cc5affbffe9 tempest-TestVolumeBootPattern-2062489882 tempest-TestVolumeBootPattern-2062489882-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:51:02.502395 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-56d5c869-a7f0-4752-a7c2-9cc5affbffe9 tempest-TestVolumeBootPattern-2062489882 tempest-TestVolumeBootPattern-2062489882-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:51:02.502998 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-56d5c869-a7f0-4752-a7c2-9cc5affbffe9 tempest-TestVolumeBootPattern-2062489882 tempest-TestVolumeBootPattern-2062489882-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:51:02.685786 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.policy [None req-56d5c869-a7f0-4752-a7c2-9cc5affbffe9 tempest-TestVolumeBootPattern-2062489882 tempest-TestVolumeBootPattern-2062489882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '568f6783dd4d43398a70a9ffa58ff660', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a3a2b5dee7a404a8445c8aa434b5a43', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128728) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:51:02.696229 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: INFO nova.api.openstack.requestlog [None req-56d5c869-a7f0-4752-a7c2-9cc5affbffe9 tempest-TestVolumeBootPattern-2062489882 tempest-TestVolumeBootPattern-2062489882-project] 10.222.0.61 "GET /compute/v2.1/servers/7ee38041-8e54-4fdb-909d-585952a4f5bd" status: 200 len: 1266 microversion: 2.1 time: 0.210602 May 14 15:51:02.707438 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: [pid: 128728|app: 0|req: 342/667] 10.222.0.61 () {58 vars in 1235 bytes} [Sat May 14 15:51:02 2022] GET /compute/v2.1/servers/7ee38041-8e54-4fdb-909d-585952a4f5bd => generated 1266 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 15:51:03.448665 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi [None req-c4b314e1-a2ca-400b-af3e-5d43ee0ec6ed tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Calling method '>' {{(pid=128729) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 15:51:03.449467 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.compute.api [None req-c4b314e1-a2ca-400b-af3e-5d43ee0ec6ed tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] [instance: e33e9970-bfb7-46f3-8d40-782dbfa3d21c] Fetching instance by UUID {{(pid=128729) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 15:51:03.459085 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-c4b314e1-a2ca-400b-af3e-5d43ee0ec6ed tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:51:03.459809 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-c4b314e1-a2ca-400b-af3e-5d43ee0ec6ed tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:51:03.460603 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-c4b314e1-a2ca-400b-af3e-5d43ee0ec6ed tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:51:03.461051 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-c4b314e1-a2ca-400b-af3e-5d43ee0ec6ed tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:51:03.627781 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.policy [None req-c4b314e1-a2ca-400b-af3e-5d43ee0ec6ed tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58bfb7417bc94583963401ae0fe9d39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0672be3fa3f7414da1c1a5b7300abbe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128729) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:51:03.636734 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.policy [None req-c4b314e1-a2ca-400b-af3e-5d43ee0ec6ed tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58bfb7417bc94583963401ae0fe9d39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0672be3fa3f7414da1c1a5b7300abbe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128729) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:51:03.638394 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.policy [None req-c4b314e1-a2ca-400b-af3e-5d43ee0ec6ed tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58bfb7417bc94583963401ae0fe9d39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0672be3fa3f7414da1c1a5b7300abbe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128729) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:51:03.639924 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: INFO nova.api.openstack.requestlog [None req-c4b314e1-a2ca-400b-af3e-5d43ee0ec6ed tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] 10.222.0.61 "GET /compute/v2.1/servers/e33e9970-bfb7-46f3-8d40-782dbfa3d21c" status: 200 len: 1738 microversion: 2.20 time: 0.195262 May 14 15:51:03.640513 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: [pid: 128729|app: 0|req: 326/668] 10.222.0.61 () {60 vars in 1276 bytes} [Sat May 14 15:51:03 2022] GET /compute/v2.1/servers/e33e9970-bfb7-46f3-8d40-782dbfa3d21c => generated 1738 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 14 15:51:03.730046 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi [None req-7e752d2f-aeed-4ad5-bca0-4ea159820c63 tempest-TestVolumeBootPattern-2062489882 tempest-TestVolumeBootPattern-2062489882-project] Calling method '>' {{(pid=128728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 15:51:03.730760 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.compute.api [None req-7e752d2f-aeed-4ad5-bca0-4ea159820c63 tempest-TestVolumeBootPattern-2062489882 tempest-TestVolumeBootPattern-2062489882-project] [instance: 7ee38041-8e54-4fdb-909d-585952a4f5bd] Fetching instance by UUID {{(pid=128728) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 15:51:03.745280 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-7e752d2f-aeed-4ad5-bca0-4ea159820c63 tempest-TestVolumeBootPattern-2062489882 tempest-TestVolumeBootPattern-2062489882-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:51:03.746423 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-7e752d2f-aeed-4ad5-bca0-4ea159820c63 tempest-TestVolumeBootPattern-2062489882 tempest-TestVolumeBootPattern-2062489882-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:51:03.747742 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-7e752d2f-aeed-4ad5-bca0-4ea159820c63 tempest-TestVolumeBootPattern-2062489882 tempest-TestVolumeBootPattern-2062489882-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:51:03.753804 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-7e752d2f-aeed-4ad5-bca0-4ea159820c63 tempest-TestVolumeBootPattern-2062489882 tempest-TestVolumeBootPattern-2062489882-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:51:03.905895 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.policy [None req-7e752d2f-aeed-4ad5-bca0-4ea159820c63 tempest-TestVolumeBootPattern-2062489882 tempest-TestVolumeBootPattern-2062489882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '568f6783dd4d43398a70a9ffa58ff660', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a3a2b5dee7a404a8445c8aa434b5a43', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128728) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:51:03.914779 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: INFO nova.api.openstack.requestlog [None req-7e752d2f-aeed-4ad5-bca0-4ea159820c63 tempest-TestVolumeBootPattern-2062489882 tempest-TestVolumeBootPattern-2062489882-project] 10.222.0.61 "GET /compute/v2.1/servers/7ee38041-8e54-4fdb-909d-585952a4f5bd" status: 200 len: 1266 microversion: 2.1 time: 0.196186 May 14 15:51:03.915365 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: [pid: 128728|app: 0|req: 343/669] 10.222.0.61 () {58 vars in 1235 bytes} [Sat May 14 15:51:03 2022] GET /compute/v2.1/servers/7ee38041-8e54-4fdb-909d-585952a4f5bd => generated 1266 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 15:51:04.659461 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi [None req-973d23b3-c0a8-4970-b761-616ce77f0015 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Calling method '>' {{(pid=128729) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 15:51:04.660069 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.compute.api [None req-973d23b3-c0a8-4970-b761-616ce77f0015 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] [instance: e33e9970-bfb7-46f3-8d40-782dbfa3d21c] Fetching instance by UUID {{(pid=128729) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 15:51:04.666860 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-973d23b3-c0a8-4970-b761-616ce77f0015 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:51:04.667632 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-973d23b3-c0a8-4970-b761-616ce77f0015 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:51:04.668501 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-973d23b3-c0a8-4970-b761-616ce77f0015 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:51:04.669134 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-973d23b3-c0a8-4970-b761-616ce77f0015 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:51:04.845327 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.policy [None req-973d23b3-c0a8-4970-b761-616ce77f0015 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58bfb7417bc94583963401ae0fe9d39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0672be3fa3f7414da1c1a5b7300abbe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128729) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:51:04.854828 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.policy [None req-973d23b3-c0a8-4970-b761-616ce77f0015 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58bfb7417bc94583963401ae0fe9d39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0672be3fa3f7414da1c1a5b7300abbe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128729) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:51:04.856624 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.policy [None req-973d23b3-c0a8-4970-b761-616ce77f0015 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58bfb7417bc94583963401ae0fe9d39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0672be3fa3f7414da1c1a5b7300abbe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128729) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:51:04.858942 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: INFO nova.api.openstack.requestlog [None req-973d23b3-c0a8-4970-b761-616ce77f0015 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] 10.222.0.61 "GET /compute/v2.1/servers/e33e9970-bfb7-46f3-8d40-782dbfa3d21c" status: 200 len: 1738 microversion: 2.20 time: 0.203361 May 14 15:51:04.860001 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: [pid: 128729|app: 0|req: 327/670] 10.222.0.61 () {60 vars in 1276 bytes} [Sat May 14 15:51:04 2022] GET /compute/v2.1/servers/e33e9970-bfb7-46f3-8d40-782dbfa3d21c => generated 1738 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 14 15:51:04.932256 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi [None req-99244000-ac8a-4157-b936-6725b4d55436 tempest-TestVolumeBootPattern-2062489882 tempest-TestVolumeBootPattern-2062489882-project] Calling method '>' {{(pid=128728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 15:51:04.932869 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.compute.api [None req-99244000-ac8a-4157-b936-6725b4d55436 tempest-TestVolumeBootPattern-2062489882 tempest-TestVolumeBootPattern-2062489882-project] [instance: 7ee38041-8e54-4fdb-909d-585952a4f5bd] Fetching instance by UUID {{(pid=128728) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 15:51:04.941869 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-99244000-ac8a-4157-b936-6725b4d55436 tempest-TestVolumeBootPattern-2062489882 tempest-TestVolumeBootPattern-2062489882-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:51:04.943228 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-99244000-ac8a-4157-b936-6725b4d55436 tempest-TestVolumeBootPattern-2062489882 tempest-TestVolumeBootPattern-2062489882-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:51:04.943228 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-99244000-ac8a-4157-b936-6725b4d55436 tempest-TestVolumeBootPattern-2062489882 tempest-TestVolumeBootPattern-2062489882-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:51:04.943564 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-99244000-ac8a-4157-b936-6725b4d55436 tempest-TestVolumeBootPattern-2062489882 tempest-TestVolumeBootPattern-2062489882-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:51:05.101704 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.policy [None req-99244000-ac8a-4157-b936-6725b4d55436 tempest-TestVolumeBootPattern-2062489882 tempest-TestVolumeBootPattern-2062489882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '568f6783dd4d43398a70a9ffa58ff660', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a3a2b5dee7a404a8445c8aa434b5a43', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128728) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:51:05.110792 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: INFO nova.api.openstack.requestlog [None req-99244000-ac8a-4157-b936-6725b4d55436 tempest-TestVolumeBootPattern-2062489882 tempest-TestVolumeBootPattern-2062489882-project] 10.222.0.61 "GET /compute/v2.1/servers/7ee38041-8e54-4fdb-909d-585952a4f5bd" status: 200 len: 1266 microversion: 2.1 time: 0.182320 May 14 15:51:05.111367 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: [pid: 128728|app: 0|req: 344/671] 10.222.0.61 () {58 vars in 1235 bytes} [Sat May 14 15:51:04 2022] GET /compute/v2.1/servers/7ee38041-8e54-4fdb-909d-585952a4f5bd => generated 1266 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 15:51:05.877819 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi [None req-3b6e3155-1070-440c-8fa9-61a04f508c75 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Calling method '>' {{(pid=128729) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 15:51:05.878612 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.compute.api [None req-3b6e3155-1070-440c-8fa9-61a04f508c75 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] [instance: e33e9970-bfb7-46f3-8d40-782dbfa3d21c] Fetching instance by UUID {{(pid=128729) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 15:51:05.885622 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-3b6e3155-1070-440c-8fa9-61a04f508c75 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:51:05.886186 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-3b6e3155-1070-440c-8fa9-61a04f508c75 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:51:05.887008 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-3b6e3155-1070-440c-8fa9-61a04f508c75 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:51:05.887618 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-3b6e3155-1070-440c-8fa9-61a04f508c75 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:51:06.026829 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.policy [None req-3b6e3155-1070-440c-8fa9-61a04f508c75 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58bfb7417bc94583963401ae0fe9d39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0672be3fa3f7414da1c1a5b7300abbe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128729) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:51:06.036312 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.policy [None req-3b6e3155-1070-440c-8fa9-61a04f508c75 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58bfb7417bc94583963401ae0fe9d39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0672be3fa3f7414da1c1a5b7300abbe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128729) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:51:06.038762 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.policy [None req-3b6e3155-1070-440c-8fa9-61a04f508c75 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58bfb7417bc94583963401ae0fe9d39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0672be3fa3f7414da1c1a5b7300abbe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128729) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:51:06.040254 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: INFO nova.api.openstack.requestlog [None req-3b6e3155-1070-440c-8fa9-61a04f508c75 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] 10.222.0.61 "GET /compute/v2.1/servers/e33e9970-bfb7-46f3-8d40-782dbfa3d21c" status: 200 len: 1738 microversion: 2.20 time: 0.166445 May 14 15:51:06.040954 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: [pid: 128729|app: 0|req: 328/672] 10.222.0.61 () {60 vars in 1276 bytes} [Sat May 14 15:51:05 2022] GET /compute/v2.1/servers/e33e9970-bfb7-46f3-8d40-782dbfa3d21c => generated 1738 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 14 15:51:06.131198 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi [None req-b864184b-d45b-4e99-8e24-7e69304b962f tempest-TestVolumeBootPattern-2062489882 tempest-TestVolumeBootPattern-2062489882-project] Calling method '>' {{(pid=128728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 15:51:06.132055 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.compute.api [None req-b864184b-d45b-4e99-8e24-7e69304b962f tempest-TestVolumeBootPattern-2062489882 tempest-TestVolumeBootPattern-2062489882-project] [instance: 7ee38041-8e54-4fdb-909d-585952a4f5bd] Fetching instance by UUID {{(pid=128728) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 15:51:06.140882 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-b864184b-d45b-4e99-8e24-7e69304b962f tempest-TestVolumeBootPattern-2062489882 tempest-TestVolumeBootPattern-2062489882-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:51:06.141369 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-b864184b-d45b-4e99-8e24-7e69304b962f tempest-TestVolumeBootPattern-2062489882 tempest-TestVolumeBootPattern-2062489882-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:51:06.142250 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-b864184b-d45b-4e99-8e24-7e69304b962f tempest-TestVolumeBootPattern-2062489882 tempest-TestVolumeBootPattern-2062489882-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:51:06.142770 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-b864184b-d45b-4e99-8e24-7e69304b962f tempest-TestVolumeBootPattern-2062489882 tempest-TestVolumeBootPattern-2062489882-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:51:06.296769 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.policy [None req-b864184b-d45b-4e99-8e24-7e69304b962f tempest-TestVolumeBootPattern-2062489882 tempest-TestVolumeBootPattern-2062489882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '568f6783dd4d43398a70a9ffa58ff660', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a3a2b5dee7a404a8445c8aa434b5a43', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128728) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:51:06.304234 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: INFO nova.api.openstack.requestlog [None req-b864184b-d45b-4e99-8e24-7e69304b962f tempest-TestVolumeBootPattern-2062489882 tempest-TestVolumeBootPattern-2062489882-project] 10.222.0.61 "GET /compute/v2.1/servers/7ee38041-8e54-4fdb-909d-585952a4f5bd" status: 200 len: 1266 microversion: 2.1 time: 0.177556 May 14 15:51:06.304801 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: [pid: 128728|app: 0|req: 345/673] 10.222.0.61 () {58 vars in 1235 bytes} [Sat May 14 15:51:06 2022] GET /compute/v2.1/servers/7ee38041-8e54-4fdb-909d-585952a4f5bd => generated 1266 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 15:51:07.061193 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi [None req-a9d3cae8-c812-4836-9ae0-55d28fd91e4a tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Calling method '>' {{(pid=128729) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 15:51:07.062159 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.compute.api [None req-a9d3cae8-c812-4836-9ae0-55d28fd91e4a tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] [instance: e33e9970-bfb7-46f3-8d40-782dbfa3d21c] Fetching instance by UUID {{(pid=128729) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 15:51:07.083778 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-a9d3cae8-c812-4836-9ae0-55d28fd91e4a tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:51:07.084558 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-a9d3cae8-c812-4836-9ae0-55d28fd91e4a tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:51:07.085359 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-a9d3cae8-c812-4836-9ae0-55d28fd91e4a tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:51:07.085834 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-a9d3cae8-c812-4836-9ae0-55d28fd91e4a tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:51:07.251422 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.policy [None req-a9d3cae8-c812-4836-9ae0-55d28fd91e4a tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58bfb7417bc94583963401ae0fe9d39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0672be3fa3f7414da1c1a5b7300abbe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128729) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:51:07.264425 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.policy [None req-a9d3cae8-c812-4836-9ae0-55d28fd91e4a tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58bfb7417bc94583963401ae0fe9d39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0672be3fa3f7414da1c1a5b7300abbe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128729) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:51:07.264425 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.policy [None req-a9d3cae8-c812-4836-9ae0-55d28fd91e4a tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58bfb7417bc94583963401ae0fe9d39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0672be3fa3f7414da1c1a5b7300abbe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128729) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:51:07.264843 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: INFO nova.api.openstack.requestlog [None req-a9d3cae8-c812-4836-9ae0-55d28fd91e4a tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] 10.222.0.61 "GET /compute/v2.1/servers/e33e9970-bfb7-46f3-8d40-782dbfa3d21c" status: 200 len: 1738 microversion: 2.20 time: 0.209552 May 14 15:51:07.279669 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: [pid: 128729|app: 0|req: 329/674] 10.222.0.61 () {60 vars in 1276 bytes} [Sat May 14 15:51:07 2022] GET /compute/v2.1/servers/e33e9970-bfb7-46f3-8d40-782dbfa3d21c => generated 1738 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 14 15:51:07.322045 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi [None req-b94aba85-8a1e-4ab5-94c0-f53ada91c988 tempest-TestVolumeBootPattern-2062489882 tempest-TestVolumeBootPattern-2062489882-project] Calling method '>' {{(pid=128728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 15:51:07.323185 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.compute.api [None req-b94aba85-8a1e-4ab5-94c0-f53ada91c988 tempest-TestVolumeBootPattern-2062489882 tempest-TestVolumeBootPattern-2062489882-project] [instance: 7ee38041-8e54-4fdb-909d-585952a4f5bd] Fetching instance by UUID {{(pid=128728) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 15:51:07.339551 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-b94aba85-8a1e-4ab5-94c0-f53ada91c988 tempest-TestVolumeBootPattern-2062489882 tempest-TestVolumeBootPattern-2062489882-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:51:07.340037 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-b94aba85-8a1e-4ab5-94c0-f53ada91c988 tempest-TestVolumeBootPattern-2062489882 tempest-TestVolumeBootPattern-2062489882-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:51:07.340919 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-b94aba85-8a1e-4ab5-94c0-f53ada91c988 tempest-TestVolumeBootPattern-2062489882 tempest-TestVolumeBootPattern-2062489882-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:51:07.341392 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-b94aba85-8a1e-4ab5-94c0-f53ada91c988 tempest-TestVolumeBootPattern-2062489882 tempest-TestVolumeBootPattern-2062489882-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:51:07.530017 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.policy [None req-b94aba85-8a1e-4ab5-94c0-f53ada91c988 tempest-TestVolumeBootPattern-2062489882 tempest-TestVolumeBootPattern-2062489882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '568f6783dd4d43398a70a9ffa58ff660', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a3a2b5dee7a404a8445c8aa434b5a43', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128728) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:51:07.542707 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: INFO nova.api.openstack.requestlog [None req-b94aba85-8a1e-4ab5-94c0-f53ada91c988 tempest-TestVolumeBootPattern-2062489882 tempest-TestVolumeBootPattern-2062489882-project] 10.222.0.61 "GET /compute/v2.1/servers/7ee38041-8e54-4fdb-909d-585952a4f5bd" status: 200 len: 1266 microversion: 2.1 time: 0.224888 May 14 15:51:07.553902 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: [pid: 128728|app: 0|req: 346/675] 10.222.0.61 () {58 vars in 1235 bytes} [Sat May 14 15:51:07 2022] GET /compute/v2.1/servers/7ee38041-8e54-4fdb-909d-585952a4f5bd => generated 1266 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 15:51:08.288989 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi [None req-4e2e4c6c-3eda-45f1-b940-696468e70bdc tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Calling method '>' {{(pid=128729) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 15:51:08.290597 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.compute.api [None req-4e2e4c6c-3eda-45f1-b940-696468e70bdc tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] [instance: e33e9970-bfb7-46f3-8d40-782dbfa3d21c] Fetching instance by UUID {{(pid=128729) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 15:51:08.299064 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-4e2e4c6c-3eda-45f1-b940-696468e70bdc tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:51:08.299915 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-4e2e4c6c-3eda-45f1-b940-696468e70bdc tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:51:08.301231 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-4e2e4c6c-3eda-45f1-b940-696468e70bdc tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:51:08.301897 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-4e2e4c6c-3eda-45f1-b940-696468e70bdc tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:51:08.464523 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.policy [None req-4e2e4c6c-3eda-45f1-b940-696468e70bdc tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58bfb7417bc94583963401ae0fe9d39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0672be3fa3f7414da1c1a5b7300abbe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128729) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:51:08.479938 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.policy [None req-4e2e4c6c-3eda-45f1-b940-696468e70bdc tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58bfb7417bc94583963401ae0fe9d39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0672be3fa3f7414da1c1a5b7300abbe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128729) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:51:08.481525 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.policy [None req-4e2e4c6c-3eda-45f1-b940-696468e70bdc tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58bfb7417bc94583963401ae0fe9d39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0672be3fa3f7414da1c1a5b7300abbe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128729) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:51:08.483427 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: INFO nova.api.openstack.requestlog [None req-4e2e4c6c-3eda-45f1-b940-696468e70bdc tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] 10.222.0.61 "GET /compute/v2.1/servers/e33e9970-bfb7-46f3-8d40-782dbfa3d21c" status: 200 len: 1738 microversion: 2.20 time: 0.198538 May 14 15:51:08.483980 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: [pid: 128729|app: 0|req: 330/676] 10.222.0.61 () {60 vars in 1276 bytes} [Sat May 14 15:51:08 2022] GET /compute/v2.1/servers/e33e9970-bfb7-46f3-8d40-782dbfa3d21c => generated 1738 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 14 15:51:08.561323 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi [None req-41abb666-6d31-4f99-9044-8037545750bf tempest-TestVolumeBootPattern-2062489882 tempest-TestVolumeBootPattern-2062489882-project] Calling method '>' {{(pid=128728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 15:51:08.561951 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.compute.api [None req-41abb666-6d31-4f99-9044-8037545750bf tempest-TestVolumeBootPattern-2062489882 tempest-TestVolumeBootPattern-2062489882-project] [instance: 7ee38041-8e54-4fdb-909d-585952a4f5bd] Fetching instance by UUID {{(pid=128728) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 15:51:08.568492 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-41abb666-6d31-4f99-9044-8037545750bf tempest-TestVolumeBootPattern-2062489882 tempest-TestVolumeBootPattern-2062489882-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:51:08.568947 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-41abb666-6d31-4f99-9044-8037545750bf tempest-TestVolumeBootPattern-2062489882 tempest-TestVolumeBootPattern-2062489882-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:51:08.569729 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-41abb666-6d31-4f99-9044-8037545750bf tempest-TestVolumeBootPattern-2062489882 tempest-TestVolumeBootPattern-2062489882-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:51:08.570171 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-41abb666-6d31-4f99-9044-8037545750bf tempest-TestVolumeBootPattern-2062489882 tempest-TestVolumeBootPattern-2062489882-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:51:08.727021 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.policy [None req-41abb666-6d31-4f99-9044-8037545750bf tempest-TestVolumeBootPattern-2062489882 tempest-TestVolumeBootPattern-2062489882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '568f6783dd4d43398a70a9ffa58ff660', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a3a2b5dee7a404a8445c8aa434b5a43', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128728) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:51:08.735689 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: INFO nova.api.openstack.requestlog [None req-41abb666-6d31-4f99-9044-8037545750bf tempest-TestVolumeBootPattern-2062489882 tempest-TestVolumeBootPattern-2062489882-project] 10.222.0.61 "GET /compute/v2.1/servers/7ee38041-8e54-4fdb-909d-585952a4f5bd" status: 200 len: 1266 microversion: 2.1 time: 0.178571 May 14 15:51:08.737125 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: [pid: 128728|app: 0|req: 347/677] 10.222.0.61 () {58 vars in 1235 bytes} [Sat May 14 15:51:08 2022] GET /compute/v2.1/servers/7ee38041-8e54-4fdb-909d-585952a4f5bd => generated 1266 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 15:51:09.504145 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi [None req-fdf083ef-973b-468f-85b4-36a403437471 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Calling method '>' {{(pid=128729) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 15:51:09.505432 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.compute.api [None req-fdf083ef-973b-468f-85b4-36a403437471 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] [instance: e33e9970-bfb7-46f3-8d40-782dbfa3d21c] Fetching instance by UUID {{(pid=128729) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 15:51:09.512164 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-fdf083ef-973b-468f-85b4-36a403437471 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:51:09.512919 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-fdf083ef-973b-468f-85b4-36a403437471 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:51:09.514454 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-fdf083ef-973b-468f-85b4-36a403437471 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:51:09.514963 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-fdf083ef-973b-468f-85b4-36a403437471 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:51:09.683680 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.policy [None req-fdf083ef-973b-468f-85b4-36a403437471 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58bfb7417bc94583963401ae0fe9d39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0672be3fa3f7414da1c1a5b7300abbe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128729) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:51:09.696819 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.policy [None req-fdf083ef-973b-468f-85b4-36a403437471 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58bfb7417bc94583963401ae0fe9d39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0672be3fa3f7414da1c1a5b7300abbe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128729) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:51:09.698398 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.policy [None req-fdf083ef-973b-468f-85b4-36a403437471 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58bfb7417bc94583963401ae0fe9d39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0672be3fa3f7414da1c1a5b7300abbe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128729) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:51:09.699565 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: INFO nova.api.openstack.requestlog [None req-fdf083ef-973b-468f-85b4-36a403437471 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] 10.222.0.61 "GET /compute/v2.1/servers/e33e9970-bfb7-46f3-8d40-782dbfa3d21c" status: 200 len: 1738 microversion: 2.20 time: 0.200060 May 14 15:51:09.700230 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: [pid: 128729|app: 0|req: 331/678] 10.222.0.61 () {60 vars in 1276 bytes} [Sat May 14 15:51:09 2022] GET /compute/v2.1/servers/e33e9970-bfb7-46f3-8d40-782dbfa3d21c => generated 1738 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 14 15:51:09.754413 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi [None req-427cb780-18b8-4255-be43-eb2d271d90d0 tempest-TestVolumeBootPattern-2062489882 tempest-TestVolumeBootPattern-2062489882-project] Calling method '>' {{(pid=128728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 15:51:09.755363 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.compute.api [None req-427cb780-18b8-4255-be43-eb2d271d90d0 tempest-TestVolumeBootPattern-2062489882 tempest-TestVolumeBootPattern-2062489882-project] [instance: 7ee38041-8e54-4fdb-909d-585952a4f5bd] Fetching instance by UUID {{(pid=128728) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 15:51:09.765600 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-427cb780-18b8-4255-be43-eb2d271d90d0 tempest-TestVolumeBootPattern-2062489882 tempest-TestVolumeBootPattern-2062489882-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:51:09.766335 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-427cb780-18b8-4255-be43-eb2d271d90d0 tempest-TestVolumeBootPattern-2062489882 tempest-TestVolumeBootPattern-2062489882-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:51:09.767293 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-427cb780-18b8-4255-be43-eb2d271d90d0 tempest-TestVolumeBootPattern-2062489882 tempest-TestVolumeBootPattern-2062489882-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:51:09.768072 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-427cb780-18b8-4255-be43-eb2d271d90d0 tempest-TestVolumeBootPattern-2062489882 tempest-TestVolumeBootPattern-2062489882-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:51:09.947838 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.policy [None req-427cb780-18b8-4255-be43-eb2d271d90d0 tempest-TestVolumeBootPattern-2062489882 tempest-TestVolumeBootPattern-2062489882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '568f6783dd4d43398a70a9ffa58ff660', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a3a2b5dee7a404a8445c8aa434b5a43', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128728) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:51:09.952165 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi [req-ca8f2e08-34b3-4973-a85e-87aff0f68948 req-5c411841-96a0-46ac-bfaf-be99280e7ee5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7ee38041-8e54-4fdb-909d-585952a4f5bd", "name": "network-vif-plugged", "status": "completed", "tag": "bcc0c44d-e45f-498d-aad0-498370ba2097"}]} {{(pid=128729) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 15:51:09.956713 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: INFO nova.api.openstack.requestlog [None req-427cb780-18b8-4255-be43-eb2d271d90d0 tempest-TestVolumeBootPattern-2062489882 tempest-TestVolumeBootPattern-2062489882-project] 10.222.0.61 "GET /compute/v2.1/servers/7ee38041-8e54-4fdb-909d-585952a4f5bd" status: 200 len: 1266 microversion: 2.1 time: 0.206962 May 14 15:51:09.970366 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [req-ca8f2e08-34b3-4973-a85e-87aff0f68948 req-5c411841-96a0-46ac-bfaf-be99280e7ee5 service nova] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:51:09.970366 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [req-ca8f2e08-34b3-4973-a85e-87aff0f68948 req-5c411841-96a0-46ac-bfaf-be99280e7ee5 service nova] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:51:09.970624 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: [pid: 128728|app: 0|req: 348/679] 10.222.0.61 () {58 vars in 1235 bytes} [Sat May 14 15:51:09 2022] GET /compute/v2.1/servers/7ee38041-8e54-4fdb-909d-585952a4f5bd => generated 1266 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 15:51:09.985522 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: INFO nova.api.openstack.compute.server_external_events [req-ca8f2e08-34b3-4973-a85e-87aff0f68948 req-5c411841-96a0-46ac-bfaf-be99280e7ee5 service nova] Creating event network-vif-plugged:bcc0c44d-e45f-498d-aad0-498370ba2097 for instance 7ee38041-8e54-4fdb-909d-585952a4f5bd on hv-cinder-83979 May 14 15:51:09.997618 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: INFO nova.api.openstack.requestlog [req-ca8f2e08-34b3-4973-a85e-87aff0f68948 req-5c411841-96a0-46ac-bfaf-be99280e7ee5 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049372 May 14 15:51:09.999258 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: [pid: 128729|app: 0|req: 332/680] 10.222.0.61 () {64 vars in 1317 bytes} [Sat May 14 15:51:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 14 15:51:10.719402 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi [None req-02193eca-e185-4744-86fa-97c4f2cac2a5 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Calling method '>' {{(pid=128728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 15:51:10.720450 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.compute.api [None req-02193eca-e185-4744-86fa-97c4f2cac2a5 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] [instance: e33e9970-bfb7-46f3-8d40-782dbfa3d21c] Fetching instance by UUID {{(pid=128728) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 15:51:10.726829 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-02193eca-e185-4744-86fa-97c4f2cac2a5 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:51:10.727374 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-02193eca-e185-4744-86fa-97c4f2cac2a5 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:51:10.728231 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-02193eca-e185-4744-86fa-97c4f2cac2a5 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:51:10.728750 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-02193eca-e185-4744-86fa-97c4f2cac2a5 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:51:10.900428 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.policy [None req-02193eca-e185-4744-86fa-97c4f2cac2a5 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58bfb7417bc94583963401ae0fe9d39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0672be3fa3f7414da1c1a5b7300abbe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128728) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:51:10.909212 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.policy [None req-02193eca-e185-4744-86fa-97c4f2cac2a5 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58bfb7417bc94583963401ae0fe9d39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0672be3fa3f7414da1c1a5b7300abbe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128728) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:51:10.911040 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.policy [None req-02193eca-e185-4744-86fa-97c4f2cac2a5 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58bfb7417bc94583963401ae0fe9d39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0672be3fa3f7414da1c1a5b7300abbe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128728) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:51:10.912633 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: INFO nova.api.openstack.requestlog [None req-02193eca-e185-4744-86fa-97c4f2cac2a5 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] 10.222.0.61 "GET /compute/v2.1/servers/e33e9970-bfb7-46f3-8d40-782dbfa3d21c" status: 200 len: 1738 microversion: 2.20 time: 0.197780 May 14 15:51:10.914351 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: [pid: 128728|app: 0|req: 349/681] 10.222.0.61 () {60 vars in 1276 bytes} [Sat May 14 15:51:10 2022] GET /compute/v2.1/servers/e33e9970-bfb7-46f3-8d40-782dbfa3d21c => generated 1738 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 14 15:51:10.975515 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi [None req-f5776ccc-dea8-4252-be94-d458bf270a54 tempest-TestVolumeBootPattern-2062489882 tempest-TestVolumeBootPattern-2062489882-project] Calling method '>' {{(pid=128729) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 15:51:10.976825 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.compute.api [None req-f5776ccc-dea8-4252-be94-d458bf270a54 tempest-TestVolumeBootPattern-2062489882 tempest-TestVolumeBootPattern-2062489882-project] [instance: 7ee38041-8e54-4fdb-909d-585952a4f5bd] Fetching instance by UUID {{(pid=128729) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 15:51:10.985245 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-f5776ccc-dea8-4252-be94-d458bf270a54 tempest-TestVolumeBootPattern-2062489882 tempest-TestVolumeBootPattern-2062489882-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:51:10.985786 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-f5776ccc-dea8-4252-be94-d458bf270a54 tempest-TestVolumeBootPattern-2062489882 tempest-TestVolumeBootPattern-2062489882-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:51:10.987173 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-f5776ccc-dea8-4252-be94-d458bf270a54 tempest-TestVolumeBootPattern-2062489882 tempest-TestVolumeBootPattern-2062489882-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:51:10.987844 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-f5776ccc-dea8-4252-be94-d458bf270a54 tempest-TestVolumeBootPattern-2062489882 tempest-TestVolumeBootPattern-2062489882-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:51:11.130060 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.policy [None req-f5776ccc-dea8-4252-be94-d458bf270a54 tempest-TestVolumeBootPattern-2062489882 tempest-TestVolumeBootPattern-2062489882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '568f6783dd4d43398a70a9ffa58ff660', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a3a2b5dee7a404a8445c8aa434b5a43', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128729) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:51:11.137498 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: INFO nova.api.openstack.requestlog [None req-f5776ccc-dea8-4252-be94-d458bf270a54 tempest-TestVolumeBootPattern-2062489882 tempest-TestVolumeBootPattern-2062489882-project] 10.222.0.61 "GET /compute/v2.1/servers/7ee38041-8e54-4fdb-909d-585952a4f5bd" status: 200 len: 1266 microversion: 2.1 time: 0.166479 May 14 15:51:11.138044 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: [pid: 128729|app: 0|req: 333/682] 10.222.0.61 () {58 vars in 1235 bytes} [Sat May 14 15:51:10 2022] GET /compute/v2.1/servers/7ee38041-8e54-4fdb-909d-585952a4f5bd => generated 1266 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 15:51:11.931807 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi [None req-c74af4d9-57fb-41b2-bfb0-680b3c2c0314 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Calling method '>' {{(pid=128728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 15:51:11.932343 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.compute.api [None req-c74af4d9-57fb-41b2-bfb0-680b3c2c0314 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] [instance: e33e9970-bfb7-46f3-8d40-782dbfa3d21c] Fetching instance by UUID {{(pid=128728) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 15:51:11.938751 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-c74af4d9-57fb-41b2-bfb0-680b3c2c0314 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:51:11.939245 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-c74af4d9-57fb-41b2-bfb0-680b3c2c0314 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:51:11.940004 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-c74af4d9-57fb-41b2-bfb0-680b3c2c0314 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:51:11.940434 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-c74af4d9-57fb-41b2-bfb0-680b3c2c0314 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:51:12.067943 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.policy [None req-c74af4d9-57fb-41b2-bfb0-680b3c2c0314 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58bfb7417bc94583963401ae0fe9d39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0672be3fa3f7414da1c1a5b7300abbe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128728) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:51:12.076109 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.policy [None req-c74af4d9-57fb-41b2-bfb0-680b3c2c0314 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58bfb7417bc94583963401ae0fe9d39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0672be3fa3f7414da1c1a5b7300abbe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128728) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:51:12.078022 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.policy [None req-c74af4d9-57fb-41b2-bfb0-680b3c2c0314 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58bfb7417bc94583963401ae0fe9d39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0672be3fa3f7414da1c1a5b7300abbe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128728) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:51:12.079192 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: INFO nova.api.openstack.requestlog [None req-c74af4d9-57fb-41b2-bfb0-680b3c2c0314 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] 10.222.0.61 "GET /compute/v2.1/servers/e33e9970-bfb7-46f3-8d40-782dbfa3d21c" status: 200 len: 1738 microversion: 2.20 time: 0.151899 May 14 15:51:12.079737 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: [pid: 128728|app: 0|req: 350/683] 10.222.0.61 () {60 vars in 1276 bytes} [Sat May 14 15:51:11 2022] GET /compute/v2.1/servers/e33e9970-bfb7-46f3-8d40-782dbfa3d21c => generated 1738 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 14 15:51:12.154560 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi [None req-0d4d05cd-ae1b-406b-bae1-dbf5ba88230a tempest-TestVolumeBootPattern-2062489882 tempest-TestVolumeBootPattern-2062489882-project] Calling method '>' {{(pid=128729) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 15:51:12.155279 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.compute.api [None req-0d4d05cd-ae1b-406b-bae1-dbf5ba88230a tempest-TestVolumeBootPattern-2062489882 tempest-TestVolumeBootPattern-2062489882-project] [instance: 7ee38041-8e54-4fdb-909d-585952a4f5bd] Fetching instance by UUID {{(pid=128729) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 15:51:12.161516 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-0d4d05cd-ae1b-406b-bae1-dbf5ba88230a tempest-TestVolumeBootPattern-2062489882 tempest-TestVolumeBootPattern-2062489882-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:51:12.161968 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-0d4d05cd-ae1b-406b-bae1-dbf5ba88230a tempest-TestVolumeBootPattern-2062489882 tempest-TestVolumeBootPattern-2062489882-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:51:12.162795 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-0d4d05cd-ae1b-406b-bae1-dbf5ba88230a tempest-TestVolumeBootPattern-2062489882 tempest-TestVolumeBootPattern-2062489882-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:51:12.163229 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-0d4d05cd-ae1b-406b-bae1-dbf5ba88230a tempest-TestVolumeBootPattern-2062489882 tempest-TestVolumeBootPattern-2062489882-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:51:12.316607 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.policy [None req-0d4d05cd-ae1b-406b-bae1-dbf5ba88230a tempest-TestVolumeBootPattern-2062489882 tempest-TestVolumeBootPattern-2062489882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '568f6783dd4d43398a70a9ffa58ff660', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a3a2b5dee7a404a8445c8aa434b5a43', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128729) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:51:12.327534 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: INFO nova.api.openstack.requestlog [None req-0d4d05cd-ae1b-406b-bae1-dbf5ba88230a tempest-TestVolumeBootPattern-2062489882 tempest-TestVolumeBootPattern-2062489882-project] 10.222.0.61 "GET /compute/v2.1/servers/7ee38041-8e54-4fdb-909d-585952a4f5bd" status: 200 len: 1266 microversion: 2.1 time: 0.176734 May 14 15:51:12.329714 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: [pid: 128729|app: 0|req: 334/684] 10.222.0.61 () {58 vars in 1235 bytes} [Sat May 14 15:51:12 2022] GET /compute/v2.1/servers/7ee38041-8e54-4fdb-909d-585952a4f5bd => generated 1266 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 15:51:13.097462 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi [None req-1007626f-438e-4995-85f6-941049b73d9a tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Calling method '>' {{(pid=128728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 15:51:13.098074 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.compute.api [None req-1007626f-438e-4995-85f6-941049b73d9a tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] [instance: e33e9970-bfb7-46f3-8d40-782dbfa3d21c] Fetching instance by UUID {{(pid=128728) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 15:51:13.104520 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-1007626f-438e-4995-85f6-941049b73d9a tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:51:13.105048 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-1007626f-438e-4995-85f6-941049b73d9a tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:51:13.105999 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-1007626f-438e-4995-85f6-941049b73d9a tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:51:13.106473 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-1007626f-438e-4995-85f6-941049b73d9a tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:51:13.246253 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.policy [None req-1007626f-438e-4995-85f6-941049b73d9a tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58bfb7417bc94583963401ae0fe9d39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0672be3fa3f7414da1c1a5b7300abbe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128728) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:51:13.254416 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.policy [None req-1007626f-438e-4995-85f6-941049b73d9a tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58bfb7417bc94583963401ae0fe9d39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0672be3fa3f7414da1c1a5b7300abbe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128728) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:51:13.255930 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.policy [None req-1007626f-438e-4995-85f6-941049b73d9a tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58bfb7417bc94583963401ae0fe9d39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0672be3fa3f7414da1c1a5b7300abbe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128728) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:51:13.257099 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: INFO nova.api.openstack.requestlog [None req-1007626f-438e-4995-85f6-941049b73d9a tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] 10.222.0.61 "GET /compute/v2.1/servers/e33e9970-bfb7-46f3-8d40-782dbfa3d21c" status: 200 len: 1720 microversion: 2.20 time: 0.163574 May 14 15:51:13.257671 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: [pid: 128728|app: 0|req: 351/685] 10.222.0.61 () {60 vars in 1276 bytes} [Sat May 14 15:51:13 2022] GET /compute/v2.1/servers/e33e9970-bfb7-46f3-8d40-782dbfa3d21c => generated 1720 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 14 15:51:13.345517 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi [None req-c5084429-fdb3-48ad-80e6-42de6b2ac56a tempest-TestVolumeBootPattern-2062489882 tempest-TestVolumeBootPattern-2062489882-project] Calling method '>' {{(pid=128729) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 15:51:13.346200 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.compute.api [None req-c5084429-fdb3-48ad-80e6-42de6b2ac56a tempest-TestVolumeBootPattern-2062489882 tempest-TestVolumeBootPattern-2062489882-project] [instance: 7ee38041-8e54-4fdb-909d-585952a4f5bd] Fetching instance by UUID {{(pid=128729) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 15:51:13.352543 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-c5084429-fdb3-48ad-80e6-42de6b2ac56a tempest-TestVolumeBootPattern-2062489882 tempest-TestVolumeBootPattern-2062489882-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:51:13.353072 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-c5084429-fdb3-48ad-80e6-42de6b2ac56a tempest-TestVolumeBootPattern-2062489882 tempest-TestVolumeBootPattern-2062489882-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:51:13.353913 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-c5084429-fdb3-48ad-80e6-42de6b2ac56a tempest-TestVolumeBootPattern-2062489882 tempest-TestVolumeBootPattern-2062489882-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:51:13.354382 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-c5084429-fdb3-48ad-80e6-42de6b2ac56a tempest-TestVolumeBootPattern-2062489882 tempest-TestVolumeBootPattern-2062489882-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:51:13.496736 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.policy [None req-c5084429-fdb3-48ad-80e6-42de6b2ac56a tempest-TestVolumeBootPattern-2062489882 tempest-TestVolumeBootPattern-2062489882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '568f6783dd4d43398a70a9ffa58ff660', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a3a2b5dee7a404a8445c8aa434b5a43', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128729) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:51:13.504135 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: INFO nova.api.openstack.requestlog [None req-c5084429-fdb3-48ad-80e6-42de6b2ac56a tempest-TestVolumeBootPattern-2062489882 tempest-TestVolumeBootPattern-2062489882-project] 10.222.0.61 "GET /compute/v2.1/servers/7ee38041-8e54-4fdb-909d-585952a4f5bd" status: 200 len: 1453 microversion: 2.1 time: 0.163069 May 14 15:51:13.504891 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: [pid: 128729|app: 0|req: 335/686] 10.222.0.61 () {58 vars in 1235 bytes} [Sat May 14 15:51:13 2022] GET /compute/v2.1/servers/7ee38041-8e54-4fdb-909d-585952a4f5bd => generated 1453 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 15:51:13.520331 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi [None req-dea2b66d-a508-4084-9762-d1c48c630d36 tempest-TestVolumeBootPattern-2062489882 tempest-TestVolumeBootPattern-2062489882-project] Calling method '>' {{(pid=128728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 15:51:13.520941 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.compute.api [None req-dea2b66d-a508-4084-9762-d1c48c630d36 tempest-TestVolumeBootPattern-2062489882 tempest-TestVolumeBootPattern-2062489882-project] [instance: 7ee38041-8e54-4fdb-909d-585952a4f5bd] Fetching instance by UUID {{(pid=128728) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 15:51:13.526818 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-dea2b66d-a508-4084-9762-d1c48c630d36 tempest-TestVolumeBootPattern-2062489882 tempest-TestVolumeBootPattern-2062489882-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:51:13.527269 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-dea2b66d-a508-4084-9762-d1c48c630d36 tempest-TestVolumeBootPattern-2062489882 tempest-TestVolumeBootPattern-2062489882-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:51:13.528037 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-dea2b66d-a508-4084-9762-d1c48c630d36 tempest-TestVolumeBootPattern-2062489882 tempest-TestVolumeBootPattern-2062489882-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:51:13.528476 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-dea2b66d-a508-4084-9762-d1c48c630d36 tempest-TestVolumeBootPattern-2062489882 tempest-TestVolumeBootPattern-2062489882-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:51:13.657811 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.policy [None req-dea2b66d-a508-4084-9762-d1c48c630d36 tempest-TestVolumeBootPattern-2062489882 tempest-TestVolumeBootPattern-2062489882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '568f6783dd4d43398a70a9ffa58ff660', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a3a2b5dee7a404a8445c8aa434b5a43', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128728) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:51:13.665137 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: INFO nova.api.openstack.requestlog [None req-dea2b66d-a508-4084-9762-d1c48c630d36 tempest-TestVolumeBootPattern-2062489882 tempest-TestVolumeBootPattern-2062489882-project] 10.222.0.61 "GET /compute/v2.1/servers/7ee38041-8e54-4fdb-909d-585952a4f5bd" status: 200 len: 1453 microversion: 2.1 time: 0.148576 May 14 15:51:13.665696 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: [pid: 128728|app: 0|req: 352/687] 10.222.0.61 () {58 vars in 1235 bytes} [Sat May 14 15:51:13 2022] GET /compute/v2.1/servers/7ee38041-8e54-4fdb-909d-585952a4f5bd => generated 1453 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 15:51:14.275826 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi [None req-33ee6820-e927-40bf-82ec-f7d43eeb5bfc tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Calling method '>' {{(pid=128729) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 15:51:14.276437 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.compute.api [None req-33ee6820-e927-40bf-82ec-f7d43eeb5bfc tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] [instance: e33e9970-bfb7-46f3-8d40-782dbfa3d21c] Fetching instance by UUID {{(pid=128729) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 15:51:14.282334 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-33ee6820-e927-40bf-82ec-f7d43eeb5bfc tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:51:14.282813 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-33ee6820-e927-40bf-82ec-f7d43eeb5bfc tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:51:14.283590 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-33ee6820-e927-40bf-82ec-f7d43eeb5bfc tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:51:14.284029 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-33ee6820-e927-40bf-82ec-f7d43eeb5bfc tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:51:14.508640 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.policy [None req-33ee6820-e927-40bf-82ec-f7d43eeb5bfc tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58bfb7417bc94583963401ae0fe9d39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0672be3fa3f7414da1c1a5b7300abbe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128729) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:51:14.516464 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.policy [None req-33ee6820-e927-40bf-82ec-f7d43eeb5bfc tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58bfb7417bc94583963401ae0fe9d39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0672be3fa3f7414da1c1a5b7300abbe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128729) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:51:14.517980 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.policy [None req-33ee6820-e927-40bf-82ec-f7d43eeb5bfc tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58bfb7417bc94583963401ae0fe9d39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0672be3fa3f7414da1c1a5b7300abbe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128729) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:51:14.519169 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: INFO nova.api.openstack.requestlog [None req-33ee6820-e927-40bf-82ec-f7d43eeb5bfc tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] 10.222.0.61 "GET /compute/v2.1/servers/e33e9970-bfb7-46f3-8d40-782dbfa3d21c" status: 200 len: 1720 microversion: 2.20 time: 0.247262 May 14 15:51:14.519735 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: [pid: 128729|app: 0|req: 336/688] 10.222.0.61 () {60 vars in 1276 bytes} [Sat May 14 15:51:14 2022] GET /compute/v2.1/servers/e33e9970-bfb7-46f3-8d40-782dbfa3d21c => generated 1720 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 14 15:51:15.537524 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi [None req-45d3c1f8-f3db-4458-abba-14cc8fe1bfef tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Calling method '>' {{(pid=128728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 15:51:15.538363 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.compute.api [None req-45d3c1f8-f3db-4458-abba-14cc8fe1bfef tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] [instance: e33e9970-bfb7-46f3-8d40-782dbfa3d21c] Fetching instance by UUID {{(pid=128728) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 15:51:15.545668 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-45d3c1f8-f3db-4458-abba-14cc8fe1bfef tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:51:15.546415 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-45d3c1f8-f3db-4458-abba-14cc8fe1bfef tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:51:15.547222 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-45d3c1f8-f3db-4458-abba-14cc8fe1bfef tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:51:15.547697 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-45d3c1f8-f3db-4458-abba-14cc8fe1bfef tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:51:15.799697 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi [req-33b9f259-cc86-4392-8a44-07f65f1d5393 req-2fa5896f-7da4-4005-81c7-5ee7181a6276 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7ee38041-8e54-4fdb-909d-585952a4f5bd", "tag": "bcc0c44d-e45f-498d-aad0-498370ba2097"}]} {{(pid=128729) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 15:51:15.819772 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [req-33b9f259-cc86-4392-8a44-07f65f1d5393 req-2fa5896f-7da4-4005-81c7-5ee7181a6276 service nova] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:51:15.820628 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [req-33b9f259-cc86-4392-8a44-07f65f1d5393 req-2fa5896f-7da4-4005-81c7-5ee7181a6276 service nova] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:51:15.833584 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: INFO nova.api.openstack.compute.server_external_events [req-33b9f259-cc86-4392-8a44-07f65f1d5393 req-2fa5896f-7da4-4005-81c7-5ee7181a6276 service nova] Creating event network-changed:bcc0c44d-e45f-498d-aad0-498370ba2097 for instance 7ee38041-8e54-4fdb-909d-585952a4f5bd on hv-cinder-83979 May 14 15:51:15.841852 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: INFO nova.api.openstack.requestlog [req-33b9f259-cc86-4392-8a44-07f65f1d5393 req-2fa5896f-7da4-4005-81c7-5ee7181a6276 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045590 May 14 15:51:15.843199 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: [pid: 128729|app: 0|req: 337/689] 10.222.0.61 () {64 vars in 1317 bytes} [Sat May 14 15:51:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 14 15:51:15.886097 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.policy [None req-45d3c1f8-f3db-4458-abba-14cc8fe1bfef tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58bfb7417bc94583963401ae0fe9d39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0672be3fa3f7414da1c1a5b7300abbe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128728) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:51:15.901010 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi [req-2a8524e9-ef65-4efb-a94d-bf9db2392781 req-e29ecc0a-55cf-4ca2-ab66-131cb071f873 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e33e9970-bfb7-46f3-8d40-782dbfa3d21c", "name": "network-vif-unplugged", "status": "completed", "tag": "759be0ca-daaf-4eba-97b6-a252b70cbb3b"}]} {{(pid=128729) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 15:51:15.911563 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [req-2a8524e9-ef65-4efb-a94d-bf9db2392781 req-e29ecc0a-55cf-4ca2-ab66-131cb071f873 service nova] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:51:15.912185 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [req-2a8524e9-ef65-4efb-a94d-bf9db2392781 req-e29ecc0a-55cf-4ca2-ab66-131cb071f873 service nova] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:51:15.913558 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.policy [None req-45d3c1f8-f3db-4458-abba-14cc8fe1bfef tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58bfb7417bc94583963401ae0fe9d39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0672be3fa3f7414da1c1a5b7300abbe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128728) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:51:15.915107 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.policy [None req-45d3c1f8-f3db-4458-abba-14cc8fe1bfef tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58bfb7417bc94583963401ae0fe9d39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0672be3fa3f7414da1c1a5b7300abbe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128728) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:51:15.916267 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: INFO nova.api.openstack.requestlog [None req-45d3c1f8-f3db-4458-abba-14cc8fe1bfef tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] 10.222.0.61 "GET /compute/v2.1/servers/e33e9970-bfb7-46f3-8d40-782dbfa3d21c" status: 200 len: 1720 microversion: 2.20 time: 0.382726 May 14 15:51:15.924821 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: [pid: 128728|app: 0|req: 353/690] 10.222.0.61 () {60 vars in 1276 bytes} [Sat May 14 15:51:15 2022] GET /compute/v2.1/servers/e33e9970-bfb7-46f3-8d40-782dbfa3d21c => generated 1720 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 14 15:51:15.925008 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: INFO nova.api.openstack.compute.server_external_events [req-2a8524e9-ef65-4efb-a94d-bf9db2392781 req-e29ecc0a-55cf-4ca2-ab66-131cb071f873 service nova] Creating event network-vif-unplugged:759be0ca-daaf-4eba-97b6-a252b70cbb3b for instance e33e9970-bfb7-46f3-8d40-782dbfa3d21c on hv-cinder-83979 May 14 15:51:15.931776 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: INFO nova.api.openstack.requestlog [req-2a8524e9-ef65-4efb-a94d-bf9db2392781 req-e29ecc0a-55cf-4ca2-ab66-131cb071f873 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.036287 May 14 15:51:15.934961 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: [pid: 128729|app: 0|req: 338/691] 10.222.0.61 () {64 vars in 1317 bytes} [Sat May 14 15:51:15 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 14 15:51:16.938919 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi [None req-5ad16360-997c-46be-9e40-772b04a1b320 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Calling method '>' {{(pid=128728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 15:51:16.939528 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.compute.api [None req-5ad16360-997c-46be-9e40-772b04a1b320 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] [instance: e33e9970-bfb7-46f3-8d40-782dbfa3d21c] Fetching instance by UUID {{(pid=128728) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 15:51:16.945799 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-5ad16360-997c-46be-9e40-772b04a1b320 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:51:16.946245 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-5ad16360-997c-46be-9e40-772b04a1b320 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:51:16.947053 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-5ad16360-997c-46be-9e40-772b04a1b320 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:51:16.947489 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-5ad16360-997c-46be-9e40-772b04a1b320 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:51:17.080808 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.policy [None req-5ad16360-997c-46be-9e40-772b04a1b320 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58bfb7417bc94583963401ae0fe9d39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0672be3fa3f7414da1c1a5b7300abbe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128728) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:51:17.088442 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.policy [None req-5ad16360-997c-46be-9e40-772b04a1b320 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58bfb7417bc94583963401ae0fe9d39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0672be3fa3f7414da1c1a5b7300abbe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128728) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:51:17.089947 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.policy [None req-5ad16360-997c-46be-9e40-772b04a1b320 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58bfb7417bc94583963401ae0fe9d39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0672be3fa3f7414da1c1a5b7300abbe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128728) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:51:17.091682 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: INFO nova.api.openstack.requestlog [None req-5ad16360-997c-46be-9e40-772b04a1b320 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] 10.222.0.61 "GET /compute/v2.1/servers/e33e9970-bfb7-46f3-8d40-782dbfa3d21c" status: 200 len: 1663 microversion: 2.20 time: 0.156301 May 14 15:51:17.092529 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: [pid: 128728|app: 0|req: 354/692] 10.222.0.61 () {60 vars in 1276 bytes} [Sat May 14 15:51:16 2022] GET /compute/v2.1/servers/e33e9970-bfb7-46f3-8d40-782dbfa3d21c => generated 1663 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 14 15:51:17.111173 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi [None req-93b2f9c4-64ec-4e8a-b74b-0239f96b4dd1 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "d9db8edc-612c-4e07-b5dd-25af23631a4b"}} {{(pid=128729) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 15:51:17.112310 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.compute.api [None req-93b2f9c4-64ec-4e8a-b74b-0239f96b4dd1 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] [instance: e33e9970-bfb7-46f3-8d40-782dbfa3d21c] Fetching instance by UUID {{(pid=128729) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 15:51:17.118678 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-93b2f9c4-64ec-4e8a-b74b-0239f96b4dd1 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:51:17.119153 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-93b2f9c4-64ec-4e8a-b74b-0239f96b4dd1 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:51:17.119914 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-93b2f9c4-64ec-4e8a-b74b-0239f96b4dd1 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:51:17.120354 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-93b2f9c4-64ec-4e8a-b74b-0239f96b4dd1 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:51:17.385521 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: INFO nova.api.openstack.requestlog [None req-93b2f9c4-64ec-4e8a-b74b-0239f96b4dd1 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] 10.222.0.61 "POST /compute/v2.1/servers/e33e9970-bfb7-46f3-8d40-782dbfa3d21c/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.279608 May 14 15:51:17.386158 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: [pid: 128729|app: 0|req: 339/693] 10.222.0.61 () {62 vars in 1363 bytes} [Sat May 14 15:51:17 2022] POST /compute/v2.1/servers/e33e9970-bfb7-46f3-8d40-782dbfa3d21c/os-volume_attachments => generated 188 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 14 15:51:17.495115 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi [None req-79392826-ea56-44b8-8f07-257ede9656de tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=128728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 15:51:17.495687 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.compute.api [None req-79392826-ea56-44b8-8f07-257ede9656de tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] [instance: e33e9970-bfb7-46f3-8d40-782dbfa3d21c] Fetching instance by UUID {{(pid=128728) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 15:51:17.501592 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-79392826-ea56-44b8-8f07-257ede9656de tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:51:17.502041 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-79392826-ea56-44b8-8f07-257ede9656de tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:51:17.502848 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-79392826-ea56-44b8-8f07-257ede9656de tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:51:17.503285 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-79392826-ea56-44b8-8f07-257ede9656de tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:51:17.593574 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: INFO nova.api.openstack.requestlog [None req-79392826-ea56-44b8-8f07-257ede9656de tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] 10.222.0.61 "POST /compute/v2.1/servers/e33e9970-bfb7-46f3-8d40-782dbfa3d21c/action" status: 202 len: 0 microversion: 2.20 time: 0.102201 May 14 15:51:17.594257 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: [pid: 128728|app: 0|req: 355/694] 10.222.0.61 () {62 vars in 1318 bytes} [Sat May 14 15:51:17 2022] POST /compute/v2.1/servers/e33e9970-bfb7-46f3-8d40-782dbfa3d21c/action => generated 0 bytes in 104 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) May 14 15:51:17.603272 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi [None req-75d29f60-34e4-42f4-a8ce-67a35a7090a2 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Calling method '>' {{(pid=128729) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 15:51:17.604033 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.compute.api [None req-75d29f60-34e4-42f4-a8ce-67a35a7090a2 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] [instance: e33e9970-bfb7-46f3-8d40-782dbfa3d21c] Fetching instance by UUID {{(pid=128729) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 15:51:17.611743 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-75d29f60-34e4-42f4-a8ce-67a35a7090a2 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:51:17.612195 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-75d29f60-34e4-42f4-a8ce-67a35a7090a2 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:51:17.613019 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-75d29f60-34e4-42f4-a8ce-67a35a7090a2 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:51:17.613705 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-75d29f60-34e4-42f4-a8ce-67a35a7090a2 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:51:17.747881 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.policy [None req-75d29f60-34e4-42f4-a8ce-67a35a7090a2 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58bfb7417bc94583963401ae0fe9d39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0672be3fa3f7414da1c1a5b7300abbe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128729) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:51:17.757155 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.policy [None req-75d29f60-34e4-42f4-a8ce-67a35a7090a2 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58bfb7417bc94583963401ae0fe9d39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0672be3fa3f7414da1c1a5b7300abbe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128729) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:51:17.758686 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.policy [None req-75d29f60-34e4-42f4-a8ce-67a35a7090a2 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58bfb7417bc94583963401ae0fe9d39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0672be3fa3f7414da1c1a5b7300abbe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128729) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:51:17.759808 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: INFO nova.api.openstack.requestlog [None req-75d29f60-34e4-42f4-a8ce-67a35a7090a2 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] 10.222.0.61 "GET /compute/v2.1/servers/e33e9970-bfb7-46f3-8d40-782dbfa3d21c" status: 200 len: 1749 microversion: 2.20 time: 0.161033 May 14 15:51:17.760348 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: [pid: 128729|app: 0|req: 340/695] 10.222.0.61 () {60 vars in 1276 bytes} [Sat May 14 15:51:17 2022] GET /compute/v2.1/servers/e33e9970-bfb7-46f3-8d40-782dbfa3d21c => generated 1749 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 14 15:51:18.778752 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi [None req-b388bb4d-c6d7-4953-b539-6c59e4863994 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Calling method '>' {{(pid=128728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 15:51:18.780173 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.compute.api [None req-b388bb4d-c6d7-4953-b539-6c59e4863994 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] [instance: e33e9970-bfb7-46f3-8d40-782dbfa3d21c] Fetching instance by UUID {{(pid=128728) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 15:51:18.786116 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-b388bb4d-c6d7-4953-b539-6c59e4863994 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:51:18.786605 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-b388bb4d-c6d7-4953-b539-6c59e4863994 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:51:18.787382 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-b388bb4d-c6d7-4953-b539-6c59e4863994 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:51:18.787820 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-b388bb4d-c6d7-4953-b539-6c59e4863994 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:51:18.969115 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.policy [None req-b388bb4d-c6d7-4953-b539-6c59e4863994 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58bfb7417bc94583963401ae0fe9d39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0672be3fa3f7414da1c1a5b7300abbe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128728) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:51:18.977450 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.policy [None req-b388bb4d-c6d7-4953-b539-6c59e4863994 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58bfb7417bc94583963401ae0fe9d39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0672be3fa3f7414da1c1a5b7300abbe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128728) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:51:18.978993 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.policy [None req-b388bb4d-c6d7-4953-b539-6c59e4863994 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58bfb7417bc94583963401ae0fe9d39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0672be3fa3f7414da1c1a5b7300abbe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128728) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:51:18.980178 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: INFO nova.api.openstack.requestlog [None req-b388bb4d-c6d7-4953-b539-6c59e4863994 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] 10.222.0.61 "GET /compute/v2.1/servers/e33e9970-bfb7-46f3-8d40-782dbfa3d21c" status: 200 len: 1751 microversion: 2.20 time: 0.205794 May 14 15:51:18.980737 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: [pid: 128728|app: 0|req: 356/696] 10.222.0.61 () {60 vars in 1276 bytes} [Sat May 14 15:51:18 2022] GET /compute/v2.1/servers/e33e9970-bfb7-46f3-8d40-782dbfa3d21c => generated 1751 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 14 15:51:20.000293 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi [None req-ee89ea2b-7786-451c-a8b5-da9a2afbdb26 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Calling method '>' {{(pid=128729) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 15:51:20.001485 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.compute.api [None req-ee89ea2b-7786-451c-a8b5-da9a2afbdb26 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] [instance: e33e9970-bfb7-46f3-8d40-782dbfa3d21c] Fetching instance by UUID {{(pid=128729) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 15:51:20.007468 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-ee89ea2b-7786-451c-a8b5-da9a2afbdb26 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:51:20.007916 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-ee89ea2b-7786-451c-a8b5-da9a2afbdb26 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:51:20.008797 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-ee89ea2b-7786-451c-a8b5-da9a2afbdb26 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:51:20.009265 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-ee89ea2b-7786-451c-a8b5-da9a2afbdb26 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:51:20.194140 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.policy [None req-ee89ea2b-7786-451c-a8b5-da9a2afbdb26 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58bfb7417bc94583963401ae0fe9d39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0672be3fa3f7414da1c1a5b7300abbe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128729) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:51:20.203821 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.policy [None req-ee89ea2b-7786-451c-a8b5-da9a2afbdb26 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58bfb7417bc94583963401ae0fe9d39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0672be3fa3f7414da1c1a5b7300abbe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128729) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:51:20.205340 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.policy [None req-ee89ea2b-7786-451c-a8b5-da9a2afbdb26 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58bfb7417bc94583963401ae0fe9d39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0672be3fa3f7414da1c1a5b7300abbe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128729) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:51:20.206552 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: INFO nova.api.openstack.requestlog [None req-ee89ea2b-7786-451c-a8b5-da9a2afbdb26 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] 10.222.0.61 "GET /compute/v2.1/servers/e33e9970-bfb7-46f3-8d40-782dbfa3d21c" status: 200 len: 1807 microversion: 2.20 time: 0.210570 May 14 15:51:20.207112 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: [pid: 128729|app: 0|req: 341/697] 10.222.0.61 () {60 vars in 1276 bytes} [Sat May 14 15:51:19 2022] GET /compute/v2.1/servers/e33e9970-bfb7-46f3-8d40-782dbfa3d21c => generated 1807 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 14 15:51:21.227043 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi [None req-662261e7-9293-48a9-98e0-df0df3ad0195 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Calling method '>' {{(pid=128728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 15:51:21.227813 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.compute.api [None req-662261e7-9293-48a9-98e0-df0df3ad0195 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] [instance: e33e9970-bfb7-46f3-8d40-782dbfa3d21c] Fetching instance by UUID {{(pid=128728) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 15:51:21.234966 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-662261e7-9293-48a9-98e0-df0df3ad0195 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:51:21.235598 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-662261e7-9293-48a9-98e0-df0df3ad0195 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:51:21.236632 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-662261e7-9293-48a9-98e0-df0df3ad0195 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:51:21.237235 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-662261e7-9293-48a9-98e0-df0df3ad0195 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:51:21.376339 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.policy [None req-662261e7-9293-48a9-98e0-df0df3ad0195 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58bfb7417bc94583963401ae0fe9d39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0672be3fa3f7414da1c1a5b7300abbe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128728) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:51:21.384865 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.policy [None req-662261e7-9293-48a9-98e0-df0df3ad0195 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58bfb7417bc94583963401ae0fe9d39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0672be3fa3f7414da1c1a5b7300abbe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128728) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:51:21.386410 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.policy [None req-662261e7-9293-48a9-98e0-df0df3ad0195 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58bfb7417bc94583963401ae0fe9d39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0672be3fa3f7414da1c1a5b7300abbe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128728) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:51:21.387576 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: INFO nova.api.openstack.requestlog [None req-662261e7-9293-48a9-98e0-df0df3ad0195 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] 10.222.0.61 "GET /compute/v2.1/servers/e33e9970-bfb7-46f3-8d40-782dbfa3d21c" status: 200 len: 1807 microversion: 2.20 time: 0.165947 May 14 15:51:21.390017 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: [pid: 128728|app: 0|req: 357/698] 10.222.0.61 () {60 vars in 1276 bytes} [Sat May 14 15:51:21 2022] GET /compute/v2.1/servers/e33e9970-bfb7-46f3-8d40-782dbfa3d21c => generated 1807 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 14 15:51:22.409241 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi [None req-d629b25a-dcdd-4da3-8c44-21662c240015 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Calling method '>' {{(pid=128729) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 15:51:22.409865 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.compute.api [None req-d629b25a-dcdd-4da3-8c44-21662c240015 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] [instance: e33e9970-bfb7-46f3-8d40-782dbfa3d21c] Fetching instance by UUID {{(pid=128729) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 15:51:22.416897 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-d629b25a-dcdd-4da3-8c44-21662c240015 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:51:22.417350 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-d629b25a-dcdd-4da3-8c44-21662c240015 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:51:22.418400 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-d629b25a-dcdd-4da3-8c44-21662c240015 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:51:22.419018 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-d629b25a-dcdd-4da3-8c44-21662c240015 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:51:22.554754 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.policy [None req-d629b25a-dcdd-4da3-8c44-21662c240015 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58bfb7417bc94583963401ae0fe9d39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0672be3fa3f7414da1c1a5b7300abbe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128729) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:51:22.563274 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.policy [None req-d629b25a-dcdd-4da3-8c44-21662c240015 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58bfb7417bc94583963401ae0fe9d39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0672be3fa3f7414da1c1a5b7300abbe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128729) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:51:22.565054 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.policy [None req-d629b25a-dcdd-4da3-8c44-21662c240015 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58bfb7417bc94583963401ae0fe9d39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0672be3fa3f7414da1c1a5b7300abbe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128729) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:51:22.566218 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: INFO nova.api.openstack.requestlog [None req-d629b25a-dcdd-4da3-8c44-21662c240015 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] 10.222.0.61 "GET /compute/v2.1/servers/e33e9970-bfb7-46f3-8d40-782dbfa3d21c" status: 200 len: 1807 microversion: 2.20 time: 0.161019 May 14 15:51:22.566802 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: [pid: 128729|app: 0|req: 342/699] 10.222.0.61 () {60 vars in 1276 bytes} [Sat May 14 15:51:22 2022] GET /compute/v2.1/servers/e33e9970-bfb7-46f3-8d40-782dbfa3d21c => generated 1807 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 14 15:51:23.585060 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi [None req-8b7b35d1-da8e-4020-85c4-51da5756a3f5 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Calling method '>' {{(pid=128728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 15:51:23.585681 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.compute.api [None req-8b7b35d1-da8e-4020-85c4-51da5756a3f5 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] [instance: e33e9970-bfb7-46f3-8d40-782dbfa3d21c] Fetching instance by UUID {{(pid=128728) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 15:51:23.592580 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-8b7b35d1-da8e-4020-85c4-51da5756a3f5 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:51:23.593029 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-8b7b35d1-da8e-4020-85c4-51da5756a3f5 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:51:23.593815 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-8b7b35d1-da8e-4020-85c4-51da5756a3f5 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:51:23.594252 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-8b7b35d1-da8e-4020-85c4-51da5756a3f5 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:51:23.730575 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.policy [None req-8b7b35d1-da8e-4020-85c4-51da5756a3f5 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58bfb7417bc94583963401ae0fe9d39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0672be3fa3f7414da1c1a5b7300abbe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128728) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:51:23.739778 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.policy [None req-8b7b35d1-da8e-4020-85c4-51da5756a3f5 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58bfb7417bc94583963401ae0fe9d39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0672be3fa3f7414da1c1a5b7300abbe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128728) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:51:23.741329 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.policy [None req-8b7b35d1-da8e-4020-85c4-51da5756a3f5 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58bfb7417bc94583963401ae0fe9d39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0672be3fa3f7414da1c1a5b7300abbe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128728) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:51:23.742666 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: INFO nova.api.openstack.requestlog [None req-8b7b35d1-da8e-4020-85c4-51da5756a3f5 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] 10.222.0.61 "GET /compute/v2.1/servers/e33e9970-bfb7-46f3-8d40-782dbfa3d21c" status: 200 len: 1807 microversion: 2.20 time: 0.161406 May 14 15:51:23.743226 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: [pid: 128728|app: 0|req: 358/700] 10.222.0.61 () {60 vars in 1276 bytes} [Sat May 14 15:51:23 2022] GET /compute/v2.1/servers/e33e9970-bfb7-46f3-8d40-782dbfa3d21c => generated 1807 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 14 15:51:24.761338 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi [None req-2a07402f-a810-494d-9fb8-0d84a96a3597 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Calling method '>' {{(pid=128729) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 15:51:24.761981 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.compute.api [None req-2a07402f-a810-494d-9fb8-0d84a96a3597 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] [instance: e33e9970-bfb7-46f3-8d40-782dbfa3d21c] Fetching instance by UUID {{(pid=128729) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 15:51:24.769342 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-2a07402f-a810-494d-9fb8-0d84a96a3597 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:51:24.769796 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-2a07402f-a810-494d-9fb8-0d84a96a3597 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:51:24.770602 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-2a07402f-a810-494d-9fb8-0d84a96a3597 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:51:24.771040 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-2a07402f-a810-494d-9fb8-0d84a96a3597 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:51:24.926496 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.policy [None req-2a07402f-a810-494d-9fb8-0d84a96a3597 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58bfb7417bc94583963401ae0fe9d39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0672be3fa3f7414da1c1a5b7300abbe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128729) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:51:24.935635 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.policy [None req-2a07402f-a810-494d-9fb8-0d84a96a3597 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58bfb7417bc94583963401ae0fe9d39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0672be3fa3f7414da1c1a5b7300abbe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128729) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:51:24.937155 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.policy [None req-2a07402f-a810-494d-9fb8-0d84a96a3597 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58bfb7417bc94583963401ae0fe9d39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0672be3fa3f7414da1c1a5b7300abbe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128729) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:51:24.938337 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: INFO nova.api.openstack.requestlog [None req-2a07402f-a810-494d-9fb8-0d84a96a3597 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] 10.222.0.61 "GET /compute/v2.1/servers/e33e9970-bfb7-46f3-8d40-782dbfa3d21c" status: 200 len: 1807 microversion: 2.20 time: 0.181027 May 14 15:51:24.938901 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: [pid: 128729|app: 0|req: 343/701] 10.222.0.61 () {60 vars in 1276 bytes} [Sat May 14 15:51:24 2022] GET /compute/v2.1/servers/e33e9970-bfb7-46f3-8d40-782dbfa3d21c => generated 1807 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 14 15:51:25.956550 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi [None req-800f4181-5ad1-4252-b2e0-b0da5b325088 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Calling method '>' {{(pid=128728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 15:51:25.957242 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.compute.api [None req-800f4181-5ad1-4252-b2e0-b0da5b325088 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] [instance: e33e9970-bfb7-46f3-8d40-782dbfa3d21c] Fetching instance by UUID {{(pid=128728) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 15:51:25.964378 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-800f4181-5ad1-4252-b2e0-b0da5b325088 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:51:25.965156 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-800f4181-5ad1-4252-b2e0-b0da5b325088 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:51:25.970825 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-800f4181-5ad1-4252-b2e0-b0da5b325088 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:51:25.971348 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-800f4181-5ad1-4252-b2e0-b0da5b325088 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:51:26.115599 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.policy [None req-800f4181-5ad1-4252-b2e0-b0da5b325088 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58bfb7417bc94583963401ae0fe9d39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0672be3fa3f7414da1c1a5b7300abbe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128728) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:51:26.123731 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.policy [None req-800f4181-5ad1-4252-b2e0-b0da5b325088 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58bfb7417bc94583963401ae0fe9d39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0672be3fa3f7414da1c1a5b7300abbe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128728) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:51:26.125261 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.policy [None req-800f4181-5ad1-4252-b2e0-b0da5b325088 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58bfb7417bc94583963401ae0fe9d39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0672be3fa3f7414da1c1a5b7300abbe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128728) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:51:26.126442 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: INFO nova.api.openstack.requestlog [None req-800f4181-5ad1-4252-b2e0-b0da5b325088 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] 10.222.0.61 "GET /compute/v2.1/servers/e33e9970-bfb7-46f3-8d40-782dbfa3d21c" status: 200 len: 1807 microversion: 2.20 time: 0.173763 May 14 15:51:26.126999 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: [pid: 128728|app: 0|req: 359/702] 10.222.0.61 () {60 vars in 1276 bytes} [Sat May 14 15:51:25 2022] GET /compute/v2.1/servers/e33e9970-bfb7-46f3-8d40-782dbfa3d21c => generated 1807 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 14 15:51:27.144847 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi [None req-8e3001cb-772c-4d28-b855-1a88ae7662ae tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Calling method '>' {{(pid=128729) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 15:51:27.145463 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.compute.api [None req-8e3001cb-772c-4d28-b855-1a88ae7662ae tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] [instance: e33e9970-bfb7-46f3-8d40-782dbfa3d21c] Fetching instance by UUID {{(pid=128729) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 15:51:27.151781 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-8e3001cb-772c-4d28-b855-1a88ae7662ae tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:51:27.152234 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-8e3001cb-772c-4d28-b855-1a88ae7662ae tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:51:27.153027 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-8e3001cb-772c-4d28-b855-1a88ae7662ae tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:51:27.153939 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-8e3001cb-772c-4d28-b855-1a88ae7662ae tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:51:27.283217 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.policy [None req-8e3001cb-772c-4d28-b855-1a88ae7662ae tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58bfb7417bc94583963401ae0fe9d39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0672be3fa3f7414da1c1a5b7300abbe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128729) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:51:27.291582 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.policy [None req-8e3001cb-772c-4d28-b855-1a88ae7662ae tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58bfb7417bc94583963401ae0fe9d39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0672be3fa3f7414da1c1a5b7300abbe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128729) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:51:27.293098 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.policy [None req-8e3001cb-772c-4d28-b855-1a88ae7662ae tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58bfb7417bc94583963401ae0fe9d39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0672be3fa3f7414da1c1a5b7300abbe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128729) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:51:27.294759 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: INFO nova.api.openstack.requestlog [None req-8e3001cb-772c-4d28-b855-1a88ae7662ae tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] 10.222.0.61 "GET /compute/v2.1/servers/e33e9970-bfb7-46f3-8d40-782dbfa3d21c" status: 200 len: 1807 microversion: 2.20 time: 0.153319 May 14 15:51:27.295319 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: [pid: 128729|app: 0|req: 344/703] 10.222.0.61 () {60 vars in 1276 bytes} [Sat May 14 15:51:27 2022] GET /compute/v2.1/servers/e33e9970-bfb7-46f3-8d40-782dbfa3d21c => generated 1807 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 14 15:51:28.313065 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi [None req-76e434e7-6d17-4f0d-a416-90e35d527829 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Calling method '>' {{(pid=128728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 15:51:28.313587 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.compute.api [None req-76e434e7-6d17-4f0d-a416-90e35d527829 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] [instance: e33e9970-bfb7-46f3-8d40-782dbfa3d21c] Fetching instance by UUID {{(pid=128728) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 15:51:28.320052 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-76e434e7-6d17-4f0d-a416-90e35d527829 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:51:28.320501 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-76e434e7-6d17-4f0d-a416-90e35d527829 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:51:28.321273 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-76e434e7-6d17-4f0d-a416-90e35d527829 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:51:28.321710 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-76e434e7-6d17-4f0d-a416-90e35d527829 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:51:28.473392 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.policy [None req-76e434e7-6d17-4f0d-a416-90e35d527829 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58bfb7417bc94583963401ae0fe9d39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0672be3fa3f7414da1c1a5b7300abbe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128728) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:51:28.483436 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.policy [None req-76e434e7-6d17-4f0d-a416-90e35d527829 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58bfb7417bc94583963401ae0fe9d39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0672be3fa3f7414da1c1a5b7300abbe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128728) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:51:28.484967 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.policy [None req-76e434e7-6d17-4f0d-a416-90e35d527829 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58bfb7417bc94583963401ae0fe9d39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0672be3fa3f7414da1c1a5b7300abbe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128728) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:51:28.486153 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: INFO nova.api.openstack.requestlog [None req-76e434e7-6d17-4f0d-a416-90e35d527829 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] 10.222.0.61 "GET /compute/v2.1/servers/e33e9970-bfb7-46f3-8d40-782dbfa3d21c" status: 200 len: 1807 microversion: 2.20 time: 0.177802 May 14 15:51:28.499155 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: [pid: 128728|app: 0|req: 360/704] 10.222.0.61 () {60 vars in 1276 bytes} [Sat May 14 15:51:28 2022] GET /compute/v2.1/servers/e33e9970-bfb7-46f3-8d40-782dbfa3d21c => generated 1807 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 14 15:51:29.505148 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi [None req-7a88cadd-3163-47e9-bdb2-8a313ba2fa4c tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Calling method '>' {{(pid=128729) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 15:51:29.505839 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.compute.api [None req-7a88cadd-3163-47e9-bdb2-8a313ba2fa4c tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] [instance: e33e9970-bfb7-46f3-8d40-782dbfa3d21c] Fetching instance by UUID {{(pid=128729) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 15:51:29.512146 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-7a88cadd-3163-47e9-bdb2-8a313ba2fa4c tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:51:29.512594 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-7a88cadd-3163-47e9-bdb2-8a313ba2fa4c tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:51:29.513362 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-7a88cadd-3163-47e9-bdb2-8a313ba2fa4c tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:51:29.514441 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-7a88cadd-3163-47e9-bdb2-8a313ba2fa4c tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:51:29.646352 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.policy [None req-7a88cadd-3163-47e9-bdb2-8a313ba2fa4c tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58bfb7417bc94583963401ae0fe9d39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0672be3fa3f7414da1c1a5b7300abbe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128729) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:51:29.655701 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.policy [None req-7a88cadd-3163-47e9-bdb2-8a313ba2fa4c tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58bfb7417bc94583963401ae0fe9d39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0672be3fa3f7414da1c1a5b7300abbe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128729) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:51:29.657482 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.policy [None req-7a88cadd-3163-47e9-bdb2-8a313ba2fa4c tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58bfb7417bc94583963401ae0fe9d39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0672be3fa3f7414da1c1a5b7300abbe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128729) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:51:29.659543 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: INFO nova.api.openstack.requestlog [None req-7a88cadd-3163-47e9-bdb2-8a313ba2fa4c tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] 10.222.0.61 "GET /compute/v2.1/servers/e33e9970-bfb7-46f3-8d40-782dbfa3d21c" status: 200 len: 1807 microversion: 2.20 time: 0.158320 May 14 15:51:29.660055 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: [pid: 128729|app: 0|req: 345/705] 10.222.0.61 () {60 vars in 1276 bytes} [Sat May 14 15:51:29 2022] GET /compute/v2.1/servers/e33e9970-bfb7-46f3-8d40-782dbfa3d21c => generated 1807 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 14 15:51:30.678567 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi [None req-577ef951-6d6b-4543-afcf-1be5cee764c3 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Calling method '>' {{(pid=128728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 15:51:30.679206 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.compute.api [None req-577ef951-6d6b-4543-afcf-1be5cee764c3 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] [instance: e33e9970-bfb7-46f3-8d40-782dbfa3d21c] Fetching instance by UUID {{(pid=128728) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 15:51:30.685523 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-577ef951-6d6b-4543-afcf-1be5cee764c3 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:51:30.685967 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-577ef951-6d6b-4543-afcf-1be5cee764c3 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:51:30.687319 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-577ef951-6d6b-4543-afcf-1be5cee764c3 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:51:30.687759 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-577ef951-6d6b-4543-afcf-1be5cee764c3 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:51:30.834982 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.policy [None req-577ef951-6d6b-4543-afcf-1be5cee764c3 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58bfb7417bc94583963401ae0fe9d39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0672be3fa3f7414da1c1a5b7300abbe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128728) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:51:30.842720 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.policy [None req-577ef951-6d6b-4543-afcf-1be5cee764c3 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58bfb7417bc94583963401ae0fe9d39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0672be3fa3f7414da1c1a5b7300abbe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128728) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:51:30.844466 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.policy [None req-577ef951-6d6b-4543-afcf-1be5cee764c3 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58bfb7417bc94583963401ae0fe9d39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0672be3fa3f7414da1c1a5b7300abbe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128728) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:51:30.845596 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: INFO nova.api.openstack.requestlog [None req-577ef951-6d6b-4543-afcf-1be5cee764c3 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] 10.222.0.61 "GET /compute/v2.1/servers/e33e9970-bfb7-46f3-8d40-782dbfa3d21c" status: 200 len: 1807 microversion: 2.20 time: 0.171338 May 14 15:51:30.846300 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: [pid: 128728|app: 0|req: 361/706] 10.222.0.61 () {60 vars in 1276 bytes} [Sat May 14 15:51:30 2022] GET /compute/v2.1/servers/e33e9970-bfb7-46f3-8d40-782dbfa3d21c => generated 1807 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 14 15:51:31.864947 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi [None req-76ec7514-5d11-4640-bfaa-bfad17752080 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Calling method '>' {{(pid=128729) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 15:51:31.865545 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.compute.api [None req-76ec7514-5d11-4640-bfaa-bfad17752080 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] [instance: e33e9970-bfb7-46f3-8d40-782dbfa3d21c] Fetching instance by UUID {{(pid=128729) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 15:51:31.871867 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-76ec7514-5d11-4640-bfaa-bfad17752080 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:51:31.872320 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-76ec7514-5d11-4640-bfaa-bfad17752080 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:51:31.873097 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-76ec7514-5d11-4640-bfaa-bfad17752080 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:51:31.873532 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-76ec7514-5d11-4640-bfaa-bfad17752080 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:51:32.008106 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.policy [None req-76ec7514-5d11-4640-bfaa-bfad17752080 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58bfb7417bc94583963401ae0fe9d39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0672be3fa3f7414da1c1a5b7300abbe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128729) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:51:32.017105 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.policy [None req-76ec7514-5d11-4640-bfaa-bfad17752080 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58bfb7417bc94583963401ae0fe9d39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0672be3fa3f7414da1c1a5b7300abbe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128729) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:51:32.018623 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.policy [None req-76ec7514-5d11-4640-bfaa-bfad17752080 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58bfb7417bc94583963401ae0fe9d39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0672be3fa3f7414da1c1a5b7300abbe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128729) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:51:32.019772 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: INFO nova.api.openstack.requestlog [None req-76ec7514-5d11-4640-bfaa-bfad17752080 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] 10.222.0.61 "GET /compute/v2.1/servers/e33e9970-bfb7-46f3-8d40-782dbfa3d21c" status: 200 len: 1807 microversion: 2.20 time: 0.158988 May 14 15:51:32.020336 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: [pid: 128729|app: 0|req: 346/707] 10.222.0.61 () {60 vars in 1276 bytes} [Sat May 14 15:51:31 2022] GET /compute/v2.1/servers/e33e9970-bfb7-46f3-8d40-782dbfa3d21c => generated 1807 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 14 15:51:33.038675 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi [None req-f8d7789c-fc20-4a00-9768-cc105031dca4 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Calling method '>' {{(pid=128728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 15:51:33.039298 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.compute.api [None req-f8d7789c-fc20-4a00-9768-cc105031dca4 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] [instance: e33e9970-bfb7-46f3-8d40-782dbfa3d21c] Fetching instance by UUID {{(pid=128728) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 15:51:33.046543 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-f8d7789c-fc20-4a00-9768-cc105031dca4 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:51:33.047062 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-f8d7789c-fc20-4a00-9768-cc105031dca4 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:51:33.048226 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-f8d7789c-fc20-4a00-9768-cc105031dca4 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:51:33.048898 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-f8d7789c-fc20-4a00-9768-cc105031dca4 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:51:33.221597 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.policy [None req-f8d7789c-fc20-4a00-9768-cc105031dca4 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58bfb7417bc94583963401ae0fe9d39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0672be3fa3f7414da1c1a5b7300abbe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128728) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:51:33.230674 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.policy [None req-f8d7789c-fc20-4a00-9768-cc105031dca4 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58bfb7417bc94583963401ae0fe9d39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0672be3fa3f7414da1c1a5b7300abbe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128728) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:51:33.232188 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.policy [None req-f8d7789c-fc20-4a00-9768-cc105031dca4 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58bfb7417bc94583963401ae0fe9d39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0672be3fa3f7414da1c1a5b7300abbe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128728) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:51:33.234018 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: INFO nova.api.openstack.requestlog [None req-f8d7789c-fc20-4a00-9768-cc105031dca4 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] 10.222.0.61 "GET /compute/v2.1/servers/e33e9970-bfb7-46f3-8d40-782dbfa3d21c" status: 200 len: 1807 microversion: 2.20 time: 0.198716 May 14 15:51:33.234663 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: [pid: 128728|app: 0|req: 362/708] 10.222.0.61 () {60 vars in 1276 bytes} [Sat May 14 15:51:33 2022] GET /compute/v2.1/servers/e33e9970-bfb7-46f3-8d40-782dbfa3d21c => generated 1807 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 14 15:51:34.253381 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi [None req-00beaf13-d415-47e5-9e48-6210c2405678 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Calling method '>' {{(pid=128729) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 15:51:34.254039 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.compute.api [None req-00beaf13-d415-47e5-9e48-6210c2405678 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] [instance: e33e9970-bfb7-46f3-8d40-782dbfa3d21c] Fetching instance by UUID {{(pid=128729) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 15:51:34.260164 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-00beaf13-d415-47e5-9e48-6210c2405678 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:51:34.260609 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-00beaf13-d415-47e5-9e48-6210c2405678 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:51:34.261389 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-00beaf13-d415-47e5-9e48-6210c2405678 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:51:34.261821 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-00beaf13-d415-47e5-9e48-6210c2405678 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:51:34.399054 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.policy [None req-00beaf13-d415-47e5-9e48-6210c2405678 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58bfb7417bc94583963401ae0fe9d39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0672be3fa3f7414da1c1a5b7300abbe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128729) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:51:34.407951 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.policy [None req-00beaf13-d415-47e5-9e48-6210c2405678 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58bfb7417bc94583963401ae0fe9d39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0672be3fa3f7414da1c1a5b7300abbe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128729) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:51:34.409431 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.policy [None req-00beaf13-d415-47e5-9e48-6210c2405678 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58bfb7417bc94583963401ae0fe9d39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0672be3fa3f7414da1c1a5b7300abbe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128729) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:51:34.410612 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: INFO nova.api.openstack.requestlog [None req-00beaf13-d415-47e5-9e48-6210c2405678 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] 10.222.0.61 "GET /compute/v2.1/servers/e33e9970-bfb7-46f3-8d40-782dbfa3d21c" status: 200 len: 1807 microversion: 2.20 time: 0.161560 May 14 15:51:34.411167 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: [pid: 128729|app: 0|req: 347/709] 10.222.0.61 () {60 vars in 1276 bytes} [Sat May 14 15:51:34 2022] GET /compute/v2.1/servers/e33e9970-bfb7-46f3-8d40-782dbfa3d21c => generated 1807 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 14 15:51:35.429146 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi [None req-f0f741da-5220-484e-a0b6-c2bd95f3fd5b tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Calling method '>' {{(pid=128728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 15:51:35.429838 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.compute.api [None req-f0f741da-5220-484e-a0b6-c2bd95f3fd5b tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] [instance: e33e9970-bfb7-46f3-8d40-782dbfa3d21c] Fetching instance by UUID {{(pid=128728) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 15:51:35.437284 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-f0f741da-5220-484e-a0b6-c2bd95f3fd5b tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:51:35.437826 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-f0f741da-5220-484e-a0b6-c2bd95f3fd5b tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:51:35.438636 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-f0f741da-5220-484e-a0b6-c2bd95f3fd5b tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:51:35.439079 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-f0f741da-5220-484e-a0b6-c2bd95f3fd5b tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:51:35.573599 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.policy [None req-f0f741da-5220-484e-a0b6-c2bd95f3fd5b tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58bfb7417bc94583963401ae0fe9d39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0672be3fa3f7414da1c1a5b7300abbe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128728) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:51:35.582757 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.policy [None req-f0f741da-5220-484e-a0b6-c2bd95f3fd5b tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58bfb7417bc94583963401ae0fe9d39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0672be3fa3f7414da1c1a5b7300abbe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128728) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:51:35.584311 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.policy [None req-f0f741da-5220-484e-a0b6-c2bd95f3fd5b tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58bfb7417bc94583963401ae0fe9d39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0672be3fa3f7414da1c1a5b7300abbe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128728) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:51:35.585561 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: INFO nova.api.openstack.requestlog [None req-f0f741da-5220-484e-a0b6-c2bd95f3fd5b tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] 10.222.0.61 "GET /compute/v2.1/servers/e33e9970-bfb7-46f3-8d40-782dbfa3d21c" status: 200 len: 1807 microversion: 2.20 time: 0.160863 May 14 15:51:35.586127 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: [pid: 128728|app: 0|req: 363/710] 10.222.0.61 () {60 vars in 1276 bytes} [Sat May 14 15:51:35 2022] GET /compute/v2.1/servers/e33e9970-bfb7-46f3-8d40-782dbfa3d21c => generated 1807 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 14 15:51:36.605215 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi [None req-364c7442-b8cb-44f4-8cc0-95d5ac599f8d tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Calling method '>' {{(pid=128729) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 15:51:36.605822 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.compute.api [None req-364c7442-b8cb-44f4-8cc0-95d5ac599f8d tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] [instance: e33e9970-bfb7-46f3-8d40-782dbfa3d21c] Fetching instance by UUID {{(pid=128729) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 15:51:36.613195 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-364c7442-b8cb-44f4-8cc0-95d5ac599f8d tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:51:36.613901 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-364c7442-b8cb-44f4-8cc0-95d5ac599f8d tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:51:36.614700 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-364c7442-b8cb-44f4-8cc0-95d5ac599f8d tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:51:36.615141 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-364c7442-b8cb-44f4-8cc0-95d5ac599f8d tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:51:36.745271 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.policy [None req-364c7442-b8cb-44f4-8cc0-95d5ac599f8d tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58bfb7417bc94583963401ae0fe9d39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0672be3fa3f7414da1c1a5b7300abbe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128729) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:51:36.754036 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.policy [None req-364c7442-b8cb-44f4-8cc0-95d5ac599f8d tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58bfb7417bc94583963401ae0fe9d39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0672be3fa3f7414da1c1a5b7300abbe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128729) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:51:36.755551 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.policy [None req-364c7442-b8cb-44f4-8cc0-95d5ac599f8d tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58bfb7417bc94583963401ae0fe9d39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0672be3fa3f7414da1c1a5b7300abbe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128729) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:51:36.756685 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: INFO nova.api.openstack.requestlog [None req-364c7442-b8cb-44f4-8cc0-95d5ac599f8d tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] 10.222.0.61 "GET /compute/v2.1/servers/e33e9970-bfb7-46f3-8d40-782dbfa3d21c" status: 200 len: 1807 microversion: 2.20 time: 0.155652 May 14 15:51:36.757235 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: [pid: 128729|app: 0|req: 348/711] 10.222.0.61 () {60 vars in 1276 bytes} [Sat May 14 15:51:36 2022] GET /compute/v2.1/servers/e33e9970-bfb7-46f3-8d40-782dbfa3d21c => generated 1807 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 14 15:51:37.775661 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi [None req-036028d4-5801-4cc3-89e6-cd1b524d31c6 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Calling method '>' {{(pid=128728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 15:51:37.776265 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.compute.api [None req-036028d4-5801-4cc3-89e6-cd1b524d31c6 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] [instance: e33e9970-bfb7-46f3-8d40-782dbfa3d21c] Fetching instance by UUID {{(pid=128728) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 15:51:37.783313 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-036028d4-5801-4cc3-89e6-cd1b524d31c6 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:51:37.783760 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-036028d4-5801-4cc3-89e6-cd1b524d31c6 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:51:37.784521 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-036028d4-5801-4cc3-89e6-cd1b524d31c6 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:51:37.784964 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-036028d4-5801-4cc3-89e6-cd1b524d31c6 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:51:38.001472 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.policy [None req-036028d4-5801-4cc3-89e6-cd1b524d31c6 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58bfb7417bc94583963401ae0fe9d39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0672be3fa3f7414da1c1a5b7300abbe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128728) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:51:38.009773 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.policy [None req-036028d4-5801-4cc3-89e6-cd1b524d31c6 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58bfb7417bc94583963401ae0fe9d39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0672be3fa3f7414da1c1a5b7300abbe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128728) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:51:38.011331 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.policy [None req-036028d4-5801-4cc3-89e6-cd1b524d31c6 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58bfb7417bc94583963401ae0fe9d39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0672be3fa3f7414da1c1a5b7300abbe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128728) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:51:38.012481 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: INFO nova.api.openstack.requestlog [None req-036028d4-5801-4cc3-89e6-cd1b524d31c6 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] 10.222.0.61 "GET /compute/v2.1/servers/e33e9970-bfb7-46f3-8d40-782dbfa3d21c" status: 200 len: 1807 microversion: 2.20 time: 0.240723 May 14 15:51:38.013038 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: [pid: 128728|app: 0|req: 364/712] 10.222.0.61 () {60 vars in 1276 bytes} [Sat May 14 15:51:37 2022] GET /compute/v2.1/servers/e33e9970-bfb7-46f3-8d40-782dbfa3d21c => generated 1807 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 14 15:51:39.031608 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi [None req-d9e30723-45d9-419f-a1ea-f9ea27ee827b tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Calling method '>' {{(pid=128729) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 15:51:39.032822 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.compute.api [None req-d9e30723-45d9-419f-a1ea-f9ea27ee827b tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] [instance: e33e9970-bfb7-46f3-8d40-782dbfa3d21c] Fetching instance by UUID {{(pid=128729) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 15:51:39.039806 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-d9e30723-45d9-419f-a1ea-f9ea27ee827b tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:51:39.040260 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-d9e30723-45d9-419f-a1ea-f9ea27ee827b tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:51:39.041405 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-d9e30723-45d9-419f-a1ea-f9ea27ee827b tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:51:39.041854 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-d9e30723-45d9-419f-a1ea-f9ea27ee827b tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:51:39.188113 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.policy [None req-d9e30723-45d9-419f-a1ea-f9ea27ee827b tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58bfb7417bc94583963401ae0fe9d39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0672be3fa3f7414da1c1a5b7300abbe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128729) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:51:39.197505 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.policy [None req-d9e30723-45d9-419f-a1ea-f9ea27ee827b tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58bfb7417bc94583963401ae0fe9d39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0672be3fa3f7414da1c1a5b7300abbe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128729) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:51:39.199077 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.policy [None req-d9e30723-45d9-419f-a1ea-f9ea27ee827b tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58bfb7417bc94583963401ae0fe9d39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0672be3fa3f7414da1c1a5b7300abbe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128729) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:51:39.200237 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: INFO nova.api.openstack.requestlog [None req-d9e30723-45d9-419f-a1ea-f9ea27ee827b tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] 10.222.0.61 "GET /compute/v2.1/servers/e33e9970-bfb7-46f3-8d40-782dbfa3d21c" status: 200 len: 1807 microversion: 2.20 time: 0.173224 May 14 15:51:39.200785 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: [pid: 128729|app: 0|req: 349/713] 10.222.0.61 () {60 vars in 1276 bytes} [Sat May 14 15:51:39 2022] GET /compute/v2.1/servers/e33e9970-bfb7-46f3-8d40-782dbfa3d21c => generated 1807 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 14 15:51:40.219738 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi [None req-aa6fd84f-fdfc-4235-9a14-7a48e4585f65 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Calling method '>' {{(pid=128728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 15:51:40.220356 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.compute.api [None req-aa6fd84f-fdfc-4235-9a14-7a48e4585f65 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] [instance: e33e9970-bfb7-46f3-8d40-782dbfa3d21c] Fetching instance by UUID {{(pid=128728) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 15:51:40.228268 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-aa6fd84f-fdfc-4235-9a14-7a48e4585f65 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:51:40.228794 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-aa6fd84f-fdfc-4235-9a14-7a48e4585f65 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:51:40.230196 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-aa6fd84f-fdfc-4235-9a14-7a48e4585f65 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:51:40.230695 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-aa6fd84f-fdfc-4235-9a14-7a48e4585f65 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:51:40.377405 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.policy [None req-aa6fd84f-fdfc-4235-9a14-7a48e4585f65 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58bfb7417bc94583963401ae0fe9d39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0672be3fa3f7414da1c1a5b7300abbe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128728) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:51:40.386576 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.policy [None req-aa6fd84f-fdfc-4235-9a14-7a48e4585f65 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58bfb7417bc94583963401ae0fe9d39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0672be3fa3f7414da1c1a5b7300abbe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128728) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:51:40.388444 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.policy [None req-aa6fd84f-fdfc-4235-9a14-7a48e4585f65 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58bfb7417bc94583963401ae0fe9d39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0672be3fa3f7414da1c1a5b7300abbe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128728) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:51:40.390999 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: INFO nova.api.openstack.requestlog [None req-aa6fd84f-fdfc-4235-9a14-7a48e4585f65 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] 10.222.0.61 "GET /compute/v2.1/servers/e33e9970-bfb7-46f3-8d40-782dbfa3d21c" status: 200 len: 1807 microversion: 2.20 time: 0.175805 May 14 15:51:40.391790 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: [pid: 128728|app: 0|req: 365/714] 10.222.0.61 () {60 vars in 1276 bytes} [Sat May 14 15:51:40 2022] GET /compute/v2.1/servers/e33e9970-bfb7-46f3-8d40-782dbfa3d21c => generated 1807 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 14 15:51:41.409494 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi [None req-d54af149-a4f7-4fab-9cde-721495ae4e03 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Calling method '>' {{(pid=128729) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 15:51:41.410097 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.compute.api [None req-d54af149-a4f7-4fab-9cde-721495ae4e03 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] [instance: e33e9970-bfb7-46f3-8d40-782dbfa3d21c] Fetching instance by UUID {{(pid=128729) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 15:51:41.416402 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-d54af149-a4f7-4fab-9cde-721495ae4e03 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:51:41.416843 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-d54af149-a4f7-4fab-9cde-721495ae4e03 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:51:41.417611 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-d54af149-a4f7-4fab-9cde-721495ae4e03 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:51:41.418041 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-d54af149-a4f7-4fab-9cde-721495ae4e03 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:51:41.550409 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.policy [None req-d54af149-a4f7-4fab-9cde-721495ae4e03 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58bfb7417bc94583963401ae0fe9d39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0672be3fa3f7414da1c1a5b7300abbe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128729) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:51:41.558634 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.policy [None req-d54af149-a4f7-4fab-9cde-721495ae4e03 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58bfb7417bc94583963401ae0fe9d39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0672be3fa3f7414da1c1a5b7300abbe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128729) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:51:41.560140 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.policy [None req-d54af149-a4f7-4fab-9cde-721495ae4e03 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58bfb7417bc94583963401ae0fe9d39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0672be3fa3f7414da1c1a5b7300abbe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128729) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:51:41.561341 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: INFO nova.api.openstack.requestlog [None req-d54af149-a4f7-4fab-9cde-721495ae4e03 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] 10.222.0.61 "GET /compute/v2.1/servers/e33e9970-bfb7-46f3-8d40-782dbfa3d21c" status: 200 len: 1807 microversion: 2.20 time: 0.156307 May 14 15:51:41.561854 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: [pid: 128729|app: 0|req: 350/715] 10.222.0.61 () {60 vars in 1276 bytes} [Sat May 14 15:51:41 2022] GET /compute/v2.1/servers/e33e9970-bfb7-46f3-8d40-782dbfa3d21c => generated 1807 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 14 15:51:42.580451 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi [None req-944acb05-cef9-4c08-93f8-ec7d7b6254fa tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Calling method '>' {{(pid=128728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 15:51:42.581067 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.compute.api [None req-944acb05-cef9-4c08-93f8-ec7d7b6254fa tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] [instance: e33e9970-bfb7-46f3-8d40-782dbfa3d21c] Fetching instance by UUID {{(pid=128728) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 15:51:42.587980 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-944acb05-cef9-4c08-93f8-ec7d7b6254fa tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:51:42.588420 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-944acb05-cef9-4c08-93f8-ec7d7b6254fa tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:51:42.589216 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-944acb05-cef9-4c08-93f8-ec7d7b6254fa tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:51:42.589643 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-944acb05-cef9-4c08-93f8-ec7d7b6254fa tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:51:42.748197 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.policy [None req-944acb05-cef9-4c08-93f8-ec7d7b6254fa tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58bfb7417bc94583963401ae0fe9d39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0672be3fa3f7414da1c1a5b7300abbe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128728) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:51:42.758700 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.policy [None req-944acb05-cef9-4c08-93f8-ec7d7b6254fa tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58bfb7417bc94583963401ae0fe9d39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0672be3fa3f7414da1c1a5b7300abbe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128728) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:51:42.760790 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.policy [None req-944acb05-cef9-4c08-93f8-ec7d7b6254fa tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58bfb7417bc94583963401ae0fe9d39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0672be3fa3f7414da1c1a5b7300abbe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128728) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:51:42.762465 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: INFO nova.api.openstack.requestlog [None req-944acb05-cef9-4c08-93f8-ec7d7b6254fa tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] 10.222.0.61 "GET /compute/v2.1/servers/e33e9970-bfb7-46f3-8d40-782dbfa3d21c" status: 200 len: 1807 microversion: 2.20 time: 0.186724 May 14 15:51:42.763231 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: [pid: 128728|app: 0|req: 366/716] 10.222.0.61 () {60 vars in 1276 bytes} [Sat May 14 15:51:42 2022] GET /compute/v2.1/servers/e33e9970-bfb7-46f3-8d40-782dbfa3d21c => generated 1807 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 14 15:51:43.782199 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi [None req-94f635dc-02ea-4fe9-8579-db2f1d0b166d tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Calling method '>' {{(pid=128729) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 15:51:43.782935 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.compute.api [None req-94f635dc-02ea-4fe9-8579-db2f1d0b166d tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] [instance: e33e9970-bfb7-46f3-8d40-782dbfa3d21c] Fetching instance by UUID {{(pid=128729) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 15:51:43.789494 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-94f635dc-02ea-4fe9-8579-db2f1d0b166d tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:51:43.790148 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-94f635dc-02ea-4fe9-8579-db2f1d0b166d tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:51:43.790979 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-94f635dc-02ea-4fe9-8579-db2f1d0b166d tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:51:43.791418 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-94f635dc-02ea-4fe9-8579-db2f1d0b166d tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:51:43.935214 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.policy [None req-94f635dc-02ea-4fe9-8579-db2f1d0b166d tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58bfb7417bc94583963401ae0fe9d39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0672be3fa3f7414da1c1a5b7300abbe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128729) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:51:43.945510 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.policy [None req-94f635dc-02ea-4fe9-8579-db2f1d0b166d tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58bfb7417bc94583963401ae0fe9d39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0672be3fa3f7414da1c1a5b7300abbe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128729) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:51:43.947606 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.policy [None req-94f635dc-02ea-4fe9-8579-db2f1d0b166d tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58bfb7417bc94583963401ae0fe9d39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0672be3fa3f7414da1c1a5b7300abbe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128729) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:51:43.950060 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: INFO nova.api.openstack.requestlog [None req-94f635dc-02ea-4fe9-8579-db2f1d0b166d tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] 10.222.0.61 "GET /compute/v2.1/servers/e33e9970-bfb7-46f3-8d40-782dbfa3d21c" status: 200 len: 1807 microversion: 2.20 time: 0.173079 May 14 15:51:43.950863 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: [pid: 128729|app: 0|req: 351/717] 10.222.0.61 () {60 vars in 1276 bytes} [Sat May 14 15:51:43 2022] GET /compute/v2.1/servers/e33e9970-bfb7-46f3-8d40-782dbfa3d21c => generated 1807 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 14 15:51:44.969563 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi [None req-c57d7d24-ca53-4725-ab56-ddf9e0a4e32e tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Calling method '>' {{(pid=128728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 15:51:44.970176 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.compute.api [None req-c57d7d24-ca53-4725-ab56-ddf9e0a4e32e tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] [instance: e33e9970-bfb7-46f3-8d40-782dbfa3d21c] Fetching instance by UUID {{(pid=128728) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 15:51:44.978645 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-c57d7d24-ca53-4725-ab56-ddf9e0a4e32e tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:51:44.979304 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-c57d7d24-ca53-4725-ab56-ddf9e0a4e32e tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:51:44.980251 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-c57d7d24-ca53-4725-ab56-ddf9e0a4e32e tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:51:44.981223 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-c57d7d24-ca53-4725-ab56-ddf9e0a4e32e tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:51:45.134916 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.policy [None req-c57d7d24-ca53-4725-ab56-ddf9e0a4e32e tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58bfb7417bc94583963401ae0fe9d39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0672be3fa3f7414da1c1a5b7300abbe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128728) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:51:45.146134 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.policy [None req-c57d7d24-ca53-4725-ab56-ddf9e0a4e32e tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58bfb7417bc94583963401ae0fe9d39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0672be3fa3f7414da1c1a5b7300abbe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128728) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:51:45.148204 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.policy [None req-c57d7d24-ca53-4725-ab56-ddf9e0a4e32e tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58bfb7417bc94583963401ae0fe9d39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0672be3fa3f7414da1c1a5b7300abbe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128728) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:51:45.151037 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: INFO nova.api.openstack.requestlog [None req-c57d7d24-ca53-4725-ab56-ddf9e0a4e32e tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] 10.222.0.61 "GET /compute/v2.1/servers/e33e9970-bfb7-46f3-8d40-782dbfa3d21c" status: 200 len: 1807 microversion: 2.20 time: 0.185249 May 14 15:51:45.152480 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: [pid: 128728|app: 0|req: 367/718] 10.222.0.61 () {60 vars in 1276 bytes} [Sat May 14 15:51:44 2022] GET /compute/v2.1/servers/e33e9970-bfb7-46f3-8d40-782dbfa3d21c => generated 1807 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 14 15:51:46.171984 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi [None req-d6490f66-c471-40a1-9cc3-4529642177e1 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Calling method '>' {{(pid=128729) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 15:51:46.172606 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.compute.api [None req-d6490f66-c471-40a1-9cc3-4529642177e1 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] [instance: e33e9970-bfb7-46f3-8d40-782dbfa3d21c] Fetching instance by UUID {{(pid=128729) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 15:51:46.179711 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-d6490f66-c471-40a1-9cc3-4529642177e1 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:51:46.180260 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-d6490f66-c471-40a1-9cc3-4529642177e1 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:51:46.181320 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-d6490f66-c471-40a1-9cc3-4529642177e1 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:51:46.181991 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-d6490f66-c471-40a1-9cc3-4529642177e1 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:51:46.352470 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.policy [None req-d6490f66-c471-40a1-9cc3-4529642177e1 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58bfb7417bc94583963401ae0fe9d39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0672be3fa3f7414da1c1a5b7300abbe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128729) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:51:46.364233 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.policy [None req-d6490f66-c471-40a1-9cc3-4529642177e1 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58bfb7417bc94583963401ae0fe9d39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0672be3fa3f7414da1c1a5b7300abbe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128729) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:51:46.367678 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.policy [None req-d6490f66-c471-40a1-9cc3-4529642177e1 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58bfb7417bc94583963401ae0fe9d39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0672be3fa3f7414da1c1a5b7300abbe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128729) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:51:46.370162 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: INFO nova.api.openstack.requestlog [None req-d6490f66-c471-40a1-9cc3-4529642177e1 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] 10.222.0.61 "GET /compute/v2.1/servers/e33e9970-bfb7-46f3-8d40-782dbfa3d21c" status: 200 len: 1807 microversion: 2.20 time: 0.202499 May 14 15:51:46.371339 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: [pid: 128729|app: 0|req: 352/719] 10.222.0.61 () {60 vars in 1276 bytes} [Sat May 14 15:51:46 2022] GET /compute/v2.1/servers/e33e9970-bfb7-46f3-8d40-782dbfa3d21c => generated 1807 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 14 15:51:47.389192 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi [None req-2c3d7409-2cca-4135-81e1-42e361bc76b9 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Calling method '>' {{(pid=128728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 15:51:47.390608 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.compute.api [None req-2c3d7409-2cca-4135-81e1-42e361bc76b9 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] [instance: e33e9970-bfb7-46f3-8d40-782dbfa3d21c] Fetching instance by UUID {{(pid=128728) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 15:51:47.398079 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-2c3d7409-2cca-4135-81e1-42e361bc76b9 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:51:47.398563 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-2c3d7409-2cca-4135-81e1-42e361bc76b9 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:51:47.399362 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-2c3d7409-2cca-4135-81e1-42e361bc76b9 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:51:47.399808 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-2c3d7409-2cca-4135-81e1-42e361bc76b9 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:51:47.662195 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.policy [None req-2c3d7409-2cca-4135-81e1-42e361bc76b9 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58bfb7417bc94583963401ae0fe9d39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0672be3fa3f7414da1c1a5b7300abbe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128728) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:51:47.672491 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.policy [None req-2c3d7409-2cca-4135-81e1-42e361bc76b9 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58bfb7417bc94583963401ae0fe9d39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0672be3fa3f7414da1c1a5b7300abbe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128728) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:51:47.677357 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.policy [None req-2c3d7409-2cca-4135-81e1-42e361bc76b9 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58bfb7417bc94583963401ae0fe9d39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0672be3fa3f7414da1c1a5b7300abbe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128728) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:51:47.678934 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: INFO nova.api.openstack.requestlog [None req-2c3d7409-2cca-4135-81e1-42e361bc76b9 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] 10.222.0.61 "GET /compute/v2.1/servers/e33e9970-bfb7-46f3-8d40-782dbfa3d21c" status: 200 len: 1807 microversion: 2.20 time: 0.293553 May 14 15:51:47.679517 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: [pid: 128728|app: 0|req: 368/720] 10.222.0.61 () {60 vars in 1276 bytes} [Sat May 14 15:51:47 2022] GET /compute/v2.1/servers/e33e9970-bfb7-46f3-8d40-782dbfa3d21c => generated 1807 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 14 15:51:48.704750 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi [None req-53d3e045-a424-4da2-8c5c-26c4f1978c46 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Calling method '>' {{(pid=128729) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 15:51:48.706628 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.compute.api [None req-53d3e045-a424-4da2-8c5c-26c4f1978c46 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] [instance: e33e9970-bfb7-46f3-8d40-782dbfa3d21c] Fetching instance by UUID {{(pid=128729) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 15:51:48.735161 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-53d3e045-a424-4da2-8c5c-26c4f1978c46 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:51:48.736380 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-53d3e045-a424-4da2-8c5c-26c4f1978c46 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:51:48.746048 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-53d3e045-a424-4da2-8c5c-26c4f1978c46 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:51:48.747544 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-53d3e045-a424-4da2-8c5c-26c4f1978c46 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:51:48.969613 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.policy [None req-53d3e045-a424-4da2-8c5c-26c4f1978c46 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58bfb7417bc94583963401ae0fe9d39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0672be3fa3f7414da1c1a5b7300abbe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128729) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:51:48.979298 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.policy [None req-53d3e045-a424-4da2-8c5c-26c4f1978c46 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58bfb7417bc94583963401ae0fe9d39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0672be3fa3f7414da1c1a5b7300abbe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128729) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:51:48.981167 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.policy [None req-53d3e045-a424-4da2-8c5c-26c4f1978c46 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58bfb7417bc94583963401ae0fe9d39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0672be3fa3f7414da1c1a5b7300abbe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128729) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:51:48.984268 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: INFO nova.api.openstack.requestlog [None req-53d3e045-a424-4da2-8c5c-26c4f1978c46 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] 10.222.0.61 "GET /compute/v2.1/servers/e33e9970-bfb7-46f3-8d40-782dbfa3d21c" status: 200 len: 1807 microversion: 2.20 time: 0.288104 May 14 15:51:48.996317 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: [pid: 128729|app: 0|req: 353/721] 10.222.0.61 () {60 vars in 1276 bytes} [Sat May 14 15:51:48 2022] GET /compute/v2.1/servers/e33e9970-bfb7-46f3-8d40-782dbfa3d21c => generated 1807 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 14 15:51:49.402476 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi [None req-df298045-8a6f-4ac5-8917-6ad4a909a313 tempest-TestShelveInstance-1853374188 tempest-TestShelveInstance-1853374188-project] Action: 'create', calling method: .version_select at 0x7f77cb706940>, body: {"keypair": {"name": "tempest-TestShelveInstance-1734050536", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAnjlYqcAbFCVluAscZrLP5oyXpFGkyZZFXAe6XoikVpWvZsNkaEe6h+wZnBRwOdD6Wl9JkQPns5GxV+ovlKwet1snS3BUMTboph1zrM8ZL/ulVEOVKgEdCAWgo1JR/D9A=="}} {{(pid=128728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 15:51:49.417672 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.quota [None req-df298045-8a6f-4ac5-8917-6ad4a909a313 tempest-TestShelveInstance-1853374188 tempest-TestShelveInstance-1853374188-project] Getting quotas for project 83d6b6f0aa4f4314811ee80480861958. Resources: {'key_pairs'} {{(pid=128728) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 14 15:51:49.422343 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.quota [None req-df298045-8a6f-4ac5-8917-6ad4a909a313 tempest-TestShelveInstance-1853374188 tempest-TestShelveInstance-1853374188-project] Getting quotas for user 4e05ae1c6a054a299e841d008f9d7a09 and project 83d6b6f0aa4f4314811ee80480861958. Resources: {'key_pairs'} {{(pid=128728) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 14 15:51:49.446831 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: INFO nova.api.openstack.requestlog [None req-df298045-8a6f-4ac5-8917-6ad4a909a313 tempest-TestShelveInstance-1853374188 tempest-TestShelveInstance-1853374188-project] 10.222.0.61 "POST /compute/v2.1/os-keypairs" status: 200 len: 397 microversion: 2.1 time: 0.236540 May 14 15:51:49.452760 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: [pid: 128728|app: 0|req: 369/722] 10.222.0.61 () {60 vars in 1158 bytes} [Sat May 14 15:51:49 2022] POST /compute/v2.1/os-keypairs => generated 397 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 14 15:51:50.003247 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi [None req-873a6ed1-cd29-489f-a9f4-85551df190ae tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Calling method '>' {{(pid=128729) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 15:51:50.003856 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.compute.api [None req-873a6ed1-cd29-489f-a9f4-85551df190ae tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] [instance: e33e9970-bfb7-46f3-8d40-782dbfa3d21c] Fetching instance by UUID {{(pid=128729) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 15:51:50.009889 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-873a6ed1-cd29-489f-a9f4-85551df190ae tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:51:50.010375 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-873a6ed1-cd29-489f-a9f4-85551df190ae tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:51:50.011150 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-873a6ed1-cd29-489f-a9f4-85551df190ae tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:51:50.011594 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-873a6ed1-cd29-489f-a9f4-85551df190ae tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:51:50.147780 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.policy [None req-873a6ed1-cd29-489f-a9f4-85551df190ae tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58bfb7417bc94583963401ae0fe9d39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0672be3fa3f7414da1c1a5b7300abbe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128729) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:51:50.156645 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.policy [None req-873a6ed1-cd29-489f-a9f4-85551df190ae tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58bfb7417bc94583963401ae0fe9d39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0672be3fa3f7414da1c1a5b7300abbe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128729) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:51:50.158155 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.policy [None req-873a6ed1-cd29-489f-a9f4-85551df190ae tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58bfb7417bc94583963401ae0fe9d39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0672be3fa3f7414da1c1a5b7300abbe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128729) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:51:50.159350 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: INFO nova.api.openstack.requestlog [None req-873a6ed1-cd29-489f-a9f4-85551df190ae tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] 10.222.0.61 "GET /compute/v2.1/servers/e33e9970-bfb7-46f3-8d40-782dbfa3d21c" status: 200 len: 1807 microversion: 2.20 time: 0.160029 May 14 15:51:50.159907 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: [pid: 128729|app: 0|req: 354/723] 10.222.0.61 () {60 vars in 1276 bytes} [Sat May 14 15:51:49 2022] GET /compute/v2.1/servers/e33e9970-bfb7-46f3-8d40-782dbfa3d21c => generated 1807 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 14 15:51:51.177684 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi [None req-d7980448-040e-4781-81f4-d66ba88cca5d tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Calling method '>' {{(pid=128728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 15:51:51.178279 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.compute.api [None req-d7980448-040e-4781-81f4-d66ba88cca5d tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] [instance: e33e9970-bfb7-46f3-8d40-782dbfa3d21c] Fetching instance by UUID {{(pid=128728) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 15:51:51.184704 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-d7980448-040e-4781-81f4-d66ba88cca5d tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:51:51.185153 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-d7980448-040e-4781-81f4-d66ba88cca5d tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:51:51.186451 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-d7980448-040e-4781-81f4-d66ba88cca5d tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:51:51.186910 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-d7980448-040e-4781-81f4-d66ba88cca5d tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:51:51.332560 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.policy [None req-d7980448-040e-4781-81f4-d66ba88cca5d tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58bfb7417bc94583963401ae0fe9d39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0672be3fa3f7414da1c1a5b7300abbe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128728) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:51:51.340927 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.policy [None req-d7980448-040e-4781-81f4-d66ba88cca5d tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58bfb7417bc94583963401ae0fe9d39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0672be3fa3f7414da1c1a5b7300abbe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128728) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:51:51.343517 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.policy [None req-d7980448-040e-4781-81f4-d66ba88cca5d tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58bfb7417bc94583963401ae0fe9d39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0672be3fa3f7414da1c1a5b7300abbe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128728) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:51:51.344685 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: INFO nova.api.openstack.requestlog [None req-d7980448-040e-4781-81f4-d66ba88cca5d tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] 10.222.0.61 "GET /compute/v2.1/servers/e33e9970-bfb7-46f3-8d40-782dbfa3d21c" status: 200 len: 1807 microversion: 2.20 time: 0.171427 May 14 15:51:51.345252 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: [pid: 128728|app: 0|req: 370/724] 10.222.0.61 () {60 vars in 1276 bytes} [Sat May 14 15:51:51 2022] GET /compute/v2.1/servers/e33e9970-bfb7-46f3-8d40-782dbfa3d21c => generated 1807 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 14 15:51:52.364150 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi [None req-b9dcffe5-bd5e-4e98-9784-9b6061178c91 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Calling method '>' {{(pid=128729) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 15:51:52.364877 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.compute.api [None req-b9dcffe5-bd5e-4e98-9784-9b6061178c91 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] [instance: e33e9970-bfb7-46f3-8d40-782dbfa3d21c] Fetching instance by UUID {{(pid=128729) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 15:51:52.371551 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-b9dcffe5-bd5e-4e98-9784-9b6061178c91 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:51:52.372005 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-b9dcffe5-bd5e-4e98-9784-9b6061178c91 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:51:52.372818 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-b9dcffe5-bd5e-4e98-9784-9b6061178c91 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:51:52.373285 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-b9dcffe5-bd5e-4e98-9784-9b6061178c91 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:51:52.509095 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.policy [None req-b9dcffe5-bd5e-4e98-9784-9b6061178c91 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58bfb7417bc94583963401ae0fe9d39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0672be3fa3f7414da1c1a5b7300abbe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128729) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:51:52.517993 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.policy [None req-b9dcffe5-bd5e-4e98-9784-9b6061178c91 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58bfb7417bc94583963401ae0fe9d39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0672be3fa3f7414da1c1a5b7300abbe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128729) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:51:52.519524 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.policy [None req-b9dcffe5-bd5e-4e98-9784-9b6061178c91 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58bfb7417bc94583963401ae0fe9d39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0672be3fa3f7414da1c1a5b7300abbe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128729) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:51:52.520676 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: INFO nova.api.openstack.requestlog [None req-b9dcffe5-bd5e-4e98-9784-9b6061178c91 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] 10.222.0.61 "GET /compute/v2.1/servers/e33e9970-bfb7-46f3-8d40-782dbfa3d21c" status: 200 len: 1807 microversion: 2.20 time: 0.160700 May 14 15:51:52.521229 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: [pid: 128729|app: 0|req: 355/725] 10.222.0.61 () {60 vars in 1276 bytes} [Sat May 14 15:51:52 2022] GET /compute/v2.1/servers/e33e9970-bfb7-46f3-8d40-782dbfa3d21c => generated 1807 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 14 15:51:53.541086 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi [None req-d4942928-5c5a-4020-bdcf-7d6fa1e37fdb tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Calling method '>' {{(pid=128728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 15:51:53.541967 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.compute.api [None req-d4942928-5c5a-4020-bdcf-7d6fa1e37fdb tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] [instance: e33e9970-bfb7-46f3-8d40-782dbfa3d21c] Fetching instance by UUID {{(pid=128728) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 15:51:53.551608 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-d4942928-5c5a-4020-bdcf-7d6fa1e37fdb tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:51:53.552063 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-d4942928-5c5a-4020-bdcf-7d6fa1e37fdb tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:51:53.553176 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-d4942928-5c5a-4020-bdcf-7d6fa1e37fdb tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:51:53.553679 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-d4942928-5c5a-4020-bdcf-7d6fa1e37fdb tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:51:53.683153 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.policy [None req-d4942928-5c5a-4020-bdcf-7d6fa1e37fdb tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58bfb7417bc94583963401ae0fe9d39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0672be3fa3f7414da1c1a5b7300abbe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128728) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:51:53.691389 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.policy [None req-d4942928-5c5a-4020-bdcf-7d6fa1e37fdb tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58bfb7417bc94583963401ae0fe9d39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0672be3fa3f7414da1c1a5b7300abbe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128728) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:51:53.692917 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.policy [None req-d4942928-5c5a-4020-bdcf-7d6fa1e37fdb tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58bfb7417bc94583963401ae0fe9d39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0672be3fa3f7414da1c1a5b7300abbe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128728) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:51:53.694101 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: INFO nova.api.openstack.requestlog [None req-d4942928-5c5a-4020-bdcf-7d6fa1e37fdb tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] 10.222.0.61 "GET /compute/v2.1/servers/e33e9970-bfb7-46f3-8d40-782dbfa3d21c" status: 200 len: 1807 microversion: 2.20 time: 0.158258 May 14 15:51:53.694706 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: [pid: 128728|app: 0|req: 371/726] 10.222.0.61 () {60 vars in 1276 bytes} [Sat May 14 15:51:53 2022] GET /compute/v2.1/servers/e33e9970-bfb7-46f3-8d40-782dbfa3d21c => generated 1807 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 14 15:51:54.713195 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi [None req-678b480f-fd5c-4455-8e4b-78c1e4963ed6 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Calling method '>' {{(pid=128729) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 15:51:54.714480 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.compute.api [None req-678b480f-fd5c-4455-8e4b-78c1e4963ed6 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] [instance: e33e9970-bfb7-46f3-8d40-782dbfa3d21c] Fetching instance by UUID {{(pid=128729) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 15:51:54.721891 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-678b480f-fd5c-4455-8e4b-78c1e4963ed6 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:51:54.722391 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-678b480f-fd5c-4455-8e4b-78c1e4963ed6 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:51:54.723242 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-678b480f-fd5c-4455-8e4b-78c1e4963ed6 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:51:54.723766 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-678b480f-fd5c-4455-8e4b-78c1e4963ed6 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:51:54.763324 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi [req-7c1aa423-cfed-430e-8e7a-3b58f92049f0 req-11f4f127-7c32-4259-9fa3-0a8a3be511fd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e33e9970-bfb7-46f3-8d40-782dbfa3d21c", "name": "network-vif-plugged", "status": "completed", "tag": "759be0ca-daaf-4eba-97b6-a252b70cbb3b"}]} {{(pid=128728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 15:51:54.772154 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [req-7c1aa423-cfed-430e-8e7a-3b58f92049f0 req-11f4f127-7c32-4259-9fa3-0a8a3be511fd service nova] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:51:54.772564 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [req-7c1aa423-cfed-430e-8e7a-3b58f92049f0 req-11f4f127-7c32-4259-9fa3-0a8a3be511fd service nova] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:51:54.784716 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: INFO nova.api.openstack.compute.server_external_events [req-7c1aa423-cfed-430e-8e7a-3b58f92049f0 req-11f4f127-7c32-4259-9fa3-0a8a3be511fd service nova] Creating event network-vif-plugged:759be0ca-daaf-4eba-97b6-a252b70cbb3b for instance e33e9970-bfb7-46f3-8d40-782dbfa3d21c on hv-cinder-83979 May 14 15:51:54.789732 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: INFO nova.api.openstack.requestlog [req-7c1aa423-cfed-430e-8e7a-3b58f92049f0 req-11f4f127-7c32-4259-9fa3-0a8a3be511fd service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029987 May 14 15:51:54.790351 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: [pid: 128728|app: 0|req: 372/727] 10.222.0.61 () {64 vars in 1317 bytes} [Sat May 14 15:51:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 14 15:51:54.881137 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.policy [None req-678b480f-fd5c-4455-8e4b-78c1e4963ed6 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58bfb7417bc94583963401ae0fe9d39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0672be3fa3f7414da1c1a5b7300abbe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128729) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:51:54.889720 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.policy [None req-678b480f-fd5c-4455-8e4b-78c1e4963ed6 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58bfb7417bc94583963401ae0fe9d39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0672be3fa3f7414da1c1a5b7300abbe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128729) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:51:54.891236 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.policy [None req-678b480f-fd5c-4455-8e4b-78c1e4963ed6 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58bfb7417bc94583963401ae0fe9d39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0672be3fa3f7414da1c1a5b7300abbe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128729) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:51:54.892377 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: INFO nova.api.openstack.requestlog [None req-678b480f-fd5c-4455-8e4b-78c1e4963ed6 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] 10.222.0.61 "GET /compute/v2.1/servers/e33e9970-bfb7-46f3-8d40-782dbfa3d21c" status: 200 len: 1807 microversion: 2.20 time: 0.183341 May 14 15:51:54.892930 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: [pid: 128729|app: 0|req: 356/728] 10.222.0.61 () {60 vars in 1276 bytes} [Sat May 14 15:51:54 2022] GET /compute/v2.1/servers/e33e9970-bfb7-46f3-8d40-782dbfa3d21c => generated 1807 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 14 15:51:55.912192 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi [None req-40661284-84a6-4755-a3f8-441ed304c0f3 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Calling method '>' {{(pid=128728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 15:51:55.912892 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.compute.api [None req-40661284-84a6-4755-a3f8-441ed304c0f3 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] [instance: e33e9970-bfb7-46f3-8d40-782dbfa3d21c] Fetching instance by UUID {{(pid=128728) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 15:51:55.919224 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-40661284-84a6-4755-a3f8-441ed304c0f3 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:51:55.919674 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-40661284-84a6-4755-a3f8-441ed304c0f3 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:51:55.921183 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-40661284-84a6-4755-a3f8-441ed304c0f3 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:51:55.921183 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-40661284-84a6-4755-a3f8-441ed304c0f3 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:51:56.057388 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.policy [None req-40661284-84a6-4755-a3f8-441ed304c0f3 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58bfb7417bc94583963401ae0fe9d39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0672be3fa3f7414da1c1a5b7300abbe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128728) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:51:56.066864 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.policy [None req-40661284-84a6-4755-a3f8-441ed304c0f3 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58bfb7417bc94583963401ae0fe9d39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0672be3fa3f7414da1c1a5b7300abbe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128728) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:51:56.068366 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.policy [None req-40661284-84a6-4755-a3f8-441ed304c0f3 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58bfb7417bc94583963401ae0fe9d39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0672be3fa3f7414da1c1a5b7300abbe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128728) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:51:56.069511 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: INFO nova.api.openstack.requestlog [None req-40661284-84a6-4755-a3f8-441ed304c0f3 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] 10.222.0.61 "GET /compute/v2.1/servers/e33e9970-bfb7-46f3-8d40-782dbfa3d21c" status: 200 len: 1807 microversion: 2.20 time: 0.162011 May 14 15:51:56.070072 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: [pid: 128728|app: 0|req: 373/729] 10.222.0.61 () {60 vars in 1276 bytes} [Sat May 14 15:51:55 2022] GET /compute/v2.1/servers/e33e9970-bfb7-46f3-8d40-782dbfa3d21c => generated 1807 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 14 15:51:57.087596 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi [None req-154ac759-6f9e-4c7c-b1ec-cbafa3cd8e4d tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Calling method '>' {{(pid=128729) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 15:51:57.088136 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.compute.api [None req-154ac759-6f9e-4c7c-b1ec-cbafa3cd8e4d tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] [instance: e33e9970-bfb7-46f3-8d40-782dbfa3d21c] Fetching instance by UUID {{(pid=128729) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 15:51:57.095641 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-154ac759-6f9e-4c7c-b1ec-cbafa3cd8e4d tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:51:57.096363 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-154ac759-6f9e-4c7c-b1ec-cbafa3cd8e4d tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:51:57.097513 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-154ac759-6f9e-4c7c-b1ec-cbafa3cd8e4d tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:51:57.098165 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-154ac759-6f9e-4c7c-b1ec-cbafa3cd8e4d tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:51:57.229881 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.policy [None req-154ac759-6f9e-4c7c-b1ec-cbafa3cd8e4d tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58bfb7417bc94583963401ae0fe9d39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0672be3fa3f7414da1c1a5b7300abbe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128729) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:51:57.239799 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.policy [None req-154ac759-6f9e-4c7c-b1ec-cbafa3cd8e4d tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58bfb7417bc94583963401ae0fe9d39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0672be3fa3f7414da1c1a5b7300abbe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128729) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:51:57.241372 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.policy [None req-154ac759-6f9e-4c7c-b1ec-cbafa3cd8e4d tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58bfb7417bc94583963401ae0fe9d39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0672be3fa3f7414da1c1a5b7300abbe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128729) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:51:57.242609 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: INFO nova.api.openstack.requestlog [None req-154ac759-6f9e-4c7c-b1ec-cbafa3cd8e4d tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] 10.222.0.61 "GET /compute/v2.1/servers/e33e9970-bfb7-46f3-8d40-782dbfa3d21c" status: 200 len: 1807 microversion: 2.20 time: 0.158917 May 14 15:51:57.243160 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: [pid: 128729|app: 0|req: 357/730] 10.222.0.61 () {60 vars in 1276 bytes} [Sat May 14 15:51:57 2022] GET /compute/v2.1/servers/e33e9970-bfb7-46f3-8d40-782dbfa3d21c => generated 1807 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 14 15:51:58.260837 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi [None req-170941af-12fa-48b1-b484-0cb5b130987c tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Calling method '>' {{(pid=128728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 15:51:58.261472 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.compute.api [None req-170941af-12fa-48b1-b484-0cb5b130987c tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] [instance: e33e9970-bfb7-46f3-8d40-782dbfa3d21c] Fetching instance by UUID {{(pid=128728) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 15:51:58.267961 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-170941af-12fa-48b1-b484-0cb5b130987c tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:51:58.268408 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-170941af-12fa-48b1-b484-0cb5b130987c tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:51:58.269204 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-170941af-12fa-48b1-b484-0cb5b130987c tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:51:58.269628 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-170941af-12fa-48b1-b484-0cb5b130987c tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:51:58.401460 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.policy [None req-170941af-12fa-48b1-b484-0cb5b130987c tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58bfb7417bc94583963401ae0fe9d39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0672be3fa3f7414da1c1a5b7300abbe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128728) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:51:58.410730 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.policy [None req-170941af-12fa-48b1-b484-0cb5b130987c tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58bfb7417bc94583963401ae0fe9d39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0672be3fa3f7414da1c1a5b7300abbe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128728) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:51:58.412221 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.policy [None req-170941af-12fa-48b1-b484-0cb5b130987c tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58bfb7417bc94583963401ae0fe9d39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0672be3fa3f7414da1c1a5b7300abbe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128728) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:51:58.413369 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: INFO nova.api.openstack.requestlog [None req-170941af-12fa-48b1-b484-0cb5b130987c tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] 10.222.0.61 "GET /compute/v2.1/servers/e33e9970-bfb7-46f3-8d40-782dbfa3d21c" status: 200 len: 1807 microversion: 2.20 time: 0.156425 May 14 15:51:58.413925 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: [pid: 128728|app: 0|req: 374/731] 10.222.0.61 () {60 vars in 1276 bytes} [Sat May 14 15:51:58 2022] GET /compute/v2.1/servers/e33e9970-bfb7-46f3-8d40-782dbfa3d21c => generated 1807 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 14 15:51:59.431198 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi [None req-3c0b2cf1-b9b8-475e-90cf-efed194345ce tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Calling method '>' {{(pid=128729) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 15:51:59.431816 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.compute.api [None req-3c0b2cf1-b9b8-475e-90cf-efed194345ce tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] [instance: e33e9970-bfb7-46f3-8d40-782dbfa3d21c] Fetching instance by UUID {{(pid=128729) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 15:51:59.439586 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-3c0b2cf1-b9b8-475e-90cf-efed194345ce tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:51:59.440044 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-3c0b2cf1-b9b8-475e-90cf-efed194345ce tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:51:59.440827 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-3c0b2cf1-b9b8-475e-90cf-efed194345ce tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:51:59.441268 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-3c0b2cf1-b9b8-475e-90cf-efed194345ce tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:51:59.584038 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.policy [None req-3c0b2cf1-b9b8-475e-90cf-efed194345ce tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58bfb7417bc94583963401ae0fe9d39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0672be3fa3f7414da1c1a5b7300abbe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128729) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:51:59.592805 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.policy [None req-3c0b2cf1-b9b8-475e-90cf-efed194345ce tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58bfb7417bc94583963401ae0fe9d39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0672be3fa3f7414da1c1a5b7300abbe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128729) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:51:59.594391 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.policy [None req-3c0b2cf1-b9b8-475e-90cf-efed194345ce tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58bfb7417bc94583963401ae0fe9d39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0672be3fa3f7414da1c1a5b7300abbe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128729) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:51:59.595550 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: INFO nova.api.openstack.requestlog [None req-3c0b2cf1-b9b8-475e-90cf-efed194345ce tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] 10.222.0.61 "GET /compute/v2.1/servers/e33e9970-bfb7-46f3-8d40-782dbfa3d21c" status: 200 len: 1807 microversion: 2.20 time: 0.168230 May 14 15:51:59.596107 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: [pid: 128729|app: 0|req: 358/732] 10.222.0.61 () {60 vars in 1276 bytes} [Sat May 14 15:51:59 2022] GET /compute/v2.1/servers/e33e9970-bfb7-46f3-8d40-782dbfa3d21c => generated 1807 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 14 15:52:00.616201 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi [None req-c758bc3f-9092-4726-8252-27a2bc802ee3 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Calling method '>' {{(pid=128728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 15:52:00.616804 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.compute.api [None req-c758bc3f-9092-4726-8252-27a2bc802ee3 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] [instance: e33e9970-bfb7-46f3-8d40-782dbfa3d21c] Fetching instance by UUID {{(pid=128728) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 15:52:00.623061 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-c758bc3f-9092-4726-8252-27a2bc802ee3 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:52:00.624207 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-c758bc3f-9092-4726-8252-27a2bc802ee3 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:52:00.625133 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-c758bc3f-9092-4726-8252-27a2bc802ee3 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:52:00.625568 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-c758bc3f-9092-4726-8252-27a2bc802ee3 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:52:00.768057 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.policy [None req-c758bc3f-9092-4726-8252-27a2bc802ee3 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58bfb7417bc94583963401ae0fe9d39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0672be3fa3f7414da1c1a5b7300abbe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128728) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:52:00.776226 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.policy [None req-c758bc3f-9092-4726-8252-27a2bc802ee3 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58bfb7417bc94583963401ae0fe9d39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0672be3fa3f7414da1c1a5b7300abbe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128728) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:52:00.777742 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.policy [None req-c758bc3f-9092-4726-8252-27a2bc802ee3 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58bfb7417bc94583963401ae0fe9d39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0672be3fa3f7414da1c1a5b7300abbe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128728) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:52:00.778940 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: INFO nova.api.openstack.requestlog [None req-c758bc3f-9092-4726-8252-27a2bc802ee3 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] 10.222.0.61 "GET /compute/v2.1/servers/e33e9970-bfb7-46f3-8d40-782dbfa3d21c" status: 200 len: 1794 microversion: 2.20 time: 0.166914 May 14 15:52:00.780565 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: [pid: 128728|app: 0|req: 375/733] 10.222.0.61 () {60 vars in 1276 bytes} [Sat May 14 15:52:00 2022] GET /compute/v2.1/servers/e33e9970-bfb7-46f3-8d40-782dbfa3d21c => generated 1794 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 14 15:52:01.735847 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi [None req-c758161f-f11d-4b59-bedb-d0b6c1f0746c tempest-TestMinimumBasicScenario-1817438735 tempest-TestMinimumBasicScenario-1817438735-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=128729) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 15:52:01.736778 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.compute.api [None req-c758161f-f11d-4b59-bedb-d0b6c1f0746c tempest-TestMinimumBasicScenario-1817438735 tempest-TestMinimumBasicScenario-1817438735-project] [instance: ef63d04a-87e5-4202-a672-d45a2a877c68] Fetching instance by UUID {{(pid=128729) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 15:52:01.743309 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-c758161f-f11d-4b59-bedb-d0b6c1f0746c tempest-TestMinimumBasicScenario-1817438735 tempest-TestMinimumBasicScenario-1817438735-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:52:01.743754 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-c758161f-f11d-4b59-bedb-d0b6c1f0746c tempest-TestMinimumBasicScenario-1817438735 tempest-TestMinimumBasicScenario-1817438735-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:52:01.744520 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-c758161f-f11d-4b59-bedb-d0b6c1f0746c tempest-TestMinimumBasicScenario-1817438735 tempest-TestMinimumBasicScenario-1817438735-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:52:01.744955 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-c758161f-f11d-4b59-bedb-d0b6c1f0746c tempest-TestMinimumBasicScenario-1817438735 tempest-TestMinimumBasicScenario-1817438735-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:52:01.818735 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: INFO nova.api.openstack.requestlog [None req-c758161f-f11d-4b59-bedb-d0b6c1f0746c tempest-TestMinimumBasicScenario-1817438735 tempest-TestMinimumBasicScenario-1817438735-project] 10.222.0.61 "POST /compute/v2.1/servers/ef63d04a-87e5-4202-a672-d45a2a877c68/action" status: 202 len: 0 microversion: 2.1 time: 0.087124 May 14 15:52:01.819426 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: [pid: 128729|app: 0|req: 359/734] 10.222.0.61 () {60 vars in 1277 bytes} [Sat May 14 15:52:01 2022] POST /compute/v2.1/servers/ef63d04a-87e5-4202-a672-d45a2a877c68/action => generated 0 bytes in 89 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 14 15:52:01.828489 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi [None req-b75495bd-9789-4287-86e9-131863bd6ddb tempest-TestMinimumBasicScenario-1817438735 tempest-TestMinimumBasicScenario-1817438735-project] Calling method '>' {{(pid=128728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 15:52:01.829110 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.compute.api [None req-b75495bd-9789-4287-86e9-131863bd6ddb tempest-TestMinimumBasicScenario-1817438735 tempest-TestMinimumBasicScenario-1817438735-project] [instance: ef63d04a-87e5-4202-a672-d45a2a877c68] Fetching instance by UUID {{(pid=128728) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 15:52:01.836059 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-b75495bd-9789-4287-86e9-131863bd6ddb tempest-TestMinimumBasicScenario-1817438735 tempest-TestMinimumBasicScenario-1817438735-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:52:01.837322 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-b75495bd-9789-4287-86e9-131863bd6ddb tempest-TestMinimumBasicScenario-1817438735 tempest-TestMinimumBasicScenario-1817438735-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:52:01.838123 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-b75495bd-9789-4287-86e9-131863bd6ddb tempest-TestMinimumBasicScenario-1817438735 tempest-TestMinimumBasicScenario-1817438735-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:52:01.841099 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-b75495bd-9789-4287-86e9-131863bd6ddb tempest-TestMinimumBasicScenario-1817438735 tempest-TestMinimumBasicScenario-1817438735-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:52:02.010479 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.policy [None req-b75495bd-9789-4287-86e9-131863bd6ddb tempest-TestMinimumBasicScenario-1817438735 tempest-TestMinimumBasicScenario-1817438735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d5f259e0b98457ea6b6b88d886c813d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fba11e8ade54d388361c4c936a43372', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128728) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:52:02.019362 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: INFO nova.api.openstack.requestlog [None req-b75495bd-9789-4287-86e9-131863bd6ddb tempest-TestMinimumBasicScenario-1817438735 tempest-TestMinimumBasicScenario-1817438735-project] 10.222.0.61 "GET /compute/v2.1/servers/ef63d04a-87e5-4202-a672-d45a2a877c68" status: 200 len: 1749 microversion: 2.1 time: 0.195765 May 14 15:52:02.019945 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: [pid: 128728|app: 0|req: 376/735] 10.222.0.61 () {58 vars in 1235 bytes} [Sat May 14 15:52:01 2022] GET /compute/v2.1/servers/ef63d04a-87e5-4202-a672-d45a2a877c68 => generated 1749 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 15:52:03.039356 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi [None req-a5ac966a-d398-40b1-b333-0ad84fe39309 tempest-TestMinimumBasicScenario-1817438735 tempest-TestMinimumBasicScenario-1817438735-project] Calling method '>' {{(pid=128729) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 15:52:03.039985 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.compute.api [None req-a5ac966a-d398-40b1-b333-0ad84fe39309 tempest-TestMinimumBasicScenario-1817438735 tempest-TestMinimumBasicScenario-1817438735-project] [instance: ef63d04a-87e5-4202-a672-d45a2a877c68] Fetching instance by UUID {{(pid=128729) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 15:52:03.046074 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-a5ac966a-d398-40b1-b333-0ad84fe39309 tempest-TestMinimumBasicScenario-1817438735 tempest-TestMinimumBasicScenario-1817438735-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:52:03.046555 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-a5ac966a-d398-40b1-b333-0ad84fe39309 tempest-TestMinimumBasicScenario-1817438735 tempest-TestMinimumBasicScenario-1817438735-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:52:03.047315 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-a5ac966a-d398-40b1-b333-0ad84fe39309 tempest-TestMinimumBasicScenario-1817438735 tempest-TestMinimumBasicScenario-1817438735-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:52:03.047744 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-a5ac966a-d398-40b1-b333-0ad84fe39309 tempest-TestMinimumBasicScenario-1817438735 tempest-TestMinimumBasicScenario-1817438735-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:52:03.187334 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.policy [None req-a5ac966a-d398-40b1-b333-0ad84fe39309 tempest-TestMinimumBasicScenario-1817438735 tempest-TestMinimumBasicScenario-1817438735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d5f259e0b98457ea6b6b88d886c813d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fba11e8ade54d388361c4c936a43372', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128729) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:52:03.194925 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: INFO nova.api.openstack.requestlog [None req-a5ac966a-d398-40b1-b333-0ad84fe39309 tempest-TestMinimumBasicScenario-1817438735 tempest-TestMinimumBasicScenario-1817438735-project] 10.222.0.61 "GET /compute/v2.1/servers/ef63d04a-87e5-4202-a672-d45a2a877c68" status: 200 len: 1754 microversion: 2.1 time: 0.160358 May 14 15:52:03.195482 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: [pid: 128729|app: 0|req: 360/736] 10.222.0.61 () {58 vars in 1235 bytes} [Sat May 14 15:52:03 2022] GET /compute/v2.1/servers/ef63d04a-87e5-4202-a672-d45a2a877c68 => generated 1754 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 15:52:04.212214 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi [None req-a8e0ecf7-0a26-4a45-b626-1328216ae0a3 tempest-TestMinimumBasicScenario-1817438735 tempest-TestMinimumBasicScenario-1817438735-project] Calling method '>' {{(pid=128728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 15:52:04.212830 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.compute.api [None req-a8e0ecf7-0a26-4a45-b626-1328216ae0a3 tempest-TestMinimumBasicScenario-1817438735 tempest-TestMinimumBasicScenario-1817438735-project] [instance: ef63d04a-87e5-4202-a672-d45a2a877c68] Fetching instance by UUID {{(pid=128728) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 15:52:04.219946 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-a8e0ecf7-0a26-4a45-b626-1328216ae0a3 tempest-TestMinimumBasicScenario-1817438735 tempest-TestMinimumBasicScenario-1817438735-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:52:04.220397 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-a8e0ecf7-0a26-4a45-b626-1328216ae0a3 tempest-TestMinimumBasicScenario-1817438735 tempest-TestMinimumBasicScenario-1817438735-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:52:04.221164 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-a8e0ecf7-0a26-4a45-b626-1328216ae0a3 tempest-TestMinimumBasicScenario-1817438735 tempest-TestMinimumBasicScenario-1817438735-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:52:04.221603 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-a8e0ecf7-0a26-4a45-b626-1328216ae0a3 tempest-TestMinimumBasicScenario-1817438735 tempest-TestMinimumBasicScenario-1817438735-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:52:04.359853 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.policy [None req-a8e0ecf7-0a26-4a45-b626-1328216ae0a3 tempest-TestMinimumBasicScenario-1817438735 tempest-TestMinimumBasicScenario-1817438735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d5f259e0b98457ea6b6b88d886c813d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fba11e8ade54d388361c4c936a43372', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128728) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:52:04.367727 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: INFO nova.api.openstack.requestlog [None req-a8e0ecf7-0a26-4a45-b626-1328216ae0a3 tempest-TestMinimumBasicScenario-1817438735 tempest-TestMinimumBasicScenario-1817438735-project] 10.222.0.61 "GET /compute/v2.1/servers/ef63d04a-87e5-4202-a672-d45a2a877c68" status: 200 len: 1754 microversion: 2.1 time: 0.159344 May 14 15:52:04.368292 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: [pid: 128728|app: 0|req: 377/737] 10.222.0.61 () {58 vars in 1235 bytes} [Sat May 14 15:52:04 2022] GET /compute/v2.1/servers/ef63d04a-87e5-4202-a672-d45a2a877c68 => generated 1754 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 15:52:05.384968 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi [None req-9d1a53bb-bbaf-476b-b58b-6d9c7d9a3194 tempest-TestMinimumBasicScenario-1817438735 tempest-TestMinimumBasicScenario-1817438735-project] Calling method '>' {{(pid=128729) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 15:52:05.385599 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.compute.api [None req-9d1a53bb-bbaf-476b-b58b-6d9c7d9a3194 tempest-TestMinimumBasicScenario-1817438735 tempest-TestMinimumBasicScenario-1817438735-project] [instance: ef63d04a-87e5-4202-a672-d45a2a877c68] Fetching instance by UUID {{(pid=128729) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 15:52:05.391704 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-9d1a53bb-bbaf-476b-b58b-6d9c7d9a3194 tempest-TestMinimumBasicScenario-1817438735 tempest-TestMinimumBasicScenario-1817438735-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:52:05.392175 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-9d1a53bb-bbaf-476b-b58b-6d9c7d9a3194 tempest-TestMinimumBasicScenario-1817438735 tempest-TestMinimumBasicScenario-1817438735-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:52:05.392935 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-9d1a53bb-bbaf-476b-b58b-6d9c7d9a3194 tempest-TestMinimumBasicScenario-1817438735 tempest-TestMinimumBasicScenario-1817438735-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:52:05.393368 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-9d1a53bb-bbaf-476b-b58b-6d9c7d9a3194 tempest-TestMinimumBasicScenario-1817438735 tempest-TestMinimumBasicScenario-1817438735-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:52:05.535840 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.policy [None req-9d1a53bb-bbaf-476b-b58b-6d9c7d9a3194 tempest-TestMinimumBasicScenario-1817438735 tempest-TestMinimumBasicScenario-1817438735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d5f259e0b98457ea6b6b88d886c813d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fba11e8ade54d388361c4c936a43372', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128729) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:52:05.543941 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: INFO nova.api.openstack.requestlog [None req-9d1a53bb-bbaf-476b-b58b-6d9c7d9a3194 tempest-TestMinimumBasicScenario-1817438735 tempest-TestMinimumBasicScenario-1817438735-project] 10.222.0.61 "GET /compute/v2.1/servers/ef63d04a-87e5-4202-a672-d45a2a877c68" status: 200 len: 1754 microversion: 2.1 time: 0.162924 May 14 15:52:05.544513 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: [pid: 128729|app: 0|req: 361/738] 10.222.0.61 () {58 vars in 1235 bytes} [Sat May 14 15:52:05 2022] GET /compute/v2.1/servers/ef63d04a-87e5-4202-a672-d45a2a877c68 => generated 1754 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 15:52:06.561183 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi [None req-f1bbc727-c517-498e-8e8f-61c1fab293a6 tempest-TestMinimumBasicScenario-1817438735 tempest-TestMinimumBasicScenario-1817438735-project] Calling method '>' {{(pid=128728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 15:52:06.561790 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.compute.api [None req-f1bbc727-c517-498e-8e8f-61c1fab293a6 tempest-TestMinimumBasicScenario-1817438735 tempest-TestMinimumBasicScenario-1817438735-project] [instance: ef63d04a-87e5-4202-a672-d45a2a877c68] Fetching instance by UUID {{(pid=128728) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 15:52:06.568109 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-f1bbc727-c517-498e-8e8f-61c1fab293a6 tempest-TestMinimumBasicScenario-1817438735 tempest-TestMinimumBasicScenario-1817438735-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:52:06.568563 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-f1bbc727-c517-498e-8e8f-61c1fab293a6 tempest-TestMinimumBasicScenario-1817438735 tempest-TestMinimumBasicScenario-1817438735-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:52:06.569328 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-f1bbc727-c517-498e-8e8f-61c1fab293a6 tempest-TestMinimumBasicScenario-1817438735 tempest-TestMinimumBasicScenario-1817438735-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:52:06.569771 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-f1bbc727-c517-498e-8e8f-61c1fab293a6 tempest-TestMinimumBasicScenario-1817438735 tempest-TestMinimumBasicScenario-1817438735-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:52:06.707771 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.policy [None req-f1bbc727-c517-498e-8e8f-61c1fab293a6 tempest-TestMinimumBasicScenario-1817438735 tempest-TestMinimumBasicScenario-1817438735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d5f259e0b98457ea6b6b88d886c813d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fba11e8ade54d388361c4c936a43372', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128728) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:52:06.715392 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: INFO nova.api.openstack.requestlog [None req-f1bbc727-c517-498e-8e8f-61c1fab293a6 tempest-TestMinimumBasicScenario-1817438735 tempest-TestMinimumBasicScenario-1817438735-project] 10.222.0.61 "GET /compute/v2.1/servers/ef63d04a-87e5-4202-a672-d45a2a877c68" status: 200 len: 1754 microversion: 2.1 time: 0.158256 May 14 15:52:06.715959 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: [pid: 128728|app: 0|req: 378/739] 10.222.0.61 () {58 vars in 1235 bytes} [Sat May 14 15:52:06 2022] GET /compute/v2.1/servers/ef63d04a-87e5-4202-a672-d45a2a877c68 => generated 1754 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 15:52:07.733001 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi [None req-5f251f44-3374-4add-a504-ce16dfdc458e tempest-TestMinimumBasicScenario-1817438735 tempest-TestMinimumBasicScenario-1817438735-project] Calling method '>' {{(pid=128729) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 15:52:07.733627 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.compute.api [None req-5f251f44-3374-4add-a504-ce16dfdc458e tempest-TestMinimumBasicScenario-1817438735 tempest-TestMinimumBasicScenario-1817438735-project] [instance: ef63d04a-87e5-4202-a672-d45a2a877c68] Fetching instance by UUID {{(pid=128729) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 15:52:07.740186 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-5f251f44-3374-4add-a504-ce16dfdc458e tempest-TestMinimumBasicScenario-1817438735 tempest-TestMinimumBasicScenario-1817438735-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:52:07.740640 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-5f251f44-3374-4add-a504-ce16dfdc458e tempest-TestMinimumBasicScenario-1817438735 tempest-TestMinimumBasicScenario-1817438735-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:52:07.741409 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-5f251f44-3374-4add-a504-ce16dfdc458e tempest-TestMinimumBasicScenario-1817438735 tempest-TestMinimumBasicScenario-1817438735-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:52:07.741854 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-5f251f44-3374-4add-a504-ce16dfdc458e tempest-TestMinimumBasicScenario-1817438735 tempest-TestMinimumBasicScenario-1817438735-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:52:07.884251 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.policy [None req-5f251f44-3374-4add-a504-ce16dfdc458e tempest-TestMinimumBasicScenario-1817438735 tempest-TestMinimumBasicScenario-1817438735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d5f259e0b98457ea6b6b88d886c813d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fba11e8ade54d388361c4c936a43372', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128729) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:52:07.891924 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: INFO nova.api.openstack.requestlog [None req-5f251f44-3374-4add-a504-ce16dfdc458e tempest-TestMinimumBasicScenario-1817438735 tempest-TestMinimumBasicScenario-1817438735-project] 10.222.0.61 "GET /compute/v2.1/servers/ef63d04a-87e5-4202-a672-d45a2a877c68" status: 200 len: 1754 microversion: 2.1 time: 0.162843 May 14 15:52:07.892457 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: [pid: 128729|app: 0|req: 362/740] 10.222.0.61 () {58 vars in 1235 bytes} [Sat May 14 15:52:07 2022] GET /compute/v2.1/servers/ef63d04a-87e5-4202-a672-d45a2a877c68 => generated 1754 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 15:52:08.909437 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi [None req-31bce618-11c7-4b05-a9c8-e68228ee291a tempest-TestMinimumBasicScenario-1817438735 tempest-TestMinimumBasicScenario-1817438735-project] Calling method '>' {{(pid=128728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 15:52:08.910078 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.compute.api [None req-31bce618-11c7-4b05-a9c8-e68228ee291a tempest-TestMinimumBasicScenario-1817438735 tempest-TestMinimumBasicScenario-1817438735-project] [instance: ef63d04a-87e5-4202-a672-d45a2a877c68] Fetching instance by UUID {{(pid=128728) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 15:52:08.916399 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-31bce618-11c7-4b05-a9c8-e68228ee291a tempest-TestMinimumBasicScenario-1817438735 tempest-TestMinimumBasicScenario-1817438735-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:52:08.916847 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-31bce618-11c7-4b05-a9c8-e68228ee291a tempest-TestMinimumBasicScenario-1817438735 tempest-TestMinimumBasicScenario-1817438735-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:52:08.917612 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-31bce618-11c7-4b05-a9c8-e68228ee291a tempest-TestMinimumBasicScenario-1817438735 tempest-TestMinimumBasicScenario-1817438735-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:52:08.918051 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-31bce618-11c7-4b05-a9c8-e68228ee291a tempest-TestMinimumBasicScenario-1817438735 tempest-TestMinimumBasicScenario-1817438735-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:52:09.054655 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.policy [None req-31bce618-11c7-4b05-a9c8-e68228ee291a tempest-TestMinimumBasicScenario-1817438735 tempest-TestMinimumBasicScenario-1817438735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d5f259e0b98457ea6b6b88d886c813d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fba11e8ade54d388361c4c936a43372', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128728) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:52:09.063539 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: INFO nova.api.openstack.requestlog [None req-31bce618-11c7-4b05-a9c8-e68228ee291a tempest-TestMinimumBasicScenario-1817438735 tempest-TestMinimumBasicScenario-1817438735-project] 10.222.0.61 "GET /compute/v2.1/servers/ef63d04a-87e5-4202-a672-d45a2a877c68" status: 200 len: 1754 microversion: 2.1 time: 0.157953 May 14 15:52:09.064116 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: [pid: 128728|app: 0|req: 379/741] 10.222.0.61 () {58 vars in 1235 bytes} [Sat May 14 15:52:08 2022] GET /compute/v2.1/servers/ef63d04a-87e5-4202-a672-d45a2a877c68 => generated 1754 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 15:52:10.081134 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi [None req-47a12ff0-0697-42ae-8d80-7349b9497602 tempest-TestMinimumBasicScenario-1817438735 tempest-TestMinimumBasicScenario-1817438735-project] Calling method '>' {{(pid=128729) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 15:52:10.081741 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.compute.api [None req-47a12ff0-0697-42ae-8d80-7349b9497602 tempest-TestMinimumBasicScenario-1817438735 tempest-TestMinimumBasicScenario-1817438735-project] [instance: ef63d04a-87e5-4202-a672-d45a2a877c68] Fetching instance by UUID {{(pid=128729) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 15:52:10.088001 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-47a12ff0-0697-42ae-8d80-7349b9497602 tempest-TestMinimumBasicScenario-1817438735 tempest-TestMinimumBasicScenario-1817438735-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:52:10.088442 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-47a12ff0-0697-42ae-8d80-7349b9497602 tempest-TestMinimumBasicScenario-1817438735 tempest-TestMinimumBasicScenario-1817438735-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:52:10.089204 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-47a12ff0-0697-42ae-8d80-7349b9497602 tempest-TestMinimumBasicScenario-1817438735 tempest-TestMinimumBasicScenario-1817438735-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:52:10.089637 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-47a12ff0-0697-42ae-8d80-7349b9497602 tempest-TestMinimumBasicScenario-1817438735 tempest-TestMinimumBasicScenario-1817438735-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:52:10.227302 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.policy [None req-47a12ff0-0697-42ae-8d80-7349b9497602 tempest-TestMinimumBasicScenario-1817438735 tempest-TestMinimumBasicScenario-1817438735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d5f259e0b98457ea6b6b88d886c813d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fba11e8ade54d388361c4c936a43372', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128729) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:52:10.234978 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: INFO nova.api.openstack.requestlog [None req-47a12ff0-0697-42ae-8d80-7349b9497602 tempest-TestMinimumBasicScenario-1817438735 tempest-TestMinimumBasicScenario-1817438735-project] 10.222.0.61 "GET /compute/v2.1/servers/ef63d04a-87e5-4202-a672-d45a2a877c68" status: 200 len: 1754 microversion: 2.1 time: 0.158313 May 14 15:52:10.235536 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: [pid: 128729|app: 0|req: 363/742] 10.222.0.61 () {58 vars in 1235 bytes} [Sat May 14 15:52:10 2022] GET /compute/v2.1/servers/ef63d04a-87e5-4202-a672-d45a2a877c68 => generated 1754 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 15:52:11.252497 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi [None req-b4bb98be-a897-47b7-8634-3d8701c0d6fb tempest-TestMinimumBasicScenario-1817438735 tempest-TestMinimumBasicScenario-1817438735-project] Calling method '>' {{(pid=128728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 15:52:11.253038 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.compute.api [None req-b4bb98be-a897-47b7-8634-3d8701c0d6fb tempest-TestMinimumBasicScenario-1817438735 tempest-TestMinimumBasicScenario-1817438735-project] [instance: ef63d04a-87e5-4202-a672-d45a2a877c68] Fetching instance by UUID {{(pid=128728) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 15:52:11.258952 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-b4bb98be-a897-47b7-8634-3d8701c0d6fb tempest-TestMinimumBasicScenario-1817438735 tempest-TestMinimumBasicScenario-1817438735-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:52:11.259400 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-b4bb98be-a897-47b7-8634-3d8701c0d6fb tempest-TestMinimumBasicScenario-1817438735 tempest-TestMinimumBasicScenario-1817438735-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:52:11.260167 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-b4bb98be-a897-47b7-8634-3d8701c0d6fb tempest-TestMinimumBasicScenario-1817438735 tempest-TestMinimumBasicScenario-1817438735-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:52:11.260606 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-b4bb98be-a897-47b7-8634-3d8701c0d6fb tempest-TestMinimumBasicScenario-1817438735 tempest-TestMinimumBasicScenario-1817438735-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:52:11.401431 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.policy [None req-b4bb98be-a897-47b7-8634-3d8701c0d6fb tempest-TestMinimumBasicScenario-1817438735 tempest-TestMinimumBasicScenario-1817438735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d5f259e0b98457ea6b6b88d886c813d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fba11e8ade54d388361c4c936a43372', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128728) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:52:11.409897 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: INFO nova.api.openstack.requestlog [None req-b4bb98be-a897-47b7-8634-3d8701c0d6fb tempest-TestMinimumBasicScenario-1817438735 tempest-TestMinimumBasicScenario-1817438735-project] 10.222.0.61 "GET /compute/v2.1/servers/ef63d04a-87e5-4202-a672-d45a2a877c68" status: 200 len: 1754 microversion: 2.1 time: 0.161545 May 14 15:52:11.410541 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: [pid: 128728|app: 0|req: 380/743] 10.222.0.61 () {58 vars in 1235 bytes} [Sat May 14 15:52:11 2022] GET /compute/v2.1/servers/ef63d04a-87e5-4202-a672-d45a2a877c68 => generated 1754 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 15:52:12.427247 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi [None req-455bb7fc-d364-45a1-adce-94da5cab44b1 tempest-TestMinimumBasicScenario-1817438735 tempest-TestMinimumBasicScenario-1817438735-project] Calling method '>' {{(pid=128729) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 15:52:12.427878 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.compute.api [None req-455bb7fc-d364-45a1-adce-94da5cab44b1 tempest-TestMinimumBasicScenario-1817438735 tempest-TestMinimumBasicScenario-1817438735-project] [instance: ef63d04a-87e5-4202-a672-d45a2a877c68] Fetching instance by UUID {{(pid=128729) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 15:52:12.434092 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-455bb7fc-d364-45a1-adce-94da5cab44b1 tempest-TestMinimumBasicScenario-1817438735 tempest-TestMinimumBasicScenario-1817438735-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:52:12.434567 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-455bb7fc-d364-45a1-adce-94da5cab44b1 tempest-TestMinimumBasicScenario-1817438735 tempest-TestMinimumBasicScenario-1817438735-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:52:12.435326 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-455bb7fc-d364-45a1-adce-94da5cab44b1 tempest-TestMinimumBasicScenario-1817438735 tempest-TestMinimumBasicScenario-1817438735-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:52:12.435881 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-455bb7fc-d364-45a1-adce-94da5cab44b1 tempest-TestMinimumBasicScenario-1817438735 tempest-TestMinimumBasicScenario-1817438735-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:52:12.580387 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.policy [None req-455bb7fc-d364-45a1-adce-94da5cab44b1 tempest-TestMinimumBasicScenario-1817438735 tempest-TestMinimumBasicScenario-1817438735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d5f259e0b98457ea6b6b88d886c813d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fba11e8ade54d388361c4c936a43372', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128729) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:52:12.588242 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: INFO nova.api.openstack.requestlog [None req-455bb7fc-d364-45a1-adce-94da5cab44b1 tempest-TestMinimumBasicScenario-1817438735 tempest-TestMinimumBasicScenario-1817438735-project] 10.222.0.61 "GET /compute/v2.1/servers/ef63d04a-87e5-4202-a672-d45a2a877c68" status: 200 len: 1754 microversion: 2.1 time: 0.164778 May 14 15:52:12.588810 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: [pid: 128729|app: 0|req: 364/744] 10.222.0.61 () {58 vars in 1235 bytes} [Sat May 14 15:52:12 2022] GET /compute/v2.1/servers/ef63d04a-87e5-4202-a672-d45a2a877c68 => generated 1754 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 15:52:13.604956 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi [None req-ee64fb2e-1f5d-4726-a905-6f6f2c71d8e7 tempest-TestMinimumBasicScenario-1817438735 tempest-TestMinimumBasicScenario-1817438735-project] Calling method '>' {{(pid=128728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 15:52:13.605573 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.compute.api [None req-ee64fb2e-1f5d-4726-a905-6f6f2c71d8e7 tempest-TestMinimumBasicScenario-1817438735 tempest-TestMinimumBasicScenario-1817438735-project] [instance: ef63d04a-87e5-4202-a672-d45a2a877c68] Fetching instance by UUID {{(pid=128728) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 15:52:13.612098 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-ee64fb2e-1f5d-4726-a905-6f6f2c71d8e7 tempest-TestMinimumBasicScenario-1817438735 tempest-TestMinimumBasicScenario-1817438735-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:52:13.612542 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-ee64fb2e-1f5d-4726-a905-6f6f2c71d8e7 tempest-TestMinimumBasicScenario-1817438735 tempest-TestMinimumBasicScenario-1817438735-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:52:13.613301 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-ee64fb2e-1f5d-4726-a905-6f6f2c71d8e7 tempest-TestMinimumBasicScenario-1817438735 tempest-TestMinimumBasicScenario-1817438735-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:52:13.613732 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-ee64fb2e-1f5d-4726-a905-6f6f2c71d8e7 tempest-TestMinimumBasicScenario-1817438735 tempest-TestMinimumBasicScenario-1817438735-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:52:13.756538 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.policy [None req-ee64fb2e-1f5d-4726-a905-6f6f2c71d8e7 tempest-TestMinimumBasicScenario-1817438735 tempest-TestMinimumBasicScenario-1817438735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d5f259e0b98457ea6b6b88d886c813d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fba11e8ade54d388361c4c936a43372', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128728) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:52:13.764961 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: INFO nova.api.openstack.requestlog [None req-ee64fb2e-1f5d-4726-a905-6f6f2c71d8e7 tempest-TestMinimumBasicScenario-1817438735 tempest-TestMinimumBasicScenario-1817438735-project] 10.222.0.61 "GET /compute/v2.1/servers/ef63d04a-87e5-4202-a672-d45a2a877c68" status: 200 len: 1754 microversion: 2.1 time: 0.163255 May 14 15:52:13.765525 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: [pid: 128728|app: 0|req: 381/745] 10.222.0.61 () {58 vars in 1235 bytes} [Sat May 14 15:52:13 2022] GET /compute/v2.1/servers/ef63d04a-87e5-4202-a672-d45a2a877c68 => generated 1754 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 15:52:14.782721 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi [None req-d07683dc-e1d5-4214-b3de-2d649a08d51e tempest-TestMinimumBasicScenario-1817438735 tempest-TestMinimumBasicScenario-1817438735-project] Calling method '>' {{(pid=128729) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 15:52:14.783329 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.compute.api [None req-d07683dc-e1d5-4214-b3de-2d649a08d51e tempest-TestMinimumBasicScenario-1817438735 tempest-TestMinimumBasicScenario-1817438735-project] [instance: ef63d04a-87e5-4202-a672-d45a2a877c68] Fetching instance by UUID {{(pid=128729) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 15:52:14.789596 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-d07683dc-e1d5-4214-b3de-2d649a08d51e tempest-TestMinimumBasicScenario-1817438735 tempest-TestMinimumBasicScenario-1817438735-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:52:14.790041 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-d07683dc-e1d5-4214-b3de-2d649a08d51e tempest-TestMinimumBasicScenario-1817438735 tempest-TestMinimumBasicScenario-1817438735-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:52:14.790824 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-d07683dc-e1d5-4214-b3de-2d649a08d51e tempest-TestMinimumBasicScenario-1817438735 tempest-TestMinimumBasicScenario-1817438735-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:52:14.791252 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-d07683dc-e1d5-4214-b3de-2d649a08d51e tempest-TestMinimumBasicScenario-1817438735 tempest-TestMinimumBasicScenario-1817438735-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:52:14.928765 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.policy [None req-d07683dc-e1d5-4214-b3de-2d649a08d51e tempest-TestMinimumBasicScenario-1817438735 tempest-TestMinimumBasicScenario-1817438735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d5f259e0b98457ea6b6b88d886c813d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fba11e8ade54d388361c4c936a43372', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128729) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:52:14.936963 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: INFO nova.api.openstack.requestlog [None req-d07683dc-e1d5-4214-b3de-2d649a08d51e tempest-TestMinimumBasicScenario-1817438735 tempest-TestMinimumBasicScenario-1817438735-project] 10.222.0.61 "GET /compute/v2.1/servers/ef63d04a-87e5-4202-a672-d45a2a877c68" status: 200 len: 1754 microversion: 2.1 time: 0.158737 May 14 15:52:14.937522 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: [pid: 128729|app: 0|req: 365/746] 10.222.0.61 () {58 vars in 1235 bytes} [Sat May 14 15:52:14 2022] GET /compute/v2.1/servers/ef63d04a-87e5-4202-a672-d45a2a877c68 => generated 1754 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 15:52:15.955099 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi [None req-2a4c32ca-d3ca-4a0d-812c-87cb43281d91 tempest-TestMinimumBasicScenario-1817438735 tempest-TestMinimumBasicScenario-1817438735-project] Calling method '>' {{(pid=128728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 15:52:15.955787 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.compute.api [None req-2a4c32ca-d3ca-4a0d-812c-87cb43281d91 tempest-TestMinimumBasicScenario-1817438735 tempest-TestMinimumBasicScenario-1817438735-project] [instance: ef63d04a-87e5-4202-a672-d45a2a877c68] Fetching instance by UUID {{(pid=128728) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 15:52:15.962637 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-2a4c32ca-d3ca-4a0d-812c-87cb43281d91 tempest-TestMinimumBasicScenario-1817438735 tempest-TestMinimumBasicScenario-1817438735-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:52:15.963141 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-2a4c32ca-d3ca-4a0d-812c-87cb43281d91 tempest-TestMinimumBasicScenario-1817438735 tempest-TestMinimumBasicScenario-1817438735-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:52:15.963991 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-2a4c32ca-d3ca-4a0d-812c-87cb43281d91 tempest-TestMinimumBasicScenario-1817438735 tempest-TestMinimumBasicScenario-1817438735-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:52:15.964496 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-2a4c32ca-d3ca-4a0d-812c-87cb43281d91 tempest-TestMinimumBasicScenario-1817438735 tempest-TestMinimumBasicScenario-1817438735-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:52:16.115187 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.policy [None req-2a4c32ca-d3ca-4a0d-812c-87cb43281d91 tempest-TestMinimumBasicScenario-1817438735 tempest-TestMinimumBasicScenario-1817438735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d5f259e0b98457ea6b6b88d886c813d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fba11e8ade54d388361c4c936a43372', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128728) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:52:16.122857 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: INFO nova.api.openstack.requestlog [None req-2a4c32ca-d3ca-4a0d-812c-87cb43281d91 tempest-TestMinimumBasicScenario-1817438735 tempest-TestMinimumBasicScenario-1817438735-project] 10.222.0.61 "GET /compute/v2.1/servers/ef63d04a-87e5-4202-a672-d45a2a877c68" status: 200 len: 1754 microversion: 2.1 time: 0.172632 May 14 15:52:16.124006 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: [pid: 128728|app: 0|req: 382/747] 10.222.0.61 () {58 vars in 1235 bytes} [Sat May 14 15:52:15 2022] GET /compute/v2.1/servers/ef63d04a-87e5-4202-a672-d45a2a877c68 => generated 1754 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 15:52:17.113261 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi [None req-e577cd2f-242a-455c-bb13-62b02f0d763d tempest-TestShelveInstance-1853374188 tempest-TestShelveInstance-1853374188-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-1132431681", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-1734050536", "security_groups": [{"name": "tempest-secgroup-smoke-766823900"}], "networks": [{"uuid": "a888ca18-035c-4252-b410-51cde566f008"}], "block_device_mapping_v2": [{"uuid": "a33b06be-6203-4c15-a14e-7a0a95813bb5", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=128729) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 15:52:17.140577 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi [None req-db7c4d12-76bf-4d30-ba82-5baa01afd39c tempest-TestMinimumBasicScenario-1817438735 tempest-TestMinimumBasicScenario-1817438735-project] Calling method '>' {{(pid=128728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 15:52:17.141205 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.compute.api [None req-db7c4d12-76bf-4d30-ba82-5baa01afd39c tempest-TestMinimumBasicScenario-1817438735 tempest-TestMinimumBasicScenario-1817438735-project] [instance: ef63d04a-87e5-4202-a672-d45a2a877c68] Fetching instance by UUID {{(pid=128728) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 15:52:17.147353 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-db7c4d12-76bf-4d30-ba82-5baa01afd39c tempest-TestMinimumBasicScenario-1817438735 tempest-TestMinimumBasicScenario-1817438735-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:52:17.147798 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-db7c4d12-76bf-4d30-ba82-5baa01afd39c tempest-TestMinimumBasicScenario-1817438735 tempest-TestMinimumBasicScenario-1817438735-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:52:17.148563 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-db7c4d12-76bf-4d30-ba82-5baa01afd39c tempest-TestMinimumBasicScenario-1817438735 tempest-TestMinimumBasicScenario-1817438735-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:52:17.148992 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-db7c4d12-76bf-4d30-ba82-5baa01afd39c tempest-TestMinimumBasicScenario-1817438735 tempest-TestMinimumBasicScenario-1817438735-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:52:17.260512 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.network.neutron [None req-e577cd2f-242a-455c-bb13-62b02f0d763d tempest-TestShelveInstance-1853374188 tempest-TestShelveInstance-1853374188-project] validate_networks() for [('a888ca18-035c-4252-b410-51cde566f008', None, None, None, None, None)] {{(pid=128729) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 14 15:52:17.376714 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.policy [None req-db7c4d12-76bf-4d30-ba82-5baa01afd39c tempest-TestMinimumBasicScenario-1817438735 tempest-TestMinimumBasicScenario-1817438735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d5f259e0b98457ea6b6b88d886c813d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fba11e8ade54d388361c4c936a43372', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128728) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:52:17.384430 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: INFO nova.api.openstack.requestlog [None req-db7c4d12-76bf-4d30-ba82-5baa01afd39c tempest-TestMinimumBasicScenario-1817438735 tempest-TestMinimumBasicScenario-1817438735-project] 10.222.0.61 "GET /compute/v2.1/servers/ef63d04a-87e5-4202-a672-d45a2a877c68" status: 200 len: 1754 microversion: 2.1 time: 0.248153 May 14 15:52:17.384998 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: [pid: 128728|app: 0|req: 383/748] 10.222.0.61 () {58 vars in 1235 bytes} [Sat May 14 15:52:17 2022] GET /compute/v2.1/servers/ef63d04a-87e5-4202-a672-d45a2a877c68 => generated 1754 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 15:52:17.741119 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.virt.hardware [None req-e577cd2f-242a-455c-bb13-62b02f0d763d tempest-TestShelveInstance-1853374188 tempest-TestShelveInstance-1853374188-project] Flavor limits 0:0:0 {{(pid=128729) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 14 15:52:17.741536 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.virt.hardware [None req-e577cd2f-242a-455c-bb13-62b02f0d763d tempest-TestShelveInstance-1853374188 tempest-TestShelveInstance-1853374188-project] Image limits 0:0:0 {{(pid=128729) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 14 15:52:17.742000 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.virt.hardware [None req-e577cd2f-242a-455c-bb13-62b02f0d763d tempest-TestShelveInstance-1853374188 tempest-TestShelveInstance-1853374188-project] Flavor pref 0:0:0 {{(pid=128729) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 14 15:52:17.742436 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.virt.hardware [None req-e577cd2f-242a-455c-bb13-62b02f0d763d tempest-TestShelveInstance-1853374188 tempest-TestShelveInstance-1853374188-project] Image pref 0:0:0 {{(pid=128729) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 14 15:52:17.742872 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.virt.hardware [None req-e577cd2f-242a-455c-bb13-62b02f0d763d tempest-TestShelveInstance-1853374188 tempest-TestShelveInstance-1853374188-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128729) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 14 15:52:17.751384 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-e577cd2f-242a-455c-bb13-62b02f0d763d tempest-TestShelveInstance-1853374188 tempest-TestShelveInstance-1853374188-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:52:17.751830 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-e577cd2f-242a-455c-bb13-62b02f0d763d tempest-TestShelveInstance-1853374188 tempest-TestShelveInstance-1853374188-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:52:17.752622 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-e577cd2f-242a-455c-bb13-62b02f0d763d tempest-TestShelveInstance-1853374188 tempest-TestShelveInstance-1853374188-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:52:17.753052 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-e577cd2f-242a-455c-bb13-62b02f0d763d tempest-TestShelveInstance-1853374188 tempest-TestShelveInstance-1853374188-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:52:17.769449 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.quota [None req-e577cd2f-242a-455c-bb13-62b02f0d763d tempest-TestShelveInstance-1853374188 tempest-TestShelveInstance-1853374188-project] Getting quotas for project 83d6b6f0aa4f4314811ee80480861958. Resources: {'instances', 'cores', 'ram'} {{(pid=128729) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 14 15:52:17.773229 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.quota [None req-e577cd2f-242a-455c-bb13-62b02f0d763d tempest-TestShelveInstance-1853374188 tempest-TestShelveInstance-1853374188-project] Getting quotas for user 4e05ae1c6a054a299e841d008f9d7a09 and project 83d6b6f0aa4f4314811ee80480861958. Resources: {'instances', 'cores', 'ram'} {{(pid=128729) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 14 15:52:17.827709 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.compute.api [None req-e577cd2f-242a-455c-bb13-62b02f0d763d tempest-TestShelveInstance-1853374188 tempest-TestShelveInstance-1853374188-project] Going to run 1 instances... {{(pid=128729) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 14 15:52:17.829815 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.compute.api [None req-e577cd2f-242a-455c-bb13-62b02f0d763d tempest-TestShelveInstance-1853374188 tempest-TestShelveInstance-1853374188-project] [instance: 08195c98-5b1d-426c-a398-c7e914c14661] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='a33b06be-6203-4c15-a14e-7a0a95813bb5',volume_size=None,volume_type=None)] {{(pid=128729) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 14 15:52:17.954477 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: INFO nova.api.openstack.requestlog [None req-e577cd2f-242a-455c-bb13-62b02f0d763d tempest-TestShelveInstance-1853374188 tempest-TestShelveInstance-1853374188-project] 10.222.0.61 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.845001 May 14 15:52:17.955122 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: [pid: 128729|app: 0|req: 366/749] 10.222.0.61 () {60 vars in 1146 bytes} [Sat May 14 15:52:17 2022] POST /compute/v2.1/servers => generated 405 bytes in 846 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 14 15:52:17.964909 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi [None req-1bc8bdd4-52a3-4ea1-8399-7b401ee6cfea tempest-TestShelveInstance-1853374188 tempest-TestShelveInstance-1853374188-project] Calling method '>' {{(pid=128728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 15:52:17.965525 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.compute.api [None req-1bc8bdd4-52a3-4ea1-8399-7b401ee6cfea tempest-TestShelveInstance-1853374188 tempest-TestShelveInstance-1853374188-project] [instance: 08195c98-5b1d-426c-a398-c7e914c14661] Fetching instance by UUID {{(pid=128728) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 15:52:18.022632 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.policy [None req-1bc8bdd4-52a3-4ea1-8399-7b401ee6cfea tempest-TestShelveInstance-1853374188 tempest-TestShelveInstance-1853374188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e05ae1c6a054a299e841d008f9d7a09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83d6b6f0aa4f4314811ee80480861958', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128728) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:52:18.029099 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: INFO nova.api.openstack.requestlog [None req-1bc8bdd4-52a3-4ea1-8399-7b401ee6cfea tempest-TestShelveInstance-1853374188 tempest-TestShelveInstance-1853374188-project] 10.222.0.61 "GET /compute/v2.1/servers/08195c98-5b1d-426c-a398-c7e914c14661" status: 200 len: 1089 microversion: 2.1 time: 0.068049 May 14 15:52:18.029704 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: [pid: 128728|app: 0|req: 384/750] 10.222.0.61 () {58 vars in 1235 bytes} [Sat May 14 15:52:17 2022] GET /compute/v2.1/servers/08195c98-5b1d-426c-a398-c7e914c14661 => generated 1089 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 15:52:18.401316 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi [None req-b22adf0f-1ed3-4b5c-9cf1-3a7c4285c5bf tempest-TestMinimumBasicScenario-1817438735 tempest-TestMinimumBasicScenario-1817438735-project] Calling method '>' {{(pid=128729) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 15:52:18.401964 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.compute.api [None req-b22adf0f-1ed3-4b5c-9cf1-3a7c4285c5bf tempest-TestMinimumBasicScenario-1817438735 tempest-TestMinimumBasicScenario-1817438735-project] [instance: ef63d04a-87e5-4202-a672-d45a2a877c68] Fetching instance by UUID {{(pid=128729) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 15:52:18.409571 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-b22adf0f-1ed3-4b5c-9cf1-3a7c4285c5bf tempest-TestMinimumBasicScenario-1817438735 tempest-TestMinimumBasicScenario-1817438735-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:52:18.410143 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-b22adf0f-1ed3-4b5c-9cf1-3a7c4285c5bf tempest-TestMinimumBasicScenario-1817438735 tempest-TestMinimumBasicScenario-1817438735-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:52:18.410956 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-b22adf0f-1ed3-4b5c-9cf1-3a7c4285c5bf tempest-TestMinimumBasicScenario-1817438735 tempest-TestMinimumBasicScenario-1817438735-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:52:18.411399 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-b22adf0f-1ed3-4b5c-9cf1-3a7c4285c5bf tempest-TestMinimumBasicScenario-1817438735 tempest-TestMinimumBasicScenario-1817438735-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:52:18.554592 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.policy [None req-b22adf0f-1ed3-4b5c-9cf1-3a7c4285c5bf tempest-TestMinimumBasicScenario-1817438735 tempest-TestMinimumBasicScenario-1817438735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d5f259e0b98457ea6b6b88d886c813d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fba11e8ade54d388361c4c936a43372', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128729) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:52:18.562571 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: INFO nova.api.openstack.requestlog [None req-b22adf0f-1ed3-4b5c-9cf1-3a7c4285c5bf tempest-TestMinimumBasicScenario-1817438735 tempest-TestMinimumBasicScenario-1817438735-project] 10.222.0.61 "GET /compute/v2.1/servers/ef63d04a-87e5-4202-a672-d45a2a877c68" status: 200 len: 1754 microversion: 2.1 time: 0.165168 May 14 15:52:18.563133 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: [pid: 128729|app: 0|req: 367/751] 10.222.0.61 () {58 vars in 1235 bytes} [Sat May 14 15:52:18 2022] GET /compute/v2.1/servers/ef63d04a-87e5-4202-a672-d45a2a877c68 => generated 1754 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 15:52:19.046806 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi [None req-898929f4-57da-4abb-a62e-1f7d5736433f tempest-TestShelveInstance-1853374188 tempest-TestShelveInstance-1853374188-project] Calling method '>' {{(pid=128728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 15:52:19.047419 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.compute.api [None req-898929f4-57da-4abb-a62e-1f7d5736433f tempest-TestShelveInstance-1853374188 tempest-TestShelveInstance-1853374188-project] [instance: 08195c98-5b1d-426c-a398-c7e914c14661] Fetching instance by UUID {{(pid=128728) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 15:52:19.053651 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-898929f4-57da-4abb-a62e-1f7d5736433f tempest-TestShelveInstance-1853374188 tempest-TestShelveInstance-1853374188-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:52:19.054093 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-898929f4-57da-4abb-a62e-1f7d5736433f tempest-TestShelveInstance-1853374188 tempest-TestShelveInstance-1853374188-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:52:19.054912 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-898929f4-57da-4abb-a62e-1f7d5736433f tempest-TestShelveInstance-1853374188 tempest-TestShelveInstance-1853374188-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:52:19.055347 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-898929f4-57da-4abb-a62e-1f7d5736433f tempest-TestShelveInstance-1853374188 tempest-TestShelveInstance-1853374188-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:52:19.120823 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.policy [None req-898929f4-57da-4abb-a62e-1f7d5736433f tempest-TestShelveInstance-1853374188 tempest-TestShelveInstance-1853374188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e05ae1c6a054a299e841d008f9d7a09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83d6b6f0aa4f4314811ee80480861958', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128728) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:52:19.129819 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: INFO nova.api.openstack.requestlog [None req-898929f4-57da-4abb-a62e-1f7d5736433f tempest-TestShelveInstance-1853374188 tempest-TestShelveInstance-1853374188-project] 10.222.0.61 "GET /compute/v2.1/servers/08195c98-5b1d-426c-a398-c7e914c14661" status: 200 len: 1139 microversion: 2.1 time: 0.087281 May 14 15:52:19.130653 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: [pid: 128728|app: 0|req: 385/752] 10.222.0.61 () {58 vars in 1235 bytes} [Sat May 14 15:52:19 2022] GET /compute/v2.1/servers/08195c98-5b1d-426c-a398-c7e914c14661 => generated 1139 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 15:52:19.580014 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi [None req-e54a0e1d-9936-47d3-9f61-c3004585f074 tempest-TestMinimumBasicScenario-1817438735 tempest-TestMinimumBasicScenario-1817438735-project] Calling method '>' {{(pid=128729) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 15:52:19.580624 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.compute.api [None req-e54a0e1d-9936-47d3-9f61-c3004585f074 tempest-TestMinimumBasicScenario-1817438735 tempest-TestMinimumBasicScenario-1817438735-project] [instance: ef63d04a-87e5-4202-a672-d45a2a877c68] Fetching instance by UUID {{(pid=128729) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 15:52:19.587090 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-e54a0e1d-9936-47d3-9f61-c3004585f074 tempest-TestMinimumBasicScenario-1817438735 tempest-TestMinimumBasicScenario-1817438735-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:52:19.587543 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-e54a0e1d-9936-47d3-9f61-c3004585f074 tempest-TestMinimumBasicScenario-1817438735 tempest-TestMinimumBasicScenario-1817438735-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:52:19.588309 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-e54a0e1d-9936-47d3-9f61-c3004585f074 tempest-TestMinimumBasicScenario-1817438735 tempest-TestMinimumBasicScenario-1817438735-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:52:19.588754 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-e54a0e1d-9936-47d3-9f61-c3004585f074 tempest-TestMinimumBasicScenario-1817438735 tempest-TestMinimumBasicScenario-1817438735-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:52:19.740343 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.policy [None req-e54a0e1d-9936-47d3-9f61-c3004585f074 tempest-TestMinimumBasicScenario-1817438735 tempest-TestMinimumBasicScenario-1817438735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d5f259e0b98457ea6b6b88d886c813d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fba11e8ade54d388361c4c936a43372', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128729) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:52:19.748406 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: INFO nova.api.openstack.requestlog [None req-e54a0e1d-9936-47d3-9f61-c3004585f074 tempest-TestMinimumBasicScenario-1817438735 tempest-TestMinimumBasicScenario-1817438735-project] 10.222.0.61 "GET /compute/v2.1/servers/ef63d04a-87e5-4202-a672-d45a2a877c68" status: 200 len: 1757 microversion: 2.1 time: 0.172363 May 14 15:52:19.749011 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: [pid: 128729|app: 0|req: 368/753] 10.222.0.61 () {58 vars in 1235 bytes} [Sat May 14 15:52:19 2022] GET /compute/v2.1/servers/ef63d04a-87e5-4202-a672-d45a2a877c68 => generated 1757 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 15:52:20.147508 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi [None req-956689ae-4563-4940-9bf9-3de72b448cca tempest-TestShelveInstance-1853374188 tempest-TestShelveInstance-1853374188-project] Calling method '>' {{(pid=128728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 15:52:20.148136 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.compute.api [None req-956689ae-4563-4940-9bf9-3de72b448cca tempest-TestShelveInstance-1853374188 tempest-TestShelveInstance-1853374188-project] [instance: 08195c98-5b1d-426c-a398-c7e914c14661] Fetching instance by UUID {{(pid=128728) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 15:52:20.155652 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-956689ae-4563-4940-9bf9-3de72b448cca tempest-TestShelveInstance-1853374188 tempest-TestShelveInstance-1853374188-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:52:20.156240 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-956689ae-4563-4940-9bf9-3de72b448cca tempest-TestShelveInstance-1853374188 tempest-TestShelveInstance-1853374188-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:52:20.157053 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-956689ae-4563-4940-9bf9-3de72b448cca tempest-TestShelveInstance-1853374188 tempest-TestShelveInstance-1853374188-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:52:20.157497 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-956689ae-4563-4940-9bf9-3de72b448cca tempest-TestShelveInstance-1853374188 tempest-TestShelveInstance-1853374188-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:52:20.221659 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.policy [None req-956689ae-4563-4940-9bf9-3de72b448cca tempest-TestShelveInstance-1853374188 tempest-TestShelveInstance-1853374188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e05ae1c6a054a299e841d008f9d7a09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83d6b6f0aa4f4314811ee80480861958', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128728) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:52:20.228970 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: INFO nova.api.openstack.requestlog [None req-956689ae-4563-4940-9bf9-3de72b448cca tempest-TestShelveInstance-1853374188 tempest-TestShelveInstance-1853374188-project] 10.222.0.61 "GET /compute/v2.1/servers/08195c98-5b1d-426c-a398-c7e914c14661" status: 200 len: 1205 microversion: 2.1 time: 0.085686 May 14 15:52:20.229643 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: [pid: 128728|app: 0|req: 386/754] 10.222.0.61 () {58 vars in 1235 bytes} [Sat May 14 15:52:20 2022] GET /compute/v2.1/servers/08195c98-5b1d-426c-a398-c7e914c14661 => generated 1205 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 15:52:21.247103 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi [None req-b8b1b31c-b55c-46dc-8598-2a210f146b98 tempest-TestShelveInstance-1853374188 tempest-TestShelveInstance-1853374188-project] Calling method '>' {{(pid=128729) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 15:52:21.247725 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.compute.api [None req-b8b1b31c-b55c-46dc-8598-2a210f146b98 tempest-TestShelveInstance-1853374188 tempest-TestShelveInstance-1853374188-project] [instance: 08195c98-5b1d-426c-a398-c7e914c14661] Fetching instance by UUID {{(pid=128729) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 15:52:21.255779 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-b8b1b31c-b55c-46dc-8598-2a210f146b98 tempest-TestShelveInstance-1853374188 tempest-TestShelveInstance-1853374188-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:52:21.256325 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-b8b1b31c-b55c-46dc-8598-2a210f146b98 tempest-TestShelveInstance-1853374188 tempest-TestShelveInstance-1853374188-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:52:21.257453 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-b8b1b31c-b55c-46dc-8598-2a210f146b98 tempest-TestShelveInstance-1853374188 tempest-TestShelveInstance-1853374188-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:52:21.257965 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-b8b1b31c-b55c-46dc-8598-2a210f146b98 tempest-TestShelveInstance-1853374188 tempest-TestShelveInstance-1853374188-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:52:21.401212 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.policy [None req-b8b1b31c-b55c-46dc-8598-2a210f146b98 tempest-TestShelveInstance-1853374188 tempest-TestShelveInstance-1853374188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e05ae1c6a054a299e841d008f9d7a09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83d6b6f0aa4f4314811ee80480861958', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128729) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:52:21.409772 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: INFO nova.api.openstack.requestlog [None req-b8b1b31c-b55c-46dc-8598-2a210f146b98 tempest-TestShelveInstance-1853374188 tempest-TestShelveInstance-1853374188-project] 10.222.0.61 "GET /compute/v2.1/servers/08195c98-5b1d-426c-a398-c7e914c14661" status: 200 len: 1260 microversion: 2.1 time: 0.166766 May 14 15:52:21.410467 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: [pid: 128729|app: 0|req: 369/755] 10.222.0.61 () {58 vars in 1235 bytes} [Sat May 14 15:52:21 2022] GET /compute/v2.1/servers/08195c98-5b1d-426c-a398-c7e914c14661 => generated 1260 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 15:52:21.525848 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi [req-a7fadeff-ab97-4690-bcd9-a1c87c79dea3 req-a2c57a2a-13a8-4e08-955c-1f4dd13c5334 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "08195c98-5b1d-426c-a398-c7e914c14661", "tag": "ff1e7e07-bb51-463a-a362-bc5fcaff458c"}]} {{(pid=128728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 15:52:21.534269 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [req-a7fadeff-ab97-4690-bcd9-a1c87c79dea3 req-a2c57a2a-13a8-4e08-955c-1f4dd13c5334 service nova] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:52:21.535033 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [req-a7fadeff-ab97-4690-bcd9-a1c87c79dea3 req-a2c57a2a-13a8-4e08-955c-1f4dd13c5334 service nova] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:52:21.548406 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: INFO nova.api.openstack.compute.server_external_events [req-a7fadeff-ab97-4690-bcd9-a1c87c79dea3 req-a2c57a2a-13a8-4e08-955c-1f4dd13c5334 service nova] Creating event network-changed:ff1e7e07-bb51-463a-a362-bc5fcaff458c for instance 08195c98-5b1d-426c-a398-c7e914c14661 on hv-cinder-83979 May 14 15:52:21.556653 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: INFO nova.api.openstack.requestlog [req-a7fadeff-ab97-4690-bcd9-a1c87c79dea3 req-a2c57a2a-13a8-4e08-955c-1f4dd13c5334 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.102198 May 14 15:52:21.557697 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: [pid: 128728|app: 0|req: 387/756] 10.222.0.61 () {64 vars in 1317 bytes} [Sat May 14 15:52:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 14 15:52:22.426680 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi [None req-f2c6b506-c212-49c1-b31a-3e858a8affe5 tempest-TestShelveInstance-1853374188 tempest-TestShelveInstance-1853374188-project] Calling method '>' {{(pid=128729) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 15:52:22.427338 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.compute.api [None req-f2c6b506-c212-49c1-b31a-3e858a8affe5 tempest-TestShelveInstance-1853374188 tempest-TestShelveInstance-1853374188-project] [instance: 08195c98-5b1d-426c-a398-c7e914c14661] Fetching instance by UUID {{(pid=128729) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 15:52:22.433693 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-f2c6b506-c212-49c1-b31a-3e858a8affe5 tempest-TestShelveInstance-1853374188 tempest-TestShelveInstance-1853374188-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:52:22.434150 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-f2c6b506-c212-49c1-b31a-3e858a8affe5 tempest-TestShelveInstance-1853374188 tempest-TestShelveInstance-1853374188-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:52:22.434970 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-f2c6b506-c212-49c1-b31a-3e858a8affe5 tempest-TestShelveInstance-1853374188 tempest-TestShelveInstance-1853374188-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:52:22.435894 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-f2c6b506-c212-49c1-b31a-3e858a8affe5 tempest-TestShelveInstance-1853374188 tempest-TestShelveInstance-1853374188-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:52:22.568606 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.policy [None req-f2c6b506-c212-49c1-b31a-3e858a8affe5 tempest-TestShelveInstance-1853374188 tempest-TestShelveInstance-1853374188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e05ae1c6a054a299e841d008f9d7a09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83d6b6f0aa4f4314811ee80480861958', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128729) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:52:22.576768 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: INFO nova.api.openstack.requestlog [None req-f2c6b506-c212-49c1-b31a-3e858a8affe5 tempest-TestShelveInstance-1853374188 tempest-TestShelveInstance-1853374188-project] 10.222.0.61 "GET /compute/v2.1/servers/08195c98-5b1d-426c-a398-c7e914c14661" status: 200 len: 1260 microversion: 2.1 time: 0.153607 May 14 15:52:22.577338 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: [pid: 128729|app: 0|req: 370/757] 10.222.0.61 () {58 vars in 1235 bytes} [Sat May 14 15:52:22 2022] GET /compute/v2.1/servers/08195c98-5b1d-426c-a398-c7e914c14661 => generated 1260 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 15:52:23.594546 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi [None req-f1ccd6c6-df5a-4e99-bc42-891d71f82d7f tempest-TestShelveInstance-1853374188 tempest-TestShelveInstance-1853374188-project] Calling method '>' {{(pid=128728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 15:52:23.595247 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.compute.api [None req-f1ccd6c6-df5a-4e99-bc42-891d71f82d7f tempest-TestShelveInstance-1853374188 tempest-TestShelveInstance-1853374188-project] [instance: 08195c98-5b1d-426c-a398-c7e914c14661] Fetching instance by UUID {{(pid=128728) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 15:52:23.601441 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-f1ccd6c6-df5a-4e99-bc42-891d71f82d7f tempest-TestShelveInstance-1853374188 tempest-TestShelveInstance-1853374188-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:52:23.601966 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-f1ccd6c6-df5a-4e99-bc42-891d71f82d7f tempest-TestShelveInstance-1853374188 tempest-TestShelveInstance-1853374188-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:52:23.602909 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-f1ccd6c6-df5a-4e99-bc42-891d71f82d7f tempest-TestShelveInstance-1853374188 tempest-TestShelveInstance-1853374188-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:52:23.603347 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-f1ccd6c6-df5a-4e99-bc42-891d71f82d7f tempest-TestShelveInstance-1853374188 tempest-TestShelveInstance-1853374188-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:52:23.739620 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.policy [None req-f1ccd6c6-df5a-4e99-bc42-891d71f82d7f tempest-TestShelveInstance-1853374188 tempest-TestShelveInstance-1853374188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e05ae1c6a054a299e841d008f9d7a09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83d6b6f0aa4f4314811ee80480861958', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128728) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:52:23.746869 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: INFO nova.api.openstack.requestlog [None req-f1ccd6c6-df5a-4e99-bc42-891d71f82d7f tempest-TestShelveInstance-1853374188 tempest-TestShelveInstance-1853374188-project] 10.222.0.61 "GET /compute/v2.1/servers/08195c98-5b1d-426c-a398-c7e914c14661" status: 200 len: 1260 microversion: 2.1 time: 0.157569 May 14 15:52:23.747432 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: [pid: 128728|app: 0|req: 388/758] 10.222.0.61 () {58 vars in 1235 bytes} [Sat May 14 15:52:23 2022] GET /compute/v2.1/servers/08195c98-5b1d-426c-a398-c7e914c14661 => generated 1260 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 15:52:24.764075 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi [None req-d3195ed0-8d95-4b97-9d38-753a0869b256 tempest-TestShelveInstance-1853374188 tempest-TestShelveInstance-1853374188-project] Calling method '>' {{(pid=128729) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 15:52:24.764683 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.compute.api [None req-d3195ed0-8d95-4b97-9d38-753a0869b256 tempest-TestShelveInstance-1853374188 tempest-TestShelveInstance-1853374188-project] [instance: 08195c98-5b1d-426c-a398-c7e914c14661] Fetching instance by UUID {{(pid=128729) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 15:52:24.770951 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-d3195ed0-8d95-4b97-9d38-753a0869b256 tempest-TestShelveInstance-1853374188 tempest-TestShelveInstance-1853374188-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:52:24.771401 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-d3195ed0-8d95-4b97-9d38-753a0869b256 tempest-TestShelveInstance-1853374188 tempest-TestShelveInstance-1853374188-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:52:24.772165 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-d3195ed0-8d95-4b97-9d38-753a0869b256 tempest-TestShelveInstance-1853374188 tempest-TestShelveInstance-1853374188-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:52:24.772600 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-d3195ed0-8d95-4b97-9d38-753a0869b256 tempest-TestShelveInstance-1853374188 tempest-TestShelveInstance-1853374188-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:52:24.905276 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.policy [None req-d3195ed0-8d95-4b97-9d38-753a0869b256 tempest-TestShelveInstance-1853374188 tempest-TestShelveInstance-1853374188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e05ae1c6a054a299e841d008f9d7a09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83d6b6f0aa4f4314811ee80480861958', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128729) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:52:24.912406 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: INFO nova.api.openstack.requestlog [None req-d3195ed0-8d95-4b97-9d38-753a0869b256 tempest-TestShelveInstance-1853374188 tempest-TestShelveInstance-1853374188-project] 10.222.0.61 "GET /compute/v2.1/servers/08195c98-5b1d-426c-a398-c7e914c14661" status: 200 len: 1260 microversion: 2.1 time: 0.152356 May 14 15:52:24.912964 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: [pid: 128729|app: 0|req: 371/759] 10.222.0.61 () {58 vars in 1235 bytes} [Sat May 14 15:52:24 2022] GET /compute/v2.1/servers/08195c98-5b1d-426c-a398-c7e914c14661 => generated 1260 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 15:52:25.929771 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi [None req-f8c9d445-eefc-470d-befd-912b1f484d07 tempest-TestShelveInstance-1853374188 tempest-TestShelveInstance-1853374188-project] Calling method '>' {{(pid=128728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 15:52:25.930444 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.compute.api [None req-f8c9d445-eefc-470d-befd-912b1f484d07 tempest-TestShelveInstance-1853374188 tempest-TestShelveInstance-1853374188-project] [instance: 08195c98-5b1d-426c-a398-c7e914c14661] Fetching instance by UUID {{(pid=128728) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 15:52:25.937312 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-f8c9d445-eefc-470d-befd-912b1f484d07 tempest-TestShelveInstance-1853374188 tempest-TestShelveInstance-1853374188-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:52:25.937764 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-f8c9d445-eefc-470d-befd-912b1f484d07 tempest-TestShelveInstance-1853374188 tempest-TestShelveInstance-1853374188-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:52:25.938653 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-f8c9d445-eefc-470d-befd-912b1f484d07 tempest-TestShelveInstance-1853374188 tempest-TestShelveInstance-1853374188-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:52:25.939089 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-f8c9d445-eefc-470d-befd-912b1f484d07 tempest-TestShelveInstance-1853374188 tempest-TestShelveInstance-1853374188-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:52:26.079653 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.policy [None req-f8c9d445-eefc-470d-befd-912b1f484d07 tempest-TestShelveInstance-1853374188 tempest-TestShelveInstance-1853374188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e05ae1c6a054a299e841d008f9d7a09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83d6b6f0aa4f4314811ee80480861958', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128728) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:52:26.088260 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: INFO nova.api.openstack.requestlog [None req-f8c9d445-eefc-470d-befd-912b1f484d07 tempest-TestShelveInstance-1853374188 tempest-TestShelveInstance-1853374188-project] 10.222.0.61 "GET /compute/v2.1/servers/08195c98-5b1d-426c-a398-c7e914c14661" status: 200 len: 1260 microversion: 2.1 time: 0.162662 May 14 15:52:26.088774 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: [pid: 128728|app: 0|req: 389/760] 10.222.0.61 () {58 vars in 1235 bytes} [Sat May 14 15:52:25 2022] GET /compute/v2.1/servers/08195c98-5b1d-426c-a398-c7e914c14661 => generated 1260 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 15:52:26.962520 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi [None req-64e4a217-4c14-4154-848c-4f2423af2a17 tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "f6a166ae-4a68-4005-a3a3-8e2d8e5725ea"}} {{(pid=128729) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 15:52:26.963653 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.compute.api [None req-64e4a217-4c14-4154-848c-4f2423af2a17 tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] [instance: 7c21adbe-7a79-46cf-aa7c-9b2a6548c767] Fetching instance by UUID {{(pid=128729) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 15:52:26.970681 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-64e4a217-4c14-4154-848c-4f2423af2a17 tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:52:26.971016 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-64e4a217-4c14-4154-848c-4f2423af2a17 tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:52:26.971800 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-64e4a217-4c14-4154-848c-4f2423af2a17 tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:52:26.972238 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-64e4a217-4c14-4154-848c-4f2423af2a17 tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:52:27.107937 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi [None req-f80263c7-709d-43d8-a679-4d4f7a48158b tempest-TestShelveInstance-1853374188 tempest-TestShelveInstance-1853374188-project] Calling method '>' {{(pid=128728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 15:52:27.109183 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.compute.api [None req-f80263c7-709d-43d8-a679-4d4f7a48158b tempest-TestShelveInstance-1853374188 tempest-TestShelveInstance-1853374188-project] [instance: 08195c98-5b1d-426c-a398-c7e914c14661] Fetching instance by UUID {{(pid=128728) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 15:52:27.116046 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-f80263c7-709d-43d8-a679-4d4f7a48158b tempest-TestShelveInstance-1853374188 tempest-TestShelveInstance-1853374188-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:52:27.116501 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-f80263c7-709d-43d8-a679-4d4f7a48158b tempest-TestShelveInstance-1853374188 tempest-TestShelveInstance-1853374188-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:52:27.117287 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-f80263c7-709d-43d8-a679-4d4f7a48158b tempest-TestShelveInstance-1853374188 tempest-TestShelveInstance-1853374188-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:52:27.117729 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-f80263c7-709d-43d8-a679-4d4f7a48158b tempest-TestShelveInstance-1853374188 tempest-TestShelveInstance-1853374188-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:52:27.250965 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: INFO nova.api.openstack.requestlog [None req-64e4a217-4c14-4154-848c-4f2423af2a17 tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] 10.222.0.61 "POST /compute/v2.1/servers/7c21adbe-7a79-46cf-aa7c-9b2a6548c767/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.400483 May 14 15:52:27.256619 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: [pid: 128729|app: 0|req: 372/761] 10.222.0.61 () {60 vars in 1322 bytes} [Sat May 14 15:52:26 2022] POST /compute/v2.1/servers/7c21adbe-7a79-46cf-aa7c-9b2a6548c767/os-volume_attachments => generated 194 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 14 15:52:27.272959 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.policy [None req-f80263c7-709d-43d8-a679-4d4f7a48158b tempest-TestShelveInstance-1853374188 tempest-TestShelveInstance-1853374188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e05ae1c6a054a299e841d008f9d7a09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83d6b6f0aa4f4314811ee80480861958', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128728) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:52:27.281293 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: INFO nova.api.openstack.requestlog [None req-f80263c7-709d-43d8-a679-4d4f7a48158b tempest-TestShelveInstance-1853374188 tempest-TestShelveInstance-1853374188-project] 10.222.0.61 "GET /compute/v2.1/servers/08195c98-5b1d-426c-a398-c7e914c14661" status: 200 len: 1260 microversion: 2.1 time: 0.178094 May 14 15:52:27.282168 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: [pid: 128728|app: 0|req: 390/762] 10.222.0.61 () {58 vars in 1235 bytes} [Sat May 14 15:52:27 2022] GET /compute/v2.1/servers/08195c98-5b1d-426c-a398-c7e914c14661 => generated 1260 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 15:52:28.299148 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi [None req-08978269-ebc8-4ef3-8380-6231e494985e tempest-TestShelveInstance-1853374188 tempest-TestShelveInstance-1853374188-project] Calling method '>' {{(pid=128729) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 15:52:28.299853 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.compute.api [None req-08978269-ebc8-4ef3-8380-6231e494985e tempest-TestShelveInstance-1853374188 tempest-TestShelveInstance-1853374188-project] [instance: 08195c98-5b1d-426c-a398-c7e914c14661] Fetching instance by UUID {{(pid=128729) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 15:52:28.306249 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-08978269-ebc8-4ef3-8380-6231e494985e tempest-TestShelveInstance-1853374188 tempest-TestShelveInstance-1853374188-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:52:28.306733 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-08978269-ebc8-4ef3-8380-6231e494985e tempest-TestShelveInstance-1853374188 tempest-TestShelveInstance-1853374188-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:52:28.307517 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-08978269-ebc8-4ef3-8380-6231e494985e tempest-TestShelveInstance-1853374188 tempest-TestShelveInstance-1853374188-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:52:28.307963 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-08978269-ebc8-4ef3-8380-6231e494985e tempest-TestShelveInstance-1853374188 tempest-TestShelveInstance-1853374188-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:52:28.449847 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.policy [None req-08978269-ebc8-4ef3-8380-6231e494985e tempest-TestShelveInstance-1853374188 tempest-TestShelveInstance-1853374188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e05ae1c6a054a299e841d008f9d7a09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83d6b6f0aa4f4314811ee80480861958', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128729) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:52:28.458594 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: INFO nova.api.openstack.requestlog [None req-08978269-ebc8-4ef3-8380-6231e494985e tempest-TestShelveInstance-1853374188 tempest-TestShelveInstance-1853374188-project] 10.222.0.61 "GET /compute/v2.1/servers/08195c98-5b1d-426c-a398-c7e914c14661" status: 200 len: 1260 microversion: 2.1 time: 0.164046 May 14 15:52:28.459228 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: [pid: 128729|app: 0|req: 373/763] 10.222.0.61 () {58 vars in 1235 bytes} [Sat May 14 15:52:28 2022] GET /compute/v2.1/servers/08195c98-5b1d-426c-a398-c7e914c14661 => generated 1260 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 15:52:29.476587 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi [None req-60bd3852-1416-4671-ac3f-448a5db8c03f tempest-TestShelveInstance-1853374188 tempest-TestShelveInstance-1853374188-project] Calling method '>' {{(pid=128728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 15:52:29.477193 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.compute.api [None req-60bd3852-1416-4671-ac3f-448a5db8c03f tempest-TestShelveInstance-1853374188 tempest-TestShelveInstance-1853374188-project] [instance: 08195c98-5b1d-426c-a398-c7e914c14661] Fetching instance by UUID {{(pid=128728) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 15:52:29.484668 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-60bd3852-1416-4671-ac3f-448a5db8c03f tempest-TestShelveInstance-1853374188 tempest-TestShelveInstance-1853374188-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:52:29.485149 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-60bd3852-1416-4671-ac3f-448a5db8c03f tempest-TestShelveInstance-1853374188 tempest-TestShelveInstance-1853374188-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:52:29.486069 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-60bd3852-1416-4671-ac3f-448a5db8c03f tempest-TestShelveInstance-1853374188 tempest-TestShelveInstance-1853374188-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:52:29.486629 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-60bd3852-1416-4671-ac3f-448a5db8c03f tempest-TestShelveInstance-1853374188 tempest-TestShelveInstance-1853374188-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:52:29.624344 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.policy [None req-60bd3852-1416-4671-ac3f-448a5db8c03f tempest-TestShelveInstance-1853374188 tempest-TestShelveInstance-1853374188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e05ae1c6a054a299e841d008f9d7a09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83d6b6f0aa4f4314811ee80480861958', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128728) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:52:29.633087 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: INFO nova.api.openstack.requestlog [None req-60bd3852-1416-4671-ac3f-448a5db8c03f tempest-TestShelveInstance-1853374188 tempest-TestShelveInstance-1853374188-project] 10.222.0.61 "GET /compute/v2.1/servers/08195c98-5b1d-426c-a398-c7e914c14661" status: 200 len: 1260 microversion: 2.1 time: 0.160293 May 14 15:52:29.633750 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: [pid: 128728|app: 0|req: 391/764] 10.222.0.61 () {58 vars in 1235 bytes} [Sat May 14 15:52:29 2022] GET /compute/v2.1/servers/08195c98-5b1d-426c-a398-c7e914c14661 => generated 1260 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 15:52:30.650490 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi [None req-f866c22e-c56b-400c-986b-2feabd0bf481 tempest-TestShelveInstance-1853374188 tempest-TestShelveInstance-1853374188-project] Calling method '>' {{(pid=128729) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 15:52:30.651082 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.compute.api [None req-f866c22e-c56b-400c-986b-2feabd0bf481 tempest-TestShelveInstance-1853374188 tempest-TestShelveInstance-1853374188-project] [instance: 08195c98-5b1d-426c-a398-c7e914c14661] Fetching instance by UUID {{(pid=128729) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 15:52:30.658061 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-f866c22e-c56b-400c-986b-2feabd0bf481 tempest-TestShelveInstance-1853374188 tempest-TestShelveInstance-1853374188-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:52:30.658583 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-f866c22e-c56b-400c-986b-2feabd0bf481 tempest-TestShelveInstance-1853374188 tempest-TestShelveInstance-1853374188-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:52:30.659601 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-f866c22e-c56b-400c-986b-2feabd0bf481 tempest-TestShelveInstance-1853374188 tempest-TestShelveInstance-1853374188-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:52:30.659809 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-f866c22e-c56b-400c-986b-2feabd0bf481 tempest-TestShelveInstance-1853374188 tempest-TestShelveInstance-1853374188-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:52:30.792873 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.policy [None req-f866c22e-c56b-400c-986b-2feabd0bf481 tempest-TestShelveInstance-1853374188 tempest-TestShelveInstance-1853374188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e05ae1c6a054a299e841d008f9d7a09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83d6b6f0aa4f4314811ee80480861958', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128729) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:52:30.800185 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: INFO nova.api.openstack.requestlog [None req-f866c22e-c56b-400c-986b-2feabd0bf481 tempest-TestShelveInstance-1853374188 tempest-TestShelveInstance-1853374188-project] 10.222.0.61 "GET /compute/v2.1/servers/08195c98-5b1d-426c-a398-c7e914c14661" status: 200 len: 1260 microversion: 2.1 time: 0.153523 May 14 15:52:30.800680 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: [pid: 128729|app: 0|req: 374/765] 10.222.0.61 () {58 vars in 1235 bytes} [Sat May 14 15:52:30 2022] GET /compute/v2.1/servers/08195c98-5b1d-426c-a398-c7e914c14661 => generated 1260 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 15:52:31.817027 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi [None req-7101e7c8-2e7f-4132-b561-2121fd5f5240 tempest-TestShelveInstance-1853374188 tempest-TestShelveInstance-1853374188-project] Calling method '>' {{(pid=128728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 15:52:31.817581 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.compute.api [None req-7101e7c8-2e7f-4132-b561-2121fd5f5240 tempest-TestShelveInstance-1853374188 tempest-TestShelveInstance-1853374188-project] [instance: 08195c98-5b1d-426c-a398-c7e914c14661] Fetching instance by UUID {{(pid=128728) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 15:52:31.823826 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-7101e7c8-2e7f-4132-b561-2121fd5f5240 tempest-TestShelveInstance-1853374188 tempest-TestShelveInstance-1853374188-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:52:31.824268 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-7101e7c8-2e7f-4132-b561-2121fd5f5240 tempest-TestShelveInstance-1853374188 tempest-TestShelveInstance-1853374188-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:52:31.825061 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-7101e7c8-2e7f-4132-b561-2121fd5f5240 tempest-TestShelveInstance-1853374188 tempest-TestShelveInstance-1853374188-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:52:31.825555 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-7101e7c8-2e7f-4132-b561-2121fd5f5240 tempest-TestShelveInstance-1853374188 tempest-TestShelveInstance-1853374188-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:52:31.964127 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.policy [None req-7101e7c8-2e7f-4132-b561-2121fd5f5240 tempest-TestShelveInstance-1853374188 tempest-TestShelveInstance-1853374188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e05ae1c6a054a299e841d008f9d7a09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83d6b6f0aa4f4314811ee80480861958', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128728) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:52:31.971958 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: INFO nova.api.openstack.requestlog [None req-7101e7c8-2e7f-4132-b561-2121fd5f5240 tempest-TestShelveInstance-1853374188 tempest-TestShelveInstance-1853374188-project] 10.222.0.61 "GET /compute/v2.1/servers/08195c98-5b1d-426c-a398-c7e914c14661" status: 200 len: 1260 microversion: 2.1 time: 0.158856 May 14 15:52:31.972529 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: [pid: 128728|app: 0|req: 392/766] 10.222.0.61 () {58 vars in 1235 bytes} [Sat May 14 15:52:31 2022] GET /compute/v2.1/servers/08195c98-5b1d-426c-a398-c7e914c14661 => generated 1260 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 15:52:32.989003 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi [None req-b87f0f36-19b4-4682-841f-098de243e4d6 tempest-TestShelveInstance-1853374188 tempest-TestShelveInstance-1853374188-project] Calling method '>' {{(pid=128729) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 15:52:32.989916 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.compute.api [None req-b87f0f36-19b4-4682-841f-098de243e4d6 tempest-TestShelveInstance-1853374188 tempest-TestShelveInstance-1853374188-project] [instance: 08195c98-5b1d-426c-a398-c7e914c14661] Fetching instance by UUID {{(pid=128729) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 15:52:32.997095 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-b87f0f36-19b4-4682-841f-098de243e4d6 tempest-TestShelveInstance-1853374188 tempest-TestShelveInstance-1853374188-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:52:32.998143 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-b87f0f36-19b4-4682-841f-098de243e4d6 tempest-TestShelveInstance-1853374188 tempest-TestShelveInstance-1853374188-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:52:32.999181 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-b87f0f36-19b4-4682-841f-098de243e4d6 tempest-TestShelveInstance-1853374188 tempest-TestShelveInstance-1853374188-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:52:32.999698 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-b87f0f36-19b4-4682-841f-098de243e4d6 tempest-TestShelveInstance-1853374188 tempest-TestShelveInstance-1853374188-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:52:33.141083 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.policy [None req-b87f0f36-19b4-4682-841f-098de243e4d6 tempest-TestShelveInstance-1853374188 tempest-TestShelveInstance-1853374188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e05ae1c6a054a299e841d008f9d7a09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83d6b6f0aa4f4314811ee80480861958', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128729) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:52:33.149468 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: INFO nova.api.openstack.requestlog [None req-b87f0f36-19b4-4682-841f-098de243e4d6 tempest-TestShelveInstance-1853374188 tempest-TestShelveInstance-1853374188-project] 10.222.0.61 "GET /compute/v2.1/servers/08195c98-5b1d-426c-a398-c7e914c14661" status: 200 len: 1260 microversion: 2.1 time: 0.164245 May 14 15:52:33.150119 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: [pid: 128729|app: 0|req: 375/767] 10.222.0.61 () {58 vars in 1235 bytes} [Sat May 14 15:52:32 2022] GET /compute/v2.1/servers/08195c98-5b1d-426c-a398-c7e914c14661 => generated 1260 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 15:52:34.167097 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi [None req-236ab8fd-7fe7-4986-8781-11c806f7d55f tempest-TestShelveInstance-1853374188 tempest-TestShelveInstance-1853374188-project] Calling method '>' {{(pid=128728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 15:52:34.167658 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.compute.api [None req-236ab8fd-7fe7-4986-8781-11c806f7d55f tempest-TestShelveInstance-1853374188 tempest-TestShelveInstance-1853374188-project] [instance: 08195c98-5b1d-426c-a398-c7e914c14661] Fetching instance by UUID {{(pid=128728) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 15:52:34.173913 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-236ab8fd-7fe7-4986-8781-11c806f7d55f tempest-TestShelveInstance-1853374188 tempest-TestShelveInstance-1853374188-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:52:34.174389 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-236ab8fd-7fe7-4986-8781-11c806f7d55f tempest-TestShelveInstance-1853374188 tempest-TestShelveInstance-1853374188-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:52:34.175158 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-236ab8fd-7fe7-4986-8781-11c806f7d55f tempest-TestShelveInstance-1853374188 tempest-TestShelveInstance-1853374188-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:52:34.175589 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-236ab8fd-7fe7-4986-8781-11c806f7d55f tempest-TestShelveInstance-1853374188 tempest-TestShelveInstance-1853374188-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:52:34.312115 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.policy [None req-236ab8fd-7fe7-4986-8781-11c806f7d55f tempest-TestShelveInstance-1853374188 tempest-TestShelveInstance-1853374188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e05ae1c6a054a299e841d008f9d7a09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83d6b6f0aa4f4314811ee80480861958', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128728) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:52:34.319553 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: INFO nova.api.openstack.requestlog [None req-236ab8fd-7fe7-4986-8781-11c806f7d55f tempest-TestShelveInstance-1853374188 tempest-TestShelveInstance-1853374188-project] 10.222.0.61 "GET /compute/v2.1/servers/08195c98-5b1d-426c-a398-c7e914c14661" status: 200 len: 1260 microversion: 2.1 time: 0.156271 May 14 15:52:34.320129 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: [pid: 128728|app: 0|req: 393/768] 10.222.0.61 () {58 vars in 1235 bytes} [Sat May 14 15:52:34 2022] GET /compute/v2.1/servers/08195c98-5b1d-426c-a398-c7e914c14661 => generated 1260 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 15:52:35.168988 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi [req-a2405d4b-fc9d-4336-9e98-125b64dbe65d req-a96db60c-c036-4a36-8c0b-b9d90390a17a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "08195c98-5b1d-426c-a398-c7e914c14661", "name": "network-vif-plugged", "status": "completed", "tag": "ff1e7e07-bb51-463a-a362-bc5fcaff458c"}]} {{(pid=128729) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 15:52:35.178364 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [req-a2405d4b-fc9d-4336-9e98-125b64dbe65d req-a96db60c-c036-4a36-8c0b-b9d90390a17a service nova] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:52:35.178820 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [req-a2405d4b-fc9d-4336-9e98-125b64dbe65d req-a96db60c-c036-4a36-8c0b-b9d90390a17a service nova] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:52:35.192150 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: INFO nova.api.openstack.compute.server_external_events [req-a2405d4b-fc9d-4336-9e98-125b64dbe65d req-a96db60c-c036-4a36-8c0b-b9d90390a17a service nova] Creating event network-vif-plugged:ff1e7e07-bb51-463a-a362-bc5fcaff458c for instance 08195c98-5b1d-426c-a398-c7e914c14661 on hv-cinder-83979 May 14 15:52:35.197348 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: INFO nova.api.openstack.requestlog [req-a2405d4b-fc9d-4336-9e98-125b64dbe65d req-a96db60c-c036-4a36-8c0b-b9d90390a17a service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.100121 May 14 15:52:35.197943 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: [pid: 128729|app: 0|req: 376/769] 10.222.0.61 () {64 vars in 1317 bytes} [Sat May 14 15:52:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 14 15:52:35.337827 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi [None req-fd966e4a-f6f7-4777-8ef2-417fdf31b68d tempest-TestShelveInstance-1853374188 tempest-TestShelveInstance-1853374188-project] Calling method '>' {{(pid=128728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 15:52:35.338507 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.compute.api [None req-fd966e4a-f6f7-4777-8ef2-417fdf31b68d tempest-TestShelveInstance-1853374188 tempest-TestShelveInstance-1853374188-project] [instance: 08195c98-5b1d-426c-a398-c7e914c14661] Fetching instance by UUID {{(pid=128728) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 15:52:35.346103 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-fd966e4a-f6f7-4777-8ef2-417fdf31b68d tempest-TestShelveInstance-1853374188 tempest-TestShelveInstance-1853374188-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:52:35.346618 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-fd966e4a-f6f7-4777-8ef2-417fdf31b68d tempest-TestShelveInstance-1853374188 tempest-TestShelveInstance-1853374188-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:52:35.347458 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-fd966e4a-f6f7-4777-8ef2-417fdf31b68d tempest-TestShelveInstance-1853374188 tempest-TestShelveInstance-1853374188-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:52:35.347982 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-fd966e4a-f6f7-4777-8ef2-417fdf31b68d tempest-TestShelveInstance-1853374188 tempest-TestShelveInstance-1853374188-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:52:35.509462 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.policy [None req-fd966e4a-f6f7-4777-8ef2-417fdf31b68d tempest-TestShelveInstance-1853374188 tempest-TestShelveInstance-1853374188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e05ae1c6a054a299e841d008f9d7a09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83d6b6f0aa4f4314811ee80480861958', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128728) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:52:35.518159 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: INFO nova.api.openstack.requestlog [None req-fd966e4a-f6f7-4777-8ef2-417fdf31b68d tempest-TestShelveInstance-1853374188 tempest-TestShelveInstance-1853374188-project] 10.222.0.61 "GET /compute/v2.1/servers/08195c98-5b1d-426c-a398-c7e914c14661" status: 200 len: 1260 microversion: 2.1 time: 0.184187 May 14 15:52:35.518766 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: [pid: 128728|app: 0|req: 394/770] 10.222.0.61 () {58 vars in 1235 bytes} [Sat May 14 15:52:35 2022] GET /compute/v2.1/servers/08195c98-5b1d-426c-a398-c7e914c14661 => generated 1260 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 15:52:36.537770 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi [None req-fa8a2e02-f1d1-4ede-b6a8-e03b59b70e6f tempest-TestShelveInstance-1853374188 tempest-TestShelveInstance-1853374188-project] Calling method '>' {{(pid=128729) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 15:52:36.538581 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.compute.api [None req-fa8a2e02-f1d1-4ede-b6a8-e03b59b70e6f tempest-TestShelveInstance-1853374188 tempest-TestShelveInstance-1853374188-project] [instance: 08195c98-5b1d-426c-a398-c7e914c14661] Fetching instance by UUID {{(pid=128729) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 15:52:36.545810 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-fa8a2e02-f1d1-4ede-b6a8-e03b59b70e6f tempest-TestShelveInstance-1853374188 tempest-TestShelveInstance-1853374188-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:52:36.546580 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-fa8a2e02-f1d1-4ede-b6a8-e03b59b70e6f tempest-TestShelveInstance-1853374188 tempest-TestShelveInstance-1853374188-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:52:36.547863 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-fa8a2e02-f1d1-4ede-b6a8-e03b59b70e6f tempest-TestShelveInstance-1853374188 tempest-TestShelveInstance-1853374188-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:52:36.548591 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-fa8a2e02-f1d1-4ede-b6a8-e03b59b70e6f tempest-TestShelveInstance-1853374188 tempest-TestShelveInstance-1853374188-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:52:36.695271 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.policy [None req-fa8a2e02-f1d1-4ede-b6a8-e03b59b70e6f tempest-TestShelveInstance-1853374188 tempest-TestShelveInstance-1853374188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e05ae1c6a054a299e841d008f9d7a09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83d6b6f0aa4f4314811ee80480861958', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128729) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:52:36.702882 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: INFO nova.api.openstack.requestlog [None req-fa8a2e02-f1d1-4ede-b6a8-e03b59b70e6f tempest-TestShelveInstance-1853374188 tempest-TestShelveInstance-1853374188-project] 10.222.0.61 "GET /compute/v2.1/servers/08195c98-5b1d-426c-a398-c7e914c14661" status: 200 len: 1260 microversion: 2.1 time: 0.171114 May 14 15:52:36.703452 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: [pid: 128729|app: 0|req: 377/771] 10.222.0.61 () {58 vars in 1235 bytes} [Sat May 14 15:52:36 2022] GET /compute/v2.1/servers/08195c98-5b1d-426c-a398-c7e914c14661 => generated 1260 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 15:52:36.858283 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi [None req-810d40ec-83c7-477c-82ba-af131ec587a4 tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=128728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 15:52:36.859135 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.compute.api [None req-810d40ec-83c7-477c-82ba-af131ec587a4 tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] [instance: 7c21adbe-7a79-46cf-aa7c-9b2a6548c767] Fetching instance by UUID {{(pid=128728) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 15:52:36.865628 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-810d40ec-83c7-477c-82ba-af131ec587a4 tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:52:36.866083 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-810d40ec-83c7-477c-82ba-af131ec587a4 tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:52:36.866885 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-810d40ec-83c7-477c-82ba-af131ec587a4 tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:52:36.867328 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-810d40ec-83c7-477c-82ba-af131ec587a4 tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:52:36.891234 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.objects.instance [None req-810d40ec-83c7-477c-82ba-af131ec587a4 tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Lazy-loading 'flavor' on Instance uuid 7c21adbe-7a79-46cf-aa7c-9b2a6548c767 {{(pid=128728) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 14 15:52:37.015744 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: INFO nova.api.openstack.requestlog [None req-810d40ec-83c7-477c-82ba-af131ec587a4 tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] 10.222.0.61 "POST /compute/v2.1/servers/7c21adbe-7a79-46cf-aa7c-9b2a6548c767/action" status: 200 len: 32 microversion: 2.1 time: 0.162084 May 14 15:52:37.016356 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: [pid: 128728|app: 0|req: 395/772] 10.222.0.61 () {60 vars in 1277 bytes} [Sat May 14 15:52:36 2022] POST /compute/v2.1/servers/7c21adbe-7a79-46cf-aa7c-9b2a6548c767/action => generated 32 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) May 14 15:52:37.027489 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi [None req-2e0e5e14-9725-4e3e-9e29-04b6da4f3812 tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Calling method '>' {{(pid=128729) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 15:52:37.028323 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.compute.api [None req-2e0e5e14-9725-4e3e-9e29-04b6da4f3812 tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] [instance: 7c21adbe-7a79-46cf-aa7c-9b2a6548c767] Fetching instance by UUID {{(pid=128729) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 15:52:37.035994 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-2e0e5e14-9725-4e3e-9e29-04b6da4f3812 tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:52:37.036581 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-2e0e5e14-9725-4e3e-9e29-04b6da4f3812 tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:52:37.037721 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-2e0e5e14-9725-4e3e-9e29-04b6da4f3812 tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:52:37.038420 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-2e0e5e14-9725-4e3e-9e29-04b6da4f3812 tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:52:37.180813 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.policy [None req-2e0e5e14-9725-4e3e-9e29-04b6da4f3812 tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b896317d96a40d6a137db0dcf5f98f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d2517d5440a4d30949f3dd36a46d813', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128729) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:52:37.188788 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: INFO nova.api.openstack.requestlog [None req-2e0e5e14-9725-4e3e-9e29-04b6da4f3812 tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] 10.222.0.61 "GET /compute/v2.1/servers/7c21adbe-7a79-46cf-aa7c-9b2a6548c767" status: 200 len: 1735 microversion: 2.1 time: 0.167324 May 14 15:52:37.189362 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: [pid: 128729|app: 0|req: 378/773] 10.222.0.61 () {58 vars in 1235 bytes} [Sat May 14 15:52:37 2022] GET /compute/v2.1/servers/7c21adbe-7a79-46cf-aa7c-9b2a6548c767 => generated 1735 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 15:52:37.720212 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi [None req-3d069548-5183-44c5-ac7e-391debb136f5 tempest-TestShelveInstance-1853374188 tempest-TestShelveInstance-1853374188-project] Calling method '>' {{(pid=128728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 15:52:37.720829 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.compute.api [None req-3d069548-5183-44c5-ac7e-391debb136f5 tempest-TestShelveInstance-1853374188 tempest-TestShelveInstance-1853374188-project] [instance: 08195c98-5b1d-426c-a398-c7e914c14661] Fetching instance by UUID {{(pid=128728) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 15:52:37.727185 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-3d069548-5183-44c5-ac7e-391debb136f5 tempest-TestShelveInstance-1853374188 tempest-TestShelveInstance-1853374188-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:52:37.727633 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-3d069548-5183-44c5-ac7e-391debb136f5 tempest-TestShelveInstance-1853374188 tempest-TestShelveInstance-1853374188-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:52:37.728399 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-3d069548-5183-44c5-ac7e-391debb136f5 tempest-TestShelveInstance-1853374188 tempest-TestShelveInstance-1853374188-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:52:37.728893 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-3d069548-5183-44c5-ac7e-391debb136f5 tempest-TestShelveInstance-1853374188 tempest-TestShelveInstance-1853374188-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:52:37.879234 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.policy [None req-3d069548-5183-44c5-ac7e-391debb136f5 tempest-TestShelveInstance-1853374188 tempest-TestShelveInstance-1853374188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e05ae1c6a054a299e841d008f9d7a09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83d6b6f0aa4f4314811ee80480861958', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128728) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:52:37.889786 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: INFO nova.api.openstack.requestlog [None req-3d069548-5183-44c5-ac7e-391debb136f5 tempest-TestShelveInstance-1853374188 tempest-TestShelveInstance-1853374188-project] 10.222.0.61 "GET /compute/v2.1/servers/08195c98-5b1d-426c-a398-c7e914c14661" status: 200 len: 1260 microversion: 2.1 time: 0.173743 May 14 15:52:37.890482 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: [pid: 128728|app: 0|req: 396/774] 10.222.0.61 () {58 vars in 1235 bytes} [Sat May 14 15:52:37 2022] GET /compute/v2.1/servers/08195c98-5b1d-426c-a398-c7e914c14661 => generated 1260 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 15:52:38.207068 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi [None req-e987246d-fbf7-4086-9a5f-5fb660f1c5e2 tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Calling method '>' {{(pid=128729) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 15:52:38.207674 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.compute.api [None req-e987246d-fbf7-4086-9a5f-5fb660f1c5e2 tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] [instance: 7c21adbe-7a79-46cf-aa7c-9b2a6548c767] Fetching instance by UUID {{(pid=128729) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 15:52:38.213914 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-e987246d-fbf7-4086-9a5f-5fb660f1c5e2 tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:52:38.214392 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-e987246d-fbf7-4086-9a5f-5fb660f1c5e2 tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:52:38.215159 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-e987246d-fbf7-4086-9a5f-5fb660f1c5e2 tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:52:38.215592 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-e987246d-fbf7-4086-9a5f-5fb660f1c5e2 tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:52:38.343855 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.policy [None req-e987246d-fbf7-4086-9a5f-5fb660f1c5e2 tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b896317d96a40d6a137db0dcf5f98f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d2517d5440a4d30949f3dd36a46d813', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128729) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:52:38.351584 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: INFO nova.api.openstack.requestlog [None req-e987246d-fbf7-4086-9a5f-5fb660f1c5e2 tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] 10.222.0.61 "GET /compute/v2.1/servers/7c21adbe-7a79-46cf-aa7c-9b2a6548c767" status: 200 len: 1735 microversion: 2.1 time: 0.149814 May 14 15:52:38.352340 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: [pid: 128729|app: 0|req: 379/775] 10.222.0.61 () {58 vars in 1235 bytes} [Sat May 14 15:52:38 2022] GET /compute/v2.1/servers/7c21adbe-7a79-46cf-aa7c-9b2a6548c767 => generated 1735 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 15:52:38.907074 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi [None req-81099c09-22d9-46ae-ae23-9b9c81785cc7 tempest-TestShelveInstance-1853374188 tempest-TestShelveInstance-1853374188-project] Calling method '>' {{(pid=128728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 15:52:38.907664 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.compute.api [None req-81099c09-22d9-46ae-ae23-9b9c81785cc7 tempest-TestShelveInstance-1853374188 tempest-TestShelveInstance-1853374188-project] [instance: 08195c98-5b1d-426c-a398-c7e914c14661] Fetching instance by UUID {{(pid=128728) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 15:52:38.913829 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-81099c09-22d9-46ae-ae23-9b9c81785cc7 tempest-TestShelveInstance-1853374188 tempest-TestShelveInstance-1853374188-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:52:38.914270 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-81099c09-22d9-46ae-ae23-9b9c81785cc7 tempest-TestShelveInstance-1853374188 tempest-TestShelveInstance-1853374188-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:52:38.915057 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-81099c09-22d9-46ae-ae23-9b9c81785cc7 tempest-TestShelveInstance-1853374188 tempest-TestShelveInstance-1853374188-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:52:38.915489 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-81099c09-22d9-46ae-ae23-9b9c81785cc7 tempest-TestShelveInstance-1853374188 tempest-TestShelveInstance-1853374188-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:52:39.050795 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.policy [None req-81099c09-22d9-46ae-ae23-9b9c81785cc7 tempest-TestShelveInstance-1853374188 tempest-TestShelveInstance-1853374188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e05ae1c6a054a299e841d008f9d7a09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83d6b6f0aa4f4314811ee80480861958', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128728) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:52:39.058018 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: INFO nova.api.openstack.requestlog [None req-81099c09-22d9-46ae-ae23-9b9c81785cc7 tempest-TestShelveInstance-1853374188 tempest-TestShelveInstance-1853374188-project] 10.222.0.61 "GET /compute/v2.1/servers/08195c98-5b1d-426c-a398-c7e914c14661" status: 200 len: 1260 microversion: 2.1 time: 0.154812 May 14 15:52:39.058617 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: [pid: 128728|app: 0|req: 397/776] 10.222.0.61 () {58 vars in 1235 bytes} [Sat May 14 15:52:38 2022] GET /compute/v2.1/servers/08195c98-5b1d-426c-a398-c7e914c14661 => generated 1260 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 15:52:39.369201 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi [None req-457c9808-6a18-42e3-9903-14b8691cc8cf tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Calling method '>' {{(pid=128729) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 15:52:39.369808 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.compute.api [None req-457c9808-6a18-42e3-9903-14b8691cc8cf tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] [instance: 7c21adbe-7a79-46cf-aa7c-9b2a6548c767] Fetching instance by UUID {{(pid=128729) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 15:52:39.376161 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-457c9808-6a18-42e3-9903-14b8691cc8cf tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:52:39.376611 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-457c9808-6a18-42e3-9903-14b8691cc8cf tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:52:39.377374 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-457c9808-6a18-42e3-9903-14b8691cc8cf tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:52:39.377810 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-457c9808-6a18-42e3-9903-14b8691cc8cf tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:52:39.504618 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.policy [None req-457c9808-6a18-42e3-9903-14b8691cc8cf tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b896317d96a40d6a137db0dcf5f98f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d2517d5440a4d30949f3dd36a46d813', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128729) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:52:39.512262 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: INFO nova.api.openstack.requestlog [None req-457c9808-6a18-42e3-9903-14b8691cc8cf tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] 10.222.0.61 "GET /compute/v2.1/servers/7c21adbe-7a79-46cf-aa7c-9b2a6548c767" status: 200 len: 1735 microversion: 2.1 time: 0.146932 May 14 15:52:39.512826 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: [pid: 128729|app: 0|req: 380/777] 10.222.0.61 () {58 vars in 1235 bytes} [Sat May 14 15:52:39 2022] GET /compute/v2.1/servers/7c21adbe-7a79-46cf-aa7c-9b2a6548c767 => generated 1735 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 15:52:40.076525 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi [None req-42724938-b13d-4bd7-9c7d-e36f61d66324 tempest-TestShelveInstance-1853374188 tempest-TestShelveInstance-1853374188-project] Calling method '>' {{(pid=128728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 15:52:40.077178 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.compute.api [None req-42724938-b13d-4bd7-9c7d-e36f61d66324 tempest-TestShelveInstance-1853374188 tempest-TestShelveInstance-1853374188-project] [instance: 08195c98-5b1d-426c-a398-c7e914c14661] Fetching instance by UUID {{(pid=128728) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 15:52:40.083594 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-42724938-b13d-4bd7-9c7d-e36f61d66324 tempest-TestShelveInstance-1853374188 tempest-TestShelveInstance-1853374188-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:52:40.084050 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-42724938-b13d-4bd7-9c7d-e36f61d66324 tempest-TestShelveInstance-1853374188 tempest-TestShelveInstance-1853374188-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:52:40.084829 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-42724938-b13d-4bd7-9c7d-e36f61d66324 tempest-TestShelveInstance-1853374188 tempest-TestShelveInstance-1853374188-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:52:40.085291 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-42724938-b13d-4bd7-9c7d-e36f61d66324 tempest-TestShelveInstance-1853374188 tempest-TestShelveInstance-1853374188-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:52:40.213076 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.policy [None req-42724938-b13d-4bd7-9c7d-e36f61d66324 tempest-TestShelveInstance-1853374188 tempest-TestShelveInstance-1853374188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e05ae1c6a054a299e841d008f9d7a09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83d6b6f0aa4f4314811ee80480861958', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128728) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:52:40.220498 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: INFO nova.api.openstack.requestlog [None req-42724938-b13d-4bd7-9c7d-e36f61d66324 tempest-TestShelveInstance-1853374188 tempest-TestShelveInstance-1853374188-project] 10.222.0.61 "GET /compute/v2.1/servers/08195c98-5b1d-426c-a398-c7e914c14661" status: 200 len: 1444 microversion: 2.1 time: 0.149503 May 14 15:52:40.221059 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: [pid: 128728|app: 0|req: 398/778] 10.222.0.61 () {58 vars in 1235 bytes} [Sat May 14 15:52:40 2022] GET /compute/v2.1/servers/08195c98-5b1d-426c-a398-c7e914c14661 => generated 1444 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 15:52:40.236770 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi [None req-b9869d32-00dd-4baf-b148-0f90d24741e7 tempest-TestShelveInstance-1853374188 tempest-TestShelveInstance-1853374188-project] Calling method '>' {{(pid=128729) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 15:52:40.237425 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.compute.api [None req-b9869d32-00dd-4baf-b148-0f90d24741e7 tempest-TestShelveInstance-1853374188 tempest-TestShelveInstance-1853374188-project] [instance: 08195c98-5b1d-426c-a398-c7e914c14661] Fetching instance by UUID {{(pid=128729) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 15:52:40.243507 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-b9869d32-00dd-4baf-b148-0f90d24741e7 tempest-TestShelveInstance-1853374188 tempest-TestShelveInstance-1853374188-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:52:40.243990 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-b9869d32-00dd-4baf-b148-0f90d24741e7 tempest-TestShelveInstance-1853374188 tempest-TestShelveInstance-1853374188-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:52:40.244759 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-b9869d32-00dd-4baf-b148-0f90d24741e7 tempest-TestShelveInstance-1853374188 tempest-TestShelveInstance-1853374188-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:52:40.245199 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-b9869d32-00dd-4baf-b148-0f90d24741e7 tempest-TestShelveInstance-1853374188 tempest-TestShelveInstance-1853374188-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:52:40.379058 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.policy [None req-b9869d32-00dd-4baf-b148-0f90d24741e7 tempest-TestShelveInstance-1853374188 tempest-TestShelveInstance-1853374188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e05ae1c6a054a299e841d008f9d7a09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83d6b6f0aa4f4314811ee80480861958', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128729) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:52:40.386339 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: INFO nova.api.openstack.requestlog [None req-b9869d32-00dd-4baf-b148-0f90d24741e7 tempest-TestShelveInstance-1853374188 tempest-TestShelveInstance-1853374188-project] 10.222.0.61 "GET /compute/v2.1/servers/08195c98-5b1d-426c-a398-c7e914c14661" status: 200 len: 1444 microversion: 2.1 time: 0.153390 May 14 15:52:40.386903 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: [pid: 128729|app: 0|req: 381/779] 10.222.0.61 () {58 vars in 1235 bytes} [Sat May 14 15:52:40 2022] GET /compute/v2.1/servers/08195c98-5b1d-426c-a398-c7e914c14661 => generated 1444 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 15:52:40.530318 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi [None req-0acd7680-b18b-489c-9c7d-d04b38dd5a36 tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Calling method '>' {{(pid=128728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 15:52:40.530961 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.compute.api [None req-0acd7680-b18b-489c-9c7d-d04b38dd5a36 tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] [instance: 7c21adbe-7a79-46cf-aa7c-9b2a6548c767] Fetching instance by UUID {{(pid=128728) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 15:52:40.537846 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-0acd7680-b18b-489c-9c7d-d04b38dd5a36 tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:52:40.538564 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-0acd7680-b18b-489c-9c7d-d04b38dd5a36 tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:52:40.539393 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-0acd7680-b18b-489c-9c7d-d04b38dd5a36 tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:52:40.539876 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-0acd7680-b18b-489c-9c7d-d04b38dd5a36 tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:52:40.739220 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.policy [None req-0acd7680-b18b-489c-9c7d-d04b38dd5a36 tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b896317d96a40d6a137db0dcf5f98f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d2517d5440a4d30949f3dd36a46d813', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128728) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:52:40.747348 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: INFO nova.api.openstack.requestlog [None req-0acd7680-b18b-489c-9c7d-d04b38dd5a36 tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] 10.222.0.61 "GET /compute/v2.1/servers/7c21adbe-7a79-46cf-aa7c-9b2a6548c767" status: 200 len: 1735 microversion: 2.1 time: 0.221680 May 14 15:52:40.748389 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: [pid: 128728|app: 0|req: 399/780] 10.222.0.61 () {58 vars in 1235 bytes} [Sat May 14 15:52:40 2022] GET /compute/v2.1/servers/7c21adbe-7a79-46cf-aa7c-9b2a6548c767 => generated 1735 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 15:52:41.765743 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi [None req-fd07904e-ec0b-40af-b6f1-3a296cc5b697 tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Calling method '>' {{(pid=128729) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 15:52:41.766393 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.compute.api [None req-fd07904e-ec0b-40af-b6f1-3a296cc5b697 tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] [instance: 7c21adbe-7a79-46cf-aa7c-9b2a6548c767] Fetching instance by UUID {{(pid=128729) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 15:52:41.772572 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-fd07904e-ec0b-40af-b6f1-3a296cc5b697 tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:52:41.773022 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-fd07904e-ec0b-40af-b6f1-3a296cc5b697 tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:52:41.773784 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-fd07904e-ec0b-40af-b6f1-3a296cc5b697 tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:52:41.774215 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-fd07904e-ec0b-40af-b6f1-3a296cc5b697 tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:52:42.012032 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.policy [None req-fd07904e-ec0b-40af-b6f1-3a296cc5b697 tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b896317d96a40d6a137db0dcf5f98f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d2517d5440a4d30949f3dd36a46d813', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128729) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:52:42.020614 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: INFO nova.api.openstack.requestlog [None req-fd07904e-ec0b-40af-b6f1-3a296cc5b697 tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] 10.222.0.61 "GET /compute/v2.1/servers/7c21adbe-7a79-46cf-aa7c-9b2a6548c767" status: 200 len: 1735 microversion: 2.1 time: 0.259249 May 14 15:52:42.021192 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: [pid: 128729|app: 0|req: 382/781] 10.222.0.61 () {58 vars in 1235 bytes} [Sat May 14 15:52:41 2022] GET /compute/v2.1/servers/7c21adbe-7a79-46cf-aa7c-9b2a6548c767 => generated 1735 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 15:52:42.510426 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi [req-aae36bae-1885-4192-a554-5a6178f3f2b9 req-524ca126-43f6-4302-bf88-30071da52bba service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "08195c98-5b1d-426c-a398-c7e914c14661", "tag": "ff1e7e07-bb51-463a-a362-bc5fcaff458c"}]} {{(pid=128728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 15:52:42.519633 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [req-aae36bae-1885-4192-a554-5a6178f3f2b9 req-524ca126-43f6-4302-bf88-30071da52bba service nova] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:52:42.520181 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [req-aae36bae-1885-4192-a554-5a6178f3f2b9 req-524ca126-43f6-4302-bf88-30071da52bba service nova] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:52:42.532171 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: INFO nova.api.openstack.compute.server_external_events [req-aae36bae-1885-4192-a554-5a6178f3f2b9 req-524ca126-43f6-4302-bf88-30071da52bba service nova] Creating event network-changed:ff1e7e07-bb51-463a-a362-bc5fcaff458c for instance 08195c98-5b1d-426c-a398-c7e914c14661 on hv-cinder-83979 May 14 15:52:42.537399 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: INFO nova.api.openstack.requestlog [req-aae36bae-1885-4192-a554-5a6178f3f2b9 req-524ca126-43f6-4302-bf88-30071da52bba service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.088606 May 14 15:52:42.538268 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: [pid: 128728|app: 0|req: 400/782] 10.222.0.61 () {64 vars in 1317 bytes} [Sat May 14 15:52:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 14 15:52:43.038274 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi [None req-43717037-3c57-4d48-89d4-e8c4726fda02 tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Calling method '>' {{(pid=128729) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 15:52:43.039129 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.compute.api [None req-43717037-3c57-4d48-89d4-e8c4726fda02 tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] [instance: 7c21adbe-7a79-46cf-aa7c-9b2a6548c767] Fetching instance by UUID {{(pid=128729) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 15:52:43.046225 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-43717037-3c57-4d48-89d4-e8c4726fda02 tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:52:43.046873 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-43717037-3c57-4d48-89d4-e8c4726fda02 tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:52:43.047780 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-43717037-3c57-4d48-89d4-e8c4726fda02 tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:52:43.048329 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-43717037-3c57-4d48-89d4-e8c4726fda02 tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:52:43.183188 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.policy [None req-43717037-3c57-4d48-89d4-e8c4726fda02 tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b896317d96a40d6a137db0dcf5f98f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d2517d5440a4d30949f3dd36a46d813', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128729) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:52:43.192301 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: INFO nova.api.openstack.requestlog [None req-43717037-3c57-4d48-89d4-e8c4726fda02 tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] 10.222.0.61 "GET /compute/v2.1/servers/7c21adbe-7a79-46cf-aa7c-9b2a6548c767" status: 200 len: 1735 microversion: 2.1 time: 0.157868 May 14 15:52:43.192891 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: [pid: 128729|app: 0|req: 383/783] 10.222.0.61 () {58 vars in 1235 bytes} [Sat May 14 15:52:43 2022] GET /compute/v2.1/servers/7c21adbe-7a79-46cf-aa7c-9b2a6548c767 => generated 1735 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 15:52:44.213217 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi [None req-3ddb0e78-b84b-477e-8378-7960c3814c07 tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Calling method '>' {{(pid=128728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 15:52:44.213833 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.compute.api [None req-3ddb0e78-b84b-477e-8378-7960c3814c07 tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] [instance: 7c21adbe-7a79-46cf-aa7c-9b2a6548c767] Fetching instance by UUID {{(pid=128728) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 15:52:44.220124 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-3ddb0e78-b84b-477e-8378-7960c3814c07 tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:52:44.220579 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-3ddb0e78-b84b-477e-8378-7960c3814c07 tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:52:44.221343 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-3ddb0e78-b84b-477e-8378-7960c3814c07 tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:52:44.221779 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-3ddb0e78-b84b-477e-8378-7960c3814c07 tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:52:44.349879 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.policy [None req-3ddb0e78-b84b-477e-8378-7960c3814c07 tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b896317d96a40d6a137db0dcf5f98f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d2517d5440a4d30949f3dd36a46d813', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128728) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:52:44.357604 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: INFO nova.api.openstack.requestlog [None req-3ddb0e78-b84b-477e-8378-7960c3814c07 tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] 10.222.0.61 "GET /compute/v2.1/servers/7c21adbe-7a79-46cf-aa7c-9b2a6548c767" status: 200 len: 1735 microversion: 2.1 time: 0.149158 May 14 15:52:44.358164 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: [pid: 128728|app: 0|req: 401/784] 10.222.0.61 () {58 vars in 1235 bytes} [Sat May 14 15:52:44 2022] GET /compute/v2.1/servers/7c21adbe-7a79-46cf-aa7c-9b2a6548c767 => generated 1735 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 15:52:45.375643 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi [None req-e825e102-88fd-4264-be77-1d1963f30149 tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Calling method '>' {{(pid=128729) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 15:52:45.376256 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.compute.api [None req-e825e102-88fd-4264-be77-1d1963f30149 tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] [instance: 7c21adbe-7a79-46cf-aa7c-9b2a6548c767] Fetching instance by UUID {{(pid=128729) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 15:52:45.382597 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-e825e102-88fd-4264-be77-1d1963f30149 tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:52:45.383045 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-e825e102-88fd-4264-be77-1d1963f30149 tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:52:45.383810 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-e825e102-88fd-4264-be77-1d1963f30149 tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:52:45.384245 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-e825e102-88fd-4264-be77-1d1963f30149 tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:52:45.509126 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.policy [None req-e825e102-88fd-4264-be77-1d1963f30149 tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b896317d96a40d6a137db0dcf5f98f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d2517d5440a4d30949f3dd36a46d813', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128729) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:52:45.517710 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: INFO nova.api.openstack.requestlog [None req-e825e102-88fd-4264-be77-1d1963f30149 tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] 10.222.0.61 "GET /compute/v2.1/servers/7c21adbe-7a79-46cf-aa7c-9b2a6548c767" status: 200 len: 1735 microversion: 2.1 time: 0.146117 May 14 15:52:45.518270 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: [pid: 128729|app: 0|req: 384/785] 10.222.0.61 () {58 vars in 1235 bytes} [Sat May 14 15:52:45 2022] GET /compute/v2.1/servers/7c21adbe-7a79-46cf-aa7c-9b2a6548c767 => generated 1735 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 15:52:46.534770 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi [None req-b7eed759-8796-456d-9a81-199eed8dc209 tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Calling method '>' {{(pid=128728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 15:52:46.535366 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.compute.api [None req-b7eed759-8796-456d-9a81-199eed8dc209 tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] [instance: 7c21adbe-7a79-46cf-aa7c-9b2a6548c767] Fetching instance by UUID {{(pid=128728) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 15:52:46.541559 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-b7eed759-8796-456d-9a81-199eed8dc209 tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:52:46.542008 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-b7eed759-8796-456d-9a81-199eed8dc209 tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:52:46.542798 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-b7eed759-8796-456d-9a81-199eed8dc209 tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:52:46.543240 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-b7eed759-8796-456d-9a81-199eed8dc209 tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:52:46.670167 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.policy [None req-b7eed759-8796-456d-9a81-199eed8dc209 tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b896317d96a40d6a137db0dcf5f98f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d2517d5440a4d30949f3dd36a46d813', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128728) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:52:46.678631 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: INFO nova.api.openstack.requestlog [None req-b7eed759-8796-456d-9a81-199eed8dc209 tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] 10.222.0.61 "GET /compute/v2.1/servers/7c21adbe-7a79-46cf-aa7c-9b2a6548c767" status: 200 len: 1735 microversion: 2.1 time: 0.147621 May 14 15:52:46.679204 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: [pid: 128728|app: 0|req: 402/786] 10.222.0.61 () {58 vars in 1235 bytes} [Sat May 14 15:52:46 2022] GET /compute/v2.1/servers/7c21adbe-7a79-46cf-aa7c-9b2a6548c767 => generated 1735 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 15:52:47.694935 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi [None req-974bc2a1-6c7f-4b0d-9dd6-38913f88d05b tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Calling method '>' {{(pid=128729) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 15:52:47.695545 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.compute.api [None req-974bc2a1-6c7f-4b0d-9dd6-38913f88d05b tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] [instance: 7c21adbe-7a79-46cf-aa7c-9b2a6548c767] Fetching instance by UUID {{(pid=128729) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 15:52:47.702661 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-974bc2a1-6c7f-4b0d-9dd6-38913f88d05b tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:52:47.703114 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-974bc2a1-6c7f-4b0d-9dd6-38913f88d05b tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:52:47.703886 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-974bc2a1-6c7f-4b0d-9dd6-38913f88d05b tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:52:47.704326 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-974bc2a1-6c7f-4b0d-9dd6-38913f88d05b tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:52:47.835576 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.policy [None req-974bc2a1-6c7f-4b0d-9dd6-38913f88d05b tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b896317d96a40d6a137db0dcf5f98f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d2517d5440a4d30949f3dd36a46d813', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128729) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:52:47.844442 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: INFO nova.api.openstack.requestlog [None req-974bc2a1-6c7f-4b0d-9dd6-38913f88d05b tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] 10.222.0.61 "GET /compute/v2.1/servers/7c21adbe-7a79-46cf-aa7c-9b2a6548c767" status: 200 len: 1735 microversion: 2.1 time: 0.153369 May 14 15:52:47.845037 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: [pid: 128729|app: 0|req: 385/787] 10.222.0.61 () {58 vars in 1235 bytes} [Sat May 14 15:52:47 2022] GET /compute/v2.1/servers/7c21adbe-7a79-46cf-aa7c-9b2a6548c767 => generated 1735 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 15:52:48.666375 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi [None req-c3d86d82-7867-4cbd-8dbc-29d0268a1436 tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] Calling method '>' {{(pid=128728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 15:52:48.666882 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.compute.api [None req-c3d86d82-7867-4cbd-8dbc-29d0268a1436 tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] [instance: 567fb38a-9c00-4de9-8a01-8070792cde75] Fetching instance by UUID {{(pid=128728) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 15:52:48.673315 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-c3d86d82-7867-4cbd-8dbc-29d0268a1436 tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:52:48.673771 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-c3d86d82-7867-4cbd-8dbc-29d0268a1436 tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:52:48.674585 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-c3d86d82-7867-4cbd-8dbc-29d0268a1436 tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:52:48.675028 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-c3d86d82-7867-4cbd-8dbc-29d0268a1436 tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:52:48.697513 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: INFO nova.api.openstack.requestlog [None req-c3d86d82-7867-4cbd-8dbc-29d0268a1436 tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] 10.222.0.61 "GET /compute/v2.1/servers/567fb38a-9c00-4de9-8a01-8070792cde75/ips" status: 200 len: 149 microversion: 2.1 time: 0.129220 May 14 15:52:48.698065 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: [pid: 128728|app: 0|req: 403/788] 10.222.0.61 () {58 vars in 1247 bytes} [Sat May 14 15:52:48 2022] GET /compute/v2.1/servers/567fb38a-9c00-4de9-8a01-8070792cde75/ips => generated 149 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 14 15:52:48.710263 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi [None req-437c3aa4-8a19-4cd1-963e-9810ab100d79 tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "0f2837f5-3eb0-4224-9cec-829916a28792"}} {{(pid=128729) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 15:52:48.711392 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.compute.api [None req-437c3aa4-8a19-4cd1-963e-9810ab100d79 tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] [instance: 567fb38a-9c00-4de9-8a01-8070792cde75] Fetching instance by UUID {{(pid=128729) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 15:52:48.718443 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-437c3aa4-8a19-4cd1-963e-9810ab100d79 tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:52:48.718893 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-437c3aa4-8a19-4cd1-963e-9810ab100d79 tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:52:48.719656 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-437c3aa4-8a19-4cd1-963e-9810ab100d79 tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:52:48.720094 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-437c3aa4-8a19-4cd1-963e-9810ab100d79 tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:52:48.798342 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: INFO nova.api.openstack.wsgi [None req-437c3aa4-8a19-4cd1-963e-9810ab100d79 tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] HTTP exception thrown: Invalid volume: volume 0f2837f5-3eb0-4224-9cec-829916a28792 is already attached to instances: 113f6b52-519c-45f4-9bc2-37168d644e15 May 14 15:52:48.800070 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi [None req-437c3aa4-8a19-4cd1-963e-9810ab100d79 tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] Request method failure captured: May 14 15:52:48.800070 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: request: POST /compute/v2.1/servers/567fb38a-9c00-4de9-8a01-8070792cde75/os-volume_attachments HTTP/1.1 May 14 15:52:48.800070 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: Accept: application/json May 14 15:52:48.800070 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: Accept-Encoding: identity May 14 15:52:48.800070 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: Connection: close May 14 15:52:48.800070 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: Content-Length: 74 May 14 15:52:48.800070 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: Content-Type: application/json May 14 15:52:48.800070 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: Host: 10.222.0.61 May 14 15:52:48.800070 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: Openstack-System-Scope: None May 14 15:52:48.800070 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: User-Agent: python-urllib3/1.26.9 May 14 15:52:48.800070 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: X-Auth-Token: gAAAAABif87SP_Zwa2IiGvFqsMgjavpLb8KTM6Zjei-leP46wpGTfISEWiNabTSLn_Se4MigqIDtVKHrnJDEVndJObAkvdE7QziqGtKnvzcsAHHCuGZvbOCiZ5Yv_050Eg71rjYT92fMkrLj82GJjq7kUvTbRuW_X-0VLgSk3UstO-oNY0ykSUs May 14 15:52:48.800070 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: X-Domain-Id: None May 14 15:52:48.800070 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: X-Domain-Name: None May 14 15:52:48.800070 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: X-Identity-Status: Confirmed May 14 15:52:48.800070 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: X-Is-Admin-Project: True May 14 15:52:48.800070 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: X-Project-Domain-Id: default May 14 15:52:48.800070 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: X-Project-Domain-Name: Default May 14 15:52:48.800070 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: X-Project-Id: 7905689c95d44a5c9169249c70f7de57 May 14 15:52:48.800070 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: X-Project-Name: tempest-AttachVolumeNegativeTest-1525749350 May 14 15:52:48.800070 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: X-Role: reader,member May 14 15:52:48.800070 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: X-Roles: reader,member May 14 15:52:48.801719 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/7905689c95d44a5c9169249c70f7de57"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/7905689c95d44a5c9169249c70f7de57"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/7905689c95d44a5c9169249c70f7de57"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_7905689c95d44a5c9169249c70f7de57"}]}] May 14 15:52:48.801719 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: X-Tenant: tempest-AttachVolumeNegativeTest-1525749350 May 14 15:52:48.801719 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: X-Tenant-Id: 7905689c95d44a5c9169249c70f7de57 May 14 15:52:48.801719 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1525749350 May 14 15:52:48.801719 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: X-User: tempest-AttachVolumeNegativeTest-1525749350-project May 14 15:52:48.801719 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: X-User-Domain-Id: default May 14 15:52:48.801719 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: X-User-Domain-Name: Default May 14 15:52:48.801719 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: X-User-Id: dc43895177134e9c9c030a9d87f94aaa May 14 15:52:48.801719 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: X-User-Name: tempest-AttachVolumeNegativeTest-1525749350-project May 14 15:52:48.801719 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: May 14 15:52:48.801719 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: {"volumeAttachment": {"volumeId": "0f2837f5-3eb0-4224-9cec-829916a28792"}} May 14 15:52:48.801719 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: method: > May 14 15:52:48.802664 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: exception: Invalid volume: volume 0f2837f5-3eb0-4224-9cec-829916a28792 is already attached to instances: 113f6b52-519c-45f4-9bc2-37168d644e15 May 14 15:52:48.802664 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: action_args: {'server_id': '567fb38a-9c00-4de9-8a01-8070792cde75', 'body': {'volumeAttachment': {'volumeId': '0f2837f5-3eb0-4224-9cec-829916a28792'}}} May 14 15:52:48.802664 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: {{(pid=128729) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 14 15:52:48.802664 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 15:52:48.802664 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create May 14 15:52:48.802664 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( May 14 15:52:48.802664 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner May 14 15:52:48.802664 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) May 14 15:52:48.802664 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner May 14 15:52:48.802664 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) May 14 15:52:48.802664 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4985, in attach_volume May 14 15:52:48.802664 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) May 14 15:52:48.802664 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4825, in _check_volume_already_attached May 14 15:52:48.802664 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) May 14 15:52:48.802664 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 0f2837f5-3eb0-4224-9cec-829916a28792 is already attached to instances: 113f6b52-519c-45f4-9bc2-37168d644e15 May 14 15:52:48.802664 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: ERROR nova.api.openstack.wsgi May 14 15:52:48.802664 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 14 15:52:48.802664 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: ERROR nova.api.openstack.wsgi May 14 15:52:48.802664 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 15:52:48.804127 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 14 15:52:48.804127 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 14 15:52:48.804127 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 14 15:52:48.804127 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 14 15:52:48.804127 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 14 15:52:48.804127 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 14 15:52:48.804127 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 14 15:52:48.804127 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 14 15:52:48.804127 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 14 15:52:48.804127 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 14 15:52:48.804127 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 14 15:52:48.804127 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 14 15:52:48.804127 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create May 14 15:52:48.804127 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) May 14 15:52:48.804127 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 0f2837f5-3eb0-4224-9cec-829916a28792 is already attached to instances: 113f6b52-519c-45f4-9bc2-37168d644e15 May 14 15:52:48.804127 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: ERROR nova.api.openstack.wsgi May 14 15:52:48.804127 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 14 15:52:48.804127 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: ERROR nova.api.openstack.wsgi May 14 15:52:48.804127 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 15:52:48.804127 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 14 15:52:48.805581 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 14 15:52:48.805581 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 14 15:52:48.805581 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 14 15:52:48.805581 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 0f2837f5-3eb0-4224-9cec-829916a28792 is already attached to instances: 113f6b52-519c-45f4-9bc2-37168d644e15 May 14 15:52:48.805581 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: ERROR nova.api.openstack.wsgi May 14 15:52:48.805581 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi [None req-437c3aa4-8a19-4cd1-963e-9810ab100d79 tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] Returning 400 to user: Invalid volume: volume 0f2837f5-3eb0-4224-9cec-829916a28792 is already attached to instances: 113f6b52-519c-45f4-9bc2-37168d644e15 {{(pid=128729) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 14 15:52:48.805581 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: INFO nova.api.openstack.requestlog [None req-437c3aa4-8a19-4cd1-963e-9810ab100d79 tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] 10.222.0.61 "POST /compute/v2.1/servers/567fb38a-9c00-4de9-8a01-8070792cde75/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.095351 May 14 15:52:48.805581 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: [pid: 128729|app: 0|req: 386/789] 10.222.0.61 () {60 vars in 1322 bytes} [Sat May 14 15:52:48 2022] POST /compute/v2.1/servers/567fb38a-9c00-4de9-8a01-8070792cde75/os-volume_attachments => generated 174 bytes in 96 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) May 14 15:52:48.811604 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi [None req-89089ae1-e052-4343-ab64-c3cc6ec0ca5f tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] Calling method '>' {{(pid=128728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 15:52:48.812045 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.compute.api [None req-89089ae1-e052-4343-ab64-c3cc6ec0ca5f tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] [instance: 567fb38a-9c00-4de9-8a01-8070792cde75] Fetching instance by UUID {{(pid=128728) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 15:52:48.817882 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-89089ae1-e052-4343-ab64-c3cc6ec0ca5f tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:52:48.818367 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-89089ae1-e052-4343-ab64-c3cc6ec0ca5f tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:52:48.819143 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-89089ae1-e052-4343-ab64-c3cc6ec0ca5f tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:52:48.819605 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-89089ae1-e052-4343-ab64-c3cc6ec0ca5f tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:52:48.847446 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.compute.api [None req-89089ae1-e052-4343-ab64-c3cc6ec0ca5f tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] [instance: 567fb38a-9c00-4de9-8a01-8070792cde75] Going to try to terminate instance {{(pid=128728) delete /opt/stack/nova/nova/compute/api.py:2664}} May 14 15:52:48.861334 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi [None req-89305817-53bc-4858-a7aa-e1507afdcbbd tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Calling method '>' {{(pid=128729) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 15:52:48.862053 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.compute.api [None req-89305817-53bc-4858-a7aa-e1507afdcbbd tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] [instance: 7c21adbe-7a79-46cf-aa7c-9b2a6548c767] Fetching instance by UUID {{(pid=128729) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 15:52:48.868234 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-89305817-53bc-4858-a7aa-e1507afdcbbd tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:52:48.868687 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-89305817-53bc-4858-a7aa-e1507afdcbbd tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:52:48.869454 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-89305817-53bc-4858-a7aa-e1507afdcbbd tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:52:48.869892 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-89305817-53bc-4858-a7aa-e1507afdcbbd tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:52:48.928993 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: INFO nova.api.openstack.requestlog [None req-89089ae1-e052-4343-ab64-c3cc6ec0ca5f tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] 10.222.0.61 "DELETE /compute/v2.1/servers/567fb38a-9c00-4de9-8a01-8070792cde75" status: 204 len: 0 microversion: 2.1 time: 0.121217 May 14 15:52:48.930005 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: [pid: 128728|app: 0|req: 404/790] 10.222.0.61 () {58 vars in 1238 bytes} [Sat May 14 15:52:48 2022] DELETE /compute/v2.1/servers/567fb38a-9c00-4de9-8a01-8070792cde75 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 14 15:52:48.938638 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi [None req-498cd8e0-1af8-4711-a52c-3666bf9ebca0 tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] Calling method '>' {{(pid=128728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 15:52:48.939334 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.compute.api [None req-498cd8e0-1af8-4711-a52c-3666bf9ebca0 tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] [instance: 567fb38a-9c00-4de9-8a01-8070792cde75] Fetching instance by UUID {{(pid=128728) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 15:52:48.945065 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-498cd8e0-1af8-4711-a52c-3666bf9ebca0 tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:52:48.945510 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-498cd8e0-1af8-4711-a52c-3666bf9ebca0 tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:52:48.946399 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-498cd8e0-1af8-4711-a52c-3666bf9ebca0 tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:52:48.946740 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-498cd8e0-1af8-4711-a52c-3666bf9ebca0 tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:52:49.035932 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.policy [None req-89305817-53bc-4858-a7aa-e1507afdcbbd tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b896317d96a40d6a137db0dcf5f98f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d2517d5440a4d30949f3dd36a46d813', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128729) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:52:49.043619 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: INFO nova.api.openstack.requestlog [None req-89305817-53bc-4858-a7aa-e1507afdcbbd tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] 10.222.0.61 "GET /compute/v2.1/servers/7c21adbe-7a79-46cf-aa7c-9b2a6548c767" status: 200 len: 1735 microversion: 2.1 time: 0.186647 May 14 15:52:49.045131 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: [pid: 128729|app: 0|req: 387/791] 10.222.0.61 () {58 vars in 1235 bytes} [Sat May 14 15:52:48 2022] GET /compute/v2.1/servers/7c21adbe-7a79-46cf-aa7c-9b2a6548c767 => generated 1735 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 15:52:49.095357 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.policy [None req-498cd8e0-1af8-4711-a52c-3666bf9ebca0 tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc43895177134e9c9c030a9d87f94aaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7905689c95d44a5c9169249c70f7de57', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128728) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:52:49.102954 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: INFO nova.api.openstack.requestlog [None req-498cd8e0-1af8-4711-a52c-3666bf9ebca0 tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] 10.222.0.61 "GET /compute/v2.1/servers/567fb38a-9c00-4de9-8a01-8070792cde75" status: 200 len: 1681 microversion: 2.1 time: 0.168757 May 14 15:52:49.103519 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: [pid: 128728|app: 0|req: 405/792] 10.222.0.61 () {58 vars in 1235 bytes} [Sat May 14 15:52:48 2022] GET /compute/v2.1/servers/567fb38a-9c00-4de9-8a01-8070792cde75 => generated 1681 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 15:52:50.061463 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi [None req-7ef8fddd-6366-4d2a-8283-8f27a2de66d7 tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Calling method '>' {{(pid=128729) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 15:52:50.061994 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.compute.api [None req-7ef8fddd-6366-4d2a-8283-8f27a2de66d7 tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] [instance: 7c21adbe-7a79-46cf-aa7c-9b2a6548c767] Fetching instance by UUID {{(pid=128729) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 15:52:50.068307 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-7ef8fddd-6366-4d2a-8283-8f27a2de66d7 tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:52:50.068761 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-7ef8fddd-6366-4d2a-8283-8f27a2de66d7 tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:52:50.069531 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-7ef8fddd-6366-4d2a-8283-8f27a2de66d7 tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:52:50.069970 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-7ef8fddd-6366-4d2a-8283-8f27a2de66d7 tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:52:50.120728 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi [None req-e2ccff0e-21c1-4de5-9b21-5ee3b570adb0 tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] Calling method '>' {{(pid=128728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 15:52:50.121398 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.compute.api [None req-e2ccff0e-21c1-4de5-9b21-5ee3b570adb0 tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] [instance: 567fb38a-9c00-4de9-8a01-8070792cde75] Fetching instance by UUID {{(pid=128728) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 15:52:50.128509 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-e2ccff0e-21c1-4de5-9b21-5ee3b570adb0 tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:52:50.128956 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-e2ccff0e-21c1-4de5-9b21-5ee3b570adb0 tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:52:50.129720 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-e2ccff0e-21c1-4de5-9b21-5ee3b570adb0 tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:52:50.130154 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-e2ccff0e-21c1-4de5-9b21-5ee3b570adb0 tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:52:50.234000 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.policy [None req-7ef8fddd-6366-4d2a-8283-8f27a2de66d7 tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b896317d96a40d6a137db0dcf5f98f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d2517d5440a4d30949f3dd36a46d813', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128729) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:52:50.242969 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: INFO nova.api.openstack.requestlog [None req-7ef8fddd-6366-4d2a-8283-8f27a2de66d7 tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] 10.222.0.61 "GET /compute/v2.1/servers/7c21adbe-7a79-46cf-aa7c-9b2a6548c767" status: 200 len: 1735 microversion: 2.1 time: 0.185855 May 14 15:52:50.243545 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: [pid: 128729|app: 0|req: 388/793] 10.222.0.61 () {58 vars in 1235 bytes} [Sat May 14 15:52:50 2022] GET /compute/v2.1/servers/7c21adbe-7a79-46cf-aa7c-9b2a6548c767 => generated 1735 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 15:52:50.282522 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.policy [None req-e2ccff0e-21c1-4de5-9b21-5ee3b570adb0 tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc43895177134e9c9c030a9d87f94aaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7905689c95d44a5c9169249c70f7de57', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128728) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:52:50.290645 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: INFO nova.api.openstack.requestlog [None req-e2ccff0e-21c1-4de5-9b21-5ee3b570adb0 tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] 10.222.0.61 "GET /compute/v2.1/servers/567fb38a-9c00-4de9-8a01-8070792cde75" status: 200 len: 1681 microversion: 2.1 time: 0.173680 May 14 15:52:50.291219 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: [pid: 128728|app: 0|req: 406/794] 10.222.0.61 () {58 vars in 1235 bytes} [Sat May 14 15:52:50 2022] GET /compute/v2.1/servers/567fb38a-9c00-4de9-8a01-8070792cde75 => generated 1681 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 15:52:51.260784 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi [None req-141bb191-ffcd-48b0-9c11-b04b1a62f330 tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Calling method '>' {{(pid=128729) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 15:52:51.261499 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.compute.api [None req-141bb191-ffcd-48b0-9c11-b04b1a62f330 tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] [instance: 7c21adbe-7a79-46cf-aa7c-9b2a6548c767] Fetching instance by UUID {{(pid=128729) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 15:52:51.267980 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-141bb191-ffcd-48b0-9c11-b04b1a62f330 tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:52:51.268505 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-141bb191-ffcd-48b0-9c11-b04b1a62f330 tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:52:51.269351 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-141bb191-ffcd-48b0-9c11-b04b1a62f330 tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:52:51.269855 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-141bb191-ffcd-48b0-9c11-b04b1a62f330 tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:52:51.317161 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi [None req-9f762fd4-d72d-444b-b7de-93b19f52cd28 tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] Calling method '>' {{(pid=128728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 15:52:51.317834 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.compute.api [None req-9f762fd4-d72d-444b-b7de-93b19f52cd28 tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] [instance: 567fb38a-9c00-4de9-8a01-8070792cde75] Fetching instance by UUID {{(pid=128728) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 15:52:51.323748 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-9f762fd4-d72d-444b-b7de-93b19f52cd28 tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:52:51.324201 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-9f762fd4-d72d-444b-b7de-93b19f52cd28 tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:52:51.324978 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-9f762fd4-d72d-444b-b7de-93b19f52cd28 tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:52:51.325969 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-9f762fd4-d72d-444b-b7de-93b19f52cd28 tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:52:51.451369 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.policy [None req-141bb191-ffcd-48b0-9c11-b04b1a62f330 tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b896317d96a40d6a137db0dcf5f98f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d2517d5440a4d30949f3dd36a46d813', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128729) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:52:51.460515 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: INFO nova.api.openstack.requestlog [None req-141bb191-ffcd-48b0-9c11-b04b1a62f330 tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] 10.222.0.61 "GET /compute/v2.1/servers/7c21adbe-7a79-46cf-aa7c-9b2a6548c767" status: 200 len: 1735 microversion: 2.1 time: 0.203284 May 14 15:52:51.461385 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: [pid: 128729|app: 0|req: 389/795] 10.222.0.61 () {58 vars in 1235 bytes} [Sat May 14 15:52:51 2022] GET /compute/v2.1/servers/7c21adbe-7a79-46cf-aa7c-9b2a6548c767 => generated 1735 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 15:52:51.488193 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.policy [None req-9f762fd4-d72d-444b-b7de-93b19f52cd28 tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc43895177134e9c9c030a9d87f94aaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7905689c95d44a5c9169249c70f7de57', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128728) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:52:51.495769 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: INFO nova.api.openstack.requestlog [None req-9f762fd4-d72d-444b-b7de-93b19f52cd28 tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] 10.222.0.61 "GET /compute/v2.1/servers/567fb38a-9c00-4de9-8a01-8070792cde75" status: 200 len: 1681 microversion: 2.1 time: 0.182410 May 14 15:52:51.496337 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: [pid: 128728|app: 0|req: 407/796] 10.222.0.61 () {58 vars in 1235 bytes} [Sat May 14 15:52:51 2022] GET /compute/v2.1/servers/567fb38a-9c00-4de9-8a01-8070792cde75 => generated 1681 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 15:52:51.807657 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi [req-699f3826-dff3-476f-b001-35a4fe3ff9ee req-5eeaca48-623a-47ff-8a1b-e0c4894fe2fb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "567fb38a-9c00-4de9-8a01-8070792cde75", "name": "network-vif-deleted", "tag": "8fdc20f7-107b-43f1-810d-31e0e55a918f"}]} {{(pid=128729) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 15:52:51.816992 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [req-699f3826-dff3-476f-b001-35a4fe3ff9ee req-5eeaca48-623a-47ff-8a1b-e0c4894fe2fb service nova] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:52:51.817743 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [req-699f3826-dff3-476f-b001-35a4fe3ff9ee req-5eeaca48-623a-47ff-8a1b-e0c4894fe2fb service nova] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:52:51.845332 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: INFO nova.api.openstack.compute.server_external_events [req-699f3826-dff3-476f-b001-35a4fe3ff9ee req-5eeaca48-623a-47ff-8a1b-e0c4894fe2fb service nova] Creating event network-vif-deleted:8fdc20f7-107b-43f1-810d-31e0e55a918f for instance 567fb38a-9c00-4de9-8a01-8070792cde75 on hv-cinder-83979 May 14 15:52:51.851542 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: INFO nova.api.openstack.requestlog [req-699f3826-dff3-476f-b001-35a4fe3ff9ee req-5eeaca48-623a-47ff-8a1b-e0c4894fe2fb service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047919 May 14 15:52:51.852695 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: [pid: 128729|app: 0|req: 390/797] 10.222.0.61 () {64 vars in 1317 bytes} [Sat May 14 15:52:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 14 15:52:52.480262 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi [None req-3360c887-44ce-457b-91e1-ad5750451c8c tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Calling method '>' {{(pid=128728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 15:52:52.481372 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.compute.api [None req-3360c887-44ce-457b-91e1-ad5750451c8c tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] [instance: 7c21adbe-7a79-46cf-aa7c-9b2a6548c767] Fetching instance by UUID {{(pid=128728) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 15:52:52.491709 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-3360c887-44ce-457b-91e1-ad5750451c8c tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:52:52.492406 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-3360c887-44ce-457b-91e1-ad5750451c8c tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:52:52.493559 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-3360c887-44ce-457b-91e1-ad5750451c8c tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:52:52.493842 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-3360c887-44ce-457b-91e1-ad5750451c8c tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:52:52.513301 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi [None req-861ab05b-f446-4bdf-adc9-14a704830e30 tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] Calling method '>' {{(pid=128729) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 15:52:52.514102 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.compute.api [None req-861ab05b-f446-4bdf-adc9-14a704830e30 tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] [instance: 567fb38a-9c00-4de9-8a01-8070792cde75] Fetching instance by UUID {{(pid=128729) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 15:52:52.520330 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-861ab05b-f446-4bdf-adc9-14a704830e30 tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:52:52.520783 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-861ab05b-f446-4bdf-adc9-14a704830e30 tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:52:52.521556 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-861ab05b-f446-4bdf-adc9-14a704830e30 tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:52:52.521995 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-861ab05b-f446-4bdf-adc9-14a704830e30 tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:52:52.547964 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: INFO nova.api.openstack.wsgi [None req-861ab05b-f446-4bdf-adc9-14a704830e30 tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] HTTP exception thrown: Instance 567fb38a-9c00-4de9-8a01-8070792cde75 could not be found. May 14 15:52:52.549620 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi [None req-861ab05b-f446-4bdf-adc9-14a704830e30 tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] Request method failure captured: May 14 15:52:52.549620 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: request: GET /compute/v2.1/servers/567fb38a-9c00-4de9-8a01-8070792cde75 HTTP/1.1 May 14 15:52:52.549620 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: Accept: application/json May 14 15:52:52.549620 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: Accept-Encoding: identity May 14 15:52:52.549620 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: Connection: close May 14 15:52:52.549620 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: Content-Length: 0 May 14 15:52:52.549620 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: Content-Type: application/json May 14 15:52:52.549620 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: Host: 10.222.0.61 May 14 15:52:52.549620 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: Openstack-System-Scope: None May 14 15:52:52.549620 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: User-Agent: python-urllib3/1.26.9 May 14 15:52:52.549620 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: X-Auth-Token: gAAAAABif87SP_Zwa2IiGvFqsMgjavpLb8KTM6Zjei-leP46wpGTfISEWiNabTSLn_Se4MigqIDtVKHrnJDEVndJObAkvdE7QziqGtKnvzcsAHHCuGZvbOCiZ5Yv_050Eg71rjYT92fMkrLj82GJjq7kUvTbRuW_X-0VLgSk3UstO-oNY0ykSUs May 14 15:52:52.549620 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: X-Domain-Id: None May 14 15:52:52.549620 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: X-Domain-Name: None May 14 15:52:52.549620 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: X-Identity-Status: Confirmed May 14 15:52:52.549620 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: X-Is-Admin-Project: True May 14 15:52:52.549620 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: X-Project-Domain-Id: default May 14 15:52:52.549620 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: X-Project-Domain-Name: Default May 14 15:52:52.549620 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: X-Project-Id: 7905689c95d44a5c9169249c70f7de57 May 14 15:52:52.549620 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: X-Project-Name: tempest-AttachVolumeNegativeTest-1525749350 May 14 15:52:52.549620 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: X-Role: reader,member May 14 15:52:52.549620 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: X-Roles: reader,member May 14 15:52:52.551040 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/7905689c95d44a5c9169249c70f7de57"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/7905689c95d44a5c9169249c70f7de57"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/7905689c95d44a5c9169249c70f7de57"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_7905689c95d44a5c9169249c70f7de57"}]}] May 14 15:52:52.551040 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: X-Tenant: tempest-AttachVolumeNegativeTest-1525749350 May 14 15:52:52.551040 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: X-Tenant-Id: 7905689c95d44a5c9169249c70f7de57 May 14 15:52:52.551040 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1525749350 May 14 15:52:52.551040 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: X-User: tempest-AttachVolumeNegativeTest-1525749350-project May 14 15:52:52.551040 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: X-User-Domain-Id: default May 14 15:52:52.551040 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: X-User-Domain-Name: Default May 14 15:52:52.551040 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: X-User-Id: dc43895177134e9c9c030a9d87f94aaa May 14 15:52:52.551040 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: X-User-Name: tempest-AttachVolumeNegativeTest-1525749350-project May 14 15:52:52.551040 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: method: > May 14 15:52:52.551040 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: exception: Instance 567fb38a-9c00-4de9-8a01-8070792cde75 could not be found. May 14 15:52:52.551040 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: action_args: {'id': '567fb38a-9c00-4de9-8a01-8070792cde75'} May 14 15:52:52.551782 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: {{(pid=128729) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 14 15:52:52.551782 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 15:52:52.551782 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 14 15:52:52.551782 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 14 15:52:52.551782 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 14 15:52:52.551782 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 14 15:52:52.551782 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 14 15:52:52.551782 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 14 15:52:52.551782 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 14 15:52:52.551782 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 14 15:52:52.551782 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 567fb38a-9c00-4de9-8a01-8070792cde75 could not be found. May 14 15:52:52.551782 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: ERROR nova.api.openstack.wsgi May 14 15:52:52.551782 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 14 15:52:52.551782 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: ERROR nova.api.openstack.wsgi May 14 15:52:52.551782 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 15:52:52.551782 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 14 15:52:52.551782 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 14 15:52:52.551782 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 14 15:52:52.551782 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 14 15:52:52.551782 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 14 15:52:52.553185 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 14 15:52:52.553185 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 14 15:52:52.553185 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 14 15:52:52.553185 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 14 15:52:52.553185 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 14 15:52:52.553185 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 14 15:52:52.553185 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 14 15:52:52.553185 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 567fb38a-9c00-4de9-8a01-8070792cde75 could not be found. May 14 15:52:52.553185 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: ERROR nova.api.openstack.wsgi May 14 15:52:52.553185 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 14 15:52:52.553185 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: ERROR nova.api.openstack.wsgi May 14 15:52:52.553185 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 15:52:52.553185 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 14 15:52:52.553185 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 14 15:52:52.553185 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 14 15:52:52.553185 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 14 15:52:52.553185 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 567fb38a-9c00-4de9-8a01-8070792cde75 could not be found. May 14 15:52:52.553185 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: ERROR nova.api.openstack.wsgi May 14 15:52:52.555397 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi [None req-861ab05b-f446-4bdf-adc9-14a704830e30 tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] Returning 404 to user: Instance 567fb38a-9c00-4de9-8a01-8070792cde75 could not be found. {{(pid=128729) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 14 15:52:52.555397 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: INFO nova.api.openstack.requestlog [None req-861ab05b-f446-4bdf-adc9-14a704830e30 tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] 10.222.0.61 "GET /compute/v2.1/servers/567fb38a-9c00-4de9-8a01-8070792cde75" status: 404 len: 111 microversion: 2.1 time: 0.041943 May 14 15:52:52.555397 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: [pid: 128729|app: 0|req: 391/798] 10.222.0.61 () {58 vars in 1235 bytes} [Sat May 14 15:52:52 2022] GET /compute/v2.1/servers/567fb38a-9c00-4de9-8a01-8070792cde75 => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 14 15:52:52.560670 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi [None req-5a678cb7-c6f6-4483-91cd-d4871fb27edd tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] Calling method '.version_select at 0x7f77dcf9af70>' {{(pid=128729) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 15:52:52.565244 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: ERROR oslo.messaging._drivers.impl_rabbit [None req-5a678cb7-c6f6-4483-91cd-d4871fb27edd tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] [c31826fc-5828-4db6-b861-01c208c29f39] AMQP server on 10.222.0.61:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer May 14 15:52:52.632987 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.policy [None req-3360c887-44ce-457b-91e1-ad5750451c8c tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b896317d96a40d6a137db0dcf5f98f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d2517d5440a4d30949f3dd36a46d813', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128728) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:52:52.641539 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: INFO nova.api.openstack.requestlog [None req-3360c887-44ce-457b-91e1-ad5750451c8c tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] 10.222.0.61 "GET /compute/v2.1/servers/7c21adbe-7a79-46cf-aa7c-9b2a6548c767" status: 200 len: 1735 microversion: 2.1 time: 0.166529 May 14 15:52:52.642117 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: [pid: 128728|app: 0|req: 408/799] 10.222.0.61 () {58 vars in 1235 bytes} [Sat May 14 15:52:52 2022] GET /compute/v2.1/servers/7c21adbe-7a79-46cf-aa7c-9b2a6548c767 => generated 1735 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 15:52:53.572983 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: INFO oslo.messaging._drivers.impl_rabbit [None req-5a678cb7-c6f6-4483-91cd-d4871fb27edd tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] [c31826fc-5828-4db6-b861-01c208c29f39] Reconnected to AMQP server on 10.222.0.61:5672 via [amqp] client with port 50820. May 14 15:52:53.592877 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: INFO nova.api.openstack.requestlog [None req-5a678cb7-c6f6-4483-91cd-d4871fb27edd tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] 10.222.0.61 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-886674356" status: 202 len: 0 microversion: 2.1 time: 1.036366 May 14 15:52:53.593450 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: [pid: 128729|app: 0|req: 392/800] 10.222.0.61 () {58 vars in 1217 bytes} [Sat May 14 15:52:52 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-886674356 => generated 0 bytes in 1038 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 14 15:52:53.659359 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi [None req-8611a179-0715-4ae4-b286-091fb441dbc1 tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Calling method '>' {{(pid=128728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 15:52:53.659975 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.compute.api [None req-8611a179-0715-4ae4-b286-091fb441dbc1 tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] [instance: 7c21adbe-7a79-46cf-aa7c-9b2a6548c767] Fetching instance by UUID {{(pid=128728) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 15:52:53.666775 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-8611a179-0715-4ae4-b286-091fb441dbc1 tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:52:53.667331 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-8611a179-0715-4ae4-b286-091fb441dbc1 tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:52:53.668179 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-8611a179-0715-4ae4-b286-091fb441dbc1 tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:52:53.668619 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-8611a179-0715-4ae4-b286-091fb441dbc1 tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:52:53.931419 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.policy [None req-8611a179-0715-4ae4-b286-091fb441dbc1 tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b896317d96a40d6a137db0dcf5f98f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d2517d5440a4d30949f3dd36a46d813', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128728) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:52:53.940231 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: INFO nova.api.openstack.requestlog [None req-8611a179-0715-4ae4-b286-091fb441dbc1 tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] 10.222.0.61 "GET /compute/v2.1/servers/7c21adbe-7a79-46cf-aa7c-9b2a6548c767" status: 200 len: 1735 microversion: 2.1 time: 0.284799 May 14 15:52:53.949936 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: [pid: 128728|app: 0|req: 409/801] 10.222.0.61 () {58 vars in 1235 bytes} [Sat May 14 15:52:53 2022] GET /compute/v2.1/servers/7c21adbe-7a79-46cf-aa7c-9b2a6548c767 => generated 1735 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 15:52:54.320831 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi [None req-37532670-2084-4134-9f16-d1b4f530e4fe tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] Calling method '>' {{(pid=128729) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 15:52:54.321329 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.compute.api [None req-37532670-2084-4134-9f16-d1b4f530e4fe tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] [instance: 113f6b52-519c-45f4-9bc2-37168d644e15] Fetching instance by UUID {{(pid=128729) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 15:52:54.329943 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-37532670-2084-4134-9f16-d1b4f530e4fe tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:52:54.330429 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-37532670-2084-4134-9f16-d1b4f530e4fe tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:52:54.331221 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-37532670-2084-4134-9f16-d1b4f530e4fe tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:52:54.331660 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-37532670-2084-4134-9f16-d1b4f530e4fe tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:52:54.464915 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.objects.instance [None req-37532670-2084-4134-9f16-d1b4f530e4fe tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] Lazy-loading 'services' on Instance uuid 113f6b52-519c-45f4-9bc2-37168d644e15 {{(pid=128729) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 14 15:52:54.582065 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: INFO nova.api.openstack.requestlog [None req-37532670-2084-4134-9f16-d1b4f530e4fe tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] 10.222.0.61 "DELETE /compute/v2.1/servers/113f6b52-519c-45f4-9bc2-37168d644e15/os-volume_attachments/0f2837f5-3eb0-4224-9cec-829916a28792" status: 202 len: 0 microversion: 2.1 time: 0.265159 May 14 15:52:54.585813 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: [pid: 128729|app: 0|req: 393/802] 10.222.0.61 () {58 vars in 1415 bytes} [Sat May 14 15:52:54 2022] DELETE /compute/v2.1/servers/113f6b52-519c-45f4-9bc2-37168d644e15/os-volume_attachments/0f2837f5-3eb0-4224-9cec-829916a28792 => generated 0 bytes in 267 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 14 15:52:54.591971 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi [None req-167ac3b7-74bb-4dc4-b8d7-b8bade108d1e tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] Calling method '>' {{(pid=128728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 15:52:54.593241 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.compute.api [None req-167ac3b7-74bb-4dc4-b8d7-b8bade108d1e tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] [instance: 113f6b52-519c-45f4-9bc2-37168d644e15] Fetching instance by UUID {{(pid=128728) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 15:52:54.599512 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-167ac3b7-74bb-4dc4-b8d7-b8bade108d1e tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:52:54.600048 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-167ac3b7-74bb-4dc4-b8d7-b8bade108d1e tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:52:54.600963 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-167ac3b7-74bb-4dc4-b8d7-b8bade108d1e tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:52:54.601505 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-167ac3b7-74bb-4dc4-b8d7-b8bade108d1e tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:52:54.630891 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: INFO nova.api.openstack.requestlog [None req-167ac3b7-74bb-4dc4-b8d7-b8bade108d1e tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] 10.222.0.61 "GET /compute/v2.1/servers/113f6b52-519c-45f4-9bc2-37168d644e15/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043591 May 14 15:52:54.631457 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: [pid: 128728|app: 0|req: 410/803] 10.222.0.61 () {58 vars in 1301 bytes} [Sat May 14 15:52:54 2022] GET /compute/v2.1/servers/113f6b52-519c-45f4-9bc2-37168d644e15/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 14 15:52:54.958126 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi [None req-90cd2c82-218d-4eb0-97d7-73236f6ed104 tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Calling method '>' {{(pid=128729) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 15:52:54.958790 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.compute.api [None req-90cd2c82-218d-4eb0-97d7-73236f6ed104 tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] [instance: 7c21adbe-7a79-46cf-aa7c-9b2a6548c767] Fetching instance by UUID {{(pid=128729) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 15:52:54.964929 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-90cd2c82-218d-4eb0-97d7-73236f6ed104 tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:52:54.965381 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-90cd2c82-218d-4eb0-97d7-73236f6ed104 tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:52:54.966185 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-90cd2c82-218d-4eb0-97d7-73236f6ed104 tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:52:54.966655 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-90cd2c82-218d-4eb0-97d7-73236f6ed104 tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:52:55.099586 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.policy [None req-90cd2c82-218d-4eb0-97d7-73236f6ed104 tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b896317d96a40d6a137db0dcf5f98f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d2517d5440a4d30949f3dd36a46d813', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128729) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:52:55.107669 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: INFO nova.api.openstack.requestlog [None req-90cd2c82-218d-4eb0-97d7-73236f6ed104 tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] 10.222.0.61 "GET /compute/v2.1/servers/7c21adbe-7a79-46cf-aa7c-9b2a6548c767" status: 200 len: 1735 microversion: 2.1 time: 0.153882 May 14 15:52:55.108224 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: [pid: 128729|app: 0|req: 394/804] 10.222.0.61 () {58 vars in 1235 bytes} [Sat May 14 15:52:54 2022] GET /compute/v2.1/servers/7c21adbe-7a79-46cf-aa7c-9b2a6548c767 => generated 1735 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 15:52:55.642895 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi [None req-7f11ca77-b506-4b2f-ba09-3ad5303e0208 tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] Calling method '>' {{(pid=128728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 15:52:55.643813 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.compute.api [None req-7f11ca77-b506-4b2f-ba09-3ad5303e0208 tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] [instance: 113f6b52-519c-45f4-9bc2-37168d644e15] Fetching instance by UUID {{(pid=128728) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 15:52:55.650046 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-7f11ca77-b506-4b2f-ba09-3ad5303e0208 tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:52:55.650539 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-7f11ca77-b506-4b2f-ba09-3ad5303e0208 tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:52:55.651292 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-7f11ca77-b506-4b2f-ba09-3ad5303e0208 tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:52:55.651726 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-7f11ca77-b506-4b2f-ba09-3ad5303e0208 tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:52:55.683521 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: INFO nova.api.openstack.requestlog [None req-7f11ca77-b506-4b2f-ba09-3ad5303e0208 tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] 10.222.0.61 "GET /compute/v2.1/servers/113f6b52-519c-45f4-9bc2-37168d644e15/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044739 May 14 15:52:55.684093 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: [pid: 128728|app: 0|req: 411/805] 10.222.0.61 () {58 vars in 1301 bytes} [Sat May 14 15:52:55 2022] GET /compute/v2.1/servers/113f6b52-519c-45f4-9bc2-37168d644e15/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 14 15:52:56.124859 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi [None req-2c19f89f-b5a8-41cf-84c6-6429c15060e2 tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Calling method '>' {{(pid=128729) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 15:52:56.125487 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.compute.api [None req-2c19f89f-b5a8-41cf-84c6-6429c15060e2 tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] [instance: 7c21adbe-7a79-46cf-aa7c-9b2a6548c767] Fetching instance by UUID {{(pid=128729) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 15:52:56.131831 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-2c19f89f-b5a8-41cf-84c6-6429c15060e2 tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:52:56.132317 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-2c19f89f-b5a8-41cf-84c6-6429c15060e2 tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:52:56.133075 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-2c19f89f-b5a8-41cf-84c6-6429c15060e2 tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:52:56.133519 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-2c19f89f-b5a8-41cf-84c6-6429c15060e2 tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:52:56.260942 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.policy [None req-2c19f89f-b5a8-41cf-84c6-6429c15060e2 tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b896317d96a40d6a137db0dcf5f98f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d2517d5440a4d30949f3dd36a46d813', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128729) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:52:56.269535 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: INFO nova.api.openstack.requestlog [None req-2c19f89f-b5a8-41cf-84c6-6429c15060e2 tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] 10.222.0.61 "GET /compute/v2.1/servers/7c21adbe-7a79-46cf-aa7c-9b2a6548c767" status: 200 len: 1735 microversion: 2.1 time: 0.148561 May 14 15:52:56.270115 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: [pid: 128729|app: 0|req: 395/806] 10.222.0.61 () {58 vars in 1235 bytes} [Sat May 14 15:52:56 2022] GET /compute/v2.1/servers/7c21adbe-7a79-46cf-aa7c-9b2a6548c767 => generated 1735 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 15:52:56.695057 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi [None req-70e265af-6d66-422b-8ba3-2c9d22682297 tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] Calling method '>' {{(pid=128728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 15:52:56.695995 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.compute.api [None req-70e265af-6d66-422b-8ba3-2c9d22682297 tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] [instance: 113f6b52-519c-45f4-9bc2-37168d644e15] Fetching instance by UUID {{(pid=128728) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 15:52:56.702706 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-70e265af-6d66-422b-8ba3-2c9d22682297 tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:52:56.703152 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-70e265af-6d66-422b-8ba3-2c9d22682297 tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:52:56.703914 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-70e265af-6d66-422b-8ba3-2c9d22682297 tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:52:56.704345 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-70e265af-6d66-422b-8ba3-2c9d22682297 tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:52:56.732179 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: INFO nova.api.openstack.requestlog [None req-70e265af-6d66-422b-8ba3-2c9d22682297 tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] 10.222.0.61 "GET /compute/v2.1/servers/113f6b52-519c-45f4-9bc2-37168d644e15/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.041005 May 14 15:52:56.732720 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: [pid: 128728|app: 0|req: 412/807] 10.222.0.61 () {58 vars in 1301 bytes} [Sat May 14 15:52:56 2022] GET /compute/v2.1/servers/113f6b52-519c-45f4-9bc2-37168d644e15/os-volume_attachments => generated 25 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 14 15:52:56.788508 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi [None req-965f12d2-0bc2-4de3-896d-e946a27d70af tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] Calling method '>' {{(pid=128729) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 15:52:56.789152 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.compute.api [None req-965f12d2-0bc2-4de3-896d-e946a27d70af tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] [instance: 113f6b52-519c-45f4-9bc2-37168d644e15] Fetching instance by UUID {{(pid=128729) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 15:52:56.795473 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-965f12d2-0bc2-4de3-896d-e946a27d70af tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:52:56.795995 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-965f12d2-0bc2-4de3-896d-e946a27d70af tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:52:56.796757 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-965f12d2-0bc2-4de3-896d-e946a27d70af tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:52:56.797199 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-965f12d2-0bc2-4de3-896d-e946a27d70af tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:52:56.821814 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.compute.api [None req-965f12d2-0bc2-4de3-896d-e946a27d70af tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] [instance: 113f6b52-519c-45f4-9bc2-37168d644e15] Going to try to terminate instance {{(pid=128729) delete /opt/stack/nova/nova/compute/api.py:2664}} May 14 15:52:56.901948 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: INFO nova.api.openstack.requestlog [None req-965f12d2-0bc2-4de3-896d-e946a27d70af tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] 10.222.0.61 "DELETE /compute/v2.1/servers/113f6b52-519c-45f4-9bc2-37168d644e15" status: 204 len: 0 microversion: 2.1 time: 0.117162 May 14 15:52:56.902575 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: [pid: 128729|app: 0|req: 396/808] 10.222.0.61 () {58 vars in 1238 bytes} [Sat May 14 15:52:56 2022] DELETE /compute/v2.1/servers/113f6b52-519c-45f4-9bc2-37168d644e15 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 14 15:52:56.911189 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi [None req-61aab817-c61f-40f3-a3a4-3a4798628d52 tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] Calling method '>' {{(pid=128728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 15:52:56.911787 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.compute.api [None req-61aab817-c61f-40f3-a3a4-3a4798628d52 tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] [instance: 113f6b52-519c-45f4-9bc2-37168d644e15] Fetching instance by UUID {{(pid=128728) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 15:52:56.917540 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-61aab817-c61f-40f3-a3a4-3a4798628d52 tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:52:56.917985 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-61aab817-c61f-40f3-a3a4-3a4798628d52 tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:52:56.918775 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-61aab817-c61f-40f3-a3a4-3a4798628d52 tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:52:56.919210 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-61aab817-c61f-40f3-a3a4-3a4798628d52 tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:52:57.047684 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.policy [None req-61aab817-c61f-40f3-a3a4-3a4798628d52 tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc43895177134e9c9c030a9d87f94aaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7905689c95d44a5c9169249c70f7de57', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128728) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:52:57.055131 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: INFO nova.api.openstack.requestlog [None req-61aab817-c61f-40f3-a3a4-3a4798628d52 tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] 10.222.0.61 "GET /compute/v2.1/servers/113f6b52-519c-45f4-9bc2-37168d644e15" status: 200 len: 1680 microversion: 2.1 time: 0.147749 May 14 15:52:57.055706 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: [pid: 128728|app: 0|req: 413/809] 10.222.0.61 () {58 vars in 1235 bytes} [Sat May 14 15:52:56 2022] GET /compute/v2.1/servers/113f6b52-519c-45f4-9bc2-37168d644e15 => generated 1680 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 15:52:57.287288 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi [None req-228b844b-f2a3-4f6a-8a44-491ce3686624 tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Calling method '>' {{(pid=128729) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 15:52:57.287906 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.compute.api [None req-228b844b-f2a3-4f6a-8a44-491ce3686624 tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] [instance: 7c21adbe-7a79-46cf-aa7c-9b2a6548c767] Fetching instance by UUID {{(pid=128729) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 15:52:57.294696 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-228b844b-f2a3-4f6a-8a44-491ce3686624 tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:52:57.295160 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-228b844b-f2a3-4f6a-8a44-491ce3686624 tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:52:57.295938 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-228b844b-f2a3-4f6a-8a44-491ce3686624 tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:52:57.296376 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-228b844b-f2a3-4f6a-8a44-491ce3686624 tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:52:57.427122 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.policy [None req-228b844b-f2a3-4f6a-8a44-491ce3686624 tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b896317d96a40d6a137db0dcf5f98f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d2517d5440a4d30949f3dd36a46d813', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128729) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:52:57.435345 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: INFO nova.api.openstack.requestlog [None req-228b844b-f2a3-4f6a-8a44-491ce3686624 tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] 10.222.0.61 "GET /compute/v2.1/servers/7c21adbe-7a79-46cf-aa7c-9b2a6548c767" status: 200 len: 1735 microversion: 2.1 time: 0.151726 May 14 15:52:57.435937 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: [pid: 128729|app: 0|req: 397/810] 10.222.0.61 () {58 vars in 1235 bytes} [Sat May 14 15:52:57 2022] GET /compute/v2.1/servers/7c21adbe-7a79-46cf-aa7c-9b2a6548c767 => generated 1735 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 15:52:58.073108 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi [None req-122b934b-9ffc-49cb-b18a-1dc46a83c44c tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] Calling method '>' {{(pid=128728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 15:52:58.074324 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.compute.api [None req-122b934b-9ffc-49cb-b18a-1dc46a83c44c tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] [instance: 113f6b52-519c-45f4-9bc2-37168d644e15] Fetching instance by UUID {{(pid=128728) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 15:52:58.081131 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-122b934b-9ffc-49cb-b18a-1dc46a83c44c tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:52:58.081584 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-122b934b-9ffc-49cb-b18a-1dc46a83c44c tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:52:58.082381 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-122b934b-9ffc-49cb-b18a-1dc46a83c44c tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:52:58.082819 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-122b934b-9ffc-49cb-b18a-1dc46a83c44c tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:52:58.212476 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.policy [None req-122b934b-9ffc-49cb-b18a-1dc46a83c44c tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc43895177134e9c9c030a9d87f94aaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7905689c95d44a5c9169249c70f7de57', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128728) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:52:58.220640 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: INFO nova.api.openstack.requestlog [None req-122b934b-9ffc-49cb-b18a-1dc46a83c44c tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] 10.222.0.61 "GET /compute/v2.1/servers/113f6b52-519c-45f4-9bc2-37168d644e15" status: 200 len: 1680 microversion: 2.1 time: 0.151391 May 14 15:52:58.221405 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: [pid: 128728|app: 0|req: 414/811] 10.222.0.61 () {58 vars in 1235 bytes} [Sat May 14 15:52:58 2022] GET /compute/v2.1/servers/113f6b52-519c-45f4-9bc2-37168d644e15 => generated 1680 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 15:52:58.452938 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi [None req-63f5b4af-d9c9-4a7c-a09f-a7070d6a1303 tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Calling method '>' {{(pid=128729) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 15:52:58.453566 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.compute.api [None req-63f5b4af-d9c9-4a7c-a09f-a7070d6a1303 tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] [instance: 7c21adbe-7a79-46cf-aa7c-9b2a6548c767] Fetching instance by UUID {{(pid=128729) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 15:52:58.460128 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-63f5b4af-d9c9-4a7c-a09f-a7070d6a1303 tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:52:58.460581 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-63f5b4af-d9c9-4a7c-a09f-a7070d6a1303 tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:52:58.461354 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-63f5b4af-d9c9-4a7c-a09f-a7070d6a1303 tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:52:58.461788 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-63f5b4af-d9c9-4a7c-a09f-a7070d6a1303 tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:52:58.597542 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.policy [None req-63f5b4af-d9c9-4a7c-a09f-a7070d6a1303 tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b896317d96a40d6a137db0dcf5f98f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d2517d5440a4d30949f3dd36a46d813', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128729) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:52:58.605462 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: INFO nova.api.openstack.requestlog [None req-63f5b4af-d9c9-4a7c-a09f-a7070d6a1303 tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] 10.222.0.61 "GET /compute/v2.1/servers/7c21adbe-7a79-46cf-aa7c-9b2a6548c767" status: 200 len: 1735 microversion: 2.1 time: 0.156989 May 14 15:52:58.606158 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: [pid: 128729|app: 0|req: 398/812] 10.222.0.61 () {58 vars in 1235 bytes} [Sat May 14 15:52:58 2022] GET /compute/v2.1/servers/7c21adbe-7a79-46cf-aa7c-9b2a6548c767 => generated 1735 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 15:52:59.091791 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi [req-c45bfea1-eb59-4a9a-adb6-b45c78f7be9b req-0bccd012-2552-4863-8827-7674cbec9fcc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "113f6b52-519c-45f4-9bc2-37168d644e15", "name": "network-vif-deleted", "tag": "60f7fd3d-dbe8-4c62-af7e-c0490eeb01d3"}]} {{(pid=128728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 15:52:59.100074 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [req-c45bfea1-eb59-4a9a-adb6-b45c78f7be9b req-0bccd012-2552-4863-8827-7674cbec9fcc service nova] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:52:59.100611 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [req-c45bfea1-eb59-4a9a-adb6-b45c78f7be9b req-0bccd012-2552-4863-8827-7674cbec9fcc service nova] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:52:59.112466 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: INFO nova.api.openstack.compute.server_external_events [req-c45bfea1-eb59-4a9a-adb6-b45c78f7be9b req-0bccd012-2552-4863-8827-7674cbec9fcc service nova] Creating event network-vif-deleted:60f7fd3d-dbe8-4c62-af7e-c0490eeb01d3 for instance 113f6b52-519c-45f4-9bc2-37168d644e15 on hv-cinder-83979 May 14 15:52:59.117919 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: INFO nova.api.openstack.requestlog [req-c45bfea1-eb59-4a9a-adb6-b45c78f7be9b req-0bccd012-2552-4863-8827-7674cbec9fcc service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029737 May 14 15:52:59.118548 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: [pid: 128728|app: 0|req: 415/813] 10.222.0.61 () {64 vars in 1317 bytes} [Sat May 14 15:52:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 14 15:52:59.237773 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi [None req-c9aafeca-6d8e-48e3-b853-dc7c351cff51 tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] Calling method '>' {{(pid=128729) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 15:52:59.238297 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.compute.api [None req-c9aafeca-6d8e-48e3-b853-dc7c351cff51 tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] [instance: 113f6b52-519c-45f4-9bc2-37168d644e15] Fetching instance by UUID {{(pid=128729) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 15:52:59.251024 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-c9aafeca-6d8e-48e3-b853-dc7c351cff51 tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:52:59.251478 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-c9aafeca-6d8e-48e3-b853-dc7c351cff51 tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:52:59.252266 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-c9aafeca-6d8e-48e3-b853-dc7c351cff51 tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:52:59.252708 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-c9aafeca-6d8e-48e3-b853-dc7c351cff51 tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:52:59.317228 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.policy [None req-c9aafeca-6d8e-48e3-b853-dc7c351cff51 tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc43895177134e9c9c030a9d87f94aaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7905689c95d44a5c9169249c70f7de57', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128729) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:52:59.324465 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: INFO nova.api.openstack.requestlog [None req-c9aafeca-6d8e-48e3-b853-dc7c351cff51 tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] 10.222.0.61 "GET /compute/v2.1/servers/113f6b52-519c-45f4-9bc2-37168d644e15" status: 200 len: 1613 microversion: 2.1 time: 0.090552 May 14 15:52:59.325032 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: [pid: 128729|app: 0|req: 399/814] 10.222.0.61 () {58 vars in 1235 bytes} [Sat May 14 15:52:59 2022] GET /compute/v2.1/servers/113f6b52-519c-45f4-9bc2-37168d644e15 => generated 1613 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 15:52:59.623466 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi [None req-03730969-2177-4331-b673-28fb6e035218 tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Calling method '>' {{(pid=128728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 15:52:59.624194 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.compute.api [None req-03730969-2177-4331-b673-28fb6e035218 tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] [instance: 7c21adbe-7a79-46cf-aa7c-9b2a6548c767] Fetching instance by UUID {{(pid=128728) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 15:52:59.630126 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-03730969-2177-4331-b673-28fb6e035218 tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:52:59.630606 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-03730969-2177-4331-b673-28fb6e035218 tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:52:59.631373 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-03730969-2177-4331-b673-28fb6e035218 tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:52:59.631810 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-03730969-2177-4331-b673-28fb6e035218 tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:52:59.767096 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.policy [None req-03730969-2177-4331-b673-28fb6e035218 tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b896317d96a40d6a137db0dcf5f98f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d2517d5440a4d30949f3dd36a46d813', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128728) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:52:59.775238 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: INFO nova.api.openstack.requestlog [None req-03730969-2177-4331-b673-28fb6e035218 tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] 10.222.0.61 "GET /compute/v2.1/servers/7c21adbe-7a79-46cf-aa7c-9b2a6548c767" status: 200 len: 1735 microversion: 2.1 time: 0.155927 May 14 15:52:59.775997 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: [pid: 128728|app: 0|req: 416/815] 10.222.0.61 () {58 vars in 1235 bytes} [Sat May 14 15:52:59 2022] GET /compute/v2.1/servers/7c21adbe-7a79-46cf-aa7c-9b2a6548c767 => generated 1735 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 15:53:00.340900 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi [None req-22f705da-9a81-4499-a691-07ceb91602f1 tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] Calling method '>' {{(pid=128729) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 15:53:00.341578 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.compute.api [None req-22f705da-9a81-4499-a691-07ceb91602f1 tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] [instance: 113f6b52-519c-45f4-9bc2-37168d644e15] Fetching instance by UUID {{(pid=128729) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 15:53:00.347826 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-22f705da-9a81-4499-a691-07ceb91602f1 tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:53:00.348276 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-22f705da-9a81-4499-a691-07ceb91602f1 tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:53:00.349040 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-22f705da-9a81-4499-a691-07ceb91602f1 tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:53:00.349472 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-22f705da-9a81-4499-a691-07ceb91602f1 tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:53:00.410945 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.policy [None req-22f705da-9a81-4499-a691-07ceb91602f1 tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc43895177134e9c9c030a9d87f94aaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7905689c95d44a5c9169249c70f7de57', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128729) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:53:00.418161 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: INFO nova.api.openstack.requestlog [None req-22f705da-9a81-4499-a691-07ceb91602f1 tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] 10.222.0.61 "GET /compute/v2.1/servers/113f6b52-519c-45f4-9bc2-37168d644e15" status: 200 len: 1613 microversion: 2.1 time: 0.081080 May 14 15:53:00.418753 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: [pid: 128729|app: 0|req: 400/816] 10.222.0.61 () {58 vars in 1235 bytes} [Sat May 14 15:53:00 2022] GET /compute/v2.1/servers/113f6b52-519c-45f4-9bc2-37168d644e15 => generated 1613 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 15:53:00.793178 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi [None req-5a9ab092-471c-42b3-a422-18bdb9c526ae tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Calling method '>' {{(pid=128728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 15:53:00.793737 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.compute.api [None req-5a9ab092-471c-42b3-a422-18bdb9c526ae tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] [instance: 7c21adbe-7a79-46cf-aa7c-9b2a6548c767] Fetching instance by UUID {{(pid=128728) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 15:53:00.801318 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-5a9ab092-471c-42b3-a422-18bdb9c526ae tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:53:00.801780 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-5a9ab092-471c-42b3-a422-18bdb9c526ae tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:53:00.802588 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-5a9ab092-471c-42b3-a422-18bdb9c526ae tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:53:00.803045 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-5a9ab092-471c-42b3-a422-18bdb9c526ae tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:53:00.942962 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.policy [None req-5a9ab092-471c-42b3-a422-18bdb9c526ae tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b896317d96a40d6a137db0dcf5f98f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d2517d5440a4d30949f3dd36a46d813', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128728) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:53:00.951378 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: INFO nova.api.openstack.requestlog [None req-5a9ab092-471c-42b3-a422-18bdb9c526ae tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] 10.222.0.61 "GET /compute/v2.1/servers/7c21adbe-7a79-46cf-aa7c-9b2a6548c767" status: 200 len: 1735 microversion: 2.1 time: 0.162188 May 14 15:53:00.951967 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: [pid: 128728|app: 0|req: 417/817] 10.222.0.61 () {58 vars in 1235 bytes} [Sat May 14 15:53:00 2022] GET /compute/v2.1/servers/7c21adbe-7a79-46cf-aa7c-9b2a6548c767 => generated 1735 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 15:53:01.436716 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi [None req-8a695c3d-b1db-477c-8e32-7b8bdd3c72e8 tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] Calling method '>' {{(pid=128729) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 15:53:01.437253 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.compute.api [None req-8a695c3d-b1db-477c-8e32-7b8bdd3c72e8 tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] [instance: 113f6b52-519c-45f4-9bc2-37168d644e15] Fetching instance by UUID {{(pid=128729) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 15:53:01.443439 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-8a695c3d-b1db-477c-8e32-7b8bdd3c72e8 tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:53:01.443883 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-8a695c3d-b1db-477c-8e32-7b8bdd3c72e8 tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:53:01.444639 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-8a695c3d-b1db-477c-8e32-7b8bdd3c72e8 tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:53:01.445067 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-8a695c3d-b1db-477c-8e32-7b8bdd3c72e8 tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:53:01.458499 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: INFO nova.api.openstack.wsgi [None req-8a695c3d-b1db-477c-8e32-7b8bdd3c72e8 tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] HTTP exception thrown: Instance 113f6b52-519c-45f4-9bc2-37168d644e15 could not be found. May 14 15:53:01.460148 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi [None req-8a695c3d-b1db-477c-8e32-7b8bdd3c72e8 tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] Request method failure captured: May 14 15:53:01.460148 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: request: GET /compute/v2.1/servers/113f6b52-519c-45f4-9bc2-37168d644e15 HTTP/1.1 May 14 15:53:01.460148 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: Accept: application/json May 14 15:53:01.460148 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: Accept-Encoding: identity May 14 15:53:01.460148 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: Connection: close May 14 15:53:01.460148 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: Content-Length: 0 May 14 15:53:01.460148 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: Content-Type: application/json May 14 15:53:01.460148 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: Host: 10.222.0.61 May 14 15:53:01.460148 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: Openstack-System-Scope: None May 14 15:53:01.460148 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: User-Agent: python-urllib3/1.26.9 May 14 15:53:01.460148 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: X-Auth-Token: gAAAAABif87SP_Zwa2IiGvFqsMgjavpLb8KTM6Zjei-leP46wpGTfISEWiNabTSLn_Se4MigqIDtVKHrnJDEVndJObAkvdE7QziqGtKnvzcsAHHCuGZvbOCiZ5Yv_050Eg71rjYT92fMkrLj82GJjq7kUvTbRuW_X-0VLgSk3UstO-oNY0ykSUs May 14 15:53:01.460148 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: X-Domain-Id: None May 14 15:53:01.460148 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: X-Domain-Name: None May 14 15:53:01.460148 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: X-Identity-Status: Confirmed May 14 15:53:01.460148 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: X-Is-Admin-Project: True May 14 15:53:01.460148 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: X-Project-Domain-Id: default May 14 15:53:01.460148 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: X-Project-Domain-Name: Default May 14 15:53:01.460148 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: X-Project-Id: 7905689c95d44a5c9169249c70f7de57 May 14 15:53:01.460148 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: X-Project-Name: tempest-AttachVolumeNegativeTest-1525749350 May 14 15:53:01.460148 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: X-Role: reader,member May 14 15:53:01.460148 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: X-Roles: reader,member May 14 15:53:01.461768 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/7905689c95d44a5c9169249c70f7de57"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/7905689c95d44a5c9169249c70f7de57"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/7905689c95d44a5c9169249c70f7de57"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_7905689c95d44a5c9169249c70f7de57"}]}] May 14 15:53:01.461768 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: X-Tenant: tempest-AttachVolumeNegativeTest-1525749350 May 14 15:53:01.461768 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: X-Tenant-Id: 7905689c95d44a5c9169249c70f7de57 May 14 15:53:01.461768 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1525749350 May 14 15:53:01.461768 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: X-User: tempest-AttachVolumeNegativeTest-1525749350-project May 14 15:53:01.461768 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: X-User-Domain-Id: default May 14 15:53:01.461768 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: X-User-Domain-Name: Default May 14 15:53:01.461768 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: X-User-Id: dc43895177134e9c9c030a9d87f94aaa May 14 15:53:01.461768 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: X-User-Name: tempest-AttachVolumeNegativeTest-1525749350-project May 14 15:53:01.461768 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: method: > May 14 15:53:01.461768 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: exception: Instance 113f6b52-519c-45f4-9bc2-37168d644e15 could not be found. May 14 15:53:01.461768 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: action_args: {'id': '113f6b52-519c-45f4-9bc2-37168d644e15'} May 14 15:53:01.462623 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: {{(pid=128729) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 14 15:53:01.462623 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 15:53:01.462623 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 14 15:53:01.462623 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 14 15:53:01.462623 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 14 15:53:01.462623 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 14 15:53:01.462623 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 14 15:53:01.462623 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 14 15:53:01.462623 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 14 15:53:01.462623 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 14 15:53:01.462623 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 113f6b52-519c-45f4-9bc2-37168d644e15 could not be found. May 14 15:53:01.462623 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: ERROR nova.api.openstack.wsgi May 14 15:53:01.462623 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 14 15:53:01.462623 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: ERROR nova.api.openstack.wsgi May 14 15:53:01.462623 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 15:53:01.462623 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 14 15:53:01.462623 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 14 15:53:01.462623 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 14 15:53:01.462623 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 14 15:53:01.462623 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 14 15:53:01.464104 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 14 15:53:01.464104 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 14 15:53:01.464104 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 14 15:53:01.464104 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 14 15:53:01.464104 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 14 15:53:01.464104 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 14 15:53:01.464104 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 14 15:53:01.464104 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 113f6b52-519c-45f4-9bc2-37168d644e15 could not be found. May 14 15:53:01.464104 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: ERROR nova.api.openstack.wsgi May 14 15:53:01.464104 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 14 15:53:01.464104 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: ERROR nova.api.openstack.wsgi May 14 15:53:01.464104 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 15:53:01.464104 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 14 15:53:01.464104 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 14 15:53:01.464104 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 14 15:53:01.464104 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 14 15:53:01.464104 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 113f6b52-519c-45f4-9bc2-37168d644e15 could not be found. May 14 15:53:01.464104 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: ERROR nova.api.openstack.wsgi May 14 15:53:01.465532 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi [None req-8a695c3d-b1db-477c-8e32-7b8bdd3c72e8 tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] Returning 404 to user: Instance 113f6b52-519c-45f4-9bc2-37168d644e15 could not be found. {{(pid=128729) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 14 15:53:01.465532 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: INFO nova.api.openstack.requestlog [None req-8a695c3d-b1db-477c-8e32-7b8bdd3c72e8 tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] 10.222.0.61 "GET /compute/v2.1/servers/113f6b52-519c-45f4-9bc2-37168d644e15" status: 404 len: 111 microversion: 2.1 time: 0.029621 May 14 15:53:01.465532 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: [pid: 128729|app: 0|req: 401/818] 10.222.0.61 () {58 vars in 1235 bytes} [Sat May 14 15:53:01 2022] GET /compute/v2.1/servers/113f6b52-519c-45f4-9bc2-37168d644e15 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 14 15:53:01.470800 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi [None req-04a654a0-543f-428a-9213-be025892d5ed tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] Calling method '.version_select at 0x7f77cb6b9d30>' {{(pid=128728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 15:53:01.488462 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: INFO nova.api.openstack.requestlog [None req-04a654a0-543f-428a-9213-be025892d5ed tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] 10.222.0.61 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1260306284" status: 202 len: 0 microversion: 2.1 time: 0.021439 May 14 15:53:01.489017 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: [pid: 128728|app: 0|req: 418/819] 10.222.0.61 () {58 vars in 1220 bytes} [Sat May 14 15:53:01 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1260306284 => generated 0 bytes in 23 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 14 15:53:01.969017 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi [None req-31e8214a-adbf-4f9e-ae3e-c338ebbcd541 tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Calling method '>' {{(pid=128729) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 15:53:01.969657 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.compute.api [None req-31e8214a-adbf-4f9e-ae3e-c338ebbcd541 tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] [instance: 7c21adbe-7a79-46cf-aa7c-9b2a6548c767] Fetching instance by UUID {{(pid=128729) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 15:53:01.975492 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-31e8214a-adbf-4f9e-ae3e-c338ebbcd541 tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:53:01.975938 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-31e8214a-adbf-4f9e-ae3e-c338ebbcd541 tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:53:01.976740 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-31e8214a-adbf-4f9e-ae3e-c338ebbcd541 tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:53:01.977189 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-31e8214a-adbf-4f9e-ae3e-c338ebbcd541 tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:53:02.180357 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.policy [None req-31e8214a-adbf-4f9e-ae3e-c338ebbcd541 tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b896317d96a40d6a137db0dcf5f98f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d2517d5440a4d30949f3dd36a46d813', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128729) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:53:02.188744 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: INFO nova.api.openstack.requestlog [None req-31e8214a-adbf-4f9e-ae3e-c338ebbcd541 tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] 10.222.0.61 "GET /compute/v2.1/servers/7c21adbe-7a79-46cf-aa7c-9b2a6548c767" status: 200 len: 1735 microversion: 2.1 time: 0.224493 May 14 15:53:02.189306 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: [pid: 128729|app: 0|req: 402/820] 10.222.0.61 () {58 vars in 1235 bytes} [Sat May 14 15:53:01 2022] GET /compute/v2.1/servers/7c21adbe-7a79-46cf-aa7c-9b2a6548c767 => generated 1735 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 15:53:02.423914 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi [None req-6ece570a-127d-4c1c-ba07-5d9c2556e7af tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] Action: 'create', calling method: .version_select at 0x7f77cb69eaf0>, body: {"keypair": {"name": "tempest-keypair-1057710515", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOq4g15goVmk2pYW6WaKXcSke4zv6Xd9RNoZJ69trTdj5po97iwJ5EKMso0LZsW2KYfZvIh3PleEIOYaJRKd4qmhNd0We5ZV9+4VPWv6pwyruDXgOl2Ox4fG3DcpcnGroA=="}} {{(pid=128728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 15:53:02.437970 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.quota [None req-6ece570a-127d-4c1c-ba07-5d9c2556e7af tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] Getting quotas for project 7905689c95d44a5c9169249c70f7de57. Resources: {'key_pairs'} {{(pid=128728) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 14 15:53:02.441743 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.quota [None req-6ece570a-127d-4c1c-ba07-5d9c2556e7af tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] Getting quotas for user dc43895177134e9c9c030a9d87f94aaa and project 7905689c95d44a5c9169249c70f7de57. Resources: {'key_pairs'} {{(pid=128728) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 14 15:53:02.462483 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: INFO nova.api.openstack.requestlog [None req-6ece570a-127d-4c1c-ba07-5d9c2556e7af tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] 10.222.0.61 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.043515 May 14 15:53:02.463069 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: [pid: 128728|app: 0|req: 419/821] 10.222.0.61 () {60 vars in 1158 bytes} [Sat May 14 15:53:02 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 14 15:53:03.206109 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi [None req-1606ed2f-5a74-46bf-b0f3-1f85cc8b65f3 tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Calling method '>' {{(pid=128729) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 15:53:03.206678 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.compute.api [None req-1606ed2f-5a74-46bf-b0f3-1f85cc8b65f3 tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] [instance: 7c21adbe-7a79-46cf-aa7c-9b2a6548c767] Fetching instance by UUID {{(pid=128729) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 15:53:03.212963 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-1606ed2f-5a74-46bf-b0f3-1f85cc8b65f3 tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:53:03.213418 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-1606ed2f-5a74-46bf-b0f3-1f85cc8b65f3 tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:53:03.214223 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-1606ed2f-5a74-46bf-b0f3-1f85cc8b65f3 tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:53:03.214690 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-1606ed2f-5a74-46bf-b0f3-1f85cc8b65f3 tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:53:03.411728 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.policy [None req-1606ed2f-5a74-46bf-b0f3-1f85cc8b65f3 tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b896317d96a40d6a137db0dcf5f98f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d2517d5440a4d30949f3dd36a46d813', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128729) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:53:03.420290 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: INFO nova.api.openstack.requestlog [None req-1606ed2f-5a74-46bf-b0f3-1f85cc8b65f3 tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] 10.222.0.61 "GET /compute/v2.1/servers/7c21adbe-7a79-46cf-aa7c-9b2a6548c767" status: 200 len: 1715 microversion: 2.1 time: 0.218083 May 14 15:53:03.420991 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: [pid: 128729|app: 0|req: 403/822] 10.222.0.61 () {58 vars in 1235 bytes} [Sat May 14 15:53:03 2022] GET /compute/v2.1/servers/7c21adbe-7a79-46cf-aa7c-9b2a6548c767 => generated 1715 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 15:53:03.475863 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi [None req-99fb5a79-b5b2-478b-a292-7a85a6a8a7a9 tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Calling method '>' {{(pid=128728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 15:53:03.476416 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.compute.api [None req-99fb5a79-b5b2-478b-a292-7a85a6a8a7a9 tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] [instance: 7c21adbe-7a79-46cf-aa7c-9b2a6548c767] Fetching instance by UUID {{(pid=128728) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 15:53:03.482858 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-99fb5a79-b5b2-478b-a292-7a85a6a8a7a9 tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:53:03.483311 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-99fb5a79-b5b2-478b-a292-7a85a6a8a7a9 tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:53:03.484084 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-99fb5a79-b5b2-478b-a292-7a85a6a8a7a9 tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:53:03.484708 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-99fb5a79-b5b2-478b-a292-7a85a6a8a7a9 tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:53:03.607771 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: INFO nova.api.openstack.wsgi [None req-99fb5a79-b5b2-478b-a292-7a85a6a8a7a9 tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] HTTP exception thrown: Cannot 'detach_volume' instance 7c21adbe-7a79-46cf-aa7c-9b2a6548c767 while it is in vm_state rescued May 14 15:53:03.609383 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi [None req-99fb5a79-b5b2-478b-a292-7a85a6a8a7a9 tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Request method failure captured: May 14 15:53:03.609383 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: request: DELETE /compute/v2.1/servers/7c21adbe-7a79-46cf-aa7c-9b2a6548c767/os-volume_attachments/f6a166ae-4a68-4005-a3a3-8e2d8e5725ea HTTP/1.1 May 14 15:53:03.609383 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: Accept: application/json May 14 15:53:03.609383 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: Accept-Encoding: identity May 14 15:53:03.609383 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: Connection: close May 14 15:53:03.609383 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: Content-Length: 0 May 14 15:53:03.609383 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: Content-Type: application/json May 14 15:53:03.609383 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: Host: 10.222.0.61 May 14 15:53:03.609383 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: Openstack-System-Scope: None May 14 15:53:03.609383 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: User-Agent: python-urllib3/1.26.9 May 14 15:53:03.609383 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: X-Auth-Token: gAAAAABif87TjanYsrrU9KpYd5057ovf5TRvtsRqqkrdTWz9P6C_YEs6Yd4CDME33lagxGClN3GtsEEl95Qsg7nFg7CgnMsPohorXTcxxG47tx7yWCVnqL6E-EqIsy7vXURQ6VzDtKaYCpcbPZh6yi-RI8tatcgKoVxklM3PcFb97OQYybSwzGM May 14 15:53:03.609383 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: X-Domain-Id: None May 14 15:53:03.609383 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: X-Domain-Name: None May 14 15:53:03.609383 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: X-Identity-Status: Confirmed May 14 15:53:03.609383 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: X-Is-Admin-Project: True May 14 15:53:03.609383 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: X-Project-Domain-Id: default May 14 15:53:03.609383 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: X-Project-Domain-Name: Default May 14 15:53:03.609383 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: X-Project-Id: 5d2517d5440a4d30949f3dd36a46d813 May 14 15:53:03.609383 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1508904783 May 14 15:53:03.609383 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: X-Role: reader,member May 14 15:53:03.609383 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: X-Roles: reader,member May 14 15:53:03.610942 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/5d2517d5440a4d30949f3dd36a46d813"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/5d2517d5440a4d30949f3dd36a46d813"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/5d2517d5440a4d30949f3dd36a46d813"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_5d2517d5440a4d30949f3dd36a46d813"}]}] May 14 15:53:03.610942 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1508904783 May 14 15:53:03.610942 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: X-Tenant-Id: 5d2517d5440a4d30949f3dd36a46d813 May 14 15:53:03.610942 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1508904783 May 14 15:53:03.610942 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: X-User: tempest-ServerRescueNegativeTestJSON-1508904783-project May 14 15:53:03.610942 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: X-User-Domain-Id: default May 14 15:53:03.610942 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: X-User-Domain-Name: Default May 14 15:53:03.610942 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: X-User-Id: 7b896317d96a40d6a137db0dcf5f98f2 May 14 15:53:03.610942 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1508904783-project May 14 15:53:03.610942 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: method: > May 14 15:53:03.610942 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: exception: Cannot 'detach_volume' instance 7c21adbe-7a79-46cf-aa7c-9b2a6548c767 while it is in vm_state rescued May 14 15:53:03.611720 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: action_args: {'server_id': '7c21adbe-7a79-46cf-aa7c-9b2a6548c767', 'id': 'f6a166ae-4a68-4005-a3a3-8e2d8e5725ea'} May 14 15:53:03.611720 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: {{(pid=128728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 14 15:53:03.611720 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 15:53:03.611720 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete May 14 15:53:03.611720 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) May 14 15:53:03.611720 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner May 14 15:53:03.611720 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) May 14 15:53:03.611720 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner May 14 15:53:03.611720 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( May 14 15:53:03.611720 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 7c21adbe-7a79-46cf-aa7c-9b2a6548c767 in vm_state rescued. Cannot detach_volume while the instance is in this state. May 14 15:53:03.611720 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: ERROR nova.api.openstack.wsgi May 14 15:53:03.611720 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 14 15:53:03.611720 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: ERROR nova.api.openstack.wsgi May 14 15:53:03.611720 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 15:53:03.611720 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 14 15:53:03.611720 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 14 15:53:03.611720 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 14 15:53:03.611720 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 14 15:53:03.611720 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 14 15:53:03.611720 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 14 15:53:03.612913 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 573, in delete May 14 15:53:03.612913 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, May 14 15:53:03.612913 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state May 14 15:53:03.612913 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) May 14 15:53:03.612913 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'detach_volume' instance 7c21adbe-7a79-46cf-aa7c-9b2a6548c767 while it is in vm_state rescued May 14 15:53:03.612913 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: ERROR nova.api.openstack.wsgi May 14 15:53:03.612913 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 14 15:53:03.612913 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: ERROR nova.api.openstack.wsgi May 14 15:53:03.612913 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 15:53:03.612913 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 14 15:53:03.612913 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 14 15:53:03.612913 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 14 15:53:03.612913 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 14 15:53:03.612913 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'detach_volume' instance 7c21adbe-7a79-46cf-aa7c-9b2a6548c767 while it is in vm_state rescued May 14 15:53:03.612913 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: ERROR nova.api.openstack.wsgi May 14 15:53:03.612913 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi [None req-99fb5a79-b5b2-478b-a292-7a85a6a8a7a9 tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Returning 409 to user: Cannot 'detach_volume' instance 7c21adbe-7a79-46cf-aa7c-9b2a6548c767 while it is in vm_state rescued {{(pid=128728) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 14 15:53:03.613885 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: INFO nova.api.openstack.requestlog [None req-99fb5a79-b5b2-478b-a292-7a85a6a8a7a9 tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] 10.222.0.61 "DELETE /compute/v2.1/servers/7c21adbe-7a79-46cf-aa7c-9b2a6548c767/os-volume_attachments/f6a166ae-4a68-4005-a3a3-8e2d8e5725ea" status: 409 len: 152 microversion: 2.1 time: 0.139493 May 14 15:53:03.613885 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: [pid: 128728|app: 0|req: 420/823] 10.222.0.61 () {58 vars in 1415 bytes} [Sat May 14 15:53:03 2022] DELETE /compute/v2.1/servers/7c21adbe-7a79-46cf-aa7c-9b2a6548c767/os-volume_attachments/f6a166ae-4a68-4005-a3a3-8e2d8e5725ea => generated 152 bytes in 141 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) May 14 15:53:03.619918 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi [None req-8aea7096-31c7-418c-bac3-9bb0016705b3 tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=128729) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 15:53:03.620450 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.compute.api [None req-8aea7096-31c7-418c-bac3-9bb0016705b3 tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] [instance: 7c21adbe-7a79-46cf-aa7c-9b2a6548c767] Fetching instance by UUID {{(pid=128729) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 15:53:03.626711 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-8aea7096-31c7-418c-bac3-9bb0016705b3 tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:53:03.627182 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-8aea7096-31c7-418c-bac3-9bb0016705b3 tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:53:03.628003 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-8aea7096-31c7-418c-bac3-9bb0016705b3 tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:53:03.628439 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-8aea7096-31c7-418c-bac3-9bb0016705b3 tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:53:03.697033 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: INFO nova.api.openstack.requestlog [None req-8aea7096-31c7-418c-bac3-9bb0016705b3 tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] 10.222.0.61 "POST /compute/v2.1/servers/7c21adbe-7a79-46cf-aa7c-9b2a6548c767/action" status: 202 len: 0 microversion: 2.1 time: 0.080590 May 14 15:53:03.697656 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: [pid: 128729|app: 0|req: 404/824] 10.222.0.61 () {60 vars in 1277 bytes} [Sat May 14 15:53:03 2022] POST /compute/v2.1/servers/7c21adbe-7a79-46cf-aa7c-9b2a6548c767/action => generated 0 bytes in 82 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) May 14 15:53:03.706479 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi [None req-60fd6657-ea49-4226-9d11-8e50ef184291 tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Calling method '>' {{(pid=128728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 15:53:03.707088 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.compute.api [None req-60fd6657-ea49-4226-9d11-8e50ef184291 tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] [instance: 7c21adbe-7a79-46cf-aa7c-9b2a6548c767] Fetching instance by UUID {{(pid=128728) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 15:53:03.714791 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-60fd6657-ea49-4226-9d11-8e50ef184291 tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:53:03.715350 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-60fd6657-ea49-4226-9d11-8e50ef184291 tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:53:03.716492 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-60fd6657-ea49-4226-9d11-8e50ef184291 tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:53:03.716746 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-60fd6657-ea49-4226-9d11-8e50ef184291 tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:53:03.784156 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi [None req-40a120b0-8737-4541-b9ef-52021968aad0 tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-11052438", "imageRef": "1381e3d5-fc27-4fa7-ab03-5d86278a0546", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "722d2578-8e0a-4535-bc1b-444c13327ab8"}], "security_groups": [{"name": "tempest-securitygroup--864490980"}], "key_name": "tempest-keypair-1057710515", "user_data": "}} {{(pid=128729) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 15:53:03.869370 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.policy [None req-60fd6657-ea49-4226-9d11-8e50ef184291 tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b896317d96a40d6a137db0dcf5f98f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d2517d5440a4d30949f3dd36a46d813', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128728) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:53:03.878483 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: INFO nova.api.openstack.requestlog [None req-60fd6657-ea49-4226-9d11-8e50ef184291 tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] 10.222.0.61 "GET /compute/v2.1/servers/7c21adbe-7a79-46cf-aa7c-9b2a6548c767" status: 200 len: 1723 microversion: 2.1 time: 0.175733 May 14 15:53:03.879349 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: [pid: 128728|app: 0|req: 421/825] 10.222.0.61 () {58 vars in 1235 bytes} [Sat May 14 15:53:03 2022] GET /compute/v2.1/servers/7c21adbe-7a79-46cf-aa7c-9b2a6548c767 => generated 1723 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 15:53:03.907524 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.network.neutron [None req-40a120b0-8737-4541-b9ef-52021968aad0 tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] validate_networks() for [('722d2578-8e0a-4535-bc1b-444c13327ab8', None, None, None, None, None)] {{(pid=128729) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 14 15:53:04.268907 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.virt.hardware [None req-40a120b0-8737-4541-b9ef-52021968aad0 tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] Flavor limits 0:0:0 {{(pid=128729) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 14 15:53:04.269531 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.virt.hardware [None req-40a120b0-8737-4541-b9ef-52021968aad0 tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] Image limits 0:0:0 {{(pid=128729) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 14 15:53:04.269786 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.virt.hardware [None req-40a120b0-8737-4541-b9ef-52021968aad0 tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] Flavor pref 0:0:0 {{(pid=128729) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 14 15:53:04.270191 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.virt.hardware [None req-40a120b0-8737-4541-b9ef-52021968aad0 tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] Image pref 0:0:0 {{(pid=128729) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 14 15:53:04.270627 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.virt.hardware [None req-40a120b0-8737-4541-b9ef-52021968aad0 tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128729) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 14 15:53:04.279232 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-40a120b0-8737-4541-b9ef-52021968aad0 tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:53:04.279680 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-40a120b0-8737-4541-b9ef-52021968aad0 tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:53:04.280485 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-40a120b0-8737-4541-b9ef-52021968aad0 tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:53:04.280920 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-40a120b0-8737-4541-b9ef-52021968aad0 tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:53:04.298563 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.quota [None req-40a120b0-8737-4541-b9ef-52021968aad0 tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] Getting quotas for project 7905689c95d44a5c9169249c70f7de57. Resources: {'instances', 'cores', 'ram'} {{(pid=128729) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 14 15:53:04.304155 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.quota [None req-40a120b0-8737-4541-b9ef-52021968aad0 tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] Getting quotas for user dc43895177134e9c9c030a9d87f94aaa and project 7905689c95d44a5c9169249c70f7de57. Resources: {'instances', 'cores', 'ram'} {{(pid=128729) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 14 15:53:04.316107 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.compute.api [None req-40a120b0-8737-4541-b9ef-52021968aad0 tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] Going to run 1 instances... {{(pid=128729) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 14 15:53:04.318515 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.compute.api [None req-40a120b0-8737-4541-b9ef-52021968aad0 tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] [instance: e10cdd60-3aac-4bee-a533-cc02b8d242e2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='1381e3d5-fc27-4fa7-ab03-5d86278a0546',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128729) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 14 15:53:04.365161 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: INFO nova.api.openstack.requestlog [None req-40a120b0-8737-4541-b9ef-52021968aad0 tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] 10.222.0.61 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.585590 May 14 15:53:04.365820 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: [pid: 128729|app: 0|req: 405/826] 10.222.0.61 () {60 vars in 1146 bytes} [Sat May 14 15:53:03 2022] POST /compute/v2.1/servers => generated 401 bytes in 587 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) May 14 15:53:04.376674 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi [None req-935d3727-4c12-4d26-ba04-c46e4cc2ded7 tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] Calling method '>' {{(pid=128728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 15:53:04.377293 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.compute.api [None req-935d3727-4c12-4d26-ba04-c46e4cc2ded7 tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] [instance: e10cdd60-3aac-4bee-a533-cc02b8d242e2] Fetching instance by UUID {{(pid=128728) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 15:53:04.433745 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.policy [None req-935d3727-4c12-4d26-ba04-c46e4cc2ded7 tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc43895177134e9c9c030a9d87f94aaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7905689c95d44a5c9169249c70f7de57', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128728) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:53:04.441071 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: INFO nova.api.openstack.requestlog [None req-935d3727-4c12-4d26-ba04-c46e4cc2ded7 tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] 10.222.0.61 "GET /compute/v2.1/servers/e10cdd60-3aac-4bee-a533-cc02b8d242e2" status: 200 len: 1240 microversion: 2.1 time: 0.069287 May 14 15:53:04.441638 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: [pid: 128728|app: 0|req: 422/827] 10.222.0.61 () {58 vars in 1235 bytes} [Sat May 14 15:53:04 2022] GET /compute/v2.1/servers/e10cdd60-3aac-4bee-a533-cc02b8d242e2 => generated 1240 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 15:53:04.900953 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi [None req-8dd0db62-d058-4da0-a67b-c32600b2567d tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Calling method '>' {{(pid=128729) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 15:53:04.901568 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.compute.api [None req-8dd0db62-d058-4da0-a67b-c32600b2567d tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] [instance: 7c21adbe-7a79-46cf-aa7c-9b2a6548c767] Fetching instance by UUID {{(pid=128729) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 15:53:04.909527 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-8dd0db62-d058-4da0-a67b-c32600b2567d tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:53:04.909980 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-8dd0db62-d058-4da0-a67b-c32600b2567d tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:53:04.910802 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-8dd0db62-d058-4da0-a67b-c32600b2567d tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:53:04.911246 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-8dd0db62-d058-4da0-a67b-c32600b2567d tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:53:05.038045 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.policy [None req-8dd0db62-d058-4da0-a67b-c32600b2567d tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b896317d96a40d6a137db0dcf5f98f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d2517d5440a4d30949f3dd36a46d813', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128729) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:53:05.046005 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: INFO nova.api.openstack.requestlog [None req-8dd0db62-d058-4da0-a67b-c32600b2567d tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] 10.222.0.61 "GET /compute/v2.1/servers/7c21adbe-7a79-46cf-aa7c-9b2a6548c767" status: 200 len: 1723 microversion: 2.1 time: 0.148907 May 14 15:53:05.046588 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: [pid: 128729|app: 0|req: 406/828] 10.222.0.61 () {58 vars in 1235 bytes} [Sat May 14 15:53:04 2022] GET /compute/v2.1/servers/7c21adbe-7a79-46cf-aa7c-9b2a6548c767 => generated 1723 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 15:53:05.457417 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi [None req-41e2206f-ecd0-4828-b7d8-a0c276828b95 tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] Calling method '>' {{(pid=128728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 15:53:05.458070 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.compute.api [None req-41e2206f-ecd0-4828-b7d8-a0c276828b95 tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] [instance: e10cdd60-3aac-4bee-a533-cc02b8d242e2] Fetching instance by UUID {{(pid=128728) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 15:53:05.465063 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-41e2206f-ecd0-4828-b7d8-a0c276828b95 tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:53:05.465590 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-41e2206f-ecd0-4828-b7d8-a0c276828b95 tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:53:05.466429 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-41e2206f-ecd0-4828-b7d8-a0c276828b95 tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:53:05.466870 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-41e2206f-ecd0-4828-b7d8-a0c276828b95 tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:53:05.526130 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.policy [None req-41e2206f-ecd0-4828-b7d8-a0c276828b95 tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc43895177134e9c9c030a9d87f94aaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7905689c95d44a5c9169249c70f7de57', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128728) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:53:05.533400 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: INFO nova.api.openstack.requestlog [None req-41e2206f-ecd0-4828-b7d8-a0c276828b95 tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] 10.222.0.61 "GET /compute/v2.1/servers/e10cdd60-3aac-4bee-a533-cc02b8d242e2" status: 200 len: 1244 microversion: 2.1 time: 0.079821 May 14 15:53:05.533964 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: [pid: 128728|app: 0|req: 423/829] 10.222.0.61 () {58 vars in 1235 bytes} [Sat May 14 15:53:05 2022] GET /compute/v2.1/servers/e10cdd60-3aac-4bee-a533-cc02b8d242e2 => generated 1244 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 15:53:06.063297 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi [None req-1eb08839-18e8-43ff-9ad0-3f15bcb690f6 tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Calling method '>' {{(pid=128729) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 15:53:06.063904 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.compute.api [None req-1eb08839-18e8-43ff-9ad0-3f15bcb690f6 tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] [instance: 7c21adbe-7a79-46cf-aa7c-9b2a6548c767] Fetching instance by UUID {{(pid=128729) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 15:53:06.070252 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-1eb08839-18e8-43ff-9ad0-3f15bcb690f6 tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:53:06.070744 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-1eb08839-18e8-43ff-9ad0-3f15bcb690f6 tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:53:06.071507 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-1eb08839-18e8-43ff-9ad0-3f15bcb690f6 tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:53:06.071942 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-1eb08839-18e8-43ff-9ad0-3f15bcb690f6 tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:53:06.200759 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.policy [None req-1eb08839-18e8-43ff-9ad0-3f15bcb690f6 tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b896317d96a40d6a137db0dcf5f98f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d2517d5440a4d30949f3dd36a46d813', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128729) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:53:06.208632 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: INFO nova.api.openstack.requestlog [None req-1eb08839-18e8-43ff-9ad0-3f15bcb690f6 tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] 10.222.0.61 "GET /compute/v2.1/servers/7c21adbe-7a79-46cf-aa7c-9b2a6548c767" status: 200 len: 1723 microversion: 2.1 time: 0.149360 May 14 15:53:06.209185 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: [pid: 128729|app: 0|req: 407/830] 10.222.0.61 () {58 vars in 1235 bytes} [Sat May 14 15:53:06 2022] GET /compute/v2.1/servers/7c21adbe-7a79-46cf-aa7c-9b2a6548c767 => generated 1723 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 15:53:06.550498 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi [None req-e3fd3e4f-777e-4d33-926f-321dc87d7325 tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] Calling method '>' {{(pid=128728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 15:53:06.551049 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.compute.api [None req-e3fd3e4f-777e-4d33-926f-321dc87d7325 tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] [instance: e10cdd60-3aac-4bee-a533-cc02b8d242e2] Fetching instance by UUID {{(pid=128728) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 15:53:06.557271 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-e3fd3e4f-777e-4d33-926f-321dc87d7325 tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:53:06.557721 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-e3fd3e4f-777e-4d33-926f-321dc87d7325 tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:53:06.558511 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-e3fd3e4f-777e-4d33-926f-321dc87d7325 tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:53:06.558951 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-e3fd3e4f-777e-4d33-926f-321dc87d7325 tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:53:06.619517 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.policy [None req-e3fd3e4f-777e-4d33-926f-321dc87d7325 tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc43895177134e9c9c030a9d87f94aaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7905689c95d44a5c9169249c70f7de57', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128728) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:53:06.627198 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: INFO nova.api.openstack.requestlog [None req-e3fd3e4f-777e-4d33-926f-321dc87d7325 tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] 10.222.0.61 "GET /compute/v2.1/servers/e10cdd60-3aac-4bee-a533-cc02b8d242e2" status: 200 len: 1244 microversion: 2.1 time: 0.080642 May 14 15:53:06.627764 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: [pid: 128728|app: 0|req: 424/831] 10.222.0.61 () {58 vars in 1235 bytes} [Sat May 14 15:53:06 2022] GET /compute/v2.1/servers/e10cdd60-3aac-4bee-a533-cc02b8d242e2 => generated 1244 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 15:53:07.225999 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi [None req-cd696ea4-9917-4b42-829a-3fd21129dd44 tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Calling method '>' {{(pid=128729) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 15:53:07.226631 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.compute.api [None req-cd696ea4-9917-4b42-829a-3fd21129dd44 tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] [instance: 7c21adbe-7a79-46cf-aa7c-9b2a6548c767] Fetching instance by UUID {{(pid=128729) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 15:53:07.233039 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-cd696ea4-9917-4b42-829a-3fd21129dd44 tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:53:07.233483 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-cd696ea4-9917-4b42-829a-3fd21129dd44 tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:53:07.234242 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-cd696ea4-9917-4b42-829a-3fd21129dd44 tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:53:07.234703 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-cd696ea4-9917-4b42-829a-3fd21129dd44 tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:53:07.369324 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.policy [None req-cd696ea4-9917-4b42-829a-3fd21129dd44 tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b896317d96a40d6a137db0dcf5f98f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d2517d5440a4d30949f3dd36a46d813', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128729) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:53:07.377289 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: INFO nova.api.openstack.requestlog [None req-cd696ea4-9917-4b42-829a-3fd21129dd44 tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] 10.222.0.61 "GET /compute/v2.1/servers/7c21adbe-7a79-46cf-aa7c-9b2a6548c767" status: 200 len: 1729 microversion: 2.1 time: 0.155067 May 14 15:53:07.377855 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: [pid: 128729|app: 0|req: 408/832] 10.222.0.61 () {58 vars in 1235 bytes} [Sat May 14 15:53:07 2022] GET /compute/v2.1/servers/7c21adbe-7a79-46cf-aa7c-9b2a6548c767 => generated 1729 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 15:53:07.393885 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi [None req-3c578391-798d-468e-8470-bd2e9fff582d tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Calling method '>' {{(pid=128728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 15:53:07.394409 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.compute.api [None req-3c578391-798d-468e-8470-bd2e9fff582d tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] [instance: 7c21adbe-7a79-46cf-aa7c-9b2a6548c767] Fetching instance by UUID {{(pid=128728) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 15:53:07.400166 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-3c578391-798d-468e-8470-bd2e9fff582d tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:53:07.400617 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-3c578391-798d-468e-8470-bd2e9fff582d tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:53:07.401387 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-3c578391-798d-468e-8470-bd2e9fff582d tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:53:07.401826 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-3c578391-798d-468e-8470-bd2e9fff582d tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:53:07.480548 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: INFO nova.api.openstack.requestlog [None req-3c578391-798d-468e-8470-bd2e9fff582d tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] 10.222.0.61 "GET /compute/v2.1/servers/7c21adbe-7a79-46cf-aa7c-9b2a6548c767/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.090404 May 14 15:53:07.481180 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: [pid: 128728|app: 0|req: 425/833] 10.222.0.61 () {58 vars in 1274 bytes} [Sat May 14 15:53:07 2022] GET /compute/v2.1/servers/7c21adbe-7a79-46cf-aa7c-9b2a6548c767/os-interface => generated 284 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 14 15:53:07.644246 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi [None req-60cb8b9b-c218-4ca6-b3bf-2e13e4f0701a tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] Calling method '>' {{(pid=128729) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 15:53:07.644862 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.compute.api [None req-60cb8b9b-c218-4ca6-b3bf-2e13e4f0701a tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] [instance: e10cdd60-3aac-4bee-a533-cc02b8d242e2] Fetching instance by UUID {{(pid=128729) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 15:53:07.650765 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-60cb8b9b-c218-4ca6-b3bf-2e13e4f0701a tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:53:07.651228 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-60cb8b9b-c218-4ca6-b3bf-2e13e4f0701a tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:53:07.652005 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-60cb8b9b-c218-4ca6-b3bf-2e13e4f0701a tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:53:07.652449 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-60cb8b9b-c218-4ca6-b3bf-2e13e4f0701a tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:53:07.745348 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.policy [None req-60cb8b9b-c218-4ca6-b3bf-2e13e4f0701a tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc43895177134e9c9c030a9d87f94aaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7905689c95d44a5c9169249c70f7de57', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128729) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:53:07.753488 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: INFO nova.api.openstack.requestlog [None req-60cb8b9b-c218-4ca6-b3bf-2e13e4f0701a tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] 10.222.0.61 "GET /compute/v2.1/servers/e10cdd60-3aac-4bee-a533-cc02b8d242e2" status: 200 len: 1292 microversion: 2.1 time: 0.113049 May 14 15:53:07.754231 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: [pid: 128729|app: 0|req: 409/834] 10.222.0.61 () {58 vars in 1235 bytes} [Sat May 14 15:53:07 2022] GET /compute/v2.1/servers/e10cdd60-3aac-4bee-a533-cc02b8d242e2 => generated 1292 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 15:53:08.451881 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi [req-f3c3a2bc-9c63-4795-b70c-1f2a50e23351 req-704d0a7e-09d9-4455-8d5f-a8056ea3be71 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7c21adbe-7a79-46cf-aa7c-9b2a6548c767", "tag": "5c35b70b-002b-48c3-9446-1ba3b1605c2b"}]} {{(pid=128728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 15:53:08.462604 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [req-f3c3a2bc-9c63-4795-b70c-1f2a50e23351 req-704d0a7e-09d9-4455-8d5f-a8056ea3be71 service nova] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:53:08.463216 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [req-f3c3a2bc-9c63-4795-b70c-1f2a50e23351 req-704d0a7e-09d9-4455-8d5f-a8056ea3be71 service nova] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:53:08.477742 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: INFO nova.api.openstack.compute.server_external_events [req-f3c3a2bc-9c63-4795-b70c-1f2a50e23351 req-704d0a7e-09d9-4455-8d5f-a8056ea3be71 service nova] Creating event network-changed:5c35b70b-002b-48c3-9446-1ba3b1605c2b for instance 7c21adbe-7a79-46cf-aa7c-9b2a6548c767 on hv-cinder-83979 May 14 15:53:08.483640 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: INFO nova.api.openstack.requestlog [req-f3c3a2bc-9c63-4795-b70c-1f2a50e23351 req-704d0a7e-09d9-4455-8d5f-a8056ea3be71 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036337 May 14 15:53:08.484333 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: [pid: 128728|app: 0|req: 426/835] 10.222.0.61 () {64 vars in 1317 bytes} [Sat May 14 15:53:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 14 15:53:08.771332 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi [None req-2980911a-60b4-41cc-9ac4-4458fab9fca7 tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] Calling method '>' {{(pid=128729) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 15:53:08.772682 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.compute.api [None req-2980911a-60b4-41cc-9ac4-4458fab9fca7 tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] [instance: e10cdd60-3aac-4bee-a533-cc02b8d242e2] Fetching instance by UUID {{(pid=128729) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 15:53:08.795600 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-2980911a-60b4-41cc-9ac4-4458fab9fca7 tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:53:08.803003 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-2980911a-60b4-41cc-9ac4-4458fab9fca7 tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:53:08.804100 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-2980911a-60b4-41cc-9ac4-4458fab9fca7 tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:53:08.804608 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-2980911a-60b4-41cc-9ac4-4458fab9fca7 tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:53:09.033568 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.policy [None req-2980911a-60b4-41cc-9ac4-4458fab9fca7 tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc43895177134e9c9c030a9d87f94aaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7905689c95d44a5c9169249c70f7de57', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128729) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:53:09.043324 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: INFO nova.api.openstack.requestlog [None req-2980911a-60b4-41cc-9ac4-4458fab9fca7 tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] 10.222.0.61 "GET /compute/v2.1/servers/e10cdd60-3aac-4bee-a533-cc02b8d242e2" status: 200 len: 1365 microversion: 2.1 time: 0.275917 May 14 15:53:09.055046 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: [pid: 128729|app: 0|req: 410/836] 10.222.0.61 () {58 vars in 1235 bytes} [Sat May 14 15:53:08 2022] GET /compute/v2.1/servers/e10cdd60-3aac-4bee-a533-cc02b8d242e2 => generated 1365 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 15:53:09.401352 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi [req-e3ec1673-f4a7-45fc-9df9-75bd4044471d req-864eede5-de97-41cc-a9be-b23e5ebf54e2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e10cdd60-3aac-4bee-a533-cc02b8d242e2", "tag": "31f05ca6-8416-443c-a8bb-aa1aed44741e"}]} {{(pid=128728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 15:53:09.412835 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [req-e3ec1673-f4a7-45fc-9df9-75bd4044471d req-864eede5-de97-41cc-a9be-b23e5ebf54e2 service nova] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:53:09.413553 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [req-e3ec1673-f4a7-45fc-9df9-75bd4044471d req-864eede5-de97-41cc-a9be-b23e5ebf54e2 service nova] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:53:09.433483 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: INFO nova.api.openstack.compute.server_external_events [req-e3ec1673-f4a7-45fc-9df9-75bd4044471d req-864eede5-de97-41cc-a9be-b23e5ebf54e2 service nova] Creating event network-changed:31f05ca6-8416-443c-a8bb-aa1aed44741e for instance e10cdd60-3aac-4bee-a533-cc02b8d242e2 on hv-cinder-83979 May 14 15:53:09.440014 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: INFO nova.api.openstack.requestlog [req-e3ec1673-f4a7-45fc-9df9-75bd4044471d req-864eede5-de97-41cc-a9be-b23e5ebf54e2 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042639 May 14 15:53:09.440623 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: [pid: 128728|app: 0|req: 427/837] 10.222.0.61 () {64 vars in 1317 bytes} [Sat May 14 15:53:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 14 15:53:10.062067 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi [None req-d4137b8a-1785-4a17-9bcb-347f38e7f163 tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] Calling method '>' {{(pid=128729) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 15:53:10.062757 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.compute.api [None req-d4137b8a-1785-4a17-9bcb-347f38e7f163 tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] [instance: e10cdd60-3aac-4bee-a533-cc02b8d242e2] Fetching instance by UUID {{(pid=128729) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 15:53:10.068972 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-d4137b8a-1785-4a17-9bcb-347f38e7f163 tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:53:10.069417 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-d4137b8a-1785-4a17-9bcb-347f38e7f163 tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:53:10.070281 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-d4137b8a-1785-4a17-9bcb-347f38e7f163 tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:53:10.070740 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-d4137b8a-1785-4a17-9bcb-347f38e7f163 tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:53:10.195257 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.policy [None req-d4137b8a-1785-4a17-9bcb-347f38e7f163 tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc43895177134e9c9c030a9d87f94aaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7905689c95d44a5c9169249c70f7de57', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128729) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:53:10.202942 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: INFO nova.api.openstack.requestlog [None req-d4137b8a-1785-4a17-9bcb-347f38e7f163 tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] 10.222.0.61 "GET /compute/v2.1/servers/e10cdd60-3aac-4bee-a533-cc02b8d242e2" status: 200 len: 1365 microversion: 2.1 time: 0.144685 May 14 15:53:10.203503 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: [pid: 128729|app: 0|req: 411/838] 10.222.0.61 () {58 vars in 1235 bytes} [Sat May 14 15:53:10 2022] GET /compute/v2.1/servers/e10cdd60-3aac-4bee-a533-cc02b8d242e2 => generated 1365 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 15:53:10.499697 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi [req-69f1c56e-0428-472c-ba4d-89c54d1a331f req-5de2eb08-1a93-4c94-b475-312c284e08e1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7c21adbe-7a79-46cf-aa7c-9b2a6548c767", "tag": "5c35b70b-002b-48c3-9446-1ba3b1605c2b"}]} {{(pid=128728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 15:53:10.507714 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [req-69f1c56e-0428-472c-ba4d-89c54d1a331f req-5de2eb08-1a93-4c94-b475-312c284e08e1 service nova] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:53:10.508160 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [req-69f1c56e-0428-472c-ba4d-89c54d1a331f req-5de2eb08-1a93-4c94-b475-312c284e08e1 service nova] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:53:10.519130 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: INFO nova.api.openstack.compute.server_external_events [req-69f1c56e-0428-472c-ba4d-89c54d1a331f req-5de2eb08-1a93-4c94-b475-312c284e08e1 service nova] Creating event network-changed:5c35b70b-002b-48c3-9446-1ba3b1605c2b for instance 7c21adbe-7a79-46cf-aa7c-9b2a6548c767 on hv-cinder-83979 May 14 15:53:10.523860 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: INFO nova.api.openstack.requestlog [req-69f1c56e-0428-472c-ba4d-89c54d1a331f req-5de2eb08-1a93-4c94-b475-312c284e08e1 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029304 May 14 15:53:10.524422 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: [pid: 128728|app: 0|req: 428/839] 10.222.0.61 () {64 vars in 1317 bytes} [Sat May 14 15:53:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 14 15:53:11.219635 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi [None req-452ef018-f325-4e6b-a62b-e7e0d8d4e5dd tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] Calling method '>' {{(pid=128729) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 15:53:11.220164 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.compute.api [None req-452ef018-f325-4e6b-a62b-e7e0d8d4e5dd tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] [instance: e10cdd60-3aac-4bee-a533-cc02b8d242e2] Fetching instance by UUID {{(pid=128729) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 15:53:11.226379 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-452ef018-f325-4e6b-a62b-e7e0d8d4e5dd tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:53:11.226829 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-452ef018-f325-4e6b-a62b-e7e0d8d4e5dd tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:53:11.227590 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-452ef018-f325-4e6b-a62b-e7e0d8d4e5dd tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:53:11.228022 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-452ef018-f325-4e6b-a62b-e7e0d8d4e5dd tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:53:11.359173 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.policy [None req-452ef018-f325-4e6b-a62b-e7e0d8d4e5dd tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc43895177134e9c9c030a9d87f94aaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7905689c95d44a5c9169249c70f7de57', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128729) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:53:11.367196 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: INFO nova.api.openstack.requestlog [None req-452ef018-f325-4e6b-a62b-e7e0d8d4e5dd tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] 10.222.0.61 "GET /compute/v2.1/servers/e10cdd60-3aac-4bee-a533-cc02b8d242e2" status: 200 len: 1365 microversion: 2.1 time: 0.152035 May 14 15:53:11.367753 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: [pid: 128729|app: 0|req: 412/840] 10.222.0.61 () {58 vars in 1235 bytes} [Sat May 14 15:53:11 2022] GET /compute/v2.1/servers/e10cdd60-3aac-4bee-a533-cc02b8d242e2 => generated 1365 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 15:53:12.384832 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi [None req-8f778140-4740-441f-8515-5beb3c8e03fe tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] Calling method '>' {{(pid=128728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 15:53:12.385566 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.compute.api [None req-8f778140-4740-441f-8515-5beb3c8e03fe tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] [instance: e10cdd60-3aac-4bee-a533-cc02b8d242e2] Fetching instance by UUID {{(pid=128728) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 15:53:12.391850 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-8f778140-4740-441f-8515-5beb3c8e03fe tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:53:12.392301 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-8f778140-4740-441f-8515-5beb3c8e03fe tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:53:12.393077 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-8f778140-4740-441f-8515-5beb3c8e03fe tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:53:12.393517 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-8f778140-4740-441f-8515-5beb3c8e03fe tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:53:12.522218 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.policy [None req-8f778140-4740-441f-8515-5beb3c8e03fe tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc43895177134e9c9c030a9d87f94aaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7905689c95d44a5c9169249c70f7de57', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128728) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:53:12.529593 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: INFO nova.api.openstack.requestlog [None req-8f778140-4740-441f-8515-5beb3c8e03fe tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] 10.222.0.61 "GET /compute/v2.1/servers/e10cdd60-3aac-4bee-a533-cc02b8d242e2" status: 200 len: 1365 microversion: 2.1 time: 0.149476 May 14 15:53:12.530152 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: [pid: 128728|app: 0|req: 429/841] 10.222.0.61 () {58 vars in 1235 bytes} [Sat May 14 15:53:12 2022] GET /compute/v2.1/servers/e10cdd60-3aac-4bee-a533-cc02b8d242e2 => generated 1365 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 15:53:13.546584 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi [None req-66bcb92a-cfc0-4750-aa87-815b201cd94f tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] Calling method '>' {{(pid=128729) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 15:53:13.548008 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.compute.api [None req-66bcb92a-cfc0-4750-aa87-815b201cd94f tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] [instance: e10cdd60-3aac-4bee-a533-cc02b8d242e2] Fetching instance by UUID {{(pid=128729) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 15:53:13.554396 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-66bcb92a-cfc0-4750-aa87-815b201cd94f tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:53:13.554849 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-66bcb92a-cfc0-4750-aa87-815b201cd94f tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:53:13.555618 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-66bcb92a-cfc0-4750-aa87-815b201cd94f tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:53:13.556057 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-66bcb92a-cfc0-4750-aa87-815b201cd94f tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:53:13.685143 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.policy [None req-66bcb92a-cfc0-4750-aa87-815b201cd94f tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc43895177134e9c9c030a9d87f94aaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7905689c95d44a5c9169249c70f7de57', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128729) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:53:13.692387 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: INFO nova.api.openstack.requestlog [None req-66bcb92a-cfc0-4750-aa87-815b201cd94f tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] 10.222.0.61 "GET /compute/v2.1/servers/e10cdd60-3aac-4bee-a533-cc02b8d242e2" status: 200 len: 1365 microversion: 2.1 time: 0.150075 May 14 15:53:13.692945 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: [pid: 128729|app: 0|req: 413/842] 10.222.0.61 () {58 vars in 1235 bytes} [Sat May 14 15:53:13 2022] GET /compute/v2.1/servers/e10cdd60-3aac-4bee-a533-cc02b8d242e2 => generated 1365 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 15:53:14.710173 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi [None req-a8cec36e-f168-42b6-a008-c39ff7777584 tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] Calling method '>' {{(pid=128728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 15:53:14.710918 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.compute.api [None req-a8cec36e-f168-42b6-a008-c39ff7777584 tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] [instance: e10cdd60-3aac-4bee-a533-cc02b8d242e2] Fetching instance by UUID {{(pid=128728) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 15:53:14.717842 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-a8cec36e-f168-42b6-a008-c39ff7777584 tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:53:14.718293 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-a8cec36e-f168-42b6-a008-c39ff7777584 tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:53:14.719152 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-a8cec36e-f168-42b6-a008-c39ff7777584 tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:53:14.719586 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-a8cec36e-f168-42b6-a008-c39ff7777584 tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:53:14.848668 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.policy [None req-a8cec36e-f168-42b6-a008-c39ff7777584 tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc43895177134e9c9c030a9d87f94aaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7905689c95d44a5c9169249c70f7de57', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128728) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:53:14.855865 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: INFO nova.api.openstack.requestlog [None req-a8cec36e-f168-42b6-a008-c39ff7777584 tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] 10.222.0.61 "GET /compute/v2.1/servers/e10cdd60-3aac-4bee-a533-cc02b8d242e2" status: 200 len: 1365 microversion: 2.1 time: 0.149520 May 14 15:53:14.856506 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: [pid: 128728|app: 0|req: 430/843] 10.222.0.61 () {58 vars in 1235 bytes} [Sat May 14 15:53:14 2022] GET /compute/v2.1/servers/e10cdd60-3aac-4bee-a533-cc02b8d242e2 => generated 1365 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 15:53:15.226415 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi [req-26c4525a-ef0c-443c-ae3f-b8e28e2156bf req-e76cb5e9-2e0b-4dfb-882f-3b0d60ea6f1b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e10cdd60-3aac-4bee-a533-cc02b8d242e2", "name": "network-vif-plugged", "status": "completed", "tag": "31f05ca6-8416-443c-a8bb-aa1aed44741e"}]} {{(pid=128729) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 15:53:15.235743 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [req-26c4525a-ef0c-443c-ae3f-b8e28e2156bf req-e76cb5e9-2e0b-4dfb-882f-3b0d60ea6f1b service nova] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:53:15.236211 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [req-26c4525a-ef0c-443c-ae3f-b8e28e2156bf req-e76cb5e9-2e0b-4dfb-882f-3b0d60ea6f1b service nova] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:53:15.248071 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: INFO nova.api.openstack.compute.server_external_events [req-26c4525a-ef0c-443c-ae3f-b8e28e2156bf req-e76cb5e9-2e0b-4dfb-882f-3b0d60ea6f1b service nova] Creating event network-vif-plugged:31f05ca6-8416-443c-a8bb-aa1aed44741e for instance e10cdd60-3aac-4bee-a533-cc02b8d242e2 on hv-cinder-83979 May 14 15:53:15.252948 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: INFO nova.api.openstack.requestlog [req-26c4525a-ef0c-443c-ae3f-b8e28e2156bf req-e76cb5e9-2e0b-4dfb-882f-3b0d60ea6f1b service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030223 May 14 15:53:15.253539 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: [pid: 128729|app: 0|req: 414/844] 10.222.0.61 () {64 vars in 1317 bytes} [Sat May 14 15:53:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 14 15:53:15.873268 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi [None req-a2c0e2ff-805e-41f3-94dd-5284f3867c78 tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] Calling method '>' {{(pid=128728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 15:53:15.873864 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.compute.api [None req-a2c0e2ff-805e-41f3-94dd-5284f3867c78 tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] [instance: e10cdd60-3aac-4bee-a533-cc02b8d242e2] Fetching instance by UUID {{(pid=128728) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 15:53:15.880236 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-a2c0e2ff-805e-41f3-94dd-5284f3867c78 tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:53:15.880686 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-a2c0e2ff-805e-41f3-94dd-5284f3867c78 tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:53:15.881453 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-a2c0e2ff-805e-41f3-94dd-5284f3867c78 tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:53:15.881888 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-a2c0e2ff-805e-41f3-94dd-5284f3867c78 tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:53:16.009639 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.policy [None req-a2c0e2ff-805e-41f3-94dd-5284f3867c78 tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc43895177134e9c9c030a9d87f94aaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7905689c95d44a5c9169249c70f7de57', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128728) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:53:16.017854 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: INFO nova.api.openstack.requestlog [None req-a2c0e2ff-805e-41f3-94dd-5284f3867c78 tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] 10.222.0.61 "GET /compute/v2.1/servers/e10cdd60-3aac-4bee-a533-cc02b8d242e2" status: 200 len: 1365 microversion: 2.1 time: 0.148849 May 14 15:53:16.018596 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: [pid: 128728|app: 0|req: 431/845] 10.222.0.61 () {58 vars in 1235 bytes} [Sat May 14 15:53:15 2022] GET /compute/v2.1/servers/e10cdd60-3aac-4bee-a533-cc02b8d242e2 => generated 1365 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 15:53:17.035966 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi [None req-5b7fd5a2-fa67-4929-8410-f2972f8b39e1 tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] Calling method '>' {{(pid=128729) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 15:53:17.036655 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.compute.api [None req-5b7fd5a2-fa67-4929-8410-f2972f8b39e1 tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] [instance: e10cdd60-3aac-4bee-a533-cc02b8d242e2] Fetching instance by UUID {{(pid=128729) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 15:53:17.042790 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-5b7fd5a2-fa67-4929-8410-f2972f8b39e1 tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:53:17.043235 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-5b7fd5a2-fa67-4929-8410-f2972f8b39e1 tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:53:17.044359 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-5b7fd5a2-fa67-4929-8410-f2972f8b39e1 tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:53:17.044796 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-5b7fd5a2-fa67-4929-8410-f2972f8b39e1 tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:53:17.168878 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.policy [None req-5b7fd5a2-fa67-4929-8410-f2972f8b39e1 tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc43895177134e9c9c030a9d87f94aaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7905689c95d44a5c9169249c70f7de57', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128729) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:53:17.176073 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: INFO nova.api.openstack.requestlog [None req-5b7fd5a2-fa67-4929-8410-f2972f8b39e1 tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] 10.222.0.61 "GET /compute/v2.1/servers/e10cdd60-3aac-4bee-a533-cc02b8d242e2" status: 200 len: 1365 microversion: 2.1 time: 0.144690 May 14 15:53:17.176635 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: [pid: 128729|app: 0|req: 415/846] 10.222.0.61 () {58 vars in 1235 bytes} [Sat May 14 15:53:17 2022] GET /compute/v2.1/servers/e10cdd60-3aac-4bee-a533-cc02b8d242e2 => generated 1365 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 15:53:18.193501 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi [None req-5aee3bb8-43cc-440c-9693-dac07dbfa1b9 tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] Calling method '>' {{(pid=128728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 15:53:18.194033 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.compute.api [None req-5aee3bb8-43cc-440c-9693-dac07dbfa1b9 tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] [instance: e10cdd60-3aac-4bee-a533-cc02b8d242e2] Fetching instance by UUID {{(pid=128728) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 15:53:18.201126 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-5aee3bb8-43cc-440c-9693-dac07dbfa1b9 tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:53:18.201573 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-5aee3bb8-43cc-440c-9693-dac07dbfa1b9 tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:53:18.202352 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-5aee3bb8-43cc-440c-9693-dac07dbfa1b9 tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:53:18.202795 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-5aee3bb8-43cc-440c-9693-dac07dbfa1b9 tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:53:18.329130 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.policy [None req-5aee3bb8-43cc-440c-9693-dac07dbfa1b9 tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc43895177134e9c9c030a9d87f94aaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7905689c95d44a5c9169249c70f7de57', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128728) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:53:18.336284 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: INFO nova.api.openstack.requestlog [None req-5aee3bb8-43cc-440c-9693-dac07dbfa1b9 tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] 10.222.0.61 "GET /compute/v2.1/servers/e10cdd60-3aac-4bee-a533-cc02b8d242e2" status: 200 len: 1555 microversion: 2.1 time: 0.146731 May 14 15:53:18.336838 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: [pid: 128728|app: 0|req: 432/847] 10.222.0.61 () {58 vars in 1235 bytes} [Sat May 14 15:53:18 2022] GET /compute/v2.1/servers/e10cdd60-3aac-4bee-a533-cc02b8d242e2 => generated 1555 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 15:53:18.352570 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi [None req-3c5d5571-d2cf-4744-a68c-ff4a8cd497a1 tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] Calling method '>' {{(pid=128729) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 15:53:18.353113 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.compute.api [None req-3c5d5571-d2cf-4744-a68c-ff4a8cd497a1 tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] [instance: e10cdd60-3aac-4bee-a533-cc02b8d242e2] Fetching instance by UUID {{(pid=128729) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 15:53:18.359598 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-3c5d5571-d2cf-4744-a68c-ff4a8cd497a1 tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:53:18.360046 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-3c5d5571-d2cf-4744-a68c-ff4a8cd497a1 tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:53:18.360803 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-3c5d5571-d2cf-4744-a68c-ff4a8cd497a1 tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:53:18.361229 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-3c5d5571-d2cf-4744-a68c-ff4a8cd497a1 tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:53:18.437614 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: INFO nova.api.openstack.requestlog [None req-3c5d5571-d2cf-4744-a68c-ff4a8cd497a1 tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] 10.222.0.61 "GET /compute/v2.1/servers/e10cdd60-3aac-4bee-a533-cc02b8d242e2/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.088774 May 14 15:53:18.438210 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: [pid: 128729|app: 0|req: 416/848] 10.222.0.61 () {58 vars in 1274 bytes} [Sat May 14 15:53:18 2022] GET /compute/v2.1/servers/e10cdd60-3aac-4bee-a533-cc02b8d242e2/os-interface => generated 285 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 14 15:53:19.644157 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi [req-0c7baac9-a9a7-43c1-b845-ee510c46a81f req-15646849-3e0c-4134-975f-81b07629ee27 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e10cdd60-3aac-4bee-a533-cc02b8d242e2", "tag": "31f05ca6-8416-443c-a8bb-aa1aed44741e"}]} {{(pid=128728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 15:53:19.652388 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [req-0c7baac9-a9a7-43c1-b845-ee510c46a81f req-15646849-3e0c-4134-975f-81b07629ee27 service nova] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:53:19.652985 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [req-0c7baac9-a9a7-43c1-b845-ee510c46a81f req-15646849-3e0c-4134-975f-81b07629ee27 service nova] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:53:19.664267 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: INFO nova.api.openstack.compute.server_external_events [req-0c7baac9-a9a7-43c1-b845-ee510c46a81f req-15646849-3e0c-4134-975f-81b07629ee27 service nova] Creating event network-changed:31f05ca6-8416-443c-a8bb-aa1aed44741e for instance e10cdd60-3aac-4bee-a533-cc02b8d242e2 on hv-cinder-83979 May 14 15:53:19.669443 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: INFO nova.api.openstack.requestlog [req-0c7baac9-a9a7-43c1-b845-ee510c46a81f req-15646849-3e0c-4134-975f-81b07629ee27 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.028959 May 14 15:53:19.670038 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: [pid: 128728|app: 0|req: 433/849] 10.222.0.61 () {64 vars in 1317 bytes} [Sat May 14 15:53:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 14 15:53:20.292215 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi [None req-3ab57668-2c70-431b-84b7-05745e873322 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Calling method '>' {{(pid=128729) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 15:53:20.292821 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.compute.api [None req-3ab57668-2c70-431b-84b7-05745e873322 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] [instance: e33e9970-bfb7-46f3-8d40-782dbfa3d21c] Fetching instance by UUID {{(pid=128729) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 15:53:20.298615 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-3ab57668-2c70-431b-84b7-05745e873322 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:53:20.299072 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-3ab57668-2c70-431b-84b7-05745e873322 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:53:20.299846 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-3ab57668-2c70-431b-84b7-05745e873322 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:53:20.300288 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-3ab57668-2c70-431b-84b7-05745e873322 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:53:20.330520 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: INFO nova.api.openstack.requestlog [None req-3ab57668-2c70-431b-84b7-05745e873322 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] 10.222.0.61 "GET /compute/v2.1/servers/e33e9970-bfb7-46f3-8d40-782dbfa3d21c/os-volume_attachments/d9db8edc-612c-4e07-b5dd-25af23631a4b" status: 200 len: 194 microversion: 2.20 time: 0.042787 May 14 15:53:20.331125 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: [pid: 128729|app: 0|req: 417/850] 10.222.0.61 () {60 vars in 1453 bytes} [Sat May 14 15:53:20 2022] GET /compute/v2.1/servers/e33e9970-bfb7-46f3-8d40-782dbfa3d21c/os-volume_attachments/d9db8edc-612c-4e07-b5dd-25af23631a4b => generated 194 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) May 14 15:53:20.393819 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi [None req-aa11330b-623c-4308-839d-4e9010650443 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Calling method '>' {{(pid=128728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 15:53:20.394432 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.compute.api [None req-aa11330b-623c-4308-839d-4e9010650443 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] [instance: e33e9970-bfb7-46f3-8d40-782dbfa3d21c] Fetching instance by UUID {{(pid=128728) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 15:53:20.400813 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-aa11330b-623c-4308-839d-4e9010650443 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:53:20.401256 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-aa11330b-623c-4308-839d-4e9010650443 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:53:20.402032 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-aa11330b-623c-4308-839d-4e9010650443 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:53:20.402503 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-aa11330b-623c-4308-839d-4e9010650443 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:53:20.486393 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.objects.instance [None req-aa11330b-623c-4308-839d-4e9010650443 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Lazy-loading 'services' on Instance uuid e33e9970-bfb7-46f3-8d40-782dbfa3d21c {{(pid=128728) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 14 15:53:20.601963 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: INFO nova.api.openstack.requestlog [None req-aa11330b-623c-4308-839d-4e9010650443 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] 10.222.0.61 "DELETE /compute/v2.1/servers/e33e9970-bfb7-46f3-8d40-782dbfa3d21c/os-volume_attachments/d9db8edc-612c-4e07-b5dd-25af23631a4b" status: 202 len: 0 microversion: 2.20 time: 0.212474 May 14 15:53:20.602611 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: [pid: 128728|app: 0|req: 434/851] 10.222.0.61 () {60 vars in 1456 bytes} [Sat May 14 15:53:20 2022] DELETE /compute/v2.1/servers/e33e9970-bfb7-46f3-8d40-782dbfa3d21c/os-volume_attachments/d9db8edc-612c-4e07-b5dd-25af23631a4b => generated 0 bytes in 215 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) May 14 15:53:20.611889 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi [None req-fdf054f6-6177-480a-9155-5729b5e90c1c tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Calling method '>' {{(pid=128729) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 15:53:20.612813 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.compute.api [None req-fdf054f6-6177-480a-9155-5729b5e90c1c tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] [instance: e33e9970-bfb7-46f3-8d40-782dbfa3d21c] Fetching instance by UUID {{(pid=128729) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 15:53:20.619303 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-fdf054f6-6177-480a-9155-5729b5e90c1c tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:53:20.619780 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-fdf054f6-6177-480a-9155-5729b5e90c1c tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:53:20.621043 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-fdf054f6-6177-480a-9155-5729b5e90c1c tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:53:20.621554 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-fdf054f6-6177-480a-9155-5729b5e90c1c tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:53:20.651997 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: INFO nova.api.openstack.requestlog [None req-fdf054f6-6177-480a-9155-5729b5e90c1c tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] 10.222.0.61 "GET /compute/v2.1/servers/e33e9970-bfb7-46f3-8d40-782dbfa3d21c/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043949 May 14 15:53:20.652565 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: [pid: 128729|app: 0|req: 418/852] 10.222.0.61 () {60 vars in 1342 bytes} [Sat May 14 15:53:20 2022] GET /compute/v2.1/servers/e33e9970-bfb7-46f3-8d40-782dbfa3d21c/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 14 15:53:21.665607 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi [None req-96a3f5f3-158b-4112-828d-6474d30d0852 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Calling method '>' {{(pid=128728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 15:53:21.666697 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.compute.api [None req-96a3f5f3-158b-4112-828d-6474d30d0852 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] [instance: e33e9970-bfb7-46f3-8d40-782dbfa3d21c] Fetching instance by UUID {{(pid=128728) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 15:53:21.673588 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-96a3f5f3-158b-4112-828d-6474d30d0852 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:53:21.674067 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-96a3f5f3-158b-4112-828d-6474d30d0852 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:53:21.674906 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-96a3f5f3-158b-4112-828d-6474d30d0852 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:53:21.675347 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-96a3f5f3-158b-4112-828d-6474d30d0852 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:53:21.703814 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: INFO nova.api.openstack.requestlog [None req-96a3f5f3-158b-4112-828d-6474d30d0852 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] 10.222.0.61 "GET /compute/v2.1/servers/e33e9970-bfb7-46f3-8d40-782dbfa3d21c/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.043003 May 14 15:53:21.704365 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: [pid: 128728|app: 0|req: 435/853] 10.222.0.61 () {60 vars in 1342 bytes} [Sat May 14 15:53:21 2022] GET /compute/v2.1/servers/e33e9970-bfb7-46f3-8d40-782dbfa3d21c/os-volume_attachments => generated 25 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 15:53:21.760411 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi [None req-aa2f9d50-7df9-49e3-baec-97aa840e09ea tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Calling method '>' {{(pid=128729) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 15:53:21.760893 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.compute.api [None req-aa2f9d50-7df9-49e3-baec-97aa840e09ea tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] [instance: e33e9970-bfb7-46f3-8d40-782dbfa3d21c] Fetching instance by UUID {{(pid=128729) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 15:53:21.767757 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-aa2f9d50-7df9-49e3-baec-97aa840e09ea tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:53:21.768202 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-aa2f9d50-7df9-49e3-baec-97aa840e09ea tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:53:21.768962 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-aa2f9d50-7df9-49e3-baec-97aa840e09ea tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:53:21.769397 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-aa2f9d50-7df9-49e3-baec-97aa840e09ea tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:53:21.794861 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.compute.api [None req-aa2f9d50-7df9-49e3-baec-97aa840e09ea tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] [instance: e33e9970-bfb7-46f3-8d40-782dbfa3d21c] Going to try to terminate instance {{(pid=128729) delete /opt/stack/nova/nova/compute/api.py:2664}} May 14 15:53:21.867611 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: INFO nova.api.openstack.requestlog [None req-aa2f9d50-7df9-49e3-baec-97aa840e09ea tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] 10.222.0.61 "DELETE /compute/v2.1/servers/e33e9970-bfb7-46f3-8d40-782dbfa3d21c" status: 204 len: 0 microversion: 2.20 time: 0.111066 May 14 15:53:21.868169 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: [pid: 128729|app: 0|req: 419/854] 10.222.0.61 () {60 vars in 1279 bytes} [Sat May 14 15:53:21 2022] DELETE /compute/v2.1/servers/e33e9970-bfb7-46f3-8d40-782dbfa3d21c => generated 0 bytes in 113 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) May 14 15:53:21.877078 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi [None req-22162ec3-dbcb-4a0b-8fed-9f4d281b8d28 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Calling method '>' {{(pid=128728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 15:53:21.877629 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.compute.api [None req-22162ec3-dbcb-4a0b-8fed-9f4d281b8d28 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] [instance: e33e9970-bfb7-46f3-8d40-782dbfa3d21c] Fetching instance by UUID {{(pid=128728) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 15:53:21.883466 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-22162ec3-dbcb-4a0b-8fed-9f4d281b8d28 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:53:21.883917 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-22162ec3-dbcb-4a0b-8fed-9f4d281b8d28 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:53:21.884689 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-22162ec3-dbcb-4a0b-8fed-9f4d281b8d28 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:53:21.885128 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-22162ec3-dbcb-4a0b-8fed-9f4d281b8d28 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:53:22.014237 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.policy [None req-22162ec3-dbcb-4a0b-8fed-9f4d281b8d28 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58bfb7417bc94583963401ae0fe9d39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0672be3fa3f7414da1c1a5b7300abbe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128728) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:53:22.021977 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.policy [None req-22162ec3-dbcb-4a0b-8fed-9f4d281b8d28 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58bfb7417bc94583963401ae0fe9d39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0672be3fa3f7414da1c1a5b7300abbe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128728) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:53:22.023521 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.policy [None req-22162ec3-dbcb-4a0b-8fed-9f4d281b8d28 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58bfb7417bc94583963401ae0fe9d39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0672be3fa3f7414da1c1a5b7300abbe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128728) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:53:22.024670 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: INFO nova.api.openstack.requestlog [None req-22162ec3-dbcb-4a0b-8fed-9f4d281b8d28 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] 10.222.0.61 "GET /compute/v2.1/servers/e33e9970-bfb7-46f3-8d40-782dbfa3d21c" status: 200 len: 1722 microversion: 2.20 time: 0.151601 May 14 15:53:22.025228 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: [pid: 128728|app: 0|req: 436/855] 10.222.0.61 () {60 vars in 1276 bytes} [Sat May 14 15:53:21 2022] GET /compute/v2.1/servers/e33e9970-bfb7-46f3-8d40-782dbfa3d21c => generated 1722 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 14 15:53:23.043968 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi [None req-9f31f1b3-ab11-4eac-b752-00e4e30755f8 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Calling method '>' {{(pid=128729) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 15:53:23.044594 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.compute.api [None req-9f31f1b3-ab11-4eac-b752-00e4e30755f8 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] [instance: e33e9970-bfb7-46f3-8d40-782dbfa3d21c] Fetching instance by UUID {{(pid=128729) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 15:53:23.050848 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-9f31f1b3-ab11-4eac-b752-00e4e30755f8 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:53:23.051306 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-9f31f1b3-ab11-4eac-b752-00e4e30755f8 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:53:23.052076 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-9f31f1b3-ab11-4eac-b752-00e4e30755f8 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:53:23.052517 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-9f31f1b3-ab11-4eac-b752-00e4e30755f8 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:53:23.185678 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.policy [None req-9f31f1b3-ab11-4eac-b752-00e4e30755f8 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58bfb7417bc94583963401ae0fe9d39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0672be3fa3f7414da1c1a5b7300abbe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128729) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:53:23.193459 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.policy [None req-9f31f1b3-ab11-4eac-b752-00e4e30755f8 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58bfb7417bc94583963401ae0fe9d39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0672be3fa3f7414da1c1a5b7300abbe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128729) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:53:23.195015 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.policy [None req-9f31f1b3-ab11-4eac-b752-00e4e30755f8 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58bfb7417bc94583963401ae0fe9d39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0672be3fa3f7414da1c1a5b7300abbe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128729) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:53:23.196174 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: INFO nova.api.openstack.requestlog [None req-9f31f1b3-ab11-4eac-b752-00e4e30755f8 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] 10.222.0.61 "GET /compute/v2.1/servers/e33e9970-bfb7-46f3-8d40-782dbfa3d21c" status: 200 len: 1722 microversion: 2.20 time: 0.156599 May 14 15:53:23.196737 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: [pid: 128729|app: 0|req: 420/856] 10.222.0.61 () {60 vars in 1276 bytes} [Sat May 14 15:53:23 2022] GET /compute/v2.1/servers/e33e9970-bfb7-46f3-8d40-782dbfa3d21c => generated 1722 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 14 15:53:24.215085 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi [None req-513a49f2-730f-415a-b963-5e6ddc7e0550 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Calling method '>' {{(pid=128728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 15:53:24.216247 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.compute.api [None req-513a49f2-730f-415a-b963-5e6ddc7e0550 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] [instance: e33e9970-bfb7-46f3-8d40-782dbfa3d21c] Fetching instance by UUID {{(pid=128728) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 15:53:24.222373 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-513a49f2-730f-415a-b963-5e6ddc7e0550 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:53:24.222822 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-513a49f2-730f-415a-b963-5e6ddc7e0550 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:53:24.223589 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-513a49f2-730f-415a-b963-5e6ddc7e0550 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:53:24.224020 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-513a49f2-730f-415a-b963-5e6ddc7e0550 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:53:24.462969 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.policy [None req-513a49f2-730f-415a-b963-5e6ddc7e0550 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58bfb7417bc94583963401ae0fe9d39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0672be3fa3f7414da1c1a5b7300abbe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128728) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:53:24.471625 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.policy [None req-513a49f2-730f-415a-b963-5e6ddc7e0550 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58bfb7417bc94583963401ae0fe9d39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0672be3fa3f7414da1c1a5b7300abbe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128728) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:53:24.473329 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.policy [None req-513a49f2-730f-415a-b963-5e6ddc7e0550 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58bfb7417bc94583963401ae0fe9d39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0672be3fa3f7414da1c1a5b7300abbe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128728) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:53:24.474814 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: INFO nova.api.openstack.requestlog [None req-513a49f2-730f-415a-b963-5e6ddc7e0550 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] 10.222.0.61 "GET /compute/v2.1/servers/e33e9970-bfb7-46f3-8d40-782dbfa3d21c" status: 200 len: 1722 microversion: 2.20 time: 0.263721 May 14 15:53:24.475382 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: [pid: 128728|app: 0|req: 437/857] 10.222.0.61 () {60 vars in 1276 bytes} [Sat May 14 15:53:24 2022] GET /compute/v2.1/servers/e33e9970-bfb7-46f3-8d40-782dbfa3d21c => generated 1722 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 14 15:53:25.023911 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi [req-75458eaa-9d16-4bc3-8901-8dca88e44692 req-3536d96a-e747-4845-be0c-e1df81221500 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e33e9970-bfb7-46f3-8d40-782dbfa3d21c", "name": "network-vif-deleted", "tag": "759be0ca-daaf-4eba-97b6-a252b70cbb3b"}]} {{(pid=128729) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 15:53:25.033977 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [req-75458eaa-9d16-4bc3-8901-8dca88e44692 req-3536d96a-e747-4845-be0c-e1df81221500 service nova] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:53:25.034490 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [req-75458eaa-9d16-4bc3-8901-8dca88e44692 req-3536d96a-e747-4845-be0c-e1df81221500 service nova] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:53:25.048765 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: INFO nova.api.openstack.compute.server_external_events [req-75458eaa-9d16-4bc3-8901-8dca88e44692 req-3536d96a-e747-4845-be0c-e1df81221500 service nova] Creating event network-vif-deleted:759be0ca-daaf-4eba-97b6-a252b70cbb3b for instance e33e9970-bfb7-46f3-8d40-782dbfa3d21c on hv-cinder-83979 May 14 15:53:25.053922 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: INFO nova.api.openstack.requestlog [req-75458eaa-9d16-4bc3-8901-8dca88e44692 req-3536d96a-e747-4845-be0c-e1df81221500 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033539 May 14 15:53:25.054934 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: [pid: 128729|app: 0|req: 421/858] 10.222.0.61 () {64 vars in 1317 bytes} [Sat May 14 15:53:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 14 15:53:25.494843 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi [None req-2cfbec89-933b-46b2-9f30-e3db0ea54dc3 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Calling method '>' {{(pid=128728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 15:53:25.495451 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.compute.api [None req-2cfbec89-933b-46b2-9f30-e3db0ea54dc3 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] [instance: e33e9970-bfb7-46f3-8d40-782dbfa3d21c] Fetching instance by UUID {{(pid=128728) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 15:53:25.502212 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-2cfbec89-933b-46b2-9f30-e3db0ea54dc3 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:53:25.502703 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-2cfbec89-933b-46b2-9f30-e3db0ea54dc3 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:53:25.503484 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-2cfbec89-933b-46b2-9f30-e3db0ea54dc3 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:53:25.503924 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-2cfbec89-933b-46b2-9f30-e3db0ea54dc3 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:53:25.534750 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-2cfbec89-933b-46b2-9f30-e3db0ea54dc3 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:53:25.535192 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-2cfbec89-933b-46b2-9f30-e3db0ea54dc3 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:53:25.535632 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.objects.instance [None req-2cfbec89-933b-46b2-9f30-e3db0ea54dc3 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Lazy-loading 'fault' on Instance uuid e33e9970-bfb7-46f3-8d40-782dbfa3d21c {{(pid=128728) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 14 15:53:25.577762 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.policy [None req-2cfbec89-933b-46b2-9f30-e3db0ea54dc3 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58bfb7417bc94583963401ae0fe9d39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0672be3fa3f7414da1c1a5b7300abbe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128728) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:53:25.585488 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.policy [None req-2cfbec89-933b-46b2-9f30-e3db0ea54dc3 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58bfb7417bc94583963401ae0fe9d39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0672be3fa3f7414da1c1a5b7300abbe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128728) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:53:25.587041 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.policy [None req-2cfbec89-933b-46b2-9f30-e3db0ea54dc3 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58bfb7417bc94583963401ae0fe9d39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0672be3fa3f7414da1c1a5b7300abbe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128728) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:53:25.588202 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: INFO nova.api.openstack.requestlog [None req-2cfbec89-933b-46b2-9f30-e3db0ea54dc3 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] 10.222.0.61 "GET /compute/v2.1/servers/e33e9970-bfb7-46f3-8d40-782dbfa3d21c" status: 200 len: 1371 microversion: 2.20 time: 0.097346 May 14 15:53:25.598641 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: [pid: 128728|app: 0|req: 438/859] 10.222.0.61 () {60 vars in 1276 bytes} [Sat May 14 15:53:25 2022] GET /compute/v2.1/servers/e33e9970-bfb7-46f3-8d40-782dbfa3d21c => generated 1371 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 14 15:53:26.610093 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi [None req-849e022f-da4e-4cbe-ab99-6e83c93184c7 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Calling method '>' {{(pid=128729) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 15:53:26.610822 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.compute.api [None req-849e022f-da4e-4cbe-ab99-6e83c93184c7 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] [instance: e33e9970-bfb7-46f3-8d40-782dbfa3d21c] Fetching instance by UUID {{(pid=128729) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 15:53:26.617230 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-849e022f-da4e-4cbe-ab99-6e83c93184c7 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:53:26.617688 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-849e022f-da4e-4cbe-ab99-6e83c93184c7 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:53:26.618503 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-849e022f-da4e-4cbe-ab99-6e83c93184c7 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:53:26.618944 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-849e022f-da4e-4cbe-ab99-6e83c93184c7 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:53:26.632833 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: INFO nova.api.openstack.wsgi [None req-849e022f-da4e-4cbe-ab99-6e83c93184c7 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] HTTP exception thrown: Instance e33e9970-bfb7-46f3-8d40-782dbfa3d21c could not be found. May 14 15:53:26.634481 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi [None req-849e022f-da4e-4cbe-ab99-6e83c93184c7 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Request method failure captured: May 14 15:53:26.634481 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: request: GET /compute/v2.1/servers/e33e9970-bfb7-46f3-8d40-782dbfa3d21c HTTP/1.1 May 14 15:53:26.634481 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: Accept: application/json May 14 15:53:26.634481 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: Accept-Encoding: identity May 14 15:53:26.634481 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: Connection: close May 14 15:53:26.634481 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: Content-Length: 0 May 14 15:53:26.634481 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: Content-Type: application/json May 14 15:53:26.634481 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: Host: 10.222.0.61 May 14 15:53:26.634481 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: Openstack-System-Scope: None May 14 15:53:26.634481 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: User-Agent: python-urllib3/1.26.9 May 14 15:53:26.634481 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: X-Auth-Token: gAAAAABif87cXLSpyUu3a9K-vtFHqSpp1aQZW1jW-zQ2Idzmz1rv6VZ5naJZjx_0Ztni3S2PMUUkq4rTnJcFNAekAJmOB4fA7zofP6VQEp1yk3kHJThjsksUCeoFnGR1cQkBPZsCy1zToVK3Lc8wCHUoVwX7ZZ0iyqkTplJDA-CIW3iXuuBg1p8 May 14 15:53:26.634481 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: X-Domain-Id: None May 14 15:53:26.634481 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: X-Domain-Name: None May 14 15:53:26.634481 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: X-Identity-Status: Confirmed May 14 15:53:26.634481 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: X-Is-Admin-Project: True May 14 15:53:26.634481 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: X-Openstack-Nova-Api-Version: 2.20 May 14 15:53:26.634481 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: X-Project-Domain-Id: default May 14 15:53:26.634481 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: X-Project-Domain-Name: Default May 14 15:53:26.634481 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: X-Project-Id: 0672be3fa3f7414da1c1a5b7300abbe7 May 14 15:53:26.634481 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1739561036 May 14 15:53:26.634481 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: X-Role: reader,member May 14 15:53:26.634481 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: X-Roles: reader,member May 14 15:53:26.636156 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/0672be3fa3f7414da1c1a5b7300abbe7"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/0672be3fa3f7414da1c1a5b7300abbe7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/0672be3fa3f7414da1c1a5b7300abbe7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_0672be3fa3f7414da1c1a5b7300abbe7"}]}] May 14 15:53:26.636156 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1739561036 May 14 15:53:26.636156 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: X-Tenant-Id: 0672be3fa3f7414da1c1a5b7300abbe7 May 14 15:53:26.636156 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1739561036 May 14 15:53:26.636156 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: X-User: tempest-AttachVolumeShelveTestJSON-1739561036-project May 14 15:53:26.636156 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: X-User-Domain-Id: default May 14 15:53:26.636156 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: X-User-Domain-Name: Default May 14 15:53:26.636156 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: X-User-Id: 58bfb7417bc94583963401ae0fe9d39a May 14 15:53:26.636156 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1739561036-project May 14 15:53:26.636156 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: method: > May 14 15:53:26.636156 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: exception: Instance e33e9970-bfb7-46f3-8d40-782dbfa3d21c could not be found. May 14 15:53:26.636156 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: action_args: {'id': 'e33e9970-bfb7-46f3-8d40-782dbfa3d21c'} May 14 15:53:26.637021 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: {{(pid=128729) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 14 15:53:26.637021 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 15:53:26.637021 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 14 15:53:26.637021 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 14 15:53:26.637021 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 14 15:53:26.637021 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 14 15:53:26.637021 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 14 15:53:26.637021 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 14 15:53:26.637021 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 14 15:53:26.637021 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 14 15:53:26.637021 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e33e9970-bfb7-46f3-8d40-782dbfa3d21c could not be found. May 14 15:53:26.637021 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: ERROR nova.api.openstack.wsgi May 14 15:53:26.637021 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 14 15:53:26.637021 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: ERROR nova.api.openstack.wsgi May 14 15:53:26.637021 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 15:53:26.637021 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 14 15:53:26.637021 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 14 15:53:26.637021 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 14 15:53:26.637021 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 14 15:53:26.637021 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 14 15:53:26.638341 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 14 15:53:26.638341 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 14 15:53:26.638341 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 14 15:53:26.638341 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 14 15:53:26.638341 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 14 15:53:26.638341 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 14 15:53:26.638341 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 14 15:53:26.638341 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e33e9970-bfb7-46f3-8d40-782dbfa3d21c could not be found. May 14 15:53:26.638341 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: ERROR nova.api.openstack.wsgi May 14 15:53:26.638341 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 14 15:53:26.638341 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: ERROR nova.api.openstack.wsgi May 14 15:53:26.638341 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 15:53:26.638341 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 14 15:53:26.638341 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 14 15:53:26.638341 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 14 15:53:26.638341 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 14 15:53:26.638341 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e33e9970-bfb7-46f3-8d40-782dbfa3d21c could not be found. May 14 15:53:26.638341 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: ERROR nova.api.openstack.wsgi May 14 15:53:26.639524 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi [None req-849e022f-da4e-4cbe-ab99-6e83c93184c7 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Returning 404 to user: Instance e33e9970-bfb7-46f3-8d40-782dbfa3d21c could not be found. {{(pid=128729) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 14 15:53:26.639524 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: INFO nova.api.openstack.requestlog [None req-849e022f-da4e-4cbe-ab99-6e83c93184c7 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] 10.222.0.61 "GET /compute/v2.1/servers/e33e9970-bfb7-46f3-8d40-782dbfa3d21c" status: 404 len: 111 microversion: 2.20 time: 0.031554 May 14 15:53:26.639524 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: [pid: 128729|app: 0|req: 422/860] 10.222.0.61 () {60 vars in 1276 bytes} [Sat May 14 15:53:26 2022] GET /compute/v2.1/servers/e33e9970-bfb7-46f3-8d40-782dbfa3d21c => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) May 14 15:53:26.644807 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi [None req-44c505c8-44c9-43bd-9730-3368efbc2627 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Calling method '.version_select at 0x7f77cb60d820>' {{(pid=128728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 15:53:26.662301 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: INFO nova.api.openstack.requestlog [None req-44c505c8-44c9-43bd-9730-3368efbc2627 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] 10.222.0.61 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1822933638" status: 204 len: 0 microversion: 2.20 time: 0.021342 May 14 15:53:26.662871 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: [pid: 128728|app: 0|req: 439/861] 10.222.0.61 () {60 vars in 1261 bytes} [Sat May 14 15:53:26 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1822933638 => generated 0 bytes in 23 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) May 14 15:53:27.546628 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi [None req-bbba5f8d-bde1-4cc2-b3b7-06d9ced6833c tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Action: 'create', calling method: .version_select at 0x7f77dce7fdc0>, body: {"keypair": {"name": "tempest-keypair-1111285347", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFHrnozVTcRcZsuZQ7Qd3Blg6UvHlPQphOH5K/o8fovlybdFSipIWZL7TEo9hV9avGJ+e4UnxxFcYsBoXtquMyWPChFVo+OH/z8m6O+gE7SS3dtjYKXsdTkFaXXmLmUEPQ=="}} {{(pid=128729) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 15:53:27.560252 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.quota [None req-bbba5f8d-bde1-4cc2-b3b7-06d9ced6833c tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Getting quotas for project 0672be3fa3f7414da1c1a5b7300abbe7. Resources: {'key_pairs'} {{(pid=128729) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 14 15:53:27.563970 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.quota [None req-bbba5f8d-bde1-4cc2-b3b7-06d9ced6833c tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Getting quotas for user 58bfb7417bc94583963401ae0fe9d39a and project 0672be3fa3f7414da1c1a5b7300abbe7. Resources: {'key_pairs'} {{(pid=128729) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 14 15:53:27.585503 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: INFO nova.api.openstack.requestlog [None req-bbba5f8d-bde1-4cc2-b3b7-06d9ced6833c tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] 10.222.0.61 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 0.042903 May 14 15:53:27.586095 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: [pid: 128729|app: 0|req: 423/862] 10.222.0.61 () {62 vars in 1199 bytes} [Sat May 14 15:53:27 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 44 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) May 14 15:53:28.880882 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi [None req-00b79bb5-ac84-4037-b45a-a6650f47cb80 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1259739414", "imageRef": "1381e3d5-fc27-4fa7-ab03-5d86278a0546", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "d4128056-aa2b-474b-a7d3-2646c1ffdbcf"}], "security_groups": [{"name": "tempest-securitygroup--1783368076"}], "key_name": "tempest-keypair-1111285347", "user_data": "}} {{(pid=128728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 15:53:29.002405 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.network.neutron [None req-00b79bb5-ac84-4037-b45a-a6650f47cb80 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] validate_networks() for [('d4128056-aa2b-474b-a7d3-2646c1ffdbcf', None, None, None, None, None)] {{(pid=128728) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 14 15:53:29.283808 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi [None req-0e5db3d2-6363-4dc0-a52f-f76637f94679 tempest-TestMinimumBasicScenario-1817438735 tempest-TestMinimumBasicScenario-1817438735-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-669680809"}} {{(pid=128729) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 15:53:29.284361 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.compute.api [None req-0e5db3d2-6363-4dc0-a52f-f76637f94679 tempest-TestMinimumBasicScenario-1817438735 tempest-TestMinimumBasicScenario-1817438735-project] [instance: ef63d04a-87e5-4202-a672-d45a2a877c68] Fetching instance by UUID {{(pid=128729) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 15:53:29.290645 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-0e5db3d2-6363-4dc0-a52f-f76637f94679 tempest-TestMinimumBasicScenario-1817438735 tempest-TestMinimumBasicScenario-1817438735-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:53:29.291100 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-0e5db3d2-6363-4dc0-a52f-f76637f94679 tempest-TestMinimumBasicScenario-1817438735 tempest-TestMinimumBasicScenario-1817438735-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:53:29.291870 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-0e5db3d2-6363-4dc0-a52f-f76637f94679 tempest-TestMinimumBasicScenario-1817438735 tempest-TestMinimumBasicScenario-1817438735-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:53:29.292301 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-0e5db3d2-6363-4dc0-a52f-f76637f94679 tempest-TestMinimumBasicScenario-1817438735 tempest-TestMinimumBasicScenario-1817438735-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:53:29.581039 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: INFO nova.network.security_group_api [None req-0e5db3d2-6363-4dc0-a52f-f76637f94679 tempest-TestMinimumBasicScenario-1817438735 tempest-TestMinimumBasicScenario-1817438735-project] Removing security group 0696e348-67b8-4f1a-858d-e461527b614c from port 61226c22-8028-48c9-8e04-0f0c0cf9fa30 May 14 15:53:29.873755 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.virt.hardware [None req-00b79bb5-ac84-4037-b45a-a6650f47cb80 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Flavor limits 0:0:0 {{(pid=128728) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 14 15:53:29.874204 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.virt.hardware [None req-00b79bb5-ac84-4037-b45a-a6650f47cb80 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Image limits 0:0:0 {{(pid=128728) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 14 15:53:29.874696 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.virt.hardware [None req-00b79bb5-ac84-4037-b45a-a6650f47cb80 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Flavor pref 0:0:0 {{(pid=128728) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 14 15:53:29.875156 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.virt.hardware [None req-00b79bb5-ac84-4037-b45a-a6650f47cb80 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Image pref 0:0:0 {{(pid=128728) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 14 15:53:29.875489 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.virt.hardware [None req-00b79bb5-ac84-4037-b45a-a6650f47cb80 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128728) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 14 15:53:29.883843 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-00b79bb5-ac84-4037-b45a-a6650f47cb80 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:53:29.884442 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-00b79bb5-ac84-4037-b45a-a6650f47cb80 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:53:29.885074 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-00b79bb5-ac84-4037-b45a-a6650f47cb80 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:53:29.885502 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-00b79bb5-ac84-4037-b45a-a6650f47cb80 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:53:29.904218 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.quota [None req-00b79bb5-ac84-4037-b45a-a6650f47cb80 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Getting quotas for project 0672be3fa3f7414da1c1a5b7300abbe7. Resources: {'instances', 'cores', 'ram'} {{(pid=128728) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 14 15:53:29.908264 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.quota [None req-00b79bb5-ac84-4037-b45a-a6650f47cb80 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Getting quotas for user 58bfb7417bc94583963401ae0fe9d39a and project 0672be3fa3f7414da1c1a5b7300abbe7. Resources: {'instances', 'cores', 'ram'} {{(pid=128728) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 14 15:53:29.918946 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.compute.api [None req-00b79bb5-ac84-4037-b45a-a6650f47cb80 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Going to run 1 instances... {{(pid=128728) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 14 15:53:29.921232 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.compute.api [None req-00b79bb5-ac84-4037-b45a-a6650f47cb80 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] [instance: cca08141-979e-4519-88b3-c77e8a71ae3e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='1381e3d5-fc27-4fa7-ab03-5d86278a0546',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128728) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 14 15:53:29.969201 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: INFO nova.api.openstack.requestlog [None req-00b79bb5-ac84-4037-b45a-a6650f47cb80 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] 10.222.0.61 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 1.092710 May 14 15:53:29.970164 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: [pid: 128728|app: 0|req: 440/863] 10.222.0.61 () {62 vars in 1187 bytes} [Sat May 14 15:53:28 2022] POST /compute/v2.1/servers => generated 402 bytes in 1094 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) May 14 15:53:29.980229 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi [None req-4c320e47-ad53-4e95-91ad-c98565b6ea7c tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Calling method '>' {{(pid=128728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 15:53:29.980933 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.compute.api [None req-4c320e47-ad53-4e95-91ad-c98565b6ea7c tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] [instance: cca08141-979e-4519-88b3-c77e8a71ae3e] Fetching instance by UUID {{(pid=128728) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 15:53:30.067276 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.policy [None req-4c320e47-ad53-4e95-91ad-c98565b6ea7c tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58bfb7417bc94583963401ae0fe9d39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0672be3fa3f7414da1c1a5b7300abbe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128728) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:53:30.075612 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.policy [None req-4c320e47-ad53-4e95-91ad-c98565b6ea7c tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58bfb7417bc94583963401ae0fe9d39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0672be3fa3f7414da1c1a5b7300abbe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128728) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:53:30.077254 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.policy [None req-4c320e47-ad53-4e95-91ad-c98565b6ea7c tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58bfb7417bc94583963401ae0fe9d39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0672be3fa3f7414da1c1a5b7300abbe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128728) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:53:30.078398 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: INFO nova.api.openstack.requestlog [None req-4c320e47-ad53-4e95-91ad-c98565b6ea7c tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] 10.222.0.61 "GET /compute/v2.1/servers/cca08141-979e-4519-88b3-c77e8a71ae3e" status: 200 len: 1282 microversion: 2.20 time: 0.102151 May 14 15:53:30.078960 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: [pid: 128728|app: 0|req: 441/864] 10.222.0.61 () {60 vars in 1276 bytes} [Sat May 14 15:53:29 2022] GET /compute/v2.1/servers/cca08141-979e-4519-88b3-c77e8a71ae3e => generated 1282 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 14 15:53:30.186619 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: INFO nova.api.openstack.requestlog [None req-0e5db3d2-6363-4dc0-a52f-f76637f94679 tempest-TestMinimumBasicScenario-1817438735 tempest-TestMinimumBasicScenario-1817438735-project] 10.222.0.61 "POST /compute/v2.1/servers/ef63d04a-87e5-4202-a672-d45a2a877c68/action" status: 202 len: 0 microversion: 2.1 time: 0.906746 May 14 15:53:30.187911 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: [pid: 128729|app: 0|req: 424/865] 10.222.0.61 () {60 vars in 1277 bytes} [Sat May 14 15:53:29 2022] POST /compute/v2.1/servers/ef63d04a-87e5-4202-a672-d45a2a877c68/action => generated 0 bytes in 909 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 14 15:53:30.195121 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi [req-7a399067-58c6-43c9-9593-af58eec1636d req-199b4bf7-7983-4788-84d5-3f6f27412020 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ef63d04a-87e5-4202-a672-d45a2a877c68", "tag": "61226c22-8028-48c9-8e04-0f0c0cf9fa30"}]} {{(pid=128728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 15:53:30.207617 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [req-7a399067-58c6-43c9-9593-af58eec1636d req-199b4bf7-7983-4788-84d5-3f6f27412020 service nova] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:53:30.208063 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [req-7a399067-58c6-43c9-9593-af58eec1636d req-199b4bf7-7983-4788-84d5-3f6f27412020 service nova] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:53:30.224029 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: INFO nova.api.openstack.compute.server_external_events [req-7a399067-58c6-43c9-9593-af58eec1636d req-199b4bf7-7983-4788-84d5-3f6f27412020 service nova] Creating event network-changed:61226c22-8028-48c9-8e04-0f0c0cf9fa30 for instance ef63d04a-87e5-4202-a672-d45a2a877c68 on hv-cinder-83979 May 14 15:53:30.248617 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: INFO nova.api.openstack.requestlog [req-7a399067-58c6-43c9-9593-af58eec1636d req-199b4bf7-7983-4788-84d5-3f6f27412020 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.057119 May 14 15:53:30.249239 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: [pid: 128728|app: 0|req: 442/866] 10.222.0.61 () {64 vars in 1317 bytes} [Sat May 14 15:53:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 14 15:53:31.096423 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi [None req-39c3d5fe-6f21-4557-98fa-453fb8a28144 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Calling method '>' {{(pid=128729) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 15:53:31.097042 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.compute.api [None req-39c3d5fe-6f21-4557-98fa-453fb8a28144 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] [instance: cca08141-979e-4519-88b3-c77e8a71ae3e] Fetching instance by UUID {{(pid=128729) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 15:53:31.104315 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-39c3d5fe-6f21-4557-98fa-453fb8a28144 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:53:31.104852 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-39c3d5fe-6f21-4557-98fa-453fb8a28144 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:53:31.107696 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-39c3d5fe-6f21-4557-98fa-453fb8a28144 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:53:31.108427 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-39c3d5fe-6f21-4557-98fa-453fb8a28144 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:53:31.212665 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.policy [None req-39c3d5fe-6f21-4557-98fa-453fb8a28144 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58bfb7417bc94583963401ae0fe9d39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0672be3fa3f7414da1c1a5b7300abbe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128729) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:53:31.221970 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.policy [None req-39c3d5fe-6f21-4557-98fa-453fb8a28144 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58bfb7417bc94583963401ae0fe9d39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0672be3fa3f7414da1c1a5b7300abbe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128729) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:53:31.223549 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.policy [None req-39c3d5fe-6f21-4557-98fa-453fb8a28144 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58bfb7417bc94583963401ae0fe9d39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0672be3fa3f7414da1c1a5b7300abbe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128729) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:53:31.224715 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: INFO nova.api.openstack.requestlog [None req-39c3d5fe-6f21-4557-98fa-453fb8a28144 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] 10.222.0.61 "GET /compute/v2.1/servers/cca08141-979e-4519-88b3-c77e8a71ae3e" status: 200 len: 1334 microversion: 2.20 time: 0.132682 May 14 15:53:31.225270 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: [pid: 128729|app: 0|req: 425/867] 10.222.0.61 () {60 vars in 1276 bytes} [Sat May 14 15:53:31 2022] GET /compute/v2.1/servers/cca08141-979e-4519-88b3-c77e8a71ae3e => generated 1334 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 14 15:53:31.945736 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi [None req-c24f105c-5b42-4049-9c63-0b1ab6a169d5 tempest-TestMinimumBasicScenario-1817438735 tempest-TestMinimumBasicScenario-1817438735-project] Calling method '>' {{(pid=128728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 15:53:31.950939 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.compute.api [None req-c24f105c-5b42-4049-9c63-0b1ab6a169d5 tempest-TestMinimumBasicScenario-1817438735 tempest-TestMinimumBasicScenario-1817438735-project] [instance: ef63d04a-87e5-4202-a672-d45a2a877c68] Fetching instance by UUID {{(pid=128728) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 15:53:31.961344 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-c24f105c-5b42-4049-9c63-0b1ab6a169d5 tempest-TestMinimumBasicScenario-1817438735 tempest-TestMinimumBasicScenario-1817438735-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:53:31.961896 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-c24f105c-5b42-4049-9c63-0b1ab6a169d5 tempest-TestMinimumBasicScenario-1817438735 tempest-TestMinimumBasicScenario-1817438735-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:53:31.963539 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-c24f105c-5b42-4049-9c63-0b1ab6a169d5 tempest-TestMinimumBasicScenario-1817438735 tempest-TestMinimumBasicScenario-1817438735-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:53:31.964092 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-c24f105c-5b42-4049-9c63-0b1ab6a169d5 tempest-TestMinimumBasicScenario-1817438735 tempest-TestMinimumBasicScenario-1817438735-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:53:32.072784 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.objects.instance [None req-c24f105c-5b42-4049-9c63-0b1ab6a169d5 tempest-TestMinimumBasicScenario-1817438735 tempest-TestMinimumBasicScenario-1817438735-project] Lazy-loading 'services' on Instance uuid ef63d04a-87e5-4202-a672-d45a2a877c68 {{(pid=128728) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 14 15:53:32.161828 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: INFO nova.api.openstack.requestlog [None req-c24f105c-5b42-4049-9c63-0b1ab6a169d5 tempest-TestMinimumBasicScenario-1817438735 tempest-TestMinimumBasicScenario-1817438735-project] 10.222.0.61 "DELETE /compute/v2.1/servers/ef63d04a-87e5-4202-a672-d45a2a877c68/os-volume_attachments/d946c5a0-5d65-4883-b9b2-c5943fa056fa" status: 202 len: 0 microversion: 2.1 time: 0.220675 May 14 15:53:32.163530 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: [pid: 128728|app: 0|req: 443/868] 10.222.0.61 () {58 vars in 1415 bytes} [Sat May 14 15:53:31 2022] DELETE /compute/v2.1/servers/ef63d04a-87e5-4202-a672-d45a2a877c68/os-volume_attachments/d946c5a0-5d65-4883-b9b2-c5943fa056fa => generated 0 bytes in 223 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 14 15:53:32.173375 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi [None req-8924ec3c-74b6-4afb-8c23-83f33a65c333 tempest-TestMinimumBasicScenario-1817438735 tempest-TestMinimumBasicScenario-1817438735-project] Calling method '>' {{(pid=128729) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 15:53:32.175008 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.compute.api [None req-8924ec3c-74b6-4afb-8c23-83f33a65c333 tempest-TestMinimumBasicScenario-1817438735 tempest-TestMinimumBasicScenario-1817438735-project] [instance: ef63d04a-87e5-4202-a672-d45a2a877c68] Fetching instance by UUID {{(pid=128729) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 15:53:32.184674 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-8924ec3c-74b6-4afb-8c23-83f33a65c333 tempest-TestMinimumBasicScenario-1817438735 tempest-TestMinimumBasicScenario-1817438735-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:53:32.185483 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-8924ec3c-74b6-4afb-8c23-83f33a65c333 tempest-TestMinimumBasicScenario-1817438735 tempest-TestMinimumBasicScenario-1817438735-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:53:32.189189 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-8924ec3c-74b6-4afb-8c23-83f33a65c333 tempest-TestMinimumBasicScenario-1817438735 tempest-TestMinimumBasicScenario-1817438735-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:53:32.189977 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-8924ec3c-74b6-4afb-8c23-83f33a65c333 tempest-TestMinimumBasicScenario-1817438735 tempest-TestMinimumBasicScenario-1817438735-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:53:32.235331 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: INFO nova.api.openstack.requestlog [None req-8924ec3c-74b6-4afb-8c23-83f33a65c333 tempest-TestMinimumBasicScenario-1817438735 tempest-TestMinimumBasicScenario-1817438735-project] 10.222.0.61 "GET /compute/v2.1/servers/ef63d04a-87e5-4202-a672-d45a2a877c68/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.066569 May 14 15:53:32.236207 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: [pid: 128729|app: 0|req: 426/869] 10.222.0.61 () {58 vars in 1301 bytes} [Sat May 14 15:53:32 2022] GET /compute/v2.1/servers/ef63d04a-87e5-4202-a672-d45a2a877c68/os-volume_attachments => generated 197 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 14 15:53:32.253421 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi [None req-03d4a650-b5b5-4823-a968-9075fa9cb64c tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Calling method '>' {{(pid=128728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 15:53:32.257728 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.compute.api [None req-03d4a650-b5b5-4823-a968-9075fa9cb64c tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] [instance: cca08141-979e-4519-88b3-c77e8a71ae3e] Fetching instance by UUID {{(pid=128728) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 15:53:32.264426 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi [req-b1470aca-1006-477b-9999-10f238188fc7 req-c5ddd0d5-1ef7-4066-b6ff-559c8d318e30 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ef63d04a-87e5-4202-a672-d45a2a877c68", "tag": "61226c22-8028-48c9-8e04-0f0c0cf9fa30"}]} {{(pid=128729) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 15:53:32.272271 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-03d4a650-b5b5-4823-a968-9075fa9cb64c tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:53:32.275347 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-03d4a650-b5b5-4823-a968-9075fa9cb64c tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:53:32.277227 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [req-b1470aca-1006-477b-9999-10f238188fc7 req-c5ddd0d5-1ef7-4066-b6ff-559c8d318e30 service nova] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:53:32.279031 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [req-b1470aca-1006-477b-9999-10f238188fc7 req-c5ddd0d5-1ef7-4066-b6ff-559c8d318e30 service nova] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:53:32.279173 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-03d4a650-b5b5-4823-a968-9075fa9cb64c tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:53:32.279629 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-03d4a650-b5b5-4823-a968-9075fa9cb64c tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:53:32.296750 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: INFO nova.api.openstack.compute.server_external_events [req-b1470aca-1006-477b-9999-10f238188fc7 req-c5ddd0d5-1ef7-4066-b6ff-559c8d318e30 service nova] Creating event network-changed:61226c22-8028-48c9-8e04-0f0c0cf9fa30 for instance ef63d04a-87e5-4202-a672-d45a2a877c68 on hv-cinder-83979 May 14 15:53:32.304329 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: INFO nova.api.openstack.requestlog [req-b1470aca-1006-477b-9999-10f238188fc7 req-c5ddd0d5-1ef7-4066-b6ff-559c8d318e30 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044084 May 14 15:53:32.305771 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: [pid: 128729|app: 0|req: 427/870] 10.222.0.61 () {64 vars in 1317 bytes} [Sat May 14 15:53:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 14 15:53:32.439992 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.policy [None req-03d4a650-b5b5-4823-a968-9075fa9cb64c tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58bfb7417bc94583963401ae0fe9d39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0672be3fa3f7414da1c1a5b7300abbe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128728) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:53:32.447818 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.policy [None req-03d4a650-b5b5-4823-a968-9075fa9cb64c tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58bfb7417bc94583963401ae0fe9d39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0672be3fa3f7414da1c1a5b7300abbe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128728) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:53:32.450217 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.policy [None req-03d4a650-b5b5-4823-a968-9075fa9cb64c tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58bfb7417bc94583963401ae0fe9d39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0672be3fa3f7414da1c1a5b7300abbe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128728) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:53:32.451361 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: INFO nova.api.openstack.requestlog [None req-03d4a650-b5b5-4823-a968-9075fa9cb64c tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] 10.222.0.61 "GET /compute/v2.1/servers/cca08141-979e-4519-88b3-c77e8a71ae3e" status: 200 len: 1408 microversion: 2.20 time: 0.205456 May 14 15:53:32.452700 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: [pid: 128728|app: 0|req: 444/871] 10.222.0.61 () {60 vars in 1276 bytes} [Sat May 14 15:53:32 2022] GET /compute/v2.1/servers/cca08141-979e-4519-88b3-c77e8a71ae3e => generated 1408 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 14 15:53:32.857456 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi [req-42ca66a1-16b3-418f-a7a4-04f33b517b4a req-deb7a51b-114c-4413-a784-5298b606ddbe service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cca08141-979e-4519-88b3-c77e8a71ae3e", "tag": "e23afae5-7b01-4137-a087-ba1a741fd1f4"}]} {{(pid=128729) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 15:53:32.870169 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [req-42ca66a1-16b3-418f-a7a4-04f33b517b4a req-deb7a51b-114c-4413-a784-5298b606ddbe service nova] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:53:32.870652 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [req-42ca66a1-16b3-418f-a7a4-04f33b517b4a req-deb7a51b-114c-4413-a784-5298b606ddbe service nova] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:53:32.904963 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: INFO nova.api.openstack.compute.server_external_events [req-42ca66a1-16b3-418f-a7a4-04f33b517b4a req-deb7a51b-114c-4413-a784-5298b606ddbe service nova] Creating event network-changed:e23afae5-7b01-4137-a087-ba1a741fd1f4 for instance cca08141-979e-4519-88b3-c77e8a71ae3e on hv-cinder-83979 May 14 15:53:32.914585 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: INFO nova.api.openstack.requestlog [req-42ca66a1-16b3-418f-a7a4-04f33b517b4a req-deb7a51b-114c-4413-a784-5298b606ddbe service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.062260 May 14 15:53:32.923292 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: [pid: 128729|app: 0|req: 428/872] 10.222.0.61 () {64 vars in 1317 bytes} [Sat May 14 15:53:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 14 15:53:33.251219 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi [None req-ae7cf916-541e-494e-8827-d8652f53f5d0 tempest-TestMinimumBasicScenario-1817438735 tempest-TestMinimumBasicScenario-1817438735-project] Calling method '>' {{(pid=128728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 15:53:33.255507 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.compute.api [None req-ae7cf916-541e-494e-8827-d8652f53f5d0 tempest-TestMinimumBasicScenario-1817438735 tempest-TestMinimumBasicScenario-1817438735-project] [instance: ef63d04a-87e5-4202-a672-d45a2a877c68] Fetching instance by UUID {{(pid=128728) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 15:53:33.264830 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-ae7cf916-541e-494e-8827-d8652f53f5d0 tempest-TestMinimumBasicScenario-1817438735 tempest-TestMinimumBasicScenario-1817438735-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:53:33.269402 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-ae7cf916-541e-494e-8827-d8652f53f5d0 tempest-TestMinimumBasicScenario-1817438735 tempest-TestMinimumBasicScenario-1817438735-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:53:33.270756 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-ae7cf916-541e-494e-8827-d8652f53f5d0 tempest-TestMinimumBasicScenario-1817438735 tempest-TestMinimumBasicScenario-1817438735-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:53:33.271431 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-ae7cf916-541e-494e-8827-d8652f53f5d0 tempest-TestMinimumBasicScenario-1817438735 tempest-TestMinimumBasicScenario-1817438735-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:53:33.306234 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: INFO nova.api.openstack.requestlog [None req-ae7cf916-541e-494e-8827-d8652f53f5d0 tempest-TestMinimumBasicScenario-1817438735 tempest-TestMinimumBasicScenario-1817438735-project] 10.222.0.61 "GET /compute/v2.1/servers/ef63d04a-87e5-4202-a672-d45a2a877c68/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.062555 May 14 15:53:33.307250 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: [pid: 128728|app: 0|req: 445/873] 10.222.0.61 () {58 vars in 1301 bytes} [Sat May 14 15:53:33 2022] GET /compute/v2.1/servers/ef63d04a-87e5-4202-a672-d45a2a877c68/os-volume_attachments => generated 197 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 14 15:53:33.472290 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi [None req-cbb756a2-8a9e-4e9a-8082-f03150b8010d tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Calling method '>' {{(pid=128729) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 15:53:33.472989 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.compute.api [None req-cbb756a2-8a9e-4e9a-8082-f03150b8010d tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] [instance: cca08141-979e-4519-88b3-c77e8a71ae3e] Fetching instance by UUID {{(pid=128729) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 15:53:33.479149 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-cbb756a2-8a9e-4e9a-8082-f03150b8010d tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:53:33.479599 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-cbb756a2-8a9e-4e9a-8082-f03150b8010d tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:53:33.480376 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-cbb756a2-8a9e-4e9a-8082-f03150b8010d tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:53:33.481427 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-cbb756a2-8a9e-4e9a-8082-f03150b8010d tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:53:33.632773 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.policy [None req-cbb756a2-8a9e-4e9a-8082-f03150b8010d tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58bfb7417bc94583963401ae0fe9d39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0672be3fa3f7414da1c1a5b7300abbe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128729) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:53:33.640804 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.policy [None req-cbb756a2-8a9e-4e9a-8082-f03150b8010d tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58bfb7417bc94583963401ae0fe9d39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0672be3fa3f7414da1c1a5b7300abbe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128729) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:53:33.642232 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.policy [None req-cbb756a2-8a9e-4e9a-8082-f03150b8010d tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58bfb7417bc94583963401ae0fe9d39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0672be3fa3f7414da1c1a5b7300abbe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128729) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:53:33.643355 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: INFO nova.api.openstack.requestlog [None req-cbb756a2-8a9e-4e9a-8082-f03150b8010d tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] 10.222.0.61 "GET /compute/v2.1/servers/cca08141-979e-4519-88b3-c77e8a71ae3e" status: 200 len: 1408 microversion: 2.20 time: 0.175877 May 14 15:53:33.643908 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: [pid: 128729|app: 0|req: 429/874] 10.222.0.61 () {60 vars in 1276 bytes} [Sat May 14 15:53:33 2022] GET /compute/v2.1/servers/cca08141-979e-4519-88b3-c77e8a71ae3e => generated 1408 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 14 15:53:34.319768 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi [None req-8710425a-7246-4bea-b69c-29e79e502bfc tempest-TestMinimumBasicScenario-1817438735 tempest-TestMinimumBasicScenario-1817438735-project] Calling method '>' {{(pid=128728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 15:53:34.320681 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.compute.api [None req-8710425a-7246-4bea-b69c-29e79e502bfc tempest-TestMinimumBasicScenario-1817438735 tempest-TestMinimumBasicScenario-1817438735-project] [instance: ef63d04a-87e5-4202-a672-d45a2a877c68] Fetching instance by UUID {{(pid=128728) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 15:53:34.327674 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-8710425a-7246-4bea-b69c-29e79e502bfc tempest-TestMinimumBasicScenario-1817438735 tempest-TestMinimumBasicScenario-1817438735-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:53:34.328117 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-8710425a-7246-4bea-b69c-29e79e502bfc tempest-TestMinimumBasicScenario-1817438735 tempest-TestMinimumBasicScenario-1817438735-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:53:34.328876 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-8710425a-7246-4bea-b69c-29e79e502bfc tempest-TestMinimumBasicScenario-1817438735 tempest-TestMinimumBasicScenario-1817438735-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:53:34.329307 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-8710425a-7246-4bea-b69c-29e79e502bfc tempest-TestMinimumBasicScenario-1817438735 tempest-TestMinimumBasicScenario-1817438735-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:53:34.356694 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: INFO nova.api.openstack.requestlog [None req-8710425a-7246-4bea-b69c-29e79e502bfc tempest-TestMinimumBasicScenario-1817438735 tempest-TestMinimumBasicScenario-1817438735-project] 10.222.0.61 "GET /compute/v2.1/servers/ef63d04a-87e5-4202-a672-d45a2a877c68/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.040906 May 14 15:53:34.357249 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: [pid: 128728|app: 0|req: 446/875] 10.222.0.61 () {58 vars in 1301 bytes} [Sat May 14 15:53:34 2022] GET /compute/v2.1/servers/ef63d04a-87e5-4202-a672-d45a2a877c68/os-volume_attachments => generated 25 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 14 15:53:34.367265 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi [None req-e57e2f09-5eaa-4d0a-8be0-7fa0a3491781 tempest-TestMinimumBasicScenario-1817438735 tempest-TestMinimumBasicScenario-1817438735-project] Calling method '>' {{(pid=128729) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 15:53:34.367751 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.compute.api [None req-e57e2f09-5eaa-4d0a-8be0-7fa0a3491781 tempest-TestMinimumBasicScenario-1817438735 tempest-TestMinimumBasicScenario-1817438735-project] [instance: ef63d04a-87e5-4202-a672-d45a2a877c68] Fetching instance by UUID {{(pid=128729) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 15:53:34.373769 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-e57e2f09-5eaa-4d0a-8be0-7fa0a3491781 tempest-TestMinimumBasicScenario-1817438735 tempest-TestMinimumBasicScenario-1817438735-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:53:34.374223 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-e57e2f09-5eaa-4d0a-8be0-7fa0a3491781 tempest-TestMinimumBasicScenario-1817438735 tempest-TestMinimumBasicScenario-1817438735-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:53:34.375022 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-e57e2f09-5eaa-4d0a-8be0-7fa0a3491781 tempest-TestMinimumBasicScenario-1817438735 tempest-TestMinimumBasicScenario-1817438735-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:53:34.375464 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-e57e2f09-5eaa-4d0a-8be0-7fa0a3491781 tempest-TestMinimumBasicScenario-1817438735 tempest-TestMinimumBasicScenario-1817438735-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:53:34.448146 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: INFO nova.api.openstack.wsgi [None req-e57e2f09-5eaa-4d0a-8be0-7fa0a3491781 tempest-TestMinimumBasicScenario-1817438735 tempest-TestMinimumBasicScenario-1817438735-project] HTTP exception thrown: Instance ef63d04a-87e5-4202-a672-d45a2a877c68 is not attached to volume d946c5a0-5d65-4883-b9b2-c5943fa056fa May 14 15:53:34.459871 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi [None req-e57e2f09-5eaa-4d0a-8be0-7fa0a3491781 tempest-TestMinimumBasicScenario-1817438735 tempest-TestMinimumBasicScenario-1817438735-project] Request method failure captured: May 14 15:53:34.459871 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: request: DELETE /compute/v2.1/servers/ef63d04a-87e5-4202-a672-d45a2a877c68/os-volume_attachments/d946c5a0-5d65-4883-b9b2-c5943fa056fa HTTP/1.1 May 14 15:53:34.459871 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: Accept: application/json May 14 15:53:34.459871 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: Accept-Encoding: identity May 14 15:53:34.459871 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: Connection: close May 14 15:53:34.459871 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: Content-Length: 0 May 14 15:53:34.459871 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: Content-Type: application/json May 14 15:53:34.459871 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: Host: 10.222.0.61 May 14 15:53:34.459871 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: Openstack-System-Scope: None May 14 15:53:34.459871 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: User-Agent: python-urllib3/1.26.9 May 14 15:53:34.459871 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: X-Auth-Token: gAAAAABif89MvX_GLHsscRl9CrqCpqU9WF-M4V5nsOhfqrvSXmD7odgzej97xrbWQQjGuy3Wz19rPXOipsaiamuPS04_hpmmgHMbtU_WSIdl8T8Vo22RVSyjAi5GBdmjl9TX_OVHQFGCY6vRABt1glYjbkBL5pUgx04yZOMMzRHVb6M22_6qzQI May 14 15:53:34.459871 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: X-Domain-Id: None May 14 15:53:34.459871 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: X-Domain-Name: None May 14 15:53:34.459871 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: X-Identity-Status: Confirmed May 14 15:53:34.459871 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: X-Is-Admin-Project: True May 14 15:53:34.459871 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: X-Project-Domain-Id: default May 14 15:53:34.459871 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: X-Project-Domain-Name: Default May 14 15:53:34.459871 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: X-Project-Id: 5fba11e8ade54d388361c4c936a43372 May 14 15:53:34.459871 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: X-Project-Name: tempest-TestMinimumBasicScenario-1817438735 May 14 15:53:34.459871 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: X-Role: reader,member May 14 15:53:34.459871 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: X-Roles: reader,member May 14 15:53:34.461556 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/5fba11e8ade54d388361c4c936a43372"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/5fba11e8ade54d388361c4c936a43372"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/5fba11e8ade54d388361c4c936a43372"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_5fba11e8ade54d388361c4c936a43372"}]}] May 14 15:53:34.461556 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: X-Tenant: tempest-TestMinimumBasicScenario-1817438735 May 14 15:53:34.461556 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: X-Tenant-Id: 5fba11e8ade54d388361c4c936a43372 May 14 15:53:34.461556 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1817438735 May 14 15:53:34.461556 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: X-User: tempest-TestMinimumBasicScenario-1817438735-project May 14 15:53:34.461556 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: X-User-Domain-Id: default May 14 15:53:34.461556 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: X-User-Domain-Name: Default May 14 15:53:34.461556 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: X-User-Id: 6d5f259e0b98457ea6b6b88d886c813d May 14 15:53:34.461556 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: X-User-Name: tempest-TestMinimumBasicScenario-1817438735-project May 14 15:53:34.461556 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: method: > May 14 15:53:34.461556 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: exception: Instance ef63d04a-87e5-4202-a672-d45a2a877c68 is not attached to volume d946c5a0-5d65-4883-b9b2-c5943fa056fa May 14 15:53:34.462480 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: action_args: {'server_id': 'ef63d04a-87e5-4202-a672-d45a2a877c68', 'id': 'd946c5a0-5d65-4883-b9b2-c5943fa056fa'} May 14 15:53:34.462480 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: {{(pid=128729) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 14 15:53:34.462480 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 15:53:34.462480 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete May 14 15:53:34.462480 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( May 14 15:53:34.462480 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper May 14 15:53:34.462480 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) May 14 15:53:34.462480 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 281, in get_by_volume_and_instance May 14 15:53:34.462480 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) May 14 15:53:34.462480 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id d946c5a0-5d65-4883-b9b2-c5943fa056fa. May 14 15:53:34.462480 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: ERROR nova.api.openstack.wsgi May 14 15:53:34.462480 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 14 15:53:34.462480 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: ERROR nova.api.openstack.wsgi May 14 15:53:34.462480 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 15:53:34.462480 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 14 15:53:34.462480 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 14 15:53:34.462480 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 14 15:53:34.462480 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 14 15:53:34.462480 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 14 15:53:34.463906 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 14 15:53:34.463906 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete May 14 15:53:34.463906 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) May 14 15:53:34.463906 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ef63d04a-87e5-4202-a672-d45a2a877c68 is not attached to volume d946c5a0-5d65-4883-b9b2-c5943fa056fa May 14 15:53:34.463906 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: ERROR nova.api.openstack.wsgi May 14 15:53:34.463906 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 14 15:53:34.463906 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: ERROR nova.api.openstack.wsgi May 14 15:53:34.463906 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 15:53:34.463906 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 14 15:53:34.463906 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 14 15:53:34.463906 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 14 15:53:34.463906 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 14 15:53:34.463906 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ef63d04a-87e5-4202-a672-d45a2a877c68 is not attached to volume d946c5a0-5d65-4883-b9b2-c5943fa056fa May 14 15:53:34.463906 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: ERROR nova.api.openstack.wsgi May 14 15:53:34.463906 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi [None req-e57e2f09-5eaa-4d0a-8be0-7fa0a3491781 tempest-TestMinimumBasicScenario-1817438735 tempest-TestMinimumBasicScenario-1817438735-project] Returning 404 to user: Instance ef63d04a-87e5-4202-a672-d45a2a877c68 is not attached to volume d946c5a0-5d65-4883-b9b2-c5943fa056fa {{(pid=128729) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 14 15:53:34.465052 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: INFO nova.api.openstack.requestlog [None req-e57e2f09-5eaa-4d0a-8be0-7fa0a3491781 tempest-TestMinimumBasicScenario-1817438735 tempest-TestMinimumBasicScenario-1817438735-project] 10.222.0.61 "DELETE /compute/v2.1/servers/ef63d04a-87e5-4202-a672-d45a2a877c68/os-volume_attachments/d946c5a0-5d65-4883-b9b2-c5943fa056fa" status: 404 len: 154 microversion: 2.1 time: 0.098433 May 14 15:53:34.465052 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: [pid: 128729|app: 0|req: 430/876] 10.222.0.61 () {58 vars in 1415 bytes} [Sat May 14 15:53:34 2022] DELETE /compute/v2.1/servers/ef63d04a-87e5-4202-a672-d45a2a877c68/os-volume_attachments/d946c5a0-5d65-4883-b9b2-c5943fa056fa => generated 154 bytes in 99 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 14 15:53:34.660829 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi [None req-aca95648-42d3-4172-8d0e-67e1b8d69adb tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Calling method '>' {{(pid=128728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 15:53:34.661437 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.compute.api [None req-aca95648-42d3-4172-8d0e-67e1b8d69adb tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] [instance: cca08141-979e-4519-88b3-c77e8a71ae3e] Fetching instance by UUID {{(pid=128728) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 15:53:34.667268 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-aca95648-42d3-4172-8d0e-67e1b8d69adb tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:53:34.667722 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-aca95648-42d3-4172-8d0e-67e1b8d69adb tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:53:34.668489 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-aca95648-42d3-4172-8d0e-67e1b8d69adb tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:53:34.668931 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-aca95648-42d3-4172-8d0e-67e1b8d69adb tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:53:34.795188 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.policy [None req-aca95648-42d3-4172-8d0e-67e1b8d69adb tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58bfb7417bc94583963401ae0fe9d39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0672be3fa3f7414da1c1a5b7300abbe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128728) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:53:34.802865 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.policy [None req-aca95648-42d3-4172-8d0e-67e1b8d69adb tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58bfb7417bc94583963401ae0fe9d39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0672be3fa3f7414da1c1a5b7300abbe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128728) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:53:34.804372 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.policy [None req-aca95648-42d3-4172-8d0e-67e1b8d69adb tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58bfb7417bc94583963401ae0fe9d39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0672be3fa3f7414da1c1a5b7300abbe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128728) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:53:34.805475 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: INFO nova.api.openstack.requestlog [None req-aca95648-42d3-4172-8d0e-67e1b8d69adb tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] 10.222.0.61 "GET /compute/v2.1/servers/cca08141-979e-4519-88b3-c77e8a71ae3e" status: 200 len: 1408 microversion: 2.20 time: 0.148512 May 14 15:53:34.806032 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: [pid: 128728|app: 0|req: 447/877] 10.222.0.61 () {60 vars in 1276 bytes} [Sat May 14 15:53:34 2022] GET /compute/v2.1/servers/cca08141-979e-4519-88b3-c77e8a71ae3e => generated 1408 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 14 15:53:35.730746 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi [None req-ef0056da-80c1-49a6-b73c-a67ad56191f6 tempest-TestMinimumBasicScenario-1817438735 tempest-TestMinimumBasicScenario-1817438735-project] Calling method '>' {{(pid=128729) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 15:53:35.731571 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.compute.api [None req-ef0056da-80c1-49a6-b73c-a67ad56191f6 tempest-TestMinimumBasicScenario-1817438735 tempest-TestMinimumBasicScenario-1817438735-project] [instance: ef63d04a-87e5-4202-a672-d45a2a877c68] Fetching instance by UUID {{(pid=128729) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 15:53:35.738988 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-ef0056da-80c1-49a6-b73c-a67ad56191f6 tempest-TestMinimumBasicScenario-1817438735 tempest-TestMinimumBasicScenario-1817438735-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:53:35.739430 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-ef0056da-80c1-49a6-b73c-a67ad56191f6 tempest-TestMinimumBasicScenario-1817438735 tempest-TestMinimumBasicScenario-1817438735-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:53:35.740647 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-ef0056da-80c1-49a6-b73c-a67ad56191f6 tempest-TestMinimumBasicScenario-1817438735 tempest-TestMinimumBasicScenario-1817438735-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:53:35.741084 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-ef0056da-80c1-49a6-b73c-a67ad56191f6 tempest-TestMinimumBasicScenario-1817438735 tempest-TestMinimumBasicScenario-1817438735-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:53:35.768555 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.compute.api [None req-ef0056da-80c1-49a6-b73c-a67ad56191f6 tempest-TestMinimumBasicScenario-1817438735 tempest-TestMinimumBasicScenario-1817438735-project] [instance: ef63d04a-87e5-4202-a672-d45a2a877c68] Going to try to terminate instance {{(pid=128729) delete /opt/stack/nova/nova/compute/api.py:2664}} May 14 15:53:35.824765 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi [None req-6da528c2-973f-4e3a-91a5-e9fa79799478 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Calling method '>' {{(pid=128728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 15:53:35.826002 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.compute.api [None req-6da528c2-973f-4e3a-91a5-e9fa79799478 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] [instance: cca08141-979e-4519-88b3-c77e8a71ae3e] Fetching instance by UUID {{(pid=128728) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 15:53:35.836230 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-6da528c2-973f-4e3a-91a5-e9fa79799478 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:53:35.837498 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-6da528c2-973f-4e3a-91a5-e9fa79799478 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:53:35.837951 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: INFO nova.api.openstack.requestlog [None req-ef0056da-80c1-49a6-b73c-a67ad56191f6 tempest-TestMinimumBasicScenario-1817438735 tempest-TestMinimumBasicScenario-1817438735-project] 10.222.0.61 "DELETE /compute/v2.1/servers/ef63d04a-87e5-4202-a672-d45a2a877c68" status: 204 len: 0 microversion: 2.1 time: 0.111419 May 14 15:53:35.838488 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-6da528c2-973f-4e3a-91a5-e9fa79799478 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:53:35.838618 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: [pid: 128729|app: 0|req: 431/878] 10.222.0.61 () {58 vars in 1238 bytes} [Sat May 14 15:53:35 2022] DELETE /compute/v2.1/servers/ef63d04a-87e5-4202-a672-d45a2a877c68 => generated 0 bytes in 113 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 14 15:53:35.842588 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-6da528c2-973f-4e3a-91a5-e9fa79799478 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:53:35.847433 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi [None req-b33ddf93-ef4c-463e-8127-5c3975d953ef tempest-TestMinimumBasicScenario-1817438735 tempest-TestMinimumBasicScenario-1817438735-project] Calling method '>' {{(pid=128729) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 15:53:35.848123 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.compute.api [None req-b33ddf93-ef4c-463e-8127-5c3975d953ef tempest-TestMinimumBasicScenario-1817438735 tempest-TestMinimumBasicScenario-1817438735-project] [instance: ef63d04a-87e5-4202-a672-d45a2a877c68] Fetching instance by UUID {{(pid=128729) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 15:53:35.854258 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-b33ddf93-ef4c-463e-8127-5c3975d953ef tempest-TestMinimumBasicScenario-1817438735 tempest-TestMinimumBasicScenario-1817438735-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:53:35.854258 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-b33ddf93-ef4c-463e-8127-5c3975d953ef tempest-TestMinimumBasicScenario-1817438735 tempest-TestMinimumBasicScenario-1817438735-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:53:35.855054 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-b33ddf93-ef4c-463e-8127-5c3975d953ef tempest-TestMinimumBasicScenario-1817438735 tempest-TestMinimumBasicScenario-1817438735-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:53:35.855457 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-b33ddf93-ef4c-463e-8127-5c3975d953ef tempest-TestMinimumBasicScenario-1817438735 tempest-TestMinimumBasicScenario-1817438735-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:53:36.039415 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.policy [None req-6da528c2-973f-4e3a-91a5-e9fa79799478 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58bfb7417bc94583963401ae0fe9d39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0672be3fa3f7414da1c1a5b7300abbe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128728) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:53:36.043420 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.policy [None req-b33ddf93-ef4c-463e-8127-5c3975d953ef tempest-TestMinimumBasicScenario-1817438735 tempest-TestMinimumBasicScenario-1817438735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d5f259e0b98457ea6b6b88d886c813d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fba11e8ade54d388361c4c936a43372', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128729) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:53:36.047648 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.policy [None req-6da528c2-973f-4e3a-91a5-e9fa79799478 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58bfb7417bc94583963401ae0fe9d39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0672be3fa3f7414da1c1a5b7300abbe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128728) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:53:36.049158 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.policy [None req-6da528c2-973f-4e3a-91a5-e9fa79799478 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58bfb7417bc94583963401ae0fe9d39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0672be3fa3f7414da1c1a5b7300abbe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128728) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:53:36.050268 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: INFO nova.api.openstack.requestlog [None req-6da528c2-973f-4e3a-91a5-e9fa79799478 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] 10.222.0.61 "GET /compute/v2.1/servers/cca08141-979e-4519-88b3-c77e8a71ae3e" status: 200 len: 1408 microversion: 2.20 time: 0.230125 May 14 15:53:36.050875 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: [pid: 128728|app: 0|req: 448/879] 10.222.0.61 () {60 vars in 1276 bytes} [Sat May 14 15:53:35 2022] GET /compute/v2.1/servers/cca08141-979e-4519-88b3-c77e8a71ae3e => generated 1408 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 14 15:53:36.051267 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: INFO nova.api.openstack.requestlog [None req-b33ddf93-ef4c-463e-8127-5c3975d953ef tempest-TestMinimumBasicScenario-1817438735 tempest-TestMinimumBasicScenario-1817438735-project] 10.222.0.61 "GET /compute/v2.1/servers/ef63d04a-87e5-4202-a672-d45a2a877c68" status: 200 len: 1671 microversion: 2.1 time: 0.207789 May 14 15:53:36.051914 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: [pid: 128729|app: 0|req: 432/880] 10.222.0.61 () {58 vars in 1235 bytes} [Sat May 14 15:53:35 2022] GET /compute/v2.1/servers/ef63d04a-87e5-4202-a672-d45a2a877c68 => generated 1671 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 15:53:37.069014 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi [None req-e7a370c3-fa7a-45f4-be06-d23f7cdcdec6 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Calling method '>' {{(pid=128729) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 15:53:37.069695 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi [None req-8693fd97-3b9d-4f22-aed1-d220fa9b9940 tempest-TestMinimumBasicScenario-1817438735 tempest-TestMinimumBasicScenario-1817438735-project] Calling method '>' {{(pid=128728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 15:53:37.070071 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.compute.api [None req-e7a370c3-fa7a-45f4-be06-d23f7cdcdec6 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] [instance: cca08141-979e-4519-88b3-c77e8a71ae3e] Fetching instance by UUID {{(pid=128729) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 15:53:37.070176 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.compute.api [None req-8693fd97-3b9d-4f22-aed1-d220fa9b9940 tempest-TestMinimumBasicScenario-1817438735 tempest-TestMinimumBasicScenario-1817438735-project] [instance: ef63d04a-87e5-4202-a672-d45a2a877c68] Fetching instance by UUID {{(pid=128728) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 15:53:37.077607 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-e7a370c3-fa7a-45f4-be06-d23f7cdcdec6 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:53:37.077797 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-8693fd97-3b9d-4f22-aed1-d220fa9b9940 tempest-TestMinimumBasicScenario-1817438735 tempest-TestMinimumBasicScenario-1817438735-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:53:37.078141 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-e7a370c3-fa7a-45f4-be06-d23f7cdcdec6 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:53:37.078359 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-8693fd97-3b9d-4f22-aed1-d220fa9b9940 tempest-TestMinimumBasicScenario-1817438735 tempest-TestMinimumBasicScenario-1817438735-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:53:37.079433 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-8693fd97-3b9d-4f22-aed1-d220fa9b9940 tempest-TestMinimumBasicScenario-1817438735 tempest-TestMinimumBasicScenario-1817438735-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:53:37.079921 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-8693fd97-3b9d-4f22-aed1-d220fa9b9940 tempest-TestMinimumBasicScenario-1817438735 tempest-TestMinimumBasicScenario-1817438735-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:53:37.080046 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-e7a370c3-fa7a-45f4-be06-d23f7cdcdec6 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:53:37.080493 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-e7a370c3-fa7a-45f4-be06-d23f7cdcdec6 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:53:37.284538 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.policy [None req-e7a370c3-fa7a-45f4-be06-d23f7cdcdec6 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58bfb7417bc94583963401ae0fe9d39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0672be3fa3f7414da1c1a5b7300abbe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128729) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:53:37.287932 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.policy [None req-8693fd97-3b9d-4f22-aed1-d220fa9b9940 tempest-TestMinimumBasicScenario-1817438735 tempest-TestMinimumBasicScenario-1817438735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d5f259e0b98457ea6b6b88d886c813d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fba11e8ade54d388361c4c936a43372', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128728) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:53:37.293088 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.policy [None req-e7a370c3-fa7a-45f4-be06-d23f7cdcdec6 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58bfb7417bc94583963401ae0fe9d39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0672be3fa3f7414da1c1a5b7300abbe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128729) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:53:37.294743 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.policy [None req-e7a370c3-fa7a-45f4-be06-d23f7cdcdec6 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58bfb7417bc94583963401ae0fe9d39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0672be3fa3f7414da1c1a5b7300abbe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128729) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:53:37.295928 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: INFO nova.api.openstack.requestlog [None req-e7a370c3-fa7a-45f4-be06-d23f7cdcdec6 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] 10.222.0.61 "GET /compute/v2.1/servers/cca08141-979e-4519-88b3-c77e8a71ae3e" status: 200 len: 1408 microversion: 2.20 time: 0.230821 May 14 15:53:37.296559 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: [pid: 128729|app: 0|req: 433/881] 10.222.0.61 () {60 vars in 1276 bytes} [Sat May 14 15:53:37 2022] GET /compute/v2.1/servers/cca08141-979e-4519-88b3-c77e8a71ae3e => generated 1408 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 14 15:53:37.297088 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: INFO nova.api.openstack.requestlog [None req-8693fd97-3b9d-4f22-aed1-d220fa9b9940 tempest-TestMinimumBasicScenario-1817438735 tempest-TestMinimumBasicScenario-1817438735-project] 10.222.0.61 "GET /compute/v2.1/servers/ef63d04a-87e5-4202-a672-d45a2a877c68" status: 200 len: 1552 microversion: 2.1 time: 0.231848 May 14 15:53:37.297710 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: [pid: 128728|app: 0|req: 449/882] 10.222.0.61 () {58 vars in 1235 bytes} [Sat May 14 15:53:37 2022] GET /compute/v2.1/servers/ef63d04a-87e5-4202-a672-d45a2a877c68 => generated 1552 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 15:53:38.314537 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi [None req-89204a2c-7fac-4e02-b981-f706c13d4df4 tempest-TestMinimumBasicScenario-1817438735 tempest-TestMinimumBasicScenario-1817438735-project] Calling method '>' {{(pid=128728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 15:53:38.315209 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.compute.api [None req-89204a2c-7fac-4e02-b981-f706c13d4df4 tempest-TestMinimumBasicScenario-1817438735 tempest-TestMinimumBasicScenario-1817438735-project] [instance: ef63d04a-87e5-4202-a672-d45a2a877c68] Fetching instance by UUID {{(pid=128728) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 15:53:38.322799 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi [None req-5bafd4be-c671-4a9b-827b-0ef978260374 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Calling method '>' {{(pid=128729) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 15:53:38.323402 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.compute.api [None req-5bafd4be-c671-4a9b-827b-0ef978260374 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] [instance: cca08141-979e-4519-88b3-c77e8a71ae3e] Fetching instance by UUID {{(pid=128729) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 15:53:38.329804 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-89204a2c-7fac-4e02-b981-f706c13d4df4 tempest-TestMinimumBasicScenario-1817438735 tempest-TestMinimumBasicScenario-1817438735-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:53:38.330002 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-5bafd4be-c671-4a9b-827b-0ef978260374 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:53:38.330265 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-89204a2c-7fac-4e02-b981-f706c13d4df4 tempest-TestMinimumBasicScenario-1817438735 tempest-TestMinimumBasicScenario-1817438735-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:53:38.330493 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-5bafd4be-c671-4a9b-827b-0ef978260374 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:53:38.331085 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-89204a2c-7fac-4e02-b981-f706c13d4df4 tempest-TestMinimumBasicScenario-1817438735 tempest-TestMinimumBasicScenario-1817438735-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:53:38.331277 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-5bafd4be-c671-4a9b-827b-0ef978260374 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:53:38.331524 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-89204a2c-7fac-4e02-b981-f706c13d4df4 tempest-TestMinimumBasicScenario-1817438735 tempest-TestMinimumBasicScenario-1817438735-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:53:38.331718 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-5bafd4be-c671-4a9b-827b-0ef978260374 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:53:38.524939 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.policy [None req-5bafd4be-c671-4a9b-827b-0ef978260374 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58bfb7417bc94583963401ae0fe9d39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0672be3fa3f7414da1c1a5b7300abbe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128729) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:53:38.529594 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.policy [None req-89204a2c-7fac-4e02-b981-f706c13d4df4 tempest-TestMinimumBasicScenario-1817438735 tempest-TestMinimumBasicScenario-1817438735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d5f259e0b98457ea6b6b88d886c813d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fba11e8ade54d388361c4c936a43372', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128728) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:53:38.533525 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.policy [None req-5bafd4be-c671-4a9b-827b-0ef978260374 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58bfb7417bc94583963401ae0fe9d39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0672be3fa3f7414da1c1a5b7300abbe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128729) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:53:38.535057 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.policy [None req-5bafd4be-c671-4a9b-827b-0ef978260374 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58bfb7417bc94583963401ae0fe9d39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0672be3fa3f7414da1c1a5b7300abbe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128729) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:53:38.536143 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: INFO nova.api.openstack.requestlog [None req-5bafd4be-c671-4a9b-827b-0ef978260374 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] 10.222.0.61 "GET /compute/v2.1/servers/cca08141-979e-4519-88b3-c77e8a71ae3e" status: 200 len: 1408 microversion: 2.20 time: 0.217122 May 14 15:53:38.536701 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: [pid: 128729|app: 0|req: 434/883] 10.222.0.61 () {60 vars in 1276 bytes} [Sat May 14 15:53:38 2022] GET /compute/v2.1/servers/cca08141-979e-4519-88b3-c77e8a71ae3e => generated 1408 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 14 15:53:38.536846 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: INFO nova.api.openstack.requestlog [None req-89204a2c-7fac-4e02-b981-f706c13d4df4 tempest-TestMinimumBasicScenario-1817438735 tempest-TestMinimumBasicScenario-1817438735-project] 10.222.0.61 "GET /compute/v2.1/servers/ef63d04a-87e5-4202-a672-d45a2a877c68" status: 200 len: 1552 microversion: 2.1 time: 0.226215 May 14 15:53:38.537317 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: [pid: 128728|app: 0|req: 450/884] 10.222.0.61 () {58 vars in 1235 bytes} [Sat May 14 15:53:38 2022] GET /compute/v2.1/servers/ef63d04a-87e5-4202-a672-d45a2a877c68 => generated 1552 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 15:53:39.315798 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi [req-c1fc26b8-f3b4-4667-bf00-4272f641a451 req-6633fe63-bf16-4eed-9fec-343d828ed24b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ef63d04a-87e5-4202-a672-d45a2a877c68", "name": "network-vif-deleted", "tag": "61226c22-8028-48c9-8e04-0f0c0cf9fa30"}]} {{(pid=128729) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 15:53:39.323823 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [req-c1fc26b8-f3b4-4667-bf00-4272f641a451 req-6633fe63-bf16-4eed-9fec-343d828ed24b service nova] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:53:39.324482 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [req-c1fc26b8-f3b4-4667-bf00-4272f641a451 req-6633fe63-bf16-4eed-9fec-343d828ed24b service nova] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:53:39.337718 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: INFO nova.api.openstack.compute.server_external_events [req-c1fc26b8-f3b4-4667-bf00-4272f641a451 req-6633fe63-bf16-4eed-9fec-343d828ed24b service nova] Creating event network-vif-deleted:61226c22-8028-48c9-8e04-0f0c0cf9fa30 for instance ef63d04a-87e5-4202-a672-d45a2a877c68 on hv-cinder-83979 May 14 15:53:39.343643 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: INFO nova.api.openstack.requestlog [req-c1fc26b8-f3b4-4667-bf00-4272f641a451 req-6633fe63-bf16-4eed-9fec-343d828ed24b service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031310 May 14 15:53:39.344614 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: [pid: 128729|app: 0|req: 435/885] 10.222.0.61 () {64 vars in 1317 bytes} [Sat May 14 15:53:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 14 15:53:39.520815 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi [req-6436ae74-d87e-418d-bcd4-a10d0525377f req-0dcd8a2b-cf72-480a-a89a-9fed0f5867f1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cca08141-979e-4519-88b3-c77e8a71ae3e", "name": "network-vif-plugged", "status": "completed", "tag": "e23afae5-7b01-4137-a087-ba1a741fd1f4"}]} {{(pid=128728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 15:53:39.529956 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [req-6436ae74-d87e-418d-bcd4-a10d0525377f req-0dcd8a2b-cf72-480a-a89a-9fed0f5867f1 service nova] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:53:39.530494 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [req-6436ae74-d87e-418d-bcd4-a10d0525377f req-0dcd8a2b-cf72-480a-a89a-9fed0f5867f1 service nova] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:53:39.541513 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: INFO nova.api.openstack.compute.server_external_events [req-6436ae74-d87e-418d-bcd4-a10d0525377f req-0dcd8a2b-cf72-480a-a89a-9fed0f5867f1 service nova] Creating event network-vif-plugged:e23afae5-7b01-4137-a087-ba1a741fd1f4 for instance cca08141-979e-4519-88b3-c77e8a71ae3e on hv-cinder-83979 May 14 15:53:39.547048 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: INFO nova.api.openstack.requestlog [req-6436ae74-d87e-418d-bcd4-a10d0525377f req-0dcd8a2b-cf72-480a-a89a-9fed0f5867f1 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029939 May 14 15:53:39.547660 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: [pid: 128728|app: 0|req: 451/886] 10.222.0.61 () {64 vars in 1317 bytes} [Sat May 14 15:53:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 14 15:53:39.553859 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi [None req-5993e763-8329-44ff-a3c6-58eb3c11916c tempest-TestMinimumBasicScenario-1817438735 tempest-TestMinimumBasicScenario-1817438735-project] Calling method '>' {{(pid=128729) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 15:53:39.554067 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi [None req-af0c383b-2a8f-4993-ab0a-a4609a65e8e4 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Calling method '>' {{(pid=128728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 15:53:39.554921 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.compute.api [None req-af0c383b-2a8f-4993-ab0a-a4609a65e8e4 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] [instance: cca08141-979e-4519-88b3-c77e8a71ae3e] Fetching instance by UUID {{(pid=128728) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 15:53:39.555374 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.compute.api [None req-5993e763-8329-44ff-a3c6-58eb3c11916c tempest-TestMinimumBasicScenario-1817438735 tempest-TestMinimumBasicScenario-1817438735-project] [instance: ef63d04a-87e5-4202-a672-d45a2a877c68] Fetching instance by UUID {{(pid=128729) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 15:53:39.561609 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-af0c383b-2a8f-4993-ab0a-a4609a65e8e4 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:53:39.562065 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-af0c383b-2a8f-4993-ab0a-a4609a65e8e4 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:53:39.562792 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-5993e763-8329-44ff-a3c6-58eb3c11916c tempest-TestMinimumBasicScenario-1817438735 tempest-TestMinimumBasicScenario-1817438735-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:53:39.563052 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-af0c383b-2a8f-4993-ab0a-a4609a65e8e4 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:53:39.563390 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-5993e763-8329-44ff-a3c6-58eb3c11916c tempest-TestMinimumBasicScenario-1817438735 tempest-TestMinimumBasicScenario-1817438735-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:53:39.563495 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-af0c383b-2a8f-4993-ab0a-a4609a65e8e4 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:53:39.564277 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-5993e763-8329-44ff-a3c6-58eb3c11916c tempest-TestMinimumBasicScenario-1817438735 tempest-TestMinimumBasicScenario-1817438735-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:53:39.564921 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-5993e763-8329-44ff-a3c6-58eb3c11916c tempest-TestMinimumBasicScenario-1817438735 tempest-TestMinimumBasicScenario-1817438735-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:53:39.595875 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-5993e763-8329-44ff-a3c6-58eb3c11916c tempest-TestMinimumBasicScenario-1817438735 tempest-TestMinimumBasicScenario-1817438735-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:53:39.596393 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-5993e763-8329-44ff-a3c6-58eb3c11916c tempest-TestMinimumBasicScenario-1817438735 tempest-TestMinimumBasicScenario-1817438735-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:53:39.596914 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.objects.instance [None req-5993e763-8329-44ff-a3c6-58eb3c11916c tempest-TestMinimumBasicScenario-1817438735 tempest-TestMinimumBasicScenario-1817438735-project] Lazy-loading 'fault' on Instance uuid ef63d04a-87e5-4202-a672-d45a2a877c68 {{(pid=128729) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 14 15:53:39.661790 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.policy [None req-5993e763-8329-44ff-a3c6-58eb3c11916c tempest-TestMinimumBasicScenario-1817438735 tempest-TestMinimumBasicScenario-1817438735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d5f259e0b98457ea6b6b88d886c813d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fba11e8ade54d388361c4c936a43372', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128729) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:53:39.669901 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: INFO nova.api.openstack.requestlog [None req-5993e763-8329-44ff-a3c6-58eb3c11916c tempest-TestMinimumBasicScenario-1817438735 tempest-TestMinimumBasicScenario-1817438735-project] 10.222.0.61 "GET /compute/v2.1/servers/ef63d04a-87e5-4202-a672-d45a2a877c68" status: 200 len: 1347 microversion: 2.1 time: 0.120033 May 14 15:53:39.677444 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: [pid: 128729|app: 0|req: 436/887] 10.222.0.61 () {58 vars in 1235 bytes} [Sat May 14 15:53:39 2022] GET /compute/v2.1/servers/ef63d04a-87e5-4202-a672-d45a2a877c68 => generated 1347 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 15:53:39.729985 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.policy [None req-af0c383b-2a8f-4993-ab0a-a4609a65e8e4 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58bfb7417bc94583963401ae0fe9d39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0672be3fa3f7414da1c1a5b7300abbe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128728) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:53:39.739056 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.policy [None req-af0c383b-2a8f-4993-ab0a-a4609a65e8e4 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58bfb7417bc94583963401ae0fe9d39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0672be3fa3f7414da1c1a5b7300abbe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128728) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:53:39.740926 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.policy [None req-af0c383b-2a8f-4993-ab0a-a4609a65e8e4 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58bfb7417bc94583963401ae0fe9d39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0672be3fa3f7414da1c1a5b7300abbe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128728) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:53:39.742045 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: INFO nova.api.openstack.requestlog [None req-af0c383b-2a8f-4993-ab0a-a4609a65e8e4 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] 10.222.0.61 "GET /compute/v2.1/servers/cca08141-979e-4519-88b3-c77e8a71ae3e" status: 200 len: 1408 microversion: 2.20 time: 0.191936 May 14 15:53:39.742638 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: [pid: 128728|app: 0|req: 452/888] 10.222.0.61 () {60 vars in 1276 bytes} [Sat May 14 15:53:39 2022] GET /compute/v2.1/servers/cca08141-979e-4519-88b3-c77e8a71ae3e => generated 1408 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 14 15:53:40.691296 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi [None req-6cd0e6d1-3ba8-4761-97d1-9c6e5b4d9536 tempest-TestMinimumBasicScenario-1817438735 tempest-TestMinimumBasicScenario-1817438735-project] Calling method '>' {{(pid=128729) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 15:53:40.691902 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.compute.api [None req-6cd0e6d1-3ba8-4761-97d1-9c6e5b4d9536 tempest-TestMinimumBasicScenario-1817438735 tempest-TestMinimumBasicScenario-1817438735-project] [instance: ef63d04a-87e5-4202-a672-d45a2a877c68] Fetching instance by UUID {{(pid=128729) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 15:53:40.698264 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-6cd0e6d1-3ba8-4761-97d1-9c6e5b4d9536 tempest-TestMinimumBasicScenario-1817438735 tempest-TestMinimumBasicScenario-1817438735-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:53:40.698736 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-6cd0e6d1-3ba8-4761-97d1-9c6e5b4d9536 tempest-TestMinimumBasicScenario-1817438735 tempest-TestMinimumBasicScenario-1817438735-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:53:40.699507 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-6cd0e6d1-3ba8-4761-97d1-9c6e5b4d9536 tempest-TestMinimumBasicScenario-1817438735 tempest-TestMinimumBasicScenario-1817438735-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:53:40.700063 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-6cd0e6d1-3ba8-4761-97d1-9c6e5b4d9536 tempest-TestMinimumBasicScenario-1817438735 tempest-TestMinimumBasicScenario-1817438735-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:53:40.715670 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: INFO nova.api.openstack.wsgi [None req-6cd0e6d1-3ba8-4761-97d1-9c6e5b4d9536 tempest-TestMinimumBasicScenario-1817438735 tempest-TestMinimumBasicScenario-1817438735-project] HTTP exception thrown: Instance ef63d04a-87e5-4202-a672-d45a2a877c68 could not be found. May 14 15:53:40.717472 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi [None req-6cd0e6d1-3ba8-4761-97d1-9c6e5b4d9536 tempest-TestMinimumBasicScenario-1817438735 tempest-TestMinimumBasicScenario-1817438735-project] Request method failure captured: May 14 15:53:40.717472 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: request: GET /compute/v2.1/servers/ef63d04a-87e5-4202-a672-d45a2a877c68 HTTP/1.1 May 14 15:53:40.717472 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: Accept: application/json May 14 15:53:40.717472 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: Accept-Encoding: identity May 14 15:53:40.717472 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: Connection: close May 14 15:53:40.717472 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: Content-Length: 0 May 14 15:53:40.717472 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: Content-Type: application/json May 14 15:53:40.717472 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: Host: 10.222.0.61 May 14 15:53:40.717472 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: Openstack-System-Scope: None May 14 15:53:40.717472 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: User-Agent: python-urllib3/1.26.9 May 14 15:53:40.717472 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: X-Auth-Token: gAAAAABif89MvX_GLHsscRl9CrqCpqU9WF-M4V5nsOhfqrvSXmD7odgzej97xrbWQQjGuy3Wz19rPXOipsaiamuPS04_hpmmgHMbtU_WSIdl8T8Vo22RVSyjAi5GBdmjl9TX_OVHQFGCY6vRABt1glYjbkBL5pUgx04yZOMMzRHVb6M22_6qzQI May 14 15:53:40.717472 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: X-Domain-Id: None May 14 15:53:40.717472 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: X-Domain-Name: None May 14 15:53:40.717472 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: X-Identity-Status: Confirmed May 14 15:53:40.717472 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: X-Is-Admin-Project: True May 14 15:53:40.717472 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: X-Project-Domain-Id: default May 14 15:53:40.717472 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: X-Project-Domain-Name: Default May 14 15:53:40.717472 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: X-Project-Id: 5fba11e8ade54d388361c4c936a43372 May 14 15:53:40.717472 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: X-Project-Name: tempest-TestMinimumBasicScenario-1817438735 May 14 15:53:40.717472 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: X-Role: reader,member May 14 15:53:40.717472 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: X-Roles: reader,member May 14 15:53:40.719118 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/5fba11e8ade54d388361c4c936a43372"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/5fba11e8ade54d388361c4c936a43372"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/5fba11e8ade54d388361c4c936a43372"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_5fba11e8ade54d388361c4c936a43372"}]}] May 14 15:53:40.719118 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: X-Tenant: tempest-TestMinimumBasicScenario-1817438735 May 14 15:53:40.719118 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: X-Tenant-Id: 5fba11e8ade54d388361c4c936a43372 May 14 15:53:40.719118 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1817438735 May 14 15:53:40.719118 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: X-User: tempest-TestMinimumBasicScenario-1817438735-project May 14 15:53:40.719118 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: X-User-Domain-Id: default May 14 15:53:40.719118 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: X-User-Domain-Name: Default May 14 15:53:40.719118 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: X-User-Id: 6d5f259e0b98457ea6b6b88d886c813d May 14 15:53:40.719118 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: X-User-Name: tempest-TestMinimumBasicScenario-1817438735-project May 14 15:53:40.719118 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: method: > May 14 15:53:40.719118 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: exception: Instance ef63d04a-87e5-4202-a672-d45a2a877c68 could not be found. May 14 15:53:40.719118 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: action_args: {'id': 'ef63d04a-87e5-4202-a672-d45a2a877c68'} May 14 15:53:40.720017 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: {{(pid=128729) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 14 15:53:40.720017 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 15:53:40.720017 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 14 15:53:40.720017 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 14 15:53:40.720017 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 14 15:53:40.720017 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 14 15:53:40.720017 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 14 15:53:40.720017 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 14 15:53:40.720017 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 14 15:53:40.720017 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 14 15:53:40.720017 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ef63d04a-87e5-4202-a672-d45a2a877c68 could not be found. May 14 15:53:40.720017 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: ERROR nova.api.openstack.wsgi May 14 15:53:40.720017 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 14 15:53:40.720017 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: ERROR nova.api.openstack.wsgi May 14 15:53:40.720017 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 15:53:40.720017 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 14 15:53:40.720017 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 14 15:53:40.720017 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 14 15:53:40.720017 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 14 15:53:40.720017 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 14 15:53:40.721543 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 14 15:53:40.721543 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 14 15:53:40.721543 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 14 15:53:40.721543 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 14 15:53:40.721543 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 14 15:53:40.721543 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 14 15:53:40.721543 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 14 15:53:40.721543 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ef63d04a-87e5-4202-a672-d45a2a877c68 could not be found. May 14 15:53:40.721543 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: ERROR nova.api.openstack.wsgi May 14 15:53:40.721543 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 14 15:53:40.721543 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: ERROR nova.api.openstack.wsgi May 14 15:53:40.721543 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 15:53:40.721543 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 14 15:53:40.721543 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 14 15:53:40.721543 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 14 15:53:40.721543 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 14 15:53:40.721543 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ef63d04a-87e5-4202-a672-d45a2a877c68 could not be found. May 14 15:53:40.721543 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: ERROR nova.api.openstack.wsgi May 14 15:53:40.723014 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi [None req-6cd0e6d1-3ba8-4761-97d1-9c6e5b4d9536 tempest-TestMinimumBasicScenario-1817438735 tempest-TestMinimumBasicScenario-1817438735-project] Returning 404 to user: Instance ef63d04a-87e5-4202-a672-d45a2a877c68 could not be found. {{(pid=128729) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 14 15:53:40.723014 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: INFO nova.api.openstack.requestlog [None req-6cd0e6d1-3ba8-4761-97d1-9c6e5b4d9536 tempest-TestMinimumBasicScenario-1817438735 tempest-TestMinimumBasicScenario-1817438735-project] 10.222.0.61 "GET /compute/v2.1/servers/ef63d04a-87e5-4202-a672-d45a2a877c68" status: 404 len: 111 microversion: 2.1 time: 0.031471 May 14 15:53:40.723014 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: [pid: 128729|app: 0|req: 437/889] 10.222.0.61 () {58 vars in 1235 bytes} [Sat May 14 15:53:40 2022] GET /compute/v2.1/servers/ef63d04a-87e5-4202-a672-d45a2a877c68 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 14 15:53:40.728150 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi [None req-41864b8f-78f9-4521-91d5-a60ad3241236 tempest-TestMinimumBasicScenario-1817438735 tempest-TestMinimumBasicScenario-1817438735-project] Calling method '.version_select at 0x7f77cb67d280>' {{(pid=128728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 15:53:40.745032 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: INFO nova.api.openstack.requestlog [None req-41864b8f-78f9-4521-91d5-a60ad3241236 tempest-TestMinimumBasicScenario-1817438735 tempest-TestMinimumBasicScenario-1817438735-project] 10.222.0.61 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-599156118" status: 202 len: 0 microversion: 2.1 time: 0.020619 May 14 15:53:40.745580 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: [pid: 128728|app: 0|req: 453/890] 10.222.0.61 () {58 vars in 1268 bytes} [Sat May 14 15:53:40 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-599156118 => generated 0 bytes in 22 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 14 15:53:40.760181 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi [None req-36bdb61e-9f7b-4dbd-b429-7f99fb724c34 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Calling method '>' {{(pid=128729) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 15:53:40.760790 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.compute.api [None req-36bdb61e-9f7b-4dbd-b429-7f99fb724c34 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] [instance: cca08141-979e-4519-88b3-c77e8a71ae3e] Fetching instance by UUID {{(pid=128729) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 15:53:40.768454 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-36bdb61e-9f7b-4dbd-b429-7f99fb724c34 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:53:40.768910 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-36bdb61e-9f7b-4dbd-b429-7f99fb724c34 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:53:40.769691 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-36bdb61e-9f7b-4dbd-b429-7f99fb724c34 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:53:40.770119 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-36bdb61e-9f7b-4dbd-b429-7f99fb724c34 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:53:40.906446 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.policy [None req-36bdb61e-9f7b-4dbd-b429-7f99fb724c34 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58bfb7417bc94583963401ae0fe9d39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0672be3fa3f7414da1c1a5b7300abbe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128729) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:53:40.914972 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.policy [None req-36bdb61e-9f7b-4dbd-b429-7f99fb724c34 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58bfb7417bc94583963401ae0fe9d39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0672be3fa3f7414da1c1a5b7300abbe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128729) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:53:40.916523 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.policy [None req-36bdb61e-9f7b-4dbd-b429-7f99fb724c34 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58bfb7417bc94583963401ae0fe9d39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0672be3fa3f7414da1c1a5b7300abbe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128729) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:53:40.917680 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: INFO nova.api.openstack.requestlog [None req-36bdb61e-9f7b-4dbd-b429-7f99fb724c34 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] 10.222.0.61 "GET /compute/v2.1/servers/cca08141-979e-4519-88b3-c77e8a71ae3e" status: 200 len: 1408 microversion: 2.20 time: 0.161425 May 14 15:53:40.918233 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: [pid: 128729|app: 0|req: 438/891] 10.222.0.61 () {60 vars in 1276 bytes} [Sat May 14 15:53:40 2022] GET /compute/v2.1/servers/cca08141-979e-4519-88b3-c77e8a71ae3e => generated 1408 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 14 15:53:41.937448 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi [None req-ae60cc60-c2c1-41dc-80c4-376be291f325 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Calling method '>' {{(pid=128728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 15:53:41.938060 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.compute.api [None req-ae60cc60-c2c1-41dc-80c4-376be291f325 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] [instance: cca08141-979e-4519-88b3-c77e8a71ae3e] Fetching instance by UUID {{(pid=128728) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 15:53:41.945590 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-ae60cc60-c2c1-41dc-80c4-376be291f325 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:53:41.947708 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-ae60cc60-c2c1-41dc-80c4-376be291f325 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:53:41.949128 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-ae60cc60-c2c1-41dc-80c4-376be291f325 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:53:41.949751 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-ae60cc60-c2c1-41dc-80c4-376be291f325 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:53:42.382733 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.policy [None req-ae60cc60-c2c1-41dc-80c4-376be291f325 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58bfb7417bc94583963401ae0fe9d39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0672be3fa3f7414da1c1a5b7300abbe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128728) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:53:42.391242 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.policy [None req-ae60cc60-c2c1-41dc-80c4-376be291f325 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58bfb7417bc94583963401ae0fe9d39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0672be3fa3f7414da1c1a5b7300abbe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128728) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:53:42.392873 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.policy [None req-ae60cc60-c2c1-41dc-80c4-376be291f325 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58bfb7417bc94583963401ae0fe9d39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0672be3fa3f7414da1c1a5b7300abbe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128728) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:53:42.394036 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: INFO nova.api.openstack.requestlog [None req-ae60cc60-c2c1-41dc-80c4-376be291f325 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] 10.222.0.61 "GET /compute/v2.1/servers/cca08141-979e-4519-88b3-c77e8a71ae3e" status: 200 len: 1600 microversion: 2.20 time: 0.461740 May 14 15:53:42.394641 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: [pid: 128728|app: 0|req: 454/892] 10.222.0.61 () {60 vars in 1276 bytes} [Sat May 14 15:53:41 2022] GET /compute/v2.1/servers/cca08141-979e-4519-88b3-c77e8a71ae3e => generated 1600 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 14 15:53:42.411334 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi [None req-93c72d65-8193-4658-96d7-8b7caea9f9e8 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Calling method '>' {{(pid=128729) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 15:53:42.412198 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.compute.api [None req-93c72d65-8193-4658-96d7-8b7caea9f9e8 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] [instance: cca08141-979e-4519-88b3-c77e8a71ae3e] Fetching instance by UUID {{(pid=128729) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 15:53:42.418440 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-93c72d65-8193-4658-96d7-8b7caea9f9e8 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:53:42.418896 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-93c72d65-8193-4658-96d7-8b7caea9f9e8 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:53:42.419665 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-93c72d65-8193-4658-96d7-8b7caea9f9e8 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:53:42.420104 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-93c72d65-8193-4658-96d7-8b7caea9f9e8 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:53:42.517722 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: INFO nova.api.openstack.requestlog [None req-93c72d65-8193-4658-96d7-8b7caea9f9e8 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] 10.222.0.61 "GET /compute/v2.1/servers/cca08141-979e-4519-88b3-c77e8a71ae3e/os-interface" status: 200 len: 285 microversion: 2.20 time: 0.110392 May 14 15:53:42.518342 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: [pid: 128729|app: 0|req: 439/893] 10.222.0.61 () {60 vars in 1315 bytes} [Sat May 14 15:53:42 2022] GET /compute/v2.1/servers/cca08141-979e-4519-88b3-c77e8a71ae3e/os-interface => generated 285 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 14 15:53:43.821650 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi [req-05ebfd3d-4e96-4d61-b3dc-2fd41ac3d863 req-8ed73cc3-065c-4117-af9e-3805e089771b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cca08141-979e-4519-88b3-c77e8a71ae3e", "tag": "e23afae5-7b01-4137-a087-ba1a741fd1f4"}]} {{(pid=128728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 15:53:43.836159 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [req-05ebfd3d-4e96-4d61-b3dc-2fd41ac3d863 req-8ed73cc3-065c-4117-af9e-3805e089771b service nova] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:53:43.836952 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [req-05ebfd3d-4e96-4d61-b3dc-2fd41ac3d863 req-8ed73cc3-065c-4117-af9e-3805e089771b service nova] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:53:43.854364 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: INFO nova.api.openstack.compute.server_external_events [req-05ebfd3d-4e96-4d61-b3dc-2fd41ac3d863 req-8ed73cc3-065c-4117-af9e-3805e089771b service nova] Creating event network-changed:e23afae5-7b01-4137-a087-ba1a741fd1f4 for instance cca08141-979e-4519-88b3-c77e8a71ae3e on hv-cinder-83979 May 14 15:53:43.860082 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: INFO nova.api.openstack.requestlog [req-05ebfd3d-4e96-4d61-b3dc-2fd41ac3d863 req-8ed73cc3-065c-4117-af9e-3805e089771b service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043354 May 14 15:53:43.860889 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: [pid: 128728|app: 0|req: 455/894] 10.222.0.61 () {64 vars in 1317 bytes} [Sat May 14 15:53:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 14 15:54:14.951099 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi [None req-22cbe677-185f-4d73-99b3-99a102de5625 tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Calling method '>' {{(pid=128729) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 15:54:14.951635 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.compute.api [None req-22cbe677-185f-4d73-99b3-99a102de5625 tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] [instance: 7c21adbe-7a79-46cf-aa7c-9b2a6548c767] Fetching instance by UUID {{(pid=128729) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 15:54:14.957864 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-22cbe677-185f-4d73-99b3-99a102de5625 tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:54:14.958329 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-22cbe677-185f-4d73-99b3-99a102de5625 tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:54:14.959107 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-22cbe677-185f-4d73-99b3-99a102de5625 tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:54:14.959541 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-22cbe677-185f-4d73-99b3-99a102de5625 tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:54:15.035564 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.objects.instance [None req-22cbe677-185f-4d73-99b3-99a102de5625 tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Lazy-loading 'services' on Instance uuid 7c21adbe-7a79-46cf-aa7c-9b2a6548c767 {{(pid=128729) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 14 15:54:15.104004 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: INFO nova.api.openstack.requestlog [None req-22cbe677-185f-4d73-99b3-99a102de5625 tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] 10.222.0.61 "DELETE /compute/v2.1/servers/7c21adbe-7a79-46cf-aa7c-9b2a6548c767/os-volume_attachments/f6a166ae-4a68-4005-a3a3-8e2d8e5725ea" status: 202 len: 0 microversion: 2.1 time: 0.157204 May 14 15:54:15.104591 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: [pid: 128729|app: 0|req: 440/895] 10.222.0.61 () {58 vars in 1415 bytes} [Sat May 14 15:54:14 2022] DELETE /compute/v2.1/servers/7c21adbe-7a79-46cf-aa7c-9b2a6548c767/os-volume_attachments/f6a166ae-4a68-4005-a3a3-8e2d8e5725ea => generated 0 bytes in 159 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 14 15:54:15.114871 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi [None req-8771dfd1-fd93-42ec-8211-44a59a950b6f tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Calling method '>' {{(pid=128728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 15:54:15.116159 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.compute.api [None req-8771dfd1-fd93-42ec-8211-44a59a950b6f tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] [instance: 7c21adbe-7a79-46cf-aa7c-9b2a6548c767] Fetching instance by UUID {{(pid=128728) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 15:54:15.122433 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-8771dfd1-fd93-42ec-8211-44a59a950b6f tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:54:15.122891 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-8771dfd1-fd93-42ec-8211-44a59a950b6f tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:54:15.123737 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-8771dfd1-fd93-42ec-8211-44a59a950b6f tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:54:15.124185 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-8771dfd1-fd93-42ec-8211-44a59a950b6f tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:54:15.155031 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: INFO nova.api.openstack.requestlog [None req-8771dfd1-fd93-42ec-8211-44a59a950b6f tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] 10.222.0.61 "GET /compute/v2.1/servers/7c21adbe-7a79-46cf-aa7c-9b2a6548c767/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045476 May 14 15:54:15.155592 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: [pid: 128728|app: 0|req: 456/896] 10.222.0.61 () {58 vars in 1301 bytes} [Sat May 14 15:54:15 2022] GET /compute/v2.1/servers/7c21adbe-7a79-46cf-aa7c-9b2a6548c767/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 14 15:54:15.223506 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi [None req-65cfd064-a00e-4b8f-a2ea-d3102040702c tempest-TestVolumeBootPattern-2062489882 tempest-TestVolumeBootPattern-2062489882-project] Calling method '>' {{(pid=128729) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 15:54:15.224093 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.compute.api [None req-65cfd064-a00e-4b8f-a2ea-d3102040702c tempest-TestVolumeBootPattern-2062489882 tempest-TestVolumeBootPattern-2062489882-project] [instance: 7ee38041-8e54-4fdb-909d-585952a4f5bd] Fetching instance by UUID {{(pid=128729) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 15:54:15.230178 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-65cfd064-a00e-4b8f-a2ea-d3102040702c tempest-TestVolumeBootPattern-2062489882 tempest-TestVolumeBootPattern-2062489882-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:54:15.230747 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-65cfd064-a00e-4b8f-a2ea-d3102040702c tempest-TestVolumeBootPattern-2062489882 tempest-TestVolumeBootPattern-2062489882-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:54:15.231517 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-65cfd064-a00e-4b8f-a2ea-d3102040702c tempest-TestVolumeBootPattern-2062489882 tempest-TestVolumeBootPattern-2062489882-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:54:15.231960 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-65cfd064-a00e-4b8f-a2ea-d3102040702c tempest-TestVolumeBootPattern-2062489882 tempest-TestVolumeBootPattern-2062489882-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:54:15.256697 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.compute.api [None req-65cfd064-a00e-4b8f-a2ea-d3102040702c tempest-TestVolumeBootPattern-2062489882 tempest-TestVolumeBootPattern-2062489882-project] [instance: 7ee38041-8e54-4fdb-909d-585952a4f5bd] Going to try to terminate instance {{(pid=128729) delete /opt/stack/nova/nova/compute/api.py:2664}} May 14 15:54:15.328509 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: INFO nova.api.openstack.requestlog [None req-65cfd064-a00e-4b8f-a2ea-d3102040702c tempest-TestVolumeBootPattern-2062489882 tempest-TestVolumeBootPattern-2062489882-project] 10.222.0.61 "DELETE /compute/v2.1/servers/7ee38041-8e54-4fdb-909d-585952a4f5bd" status: 204 len: 0 microversion: 2.1 time: 0.109253 May 14 15:54:15.329085 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: [pid: 128729|app: 0|req: 441/897] 10.222.0.61 () {58 vars in 1238 bytes} [Sat May 14 15:54:15 2022] DELETE /compute/v2.1/servers/7ee38041-8e54-4fdb-909d-585952a4f5bd => generated 0 bytes in 111 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 14 15:54:15.337276 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi [None req-28f50330-1527-4567-9404-783a259ec955 tempest-TestVolumeBootPattern-2062489882 tempest-TestVolumeBootPattern-2062489882-project] Calling method '>' {{(pid=128728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 15:54:15.337886 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.compute.api [None req-28f50330-1527-4567-9404-783a259ec955 tempest-TestVolumeBootPattern-2062489882 tempest-TestVolumeBootPattern-2062489882-project] [instance: 7ee38041-8e54-4fdb-909d-585952a4f5bd] Fetching instance by UUID {{(pid=128728) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 15:54:15.344423 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-28f50330-1527-4567-9404-783a259ec955 tempest-TestVolumeBootPattern-2062489882 tempest-TestVolumeBootPattern-2062489882-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:54:15.344869 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-28f50330-1527-4567-9404-783a259ec955 tempest-TestVolumeBootPattern-2062489882 tempest-TestVolumeBootPattern-2062489882-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:54:15.345637 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-28f50330-1527-4567-9404-783a259ec955 tempest-TestVolumeBootPattern-2062489882 tempest-TestVolumeBootPattern-2062489882-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:54:15.346075 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-28f50330-1527-4567-9404-783a259ec955 tempest-TestVolumeBootPattern-2062489882 tempest-TestVolumeBootPattern-2062489882-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:54:15.474181 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.policy [None req-28f50330-1527-4567-9404-783a259ec955 tempest-TestVolumeBootPattern-2062489882 tempest-TestVolumeBootPattern-2062489882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '568f6783dd4d43398a70a9ffa58ff660', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a3a2b5dee7a404a8445c8aa434b5a43', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128728) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:54:15.481458 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: INFO nova.api.openstack.requestlog [None req-28f50330-1527-4567-9404-783a259ec955 tempest-TestVolumeBootPattern-2062489882 tempest-TestVolumeBootPattern-2062489882-project] 10.222.0.61 "GET /compute/v2.1/servers/7ee38041-8e54-4fdb-909d-585952a4f5bd" status: 200 len: 1578 microversion: 2.1 time: 0.148028 May 14 15:54:15.482018 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: [pid: 128728|app: 0|req: 457/898] 10.222.0.61 () {58 vars in 1235 bytes} [Sat May 14 15:54:15 2022] GET /compute/v2.1/servers/7ee38041-8e54-4fdb-909d-585952a4f5bd => generated 1578 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 15:54:16.167429 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi [None req-b113aeb6-e252-43a0-b491-de5207d18dc0 tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Calling method '>' {{(pid=128729) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 15:54:16.168488 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.compute.api [None req-b113aeb6-e252-43a0-b491-de5207d18dc0 tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] [instance: 7c21adbe-7a79-46cf-aa7c-9b2a6548c767] Fetching instance by UUID {{(pid=128729) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 15:54:16.175200 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-b113aeb6-e252-43a0-b491-de5207d18dc0 tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:54:16.175647 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-b113aeb6-e252-43a0-b491-de5207d18dc0 tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:54:16.176435 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-b113aeb6-e252-43a0-b491-de5207d18dc0 tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:54:16.176870 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-b113aeb6-e252-43a0-b491-de5207d18dc0 tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:54:16.205529 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: INFO nova.api.openstack.requestlog [None req-b113aeb6-e252-43a0-b491-de5207d18dc0 tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] 10.222.0.61 "GET /compute/v2.1/servers/7c21adbe-7a79-46cf-aa7c-9b2a6548c767/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042444 May 14 15:54:16.206067 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: [pid: 128729|app: 0|req: 442/899] 10.222.0.61 () {58 vars in 1301 bytes} [Sat May 14 15:54:16 2022] GET /compute/v2.1/servers/7c21adbe-7a79-46cf-aa7c-9b2a6548c767/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 14 15:54:16.499287 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi [None req-8577d9fb-9278-4838-812c-0ee375b9a931 tempest-TestVolumeBootPattern-2062489882 tempest-TestVolumeBootPattern-2062489882-project] Calling method '>' {{(pid=128728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 15:54:16.499869 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.compute.api [None req-8577d9fb-9278-4838-812c-0ee375b9a931 tempest-TestVolumeBootPattern-2062489882 tempest-TestVolumeBootPattern-2062489882-project] [instance: 7ee38041-8e54-4fdb-909d-585952a4f5bd] Fetching instance by UUID {{(pid=128728) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 15:54:16.506088 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-8577d9fb-9278-4838-812c-0ee375b9a931 tempest-TestVolumeBootPattern-2062489882 tempest-TestVolumeBootPattern-2062489882-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:54:16.506571 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-8577d9fb-9278-4838-812c-0ee375b9a931 tempest-TestVolumeBootPattern-2062489882 tempest-TestVolumeBootPattern-2062489882-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:54:16.507339 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-8577d9fb-9278-4838-812c-0ee375b9a931 tempest-TestVolumeBootPattern-2062489882 tempest-TestVolumeBootPattern-2062489882-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:54:16.507784 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-8577d9fb-9278-4838-812c-0ee375b9a931 tempest-TestVolumeBootPattern-2062489882 tempest-TestVolumeBootPattern-2062489882-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:54:16.634404 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.policy [None req-8577d9fb-9278-4838-812c-0ee375b9a931 tempest-TestVolumeBootPattern-2062489882 tempest-TestVolumeBootPattern-2062489882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '568f6783dd4d43398a70a9ffa58ff660', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a3a2b5dee7a404a8445c8aa434b5a43', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128728) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:54:16.641718 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: INFO nova.api.openstack.requestlog [None req-8577d9fb-9278-4838-812c-0ee375b9a931 tempest-TestVolumeBootPattern-2062489882 tempest-TestVolumeBootPattern-2062489882-project] 10.222.0.61 "GET /compute/v2.1/servers/7ee38041-8e54-4fdb-909d-585952a4f5bd" status: 200 len: 1578 microversion: 2.1 time: 0.146357 May 14 15:54:16.642280 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: [pid: 128728|app: 0|req: 458/900] 10.222.0.61 () {58 vars in 1235 bytes} [Sat May 14 15:54:16 2022] GET /compute/v2.1/servers/7ee38041-8e54-4fdb-909d-585952a4f5bd => generated 1578 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 15:54:17.216993 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi [None req-cad411e5-9d4e-4588-8f61-32b03759a4db tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Calling method '>' {{(pid=128729) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 15:54:17.217908 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.compute.api [None req-cad411e5-9d4e-4588-8f61-32b03759a4db tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] [instance: 7c21adbe-7a79-46cf-aa7c-9b2a6548c767] Fetching instance by UUID {{(pid=128729) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 15:54:17.224284 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-cad411e5-9d4e-4588-8f61-32b03759a4db tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:54:17.224725 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-cad411e5-9d4e-4588-8f61-32b03759a4db tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:54:17.225496 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-cad411e5-9d4e-4588-8f61-32b03759a4db tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:54:17.225932 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-cad411e5-9d4e-4588-8f61-32b03759a4db tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:54:17.255946 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: INFO nova.api.openstack.requestlog [None req-cad411e5-9d4e-4588-8f61-32b03759a4db tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] 10.222.0.61 "GET /compute/v2.1/servers/7c21adbe-7a79-46cf-aa7c-9b2a6548c767/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042867 May 14 15:54:17.256507 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: [pid: 128729|app: 0|req: 443/901] 10.222.0.61 () {58 vars in 1301 bytes} [Sat May 14 15:54:17 2022] GET /compute/v2.1/servers/7c21adbe-7a79-46cf-aa7c-9b2a6548c767/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 14 15:54:17.658523 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi [None req-18de7dde-b170-4282-af7a-1436d3ccf3c1 tempest-TestVolumeBootPattern-2062489882 tempest-TestVolumeBootPattern-2062489882-project] Calling method '>' {{(pid=128728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 15:54:17.659182 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.compute.api [None req-18de7dde-b170-4282-af7a-1436d3ccf3c1 tempest-TestVolumeBootPattern-2062489882 tempest-TestVolumeBootPattern-2062489882-project] [instance: 7ee38041-8e54-4fdb-909d-585952a4f5bd] Fetching instance by UUID {{(pid=128728) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 15:54:17.665586 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-18de7dde-b170-4282-af7a-1436d3ccf3c1 tempest-TestVolumeBootPattern-2062489882 tempest-TestVolumeBootPattern-2062489882-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:54:17.666034 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-18de7dde-b170-4282-af7a-1436d3ccf3c1 tempest-TestVolumeBootPattern-2062489882 tempest-TestVolumeBootPattern-2062489882-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:54:17.666827 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-18de7dde-b170-4282-af7a-1436d3ccf3c1 tempest-TestVolumeBootPattern-2062489882 tempest-TestVolumeBootPattern-2062489882-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:54:17.667263 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-18de7dde-b170-4282-af7a-1436d3ccf3c1 tempest-TestVolumeBootPattern-2062489882 tempest-TestVolumeBootPattern-2062489882-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:54:17.876380 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.policy [None req-18de7dde-b170-4282-af7a-1436d3ccf3c1 tempest-TestVolumeBootPattern-2062489882 tempest-TestVolumeBootPattern-2062489882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '568f6783dd4d43398a70a9ffa58ff660', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a3a2b5dee7a404a8445c8aa434b5a43', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128728) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:54:17.883664 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: INFO nova.api.openstack.requestlog [None req-18de7dde-b170-4282-af7a-1436d3ccf3c1 tempest-TestVolumeBootPattern-2062489882 tempest-TestVolumeBootPattern-2062489882-project] 10.222.0.61 "GET /compute/v2.1/servers/7ee38041-8e54-4fdb-909d-585952a4f5bd" status: 200 len: 1578 microversion: 2.1 time: 0.229088 May 14 15:54:17.884229 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: [pid: 128728|app: 0|req: 459/902] 10.222.0.61 () {58 vars in 1235 bytes} [Sat May 14 15:54:17 2022] GET /compute/v2.1/servers/7ee38041-8e54-4fdb-909d-585952a4f5bd => generated 1578 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 15:54:18.269128 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi [None req-9a367c87-8a01-45f6-a748-b8172a00b712 tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Calling method '>' {{(pid=128729) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 15:54:18.270078 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.compute.api [None req-9a367c87-8a01-45f6-a748-b8172a00b712 tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] [instance: 7c21adbe-7a79-46cf-aa7c-9b2a6548c767] Fetching instance by UUID {{(pid=128729) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 15:54:18.276821 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-9a367c87-8a01-45f6-a748-b8172a00b712 tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:54:18.277281 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-9a367c87-8a01-45f6-a748-b8172a00b712 tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:54:18.278057 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-9a367c87-8a01-45f6-a748-b8172a00b712 tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:54:18.278537 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-9a367c87-8a01-45f6-a748-b8172a00b712 tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:54:18.309691 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: INFO nova.api.openstack.requestlog [None req-9a367c87-8a01-45f6-a748-b8172a00b712 tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] 10.222.0.61 "GET /compute/v2.1/servers/7c21adbe-7a79-46cf-aa7c-9b2a6548c767/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.045236 May 14 15:54:18.314881 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: [pid: 128729|app: 0|req: 444/903] 10.222.0.61 () {58 vars in 1301 bytes} [Sat May 14 15:54:18 2022] GET /compute/v2.1/servers/7c21adbe-7a79-46cf-aa7c-9b2a6548c767/os-volume_attachments => generated 25 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 14 15:54:18.384746 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi [None req-b172119f-d10c-43cd-bb39-3c3fbdd06f72 tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Calling method '>' {{(pid=128728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 15:54:18.385239 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.compute.api [None req-b172119f-d10c-43cd-bb39-3c3fbdd06f72 tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] [instance: 7c21adbe-7a79-46cf-aa7c-9b2a6548c767] Fetching instance by UUID {{(pid=128728) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 15:54:18.391759 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-b172119f-d10c-43cd-bb39-3c3fbdd06f72 tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:54:18.392206 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-b172119f-d10c-43cd-bb39-3c3fbdd06f72 tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:54:18.392973 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-b172119f-d10c-43cd-bb39-3c3fbdd06f72 tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:54:18.393405 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-b172119f-d10c-43cd-bb39-3c3fbdd06f72 tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:54:18.418231 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.compute.api [None req-b172119f-d10c-43cd-bb39-3c3fbdd06f72 tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] [instance: 7c21adbe-7a79-46cf-aa7c-9b2a6548c767] Going to try to terminate instance {{(pid=128728) delete /opt/stack/nova/nova/compute/api.py:2664}} May 14 15:54:18.497396 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: INFO nova.api.openstack.requestlog [None req-b172119f-d10c-43cd-bb39-3c3fbdd06f72 tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] 10.222.0.61 "DELETE /compute/v2.1/servers/7c21adbe-7a79-46cf-aa7c-9b2a6548c767" status: 204 len: 0 microversion: 2.1 time: 0.117450 May 14 15:54:18.497894 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: [pid: 128728|app: 0|req: 460/904] 10.222.0.61 () {58 vars in 1238 bytes} [Sat May 14 15:54:18 2022] DELETE /compute/v2.1/servers/7c21adbe-7a79-46cf-aa7c-9b2a6548c767 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 14 15:54:18.506226 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi [None req-a494e499-e62d-4944-822e-0919ef832b87 tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Calling method '>' {{(pid=128729) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 15:54:18.506889 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.compute.api [None req-a494e499-e62d-4944-822e-0919ef832b87 tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] [instance: 7c21adbe-7a79-46cf-aa7c-9b2a6548c767] Fetching instance by UUID {{(pid=128729) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 15:54:18.512966 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-a494e499-e62d-4944-822e-0919ef832b87 tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:54:18.513348 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-a494e499-e62d-4944-822e-0919ef832b87 tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:54:18.514369 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-a494e499-e62d-4944-822e-0919ef832b87 tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:54:18.525406 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-a494e499-e62d-4944-822e-0919ef832b87 tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:54:18.569689 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi [req-35c562d7-e274-4c59-85d4-b92cbea2f3c4 req-fde78ef1-6758-4cca-a000-a314ff149e9f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7ee38041-8e54-4fdb-909d-585952a4f5bd", "name": "network-vif-deleted", "tag": "bcc0c44d-e45f-498d-aad0-498370ba2097"}]} {{(pid=128728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 15:54:18.577999 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [req-35c562d7-e274-4c59-85d4-b92cbea2f3c4 req-fde78ef1-6758-4cca-a000-a314ff149e9f service nova] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:54:18.578573 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [req-35c562d7-e274-4c59-85d4-b92cbea2f3c4 req-fde78ef1-6758-4cca-a000-a314ff149e9f service nova] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:54:18.590274 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: INFO nova.api.openstack.compute.server_external_events [req-35c562d7-e274-4c59-85d4-b92cbea2f3c4 req-fde78ef1-6758-4cca-a000-a314ff149e9f service nova] Creating event network-vif-deleted:bcc0c44d-e45f-498d-aad0-498370ba2097 for instance 7ee38041-8e54-4fdb-909d-585952a4f5bd on hv-cinder-83979 May 14 15:54:18.596027 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: INFO nova.api.openstack.requestlog [req-35c562d7-e274-4c59-85d4-b92cbea2f3c4 req-fde78ef1-6758-4cca-a000-a314ff149e9f service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030369 May 14 15:54:18.596941 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: [pid: 128728|app: 0|req: 461/905] 10.222.0.61 () {64 vars in 1317 bytes} [Sat May 14 15:54:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 14 15:54:18.675289 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.policy [None req-a494e499-e62d-4944-822e-0919ef832b87 tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b896317d96a40d6a137db0dcf5f98f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d2517d5440a4d30949f3dd36a46d813', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128729) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:54:18.682934 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: INFO nova.api.openstack.requestlog [None req-a494e499-e62d-4944-822e-0919ef832b87 tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] 10.222.0.61 "GET /compute/v2.1/servers/7c21adbe-7a79-46cf-aa7c-9b2a6548c767" status: 200 len: 1689 microversion: 2.1 time: 0.180543 May 14 15:54:18.684199 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: [pid: 128729|app: 0|req: 445/906] 10.222.0.61 () {58 vars in 1235 bytes} [Sat May 14 15:54:18 2022] GET /compute/v2.1/servers/7c21adbe-7a79-46cf-aa7c-9b2a6548c767 => generated 1689 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 15:54:18.901324 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi [None req-ac7023ca-75c7-4289-925d-45ff88e99dcf tempest-TestVolumeBootPattern-2062489882 tempest-TestVolumeBootPattern-2062489882-project] Calling method '>' {{(pid=128728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 15:54:18.902020 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.compute.api [None req-ac7023ca-75c7-4289-925d-45ff88e99dcf tempest-TestVolumeBootPattern-2062489882 tempest-TestVolumeBootPattern-2062489882-project] [instance: 7ee38041-8e54-4fdb-909d-585952a4f5bd] Fetching instance by UUID {{(pid=128728) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 15:54:18.909369 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-ac7023ca-75c7-4289-925d-45ff88e99dcf tempest-TestVolumeBootPattern-2062489882 tempest-TestVolumeBootPattern-2062489882-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:54:18.909848 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-ac7023ca-75c7-4289-925d-45ff88e99dcf tempest-TestVolumeBootPattern-2062489882 tempest-TestVolumeBootPattern-2062489882-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:54:18.910667 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-ac7023ca-75c7-4289-925d-45ff88e99dcf tempest-TestVolumeBootPattern-2062489882 tempest-TestVolumeBootPattern-2062489882-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:54:18.911104 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-ac7023ca-75c7-4289-925d-45ff88e99dcf tempest-TestVolumeBootPattern-2062489882 tempest-TestVolumeBootPattern-2062489882-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:54:18.973608 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.policy [None req-ac7023ca-75c7-4289-925d-45ff88e99dcf tempest-TestVolumeBootPattern-2062489882 tempest-TestVolumeBootPattern-2062489882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '568f6783dd4d43398a70a9ffa58ff660', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a3a2b5dee7a404a8445c8aa434b5a43', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128728) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:54:18.981009 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: INFO nova.api.openstack.requestlog [None req-ac7023ca-75c7-4289-925d-45ff88e99dcf tempest-TestVolumeBootPattern-2062489882 tempest-TestVolumeBootPattern-2062489882-project] 10.222.0.61 "GET /compute/v2.1/servers/7ee38041-8e54-4fdb-909d-585952a4f5bd" status: 200 len: 1510 microversion: 2.1 time: 0.083673 May 14 15:54:18.981373 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: [pid: 128728|app: 0|req: 462/907] 10.222.0.61 () {58 vars in 1235 bytes} [Sat May 14 15:54:18 2022] GET /compute/v2.1/servers/7ee38041-8e54-4fdb-909d-585952a4f5bd => generated 1510 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 15:54:19.700629 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi [None req-794543fb-5596-4d4a-a119-5c86ce391c17 tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Calling method '>' {{(pid=128729) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 15:54:19.701617 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.compute.api [None req-794543fb-5596-4d4a-a119-5c86ce391c17 tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] [instance: 7c21adbe-7a79-46cf-aa7c-9b2a6548c767] Fetching instance by UUID {{(pid=128729) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 15:54:19.708644 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-794543fb-5596-4d4a-a119-5c86ce391c17 tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:54:19.709085 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-794543fb-5596-4d4a-a119-5c86ce391c17 tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:54:19.709849 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-794543fb-5596-4d4a-a119-5c86ce391c17 tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:54:19.710280 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-794543fb-5596-4d4a-a119-5c86ce391c17 tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:54:19.838390 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.policy [None req-794543fb-5596-4d4a-a119-5c86ce391c17 tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b896317d96a40d6a137db0dcf5f98f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d2517d5440a4d30949f3dd36a46d813', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128729) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:54:19.845865 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: INFO nova.api.openstack.requestlog [None req-794543fb-5596-4d4a-a119-5c86ce391c17 tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] 10.222.0.61 "GET /compute/v2.1/servers/7c21adbe-7a79-46cf-aa7c-9b2a6548c767" status: 200 len: 1689 microversion: 2.1 time: 0.149076 May 14 15:54:19.846451 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: [pid: 128729|app: 0|req: 446/908] 10.222.0.61 () {58 vars in 1235 bytes} [Sat May 14 15:54:19 2022] GET /compute/v2.1/servers/7c21adbe-7a79-46cf-aa7c-9b2a6548c767 => generated 1689 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 15:54:19.997789 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi [None req-1b4fe418-0c01-4fa2-9304-c8cc35e6aca5 tempest-TestVolumeBootPattern-2062489882 tempest-TestVolumeBootPattern-2062489882-project] Calling method '>' {{(pid=128728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 15:54:19.998431 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.compute.api [None req-1b4fe418-0c01-4fa2-9304-c8cc35e6aca5 tempest-TestVolumeBootPattern-2062489882 tempest-TestVolumeBootPattern-2062489882-project] [instance: 7ee38041-8e54-4fdb-909d-585952a4f5bd] Fetching instance by UUID {{(pid=128728) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 15:54:20.005392 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-1b4fe418-0c01-4fa2-9304-c8cc35e6aca5 tempest-TestVolumeBootPattern-2062489882 tempest-TestVolumeBootPattern-2062489882-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:54:20.005889 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-1b4fe418-0c01-4fa2-9304-c8cc35e6aca5 tempest-TestVolumeBootPattern-2062489882 tempest-TestVolumeBootPattern-2062489882-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:54:20.006688 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-1b4fe418-0c01-4fa2-9304-c8cc35e6aca5 tempest-TestVolumeBootPattern-2062489882 tempest-TestVolumeBootPattern-2062489882-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:54:20.007125 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-1b4fe418-0c01-4fa2-9304-c8cc35e6aca5 tempest-TestVolumeBootPattern-2062489882 tempest-TestVolumeBootPattern-2062489882-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:54:20.067987 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.policy [None req-1b4fe418-0c01-4fa2-9304-c8cc35e6aca5 tempest-TestVolumeBootPattern-2062489882 tempest-TestVolumeBootPattern-2062489882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '568f6783dd4d43398a70a9ffa58ff660', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a3a2b5dee7a404a8445c8aa434b5a43', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128728) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:54:20.075256 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: INFO nova.api.openstack.requestlog [None req-1b4fe418-0c01-4fa2-9304-c8cc35e6aca5 tempest-TestVolumeBootPattern-2062489882 tempest-TestVolumeBootPattern-2062489882-project] 10.222.0.61 "GET /compute/v2.1/servers/7ee38041-8e54-4fdb-909d-585952a4f5bd" status: 200 len: 1510 microversion: 2.1 time: 0.081406 May 14 15:54:20.075818 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: [pid: 128728|app: 0|req: 463/909] 10.222.0.61 () {58 vars in 1235 bytes} [Sat May 14 15:54:19 2022] GET /compute/v2.1/servers/7ee38041-8e54-4fdb-909d-585952a4f5bd => generated 1510 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 15:54:20.862601 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi [None req-81ecd39d-51be-45b3-aa71-1bbe9ffc1316 tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Calling method '>' {{(pid=128729) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 15:54:20.863209 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.compute.api [None req-81ecd39d-51be-45b3-aa71-1bbe9ffc1316 tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] [instance: 7c21adbe-7a79-46cf-aa7c-9b2a6548c767] Fetching instance by UUID {{(pid=128729) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 15:54:20.869663 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-81ecd39d-51be-45b3-aa71-1bbe9ffc1316 tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:54:20.870110 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-81ecd39d-51be-45b3-aa71-1bbe9ffc1316 tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:54:20.870904 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-81ecd39d-51be-45b3-aa71-1bbe9ffc1316 tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:54:20.871336 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-81ecd39d-51be-45b3-aa71-1bbe9ffc1316 tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:54:20.998994 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.policy [None req-81ecd39d-51be-45b3-aa71-1bbe9ffc1316 tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b896317d96a40d6a137db0dcf5f98f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d2517d5440a4d30949f3dd36a46d813', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128729) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:54:21.006290 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: INFO nova.api.openstack.requestlog [None req-81ecd39d-51be-45b3-aa71-1bbe9ffc1316 tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] 10.222.0.61 "GET /compute/v2.1/servers/7c21adbe-7a79-46cf-aa7c-9b2a6548c767" status: 200 len: 1689 microversion: 2.1 time: 0.148123 May 14 15:54:21.006878 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: [pid: 128729|app: 0|req: 447/910] 10.222.0.61 () {58 vars in 1235 bytes} [Sat May 14 15:54:20 2022] GET /compute/v2.1/servers/7c21adbe-7a79-46cf-aa7c-9b2a6548c767 => generated 1689 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 15:54:21.092302 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi [None req-5a1d5b29-ebff-4a5a-aa70-90ee3e422e25 tempest-TestVolumeBootPattern-2062489882 tempest-TestVolumeBootPattern-2062489882-project] Calling method '>' {{(pid=128728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 15:54:21.092843 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.compute.api [None req-5a1d5b29-ebff-4a5a-aa70-90ee3e422e25 tempest-TestVolumeBootPattern-2062489882 tempest-TestVolumeBootPattern-2062489882-project] [instance: 7ee38041-8e54-4fdb-909d-585952a4f5bd] Fetching instance by UUID {{(pid=128728) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 15:54:21.100407 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-5a1d5b29-ebff-4a5a-aa70-90ee3e422e25 tempest-TestVolumeBootPattern-2062489882 tempest-TestVolumeBootPattern-2062489882-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:54:21.100873 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-5a1d5b29-ebff-4a5a-aa70-90ee3e422e25 tempest-TestVolumeBootPattern-2062489882 tempest-TestVolumeBootPattern-2062489882-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:54:21.101655 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-5a1d5b29-ebff-4a5a-aa70-90ee3e422e25 tempest-TestVolumeBootPattern-2062489882 tempest-TestVolumeBootPattern-2062489882-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:54:21.102094 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-5a1d5b29-ebff-4a5a-aa70-90ee3e422e25 tempest-TestVolumeBootPattern-2062489882 tempest-TestVolumeBootPattern-2062489882-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:54:21.169456 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.policy [None req-5a1d5b29-ebff-4a5a-aa70-90ee3e422e25 tempest-TestVolumeBootPattern-2062489882 tempest-TestVolumeBootPattern-2062489882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '568f6783dd4d43398a70a9ffa58ff660', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a3a2b5dee7a404a8445c8aa434b5a43', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128728) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:54:21.177546 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: INFO nova.api.openstack.requestlog [None req-5a1d5b29-ebff-4a5a-aa70-90ee3e422e25 tempest-TestVolumeBootPattern-2062489882 tempest-TestVolumeBootPattern-2062489882-project] 10.222.0.61 "GET /compute/v2.1/servers/7ee38041-8e54-4fdb-909d-585952a4f5bd" status: 200 len: 1510 microversion: 2.1 time: 0.089143 May 14 15:54:21.178112 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: [pid: 128728|app: 0|req: 464/911] 10.222.0.61 () {58 vars in 1235 bytes} [Sat May 14 15:54:21 2022] GET /compute/v2.1/servers/7ee38041-8e54-4fdb-909d-585952a4f5bd => generated 1510 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 15:54:22.023162 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi [None req-f20b1e62-a4ab-4d61-b33d-4f4890aa141d tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Calling method '>' {{(pid=128729) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 15:54:22.023694 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.compute.api [None req-f20b1e62-a4ab-4d61-b33d-4f4890aa141d tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] [instance: 7c21adbe-7a79-46cf-aa7c-9b2a6548c767] Fetching instance by UUID {{(pid=128729) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 15:54:22.029947 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-f20b1e62-a4ab-4d61-b33d-4f4890aa141d tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:54:22.030435 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-f20b1e62-a4ab-4d61-b33d-4f4890aa141d tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:54:22.031552 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-f20b1e62-a4ab-4d61-b33d-4f4890aa141d tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:54:22.032005 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-f20b1e62-a4ab-4d61-b33d-4f4890aa141d tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:54:22.165191 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.policy [None req-f20b1e62-a4ab-4d61-b33d-4f4890aa141d tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b896317d96a40d6a137db0dcf5f98f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d2517d5440a4d30949f3dd36a46d813', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128729) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:54:22.173072 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: INFO nova.api.openstack.requestlog [None req-f20b1e62-a4ab-4d61-b33d-4f4890aa141d tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] 10.222.0.61 "GET /compute/v2.1/servers/7c21adbe-7a79-46cf-aa7c-9b2a6548c767" status: 200 len: 1689 microversion: 2.1 time: 0.153858 May 14 15:54:22.173628 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: [pid: 128729|app: 0|req: 448/912] 10.222.0.61 () {58 vars in 1235 bytes} [Sat May 14 15:54:22 2022] GET /compute/v2.1/servers/7c21adbe-7a79-46cf-aa7c-9b2a6548c767 => generated 1689 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 15:54:22.194425 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi [None req-d6c9a352-03c2-486a-ab83-922951c6a4db tempest-TestVolumeBootPattern-2062489882 tempest-TestVolumeBootPattern-2062489882-project] Calling method '>' {{(pid=128728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 15:54:22.195032 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.compute.api [None req-d6c9a352-03c2-486a-ab83-922951c6a4db tempest-TestVolumeBootPattern-2062489882 tempest-TestVolumeBootPattern-2062489882-project] [instance: 7ee38041-8e54-4fdb-909d-585952a4f5bd] Fetching instance by UUID {{(pid=128728) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 15:54:22.201189 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-d6c9a352-03c2-486a-ab83-922951c6a4db tempest-TestVolumeBootPattern-2062489882 tempest-TestVolumeBootPattern-2062489882-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:54:22.201632 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-d6c9a352-03c2-486a-ab83-922951c6a4db tempest-TestVolumeBootPattern-2062489882 tempest-TestVolumeBootPattern-2062489882-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:54:22.202420 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-d6c9a352-03c2-486a-ab83-922951c6a4db tempest-TestVolumeBootPattern-2062489882 tempest-TestVolumeBootPattern-2062489882-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:54:22.202914 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-d6c9a352-03c2-486a-ab83-922951c6a4db tempest-TestVolumeBootPattern-2062489882 tempest-TestVolumeBootPattern-2062489882-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:54:22.232761 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-d6c9a352-03c2-486a-ab83-922951c6a4db tempest-TestVolumeBootPattern-2062489882 tempest-TestVolumeBootPattern-2062489882-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:54:22.233206 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-d6c9a352-03c2-486a-ab83-922951c6a4db tempest-TestVolumeBootPattern-2062489882 tempest-TestVolumeBootPattern-2062489882-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:54:22.233645 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.objects.instance [None req-d6c9a352-03c2-486a-ab83-922951c6a4db tempest-TestVolumeBootPattern-2062489882 tempest-TestVolumeBootPattern-2062489882-project] Lazy-loading 'fault' on Instance uuid 7ee38041-8e54-4fdb-909d-585952a4f5bd {{(pid=128728) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 14 15:54:22.276710 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.policy [None req-d6c9a352-03c2-486a-ab83-922951c6a4db tempest-TestVolumeBootPattern-2062489882 tempest-TestVolumeBootPattern-2062489882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '568f6783dd4d43398a70a9ffa58ff660', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a3a2b5dee7a404a8445c8aa434b5a43', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128728) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:54:22.283957 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: INFO nova.api.openstack.requestlog [None req-d6c9a352-03c2-486a-ab83-922951c6a4db tempest-TestVolumeBootPattern-2062489882 tempest-TestVolumeBootPattern-2062489882-project] 10.222.0.61 "GET /compute/v2.1/servers/7ee38041-8e54-4fdb-909d-585952a4f5bd" status: 200 len: 1230 microversion: 2.1 time: 0.093384 May 14 15:54:22.284525 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: [pid: 128728|app: 0|req: 465/913] 10.222.0.61 () {58 vars in 1235 bytes} [Sat May 14 15:54:22 2022] GET /compute/v2.1/servers/7ee38041-8e54-4fdb-909d-585952a4f5bd => generated 1230 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 15:54:23.190630 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi [None req-7123b21d-42e5-4066-8015-b2784a16c8e7 tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Calling method '>' {{(pid=128729) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 15:54:23.191246 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.compute.api [None req-7123b21d-42e5-4066-8015-b2784a16c8e7 tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] [instance: 7c21adbe-7a79-46cf-aa7c-9b2a6548c767] Fetching instance by UUID {{(pid=128729) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 15:54:23.197623 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-7123b21d-42e5-4066-8015-b2784a16c8e7 tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:54:23.198077 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-7123b21d-42e5-4066-8015-b2784a16c8e7 tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:54:23.198894 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-7123b21d-42e5-4066-8015-b2784a16c8e7 tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:54:23.199337 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-7123b21d-42e5-4066-8015-b2784a16c8e7 tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:54:23.301960 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi [None req-56b33195-53a0-44da-a6f2-82b1c2323869 tempest-TestVolumeBootPattern-2062489882 tempest-TestVolumeBootPattern-2062489882-project] Calling method '>' {{(pid=128728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 15:54:23.302533 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.compute.api [None req-56b33195-53a0-44da-a6f2-82b1c2323869 tempest-TestVolumeBootPattern-2062489882 tempest-TestVolumeBootPattern-2062489882-project] [instance: 7ee38041-8e54-4fdb-909d-585952a4f5bd] Fetching instance by UUID {{(pid=128728) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 15:54:23.309057 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-56b33195-53a0-44da-a6f2-82b1c2323869 tempest-TestVolumeBootPattern-2062489882 tempest-TestVolumeBootPattern-2062489882-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:54:23.309506 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-56b33195-53a0-44da-a6f2-82b1c2323869 tempest-TestVolumeBootPattern-2062489882 tempest-TestVolumeBootPattern-2062489882-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:54:23.310285 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-56b33195-53a0-44da-a6f2-82b1c2323869 tempest-TestVolumeBootPattern-2062489882 tempest-TestVolumeBootPattern-2062489882-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:54:23.310993 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-56b33195-53a0-44da-a6f2-82b1c2323869 tempest-TestVolumeBootPattern-2062489882 tempest-TestVolumeBootPattern-2062489882-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:54:23.327037 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: INFO nova.api.openstack.wsgi [None req-56b33195-53a0-44da-a6f2-82b1c2323869 tempest-TestVolumeBootPattern-2062489882 tempest-TestVolumeBootPattern-2062489882-project] HTTP exception thrown: Instance 7ee38041-8e54-4fdb-909d-585952a4f5bd could not be found. May 14 15:54:23.329026 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi [None req-56b33195-53a0-44da-a6f2-82b1c2323869 tempest-TestVolumeBootPattern-2062489882 tempest-TestVolumeBootPattern-2062489882-project] Request method failure captured: May 14 15:54:23.329026 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: request: GET /compute/v2.1/servers/7ee38041-8e54-4fdb-909d-585952a4f5bd HTTP/1.1 May 14 15:54:23.329026 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: Accept: application/json May 14 15:54:23.329026 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: Accept-Encoding: identity May 14 15:54:23.329026 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: Connection: close May 14 15:54:23.329026 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: Content-Length: 0 May 14 15:54:23.329026 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: Content-Type: application/json May 14 15:54:23.329026 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: Host: 10.222.0.61 May 14 15:54:23.329026 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: Openstack-System-Scope: None May 14 15:54:23.329026 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: User-Agent: python-urllib3/1.26.9 May 14 15:54:23.329026 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: X-Auth-Token: gAAAAABif8-lCLq-GQek68v-_sRqyHHqHhinLFceOm1nxU0oEpG1HfTWZbvoXlaDlvIU3j62ihUgO3gpKQoVZ_Mbcr-Tz4MT6eGJscH5YeNw12lcZBRyAEEuzJzzBdMJWhMHN_wlrrar4GMjLQJoWNJfsFXqC8FnnClvp4CX1Z0sCsKsqQmufeM May 14 15:54:23.329026 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: X-Domain-Id: None May 14 15:54:23.329026 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: X-Domain-Name: None May 14 15:54:23.329026 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: X-Identity-Status: Confirmed May 14 15:54:23.329026 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: X-Is-Admin-Project: True May 14 15:54:23.329026 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: X-Project-Domain-Id: default May 14 15:54:23.329026 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: X-Project-Domain-Name: Default May 14 15:54:23.329026 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: X-Project-Id: 7a3a2b5dee7a404a8445c8aa434b5a43 May 14 15:54:23.329026 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: X-Project-Name: tempest-TestVolumeBootPattern-2062489882 May 14 15:54:23.329026 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: X-Role: reader,member May 14 15:54:23.329026 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: X-Roles: reader,member May 14 15:54:23.330681 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/7a3a2b5dee7a404a8445c8aa434b5a43"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/7a3a2b5dee7a404a8445c8aa434b5a43"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/7a3a2b5dee7a404a8445c8aa434b5a43"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_7a3a2b5dee7a404a8445c8aa434b5a43"}]}] May 14 15:54:23.330681 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: X-Tenant: tempest-TestVolumeBootPattern-2062489882 May 14 15:54:23.330681 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: X-Tenant-Id: 7a3a2b5dee7a404a8445c8aa434b5a43 May 14 15:54:23.330681 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: X-Tenant-Name: tempest-TestVolumeBootPattern-2062489882 May 14 15:54:23.330681 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: X-User: tempest-TestVolumeBootPattern-2062489882-project May 14 15:54:23.330681 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: X-User-Domain-Id: default May 14 15:54:23.330681 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: X-User-Domain-Name: Default May 14 15:54:23.330681 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: X-User-Id: 568f6783dd4d43398a70a9ffa58ff660 May 14 15:54:23.330681 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: X-User-Name: tempest-TestVolumeBootPattern-2062489882-project May 14 15:54:23.330681 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: method: > May 14 15:54:23.330681 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: exception: Instance 7ee38041-8e54-4fdb-909d-585952a4f5bd could not be found. May 14 15:54:23.330681 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: action_args: {'id': '7ee38041-8e54-4fdb-909d-585952a4f5bd'} May 14 15:54:23.331490 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: {{(pid=128728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 14 15:54:23.331490 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 15:54:23.331490 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 14 15:54:23.331490 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 14 15:54:23.331490 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 14 15:54:23.331490 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 14 15:54:23.331490 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 14 15:54:23.331490 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 14 15:54:23.331490 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 14 15:54:23.331490 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 14 15:54:23.331490 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7ee38041-8e54-4fdb-909d-585952a4f5bd could not be found. May 14 15:54:23.331490 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: ERROR nova.api.openstack.wsgi May 14 15:54:23.331490 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 14 15:54:23.331490 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: ERROR nova.api.openstack.wsgi May 14 15:54:23.331490 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 15:54:23.331490 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 14 15:54:23.331490 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 14 15:54:23.331490 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 14 15:54:23.331490 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 14 15:54:23.331490 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 14 15:54:23.332755 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 14 15:54:23.332755 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 14 15:54:23.332755 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 14 15:54:23.332755 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 14 15:54:23.332755 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 14 15:54:23.332755 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 14 15:54:23.332755 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 14 15:54:23.332755 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7ee38041-8e54-4fdb-909d-585952a4f5bd could not be found. May 14 15:54:23.332755 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: ERROR nova.api.openstack.wsgi May 14 15:54:23.332755 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 14 15:54:23.332755 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: ERROR nova.api.openstack.wsgi May 14 15:54:23.332755 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 15:54:23.332755 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 14 15:54:23.332755 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 14 15:54:23.332755 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 14 15:54:23.332755 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 14 15:54:23.332755 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7ee38041-8e54-4fdb-909d-585952a4f5bd could not be found. May 14 15:54:23.332755 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: ERROR nova.api.openstack.wsgi May 14 15:54:23.333875 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi [None req-56b33195-53a0-44da-a6f2-82b1c2323869 tempest-TestVolumeBootPattern-2062489882 tempest-TestVolumeBootPattern-2062489882-project] Returning 404 to user: Instance 7ee38041-8e54-4fdb-909d-585952a4f5bd could not be found. {{(pid=128728) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 14 15:54:23.333875 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: INFO nova.api.openstack.requestlog [None req-56b33195-53a0-44da-a6f2-82b1c2323869 tempest-TestVolumeBootPattern-2062489882 tempest-TestVolumeBootPattern-2062489882-project] 10.222.0.61 "GET /compute/v2.1/servers/7ee38041-8e54-4fdb-909d-585952a4f5bd" status: 404 len: 111 microversion: 2.1 time: 0.032643 May 14 15:54:23.335118 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: [pid: 128728|app: 0|req: 466/914] 10.222.0.61 () {58 vars in 1235 bytes} [Sat May 14 15:54:23 2022] GET /compute/v2.1/servers/7ee38041-8e54-4fdb-909d-585952a4f5bd => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 14 15:54:23.435013 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi [None req-b86c88c0-e365-461d-a05e-7b77d350c840 tempest-TestVolumeBootPattern-2062489882 tempest-TestVolumeBootPattern-2062489882-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1412393686", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1553604469", "security_groups": [{"name": "tempest-secgroup-smoke-1987363797"}], "block_device_mapping_v2": [{"uuid": "1daa7061-1ad2-4874-b43e-2d12308fbd9d", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "791585d6-2e4a-4237-ab00-9a26c50b495e"}]}} {{(pid=128728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 15:54:23.513380 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.policy [None req-7123b21d-42e5-4066-8015-b2784a16c8e7 tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b896317d96a40d6a137db0dcf5f98f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d2517d5440a4d30949f3dd36a46d813', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128729) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:54:23.522866 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: INFO nova.api.openstack.requestlog [None req-7123b21d-42e5-4066-8015-b2784a16c8e7 tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] 10.222.0.61 "GET /compute/v2.1/servers/7c21adbe-7a79-46cf-aa7c-9b2a6548c767" status: 200 len: 1621 microversion: 2.1 time: 0.336493 May 14 15:54:23.523534 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: [pid: 128729|app: 0|req: 449/915] 10.222.0.61 () {58 vars in 1235 bytes} [Sat May 14 15:54:23 2022] GET /compute/v2.1/servers/7c21adbe-7a79-46cf-aa7c-9b2a6548c767 => generated 1621 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 15:54:23.623315 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.network.neutron [None req-b86c88c0-e365-461d-a05e-7b77d350c840 tempest-TestVolumeBootPattern-2062489882 tempest-TestVolumeBootPattern-2062489882-project] validate_networks() for [('791585d6-2e4a-4237-ab00-9a26c50b495e', None, None, None, None, None)] {{(pid=128728) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 14 15:54:23.627872 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi [req-b93e7fd9-e2a0-4112-af14-eeca3e193746 req-67a6334a-0b6d-4050-a1ca-6a4134b9e76a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7c21adbe-7a79-46cf-aa7c-9b2a6548c767", "name": "network-vif-deleted", "tag": "5c35b70b-002b-48c3-9446-1ba3b1605c2b"}]} {{(pid=128729) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 15:54:23.651239 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [req-b93e7fd9-e2a0-4112-af14-eeca3e193746 req-67a6334a-0b6d-4050-a1ca-6a4134b9e76a service nova] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:54:23.651698 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [req-b93e7fd9-e2a0-4112-af14-eeca3e193746 req-67a6334a-0b6d-4050-a1ca-6a4134b9e76a service nova] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:54:23.666355 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: INFO nova.api.openstack.compute.server_external_events [req-b93e7fd9-e2a0-4112-af14-eeca3e193746 req-67a6334a-0b6d-4050-a1ca-6a4134b9e76a service nova] Creating event network-vif-deleted:5c35b70b-002b-48c3-9446-1ba3b1605c2b for instance 7c21adbe-7a79-46cf-aa7c-9b2a6548c767 on hv-cinder-83979 May 14 15:54:23.671377 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: INFO nova.api.openstack.requestlog [req-b93e7fd9-e2a0-4112-af14-eeca3e193746 req-67a6334a-0b6d-4050-a1ca-6a4134b9e76a service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.057511 May 14 15:54:23.672709 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: [pid: 128729|app: 0|req: 450/916] 10.222.0.61 () {64 vars in 1317 bytes} [Sat May 14 15:54:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 14 15:54:24.011420 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.virt.hardware [None req-b86c88c0-e365-461d-a05e-7b77d350c840 tempest-TestVolumeBootPattern-2062489882 tempest-TestVolumeBootPattern-2062489882-project] Flavor limits 0:0:0 {{(pid=128728) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 14 15:54:24.011838 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.virt.hardware [None req-b86c88c0-e365-461d-a05e-7b77d350c840 tempest-TestVolumeBootPattern-2062489882 tempest-TestVolumeBootPattern-2062489882-project] Image limits 0:0:0 {{(pid=128728) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 14 15:54:24.012324 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.virt.hardware [None req-b86c88c0-e365-461d-a05e-7b77d350c840 tempest-TestVolumeBootPattern-2062489882 tempest-TestVolumeBootPattern-2062489882-project] Flavor pref 0:0:0 {{(pid=128728) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 14 15:54:24.012727 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.virt.hardware [None req-b86c88c0-e365-461d-a05e-7b77d350c840 tempest-TestVolumeBootPattern-2062489882 tempest-TestVolumeBootPattern-2062489882-project] Image pref 0:0:0 {{(pid=128728) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 14 15:54:24.013129 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.virt.hardware [None req-b86c88c0-e365-461d-a05e-7b77d350c840 tempest-TestVolumeBootPattern-2062489882 tempest-TestVolumeBootPattern-2062489882-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128728) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 14 15:54:24.030872 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-b86c88c0-e365-461d-a05e-7b77d350c840 tempest-TestVolumeBootPattern-2062489882 tempest-TestVolumeBootPattern-2062489882-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:54:24.031394 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-b86c88c0-e365-461d-a05e-7b77d350c840 tempest-TestVolumeBootPattern-2062489882 tempest-TestVolumeBootPattern-2062489882-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:54:24.032200 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-b86c88c0-e365-461d-a05e-7b77d350c840 tempest-TestVolumeBootPattern-2062489882 tempest-TestVolumeBootPattern-2062489882-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:54:24.032649 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-b86c88c0-e365-461d-a05e-7b77d350c840 tempest-TestVolumeBootPattern-2062489882 tempest-TestVolumeBootPattern-2062489882-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:54:24.049231 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.quota [None req-b86c88c0-e365-461d-a05e-7b77d350c840 tempest-TestVolumeBootPattern-2062489882 tempest-TestVolumeBootPattern-2062489882-project] Getting quotas for project 7a3a2b5dee7a404a8445c8aa434b5a43. Resources: {'instances', 'cores', 'ram'} {{(pid=128728) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 14 15:54:24.053814 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.quota [None req-b86c88c0-e365-461d-a05e-7b77d350c840 tempest-TestVolumeBootPattern-2062489882 tempest-TestVolumeBootPattern-2062489882-project] Getting quotas for user 568f6783dd4d43398a70a9ffa58ff660 and project 7a3a2b5dee7a404a8445c8aa434b5a43. Resources: {'instances', 'cores', 'ram'} {{(pid=128728) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 14 15:54:24.114469 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.compute.api [None req-b86c88c0-e365-461d-a05e-7b77d350c840 tempest-TestVolumeBootPattern-2062489882 tempest-TestVolumeBootPattern-2062489882-project] Going to run 1 instances... {{(pid=128728) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 14 15:54:24.117038 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.compute.api [None req-b86c88c0-e365-461d-a05e-7b77d350c840 tempest-TestVolumeBootPattern-2062489882 tempest-TestVolumeBootPattern-2062489882-project] [instance: a3ea9ec3-f9f5-4d5f-81e2-83d33e93a74b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='1daa7061-1ad2-4874-b43e-2d12308fbd9d',volume_size=None,volume_type=None)] {{(pid=128728) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 14 15:54:24.248468 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: INFO nova.api.openstack.requestlog [None req-b86c88c0-e365-461d-a05e-7b77d350c840 tempest-TestVolumeBootPattern-2062489882 tempest-TestVolumeBootPattern-2062489882-project] 10.222.0.61 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.817364 May 14 15:54:24.249117 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: [pid: 128728|app: 0|req: 467/917] 10.222.0.61 () {60 vars in 1146 bytes} [Sat May 14 15:54:23 2022] POST /compute/v2.1/servers => generated 406 bytes in 819 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 14 15:54:24.260382 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi [None req-0e9e2024-e75e-4f53-b484-dc9af1f72e54 tempest-TestVolumeBootPattern-2062489882 tempest-TestVolumeBootPattern-2062489882-project] Calling method '>' {{(pid=128729) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 15:54:24.261069 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.compute.api [None req-0e9e2024-e75e-4f53-b484-dc9af1f72e54 tempest-TestVolumeBootPattern-2062489882 tempest-TestVolumeBootPattern-2062489882-project] [instance: a3ea9ec3-f9f5-4d5f-81e2-83d33e93a74b] Fetching instance by UUID {{(pid=128729) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 15:54:24.320518 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.policy [None req-0e9e2024-e75e-4f53-b484-dc9af1f72e54 tempest-TestVolumeBootPattern-2062489882 tempest-TestVolumeBootPattern-2062489882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '568f6783dd4d43398a70a9ffa58ff660', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a3a2b5dee7a404a8445c8aa434b5a43', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128729) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:54:24.327141 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: INFO nova.api.openstack.requestlog [None req-0e9e2024-e75e-4f53-b484-dc9af1f72e54 tempest-TestVolumeBootPattern-2062489882 tempest-TestVolumeBootPattern-2062489882-project] 10.222.0.61 "GET /compute/v2.1/servers/a3ea9ec3-f9f5-4d5f-81e2-83d33e93a74b" status: 200 len: 1095 microversion: 2.1 time: 0.071074 May 14 15:54:24.327741 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: [pid: 128729|app: 0|req: 451/918] 10.222.0.61 () {58 vars in 1235 bytes} [Sat May 14 15:54:24 2022] GET /compute/v2.1/servers/a3ea9ec3-f9f5-4d5f-81e2-83d33e93a74b => generated 1095 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 15:54:24.540723 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi [None req-f1d1ec99-43f4-4ce8-b9d7-64bdb81d6aa4 tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Calling method '>' {{(pid=128728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 15:54:24.541322 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.compute.api [None req-f1d1ec99-43f4-4ce8-b9d7-64bdb81d6aa4 tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] [instance: 7c21adbe-7a79-46cf-aa7c-9b2a6548c767] Fetching instance by UUID {{(pid=128728) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 15:54:24.548247 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-f1d1ec99-43f4-4ce8-b9d7-64bdb81d6aa4 tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:54:24.548767 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-f1d1ec99-43f4-4ce8-b9d7-64bdb81d6aa4 tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:54:24.549608 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-f1d1ec99-43f4-4ce8-b9d7-64bdb81d6aa4 tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:54:24.550111 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-f1d1ec99-43f4-4ce8-b9d7-64bdb81d6aa4 tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:54:24.564886 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: INFO nova.api.openstack.wsgi [None req-f1d1ec99-43f4-4ce8-b9d7-64bdb81d6aa4 tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] HTTP exception thrown: Instance 7c21adbe-7a79-46cf-aa7c-9b2a6548c767 could not be found. May 14 15:54:24.566822 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi [None req-f1d1ec99-43f4-4ce8-b9d7-64bdb81d6aa4 tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Request method failure captured: May 14 15:54:24.566822 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: request: GET /compute/v2.1/servers/7c21adbe-7a79-46cf-aa7c-9b2a6548c767 HTTP/1.1 May 14 15:54:24.566822 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: Accept: application/json May 14 15:54:24.566822 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: Accept-Encoding: identity May 14 15:54:24.566822 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: Connection: close May 14 15:54:24.566822 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: Content-Length: 0 May 14 15:54:24.566822 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: Content-Type: application/json May 14 15:54:24.566822 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: Host: 10.222.0.61 May 14 15:54:24.566822 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: Openstack-System-Scope: None May 14 15:54:24.566822 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: User-Agent: python-urllib3/1.26.9 May 14 15:54:24.566822 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: X-Auth-Token: gAAAAABif87TjanYsrrU9KpYd5057ovf5TRvtsRqqkrdTWz9P6C_YEs6Yd4CDME33lagxGClN3GtsEEl95Qsg7nFg7CgnMsPohorXTcxxG47tx7yWCVnqL6E-EqIsy7vXURQ6VzDtKaYCpcbPZh6yi-RI8tatcgKoVxklM3PcFb97OQYybSwzGM May 14 15:54:24.566822 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: X-Domain-Id: None May 14 15:54:24.566822 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: X-Domain-Name: None May 14 15:54:24.566822 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: X-Identity-Status: Confirmed May 14 15:54:24.566822 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: X-Is-Admin-Project: True May 14 15:54:24.566822 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: X-Project-Domain-Id: default May 14 15:54:24.566822 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: X-Project-Domain-Name: Default May 14 15:54:24.566822 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: X-Project-Id: 5d2517d5440a4d30949f3dd36a46d813 May 14 15:54:24.566822 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1508904783 May 14 15:54:24.566822 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: X-Role: reader,member May 14 15:54:24.566822 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: X-Roles: reader,member May 14 15:54:24.568426 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/5d2517d5440a4d30949f3dd36a46d813"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/5d2517d5440a4d30949f3dd36a46d813"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/5d2517d5440a4d30949f3dd36a46d813"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_5d2517d5440a4d30949f3dd36a46d813"}]}] May 14 15:54:24.568426 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1508904783 May 14 15:54:24.568426 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: X-Tenant-Id: 5d2517d5440a4d30949f3dd36a46d813 May 14 15:54:24.568426 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1508904783 May 14 15:54:24.568426 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: X-User: tempest-ServerRescueNegativeTestJSON-1508904783-project May 14 15:54:24.568426 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: X-User-Domain-Id: default May 14 15:54:24.568426 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: X-User-Domain-Name: Default May 14 15:54:24.568426 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: X-User-Id: 7b896317d96a40d6a137db0dcf5f98f2 May 14 15:54:24.568426 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1508904783-project May 14 15:54:24.568426 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: method: > May 14 15:54:24.568426 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: exception: Instance 7c21adbe-7a79-46cf-aa7c-9b2a6548c767 could not be found. May 14 15:54:24.568426 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: action_args: {'id': '7c21adbe-7a79-46cf-aa7c-9b2a6548c767'} May 14 15:54:24.569390 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: {{(pid=128728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 14 15:54:24.569390 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 15:54:24.569390 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 14 15:54:24.569390 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 14 15:54:24.569390 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 14 15:54:24.569390 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 14 15:54:24.569390 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 14 15:54:24.569390 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 14 15:54:24.569390 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 14 15:54:24.569390 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 14 15:54:24.569390 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7c21adbe-7a79-46cf-aa7c-9b2a6548c767 could not be found. May 14 15:54:24.569390 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: ERROR nova.api.openstack.wsgi May 14 15:54:24.569390 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 14 15:54:24.569390 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: ERROR nova.api.openstack.wsgi May 14 15:54:24.569390 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 15:54:24.569390 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 14 15:54:24.569390 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 14 15:54:24.569390 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 14 15:54:24.569390 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 14 15:54:24.569390 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 14 15:54:24.570789 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 14 15:54:24.570789 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 14 15:54:24.570789 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 14 15:54:24.570789 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 14 15:54:24.570789 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 14 15:54:24.570789 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 14 15:54:24.570789 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 14 15:54:24.570789 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7c21adbe-7a79-46cf-aa7c-9b2a6548c767 could not be found. May 14 15:54:24.570789 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: ERROR nova.api.openstack.wsgi May 14 15:54:24.570789 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 14 15:54:24.570789 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: ERROR nova.api.openstack.wsgi May 14 15:54:24.570789 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 15:54:24.570789 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 14 15:54:24.570789 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 14 15:54:24.570789 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 14 15:54:24.570789 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 14 15:54:24.570789 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7c21adbe-7a79-46cf-aa7c-9b2a6548c767 could not be found. May 14 15:54:24.570789 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: ERROR nova.api.openstack.wsgi May 14 15:54:24.572797 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi [None req-f1d1ec99-43f4-4ce8-b9d7-64bdb81d6aa4 tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Returning 404 to user: Instance 7c21adbe-7a79-46cf-aa7c-9b2a6548c767 could not be found. {{(pid=128728) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 14 15:54:24.573632 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: INFO nova.api.openstack.requestlog [None req-f1d1ec99-43f4-4ce8-b9d7-64bdb81d6aa4 tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] 10.222.0.61 "GET /compute/v2.1/servers/7c21adbe-7a79-46cf-aa7c-9b2a6548c767" status: 404 len: 111 microversion: 2.1 time: 0.037583 May 14 15:54:24.574176 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: [pid: 128728|app: 0|req: 468/919] 10.222.0.61 () {58 vars in 1235 bytes} [Sat May 14 15:54:24 2022] GET /compute/v2.1/servers/7c21adbe-7a79-46cf-aa7c-9b2a6548c767 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 14 15:54:24.582655 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi [None req-245a084c-6d84-4d30-90b6-6ad925001ab8 tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Calling method '.version_select at 0x7f77dce7f5e0>' {{(pid=128729) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 15:54:24.601674 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: INFO nova.api.openstack.requestlog [None req-245a084c-6d84-4d30-90b6-6ad925001ab8 tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] 10.222.0.61 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-914910257" status: 202 len: 0 microversion: 2.1 time: 0.022886 May 14 15:54:24.602382 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: [pid: 128729|app: 0|req: 452/920] 10.222.0.61 () {58 vars in 1217 bytes} [Sat May 14 15:54:24 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-914910257 => generated 0 bytes in 24 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) May 14 15:54:25.344244 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi [None req-941ad3cf-5e18-46ae-bdf6-55fdef279fa5 tempest-TestVolumeBootPattern-2062489882 tempest-TestVolumeBootPattern-2062489882-project] Calling method '>' {{(pid=128728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 15:54:25.344848 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.compute.api [None req-941ad3cf-5e18-46ae-bdf6-55fdef279fa5 tempest-TestVolumeBootPattern-2062489882 tempest-TestVolumeBootPattern-2062489882-project] [instance: a3ea9ec3-f9f5-4d5f-81e2-83d33e93a74b] Fetching instance by UUID {{(pid=128728) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 15:54:25.350712 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-941ad3cf-5e18-46ae-bdf6-55fdef279fa5 tempest-TestVolumeBootPattern-2062489882 tempest-TestVolumeBootPattern-2062489882-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:54:25.351306 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-941ad3cf-5e18-46ae-bdf6-55fdef279fa5 tempest-TestVolumeBootPattern-2062489882 tempest-TestVolumeBootPattern-2062489882-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:54:25.352083 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-941ad3cf-5e18-46ae-bdf6-55fdef279fa5 tempest-TestVolumeBootPattern-2062489882 tempest-TestVolumeBootPattern-2062489882-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:54:25.352745 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-941ad3cf-5e18-46ae-bdf6-55fdef279fa5 tempest-TestVolumeBootPattern-2062489882 tempest-TestVolumeBootPattern-2062489882-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:54:25.427356 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.policy [None req-941ad3cf-5e18-46ae-bdf6-55fdef279fa5 tempest-TestVolumeBootPattern-2062489882 tempest-TestVolumeBootPattern-2062489882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '568f6783dd4d43398a70a9ffa58ff660', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a3a2b5dee7a404a8445c8aa434b5a43', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128728) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:54:25.434513 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: INFO nova.api.openstack.requestlog [None req-941ad3cf-5e18-46ae-bdf6-55fdef279fa5 tempest-TestVolumeBootPattern-2062489882 tempest-TestVolumeBootPattern-2062489882-project] 10.222.0.61 "GET /compute/v2.1/servers/a3ea9ec3-f9f5-4d5f-81e2-83d33e93a74b" status: 200 len: 1211 microversion: 2.1 time: 0.094689 May 14 15:54:25.435076 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: [pid: 128728|app: 0|req: 469/921] 10.222.0.61 () {58 vars in 1235 bytes} [Sat May 14 15:54:25 2022] GET /compute/v2.1/servers/a3ea9ec3-f9f5-4d5f-81e2-83d33e93a74b => generated 1211 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 15:54:26.452333 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi [None req-83c9ce95-8994-45d8-bd5f-132fc94a2cd0 tempest-TestVolumeBootPattern-2062489882 tempest-TestVolumeBootPattern-2062489882-project] Calling method '>' {{(pid=128729) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 15:54:26.453797 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.compute.api [None req-83c9ce95-8994-45d8-bd5f-132fc94a2cd0 tempest-TestVolumeBootPattern-2062489882 tempest-TestVolumeBootPattern-2062489882-project] [instance: a3ea9ec3-f9f5-4d5f-81e2-83d33e93a74b] Fetching instance by UUID {{(pid=128729) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 15:54:26.470688 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-83c9ce95-8994-45d8-bd5f-132fc94a2cd0 tempest-TestVolumeBootPattern-2062489882 tempest-TestVolumeBootPattern-2062489882-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:54:26.471225 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-83c9ce95-8994-45d8-bd5f-132fc94a2cd0 tempest-TestVolumeBootPattern-2062489882 tempest-TestVolumeBootPattern-2062489882-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:54:26.472077 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-83c9ce95-8994-45d8-bd5f-132fc94a2cd0 tempest-TestVolumeBootPattern-2062489882 tempest-TestVolumeBootPattern-2062489882-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:54:26.472611 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-83c9ce95-8994-45d8-bd5f-132fc94a2cd0 tempest-TestVolumeBootPattern-2062489882 tempest-TestVolumeBootPattern-2062489882-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:54:26.679706 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.policy [None req-83c9ce95-8994-45d8-bd5f-132fc94a2cd0 tempest-TestVolumeBootPattern-2062489882 tempest-TestVolumeBootPattern-2062489882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '568f6783dd4d43398a70a9ffa58ff660', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a3a2b5dee7a404a8445c8aa434b5a43', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128729) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:54:26.687919 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: INFO nova.api.openstack.requestlog [None req-83c9ce95-8994-45d8-bd5f-132fc94a2cd0 tempest-TestVolumeBootPattern-2062489882 tempest-TestVolumeBootPattern-2062489882-project] 10.222.0.61 "GET /compute/v2.1/servers/a3ea9ec3-f9f5-4d5f-81e2-83d33e93a74b" status: 200 len: 1267 microversion: 2.1 time: 0.239659 May 14 15:54:26.688634 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: [pid: 128729|app: 0|req: 453/922] 10.222.0.61 () {58 vars in 1235 bytes} [Sat May 14 15:54:26 2022] GET /compute/v2.1/servers/a3ea9ec3-f9f5-4d5f-81e2-83d33e93a74b => generated 1267 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 15:54:26.809077 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi [req-ccebc0d3-069d-418f-8b4f-c1d5ee0e22f0 req-c29e689d-bbee-458e-aec8-5fb017a50bfa service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a3ea9ec3-f9f5-4d5f-81e2-83d33e93a74b", "tag": "85faf801-1e40-4e72-a22b-f9e9a859f83a"}]} {{(pid=128728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 15:54:26.818825 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [req-ccebc0d3-069d-418f-8b4f-c1d5ee0e22f0 req-c29e689d-bbee-458e-aec8-5fb017a50bfa service nova] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:54:26.819263 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [req-ccebc0d3-069d-418f-8b4f-c1d5ee0e22f0 req-c29e689d-bbee-458e-aec8-5fb017a50bfa service nova] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:54:26.842936 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: INFO nova.api.openstack.compute.server_external_events [req-ccebc0d3-069d-418f-8b4f-c1d5ee0e22f0 req-c29e689d-bbee-458e-aec8-5fb017a50bfa service nova] Creating event network-changed:85faf801-1e40-4e72-a22b-f9e9a859f83a for instance a3ea9ec3-f9f5-4d5f-81e2-83d33e93a74b on hv-cinder-83979 May 14 15:54:26.848900 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: INFO nova.api.openstack.requestlog [req-ccebc0d3-069d-418f-8b4f-c1d5ee0e22f0 req-c29e689d-bbee-458e-aec8-5fb017a50bfa service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043451 May 14 15:54:26.849499 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: [pid: 128728|app: 0|req: 470/923] 10.222.0.61 () {64 vars in 1317 bytes} [Sat May 14 15:54:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 14 15:54:27.492319 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi [None req-086b42f0-1067-409a-8d17-3deeb8dfa297 tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Calling method '>' {{(pid=128729) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 15:54:27.492841 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.compute.api [None req-086b42f0-1067-409a-8d17-3deeb8dfa297 tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] [instance: 563c74e0-060d-49d5-abc5-389cee4bd9d5] Fetching instance by UUID {{(pid=128729) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 15:54:27.499214 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-086b42f0-1067-409a-8d17-3deeb8dfa297 tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:54:27.500598 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-086b42f0-1067-409a-8d17-3deeb8dfa297 tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:54:27.501359 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-086b42f0-1067-409a-8d17-3deeb8dfa297 tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:54:27.501795 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-086b42f0-1067-409a-8d17-3deeb8dfa297 tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:54:27.525694 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.compute.api [None req-086b42f0-1067-409a-8d17-3deeb8dfa297 tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] [instance: 563c74e0-060d-49d5-abc5-389cee4bd9d5] Going to try to terminate instance {{(pid=128729) delete /opt/stack/nova/nova/compute/api.py:2664}} May 14 15:54:27.598100 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: INFO nova.api.openstack.requestlog [None req-086b42f0-1067-409a-8d17-3deeb8dfa297 tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] 10.222.0.61 "DELETE /compute/v2.1/servers/563c74e0-060d-49d5-abc5-389cee4bd9d5" status: 204 len: 0 microversion: 2.1 time: 0.109568 May 14 15:54:27.598697 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: [pid: 128729|app: 0|req: 454/924] 10.222.0.61 () {58 vars in 1238 bytes} [Sat May 14 15:54:27 2022] DELETE /compute/v2.1/servers/563c74e0-060d-49d5-abc5-389cee4bd9d5 => generated 0 bytes in 111 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 14 15:54:27.607232 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi [None req-6d7e5c4a-1307-4b1a-9be7-80e7f81c3320 tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Calling method '>' {{(pid=128728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 15:54:27.607930 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.compute.api [None req-6d7e5c4a-1307-4b1a-9be7-80e7f81c3320 tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] [instance: 563c74e0-060d-49d5-abc5-389cee4bd9d5] Fetching instance by UUID {{(pid=128728) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 15:54:27.614656 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-6d7e5c4a-1307-4b1a-9be7-80e7f81c3320 tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:54:27.615106 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-6d7e5c4a-1307-4b1a-9be7-80e7f81c3320 tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:54:27.616125 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-6d7e5c4a-1307-4b1a-9be7-80e7f81c3320 tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:54:27.616557 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-6d7e5c4a-1307-4b1a-9be7-80e7f81c3320 tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:54:27.705564 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi [None req-06ab5048-ba54-452b-884b-f320aecab058 tempest-TestVolumeBootPattern-2062489882 tempest-TestVolumeBootPattern-2062489882-project] Calling method '>' {{(pid=128729) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 15:54:27.706268 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.compute.api [None req-06ab5048-ba54-452b-884b-f320aecab058 tempest-TestVolumeBootPattern-2062489882 tempest-TestVolumeBootPattern-2062489882-project] [instance: a3ea9ec3-f9f5-4d5f-81e2-83d33e93a74b] Fetching instance by UUID {{(pid=128729) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 15:54:27.712191 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-06ab5048-ba54-452b-884b-f320aecab058 tempest-TestVolumeBootPattern-2062489882 tempest-TestVolumeBootPattern-2062489882-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:54:27.712641 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-06ab5048-ba54-452b-884b-f320aecab058 tempest-TestVolumeBootPattern-2062489882 tempest-TestVolumeBootPattern-2062489882-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:54:27.713413 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-06ab5048-ba54-452b-884b-f320aecab058 tempest-TestVolumeBootPattern-2062489882 tempest-TestVolumeBootPattern-2062489882-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:54:27.713845 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-06ab5048-ba54-452b-884b-f320aecab058 tempest-TestVolumeBootPattern-2062489882 tempest-TestVolumeBootPattern-2062489882-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:54:27.750194 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.policy [None req-6d7e5c4a-1307-4b1a-9be7-80e7f81c3320 tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b896317d96a40d6a137db0dcf5f98f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d2517d5440a4d30949f3dd36a46d813', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128728) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:54:27.757737 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: INFO nova.api.openstack.requestlog [None req-6d7e5c4a-1307-4b1a-9be7-80e7f81c3320 tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] 10.222.0.61 "GET /compute/v2.1/servers/563c74e0-060d-49d5-abc5-389cee4bd9d5" status: 200 len: 1508 microversion: 2.1 time: 0.154574 May 14 15:54:27.758643 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: [pid: 128728|app: 0|req: 471/925] 10.222.0.61 () {58 vars in 1235 bytes} [Sat May 14 15:54:27 2022] GET /compute/v2.1/servers/563c74e0-060d-49d5-abc5-389cee4bd9d5 => generated 1508 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 15:54:27.845548 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.policy [None req-06ab5048-ba54-452b-884b-f320aecab058 tempest-TestVolumeBootPattern-2062489882 tempest-TestVolumeBootPattern-2062489882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '568f6783dd4d43398a70a9ffa58ff660', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a3a2b5dee7a404a8445c8aa434b5a43', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128729) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:54:27.852988 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: INFO nova.api.openstack.requestlog [None req-06ab5048-ba54-452b-884b-f320aecab058 tempest-TestVolumeBootPattern-2062489882 tempest-TestVolumeBootPattern-2062489882-project] 10.222.0.61 "GET /compute/v2.1/servers/a3ea9ec3-f9f5-4d5f-81e2-83d33e93a74b" status: 200 len: 1267 microversion: 2.1 time: 0.151695 May 14 15:54:27.853553 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: [pid: 128729|app: 0|req: 455/926] 10.222.0.61 () {58 vars in 1235 bytes} [Sat May 14 15:54:27 2022] GET /compute/v2.1/servers/a3ea9ec3-f9f5-4d5f-81e2-83d33e93a74b => generated 1267 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 15:54:28.775156 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi [None req-18e3861f-d358-4b46-9de8-60922ac80e3c tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Calling method '>' {{(pid=128728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 15:54:28.775777 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.compute.api [None req-18e3861f-d358-4b46-9de8-60922ac80e3c tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] [instance: 563c74e0-060d-49d5-abc5-389cee4bd9d5] Fetching instance by UUID {{(pid=128728) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 15:54:28.782460 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-18e3861f-d358-4b46-9de8-60922ac80e3c tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:54:28.782924 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-18e3861f-d358-4b46-9de8-60922ac80e3c tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:54:28.783755 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-18e3861f-d358-4b46-9de8-60922ac80e3c tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:54:28.784249 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-18e3861f-d358-4b46-9de8-60922ac80e3c tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:54:28.870495 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi [None req-34f14ff2-099f-4b9a-a362-fc49ae04e3e7 tempest-TestVolumeBootPattern-2062489882 tempest-TestVolumeBootPattern-2062489882-project] Calling method '>' {{(pid=128729) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 15:54:28.871259 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.compute.api [None req-34f14ff2-099f-4b9a-a362-fc49ae04e3e7 tempest-TestVolumeBootPattern-2062489882 tempest-TestVolumeBootPattern-2062489882-project] [instance: a3ea9ec3-f9f5-4d5f-81e2-83d33e93a74b] Fetching instance by UUID {{(pid=128729) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 15:54:28.878084 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-34f14ff2-099f-4b9a-a362-fc49ae04e3e7 tempest-TestVolumeBootPattern-2062489882 tempest-TestVolumeBootPattern-2062489882-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:54:28.878630 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-34f14ff2-099f-4b9a-a362-fc49ae04e3e7 tempest-TestVolumeBootPattern-2062489882 tempest-TestVolumeBootPattern-2062489882-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:54:28.879488 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-34f14ff2-099f-4b9a-a362-fc49ae04e3e7 tempest-TestVolumeBootPattern-2062489882 tempest-TestVolumeBootPattern-2062489882-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:54:28.879987 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-34f14ff2-099f-4b9a-a362-fc49ae04e3e7 tempest-TestVolumeBootPattern-2062489882 tempest-TestVolumeBootPattern-2062489882-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:54:28.911879 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.policy [None req-18e3861f-d358-4b46-9de8-60922ac80e3c tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b896317d96a40d6a137db0dcf5f98f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d2517d5440a4d30949f3dd36a46d813', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128728) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:54:28.922350 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: INFO nova.api.openstack.requestlog [None req-18e3861f-d358-4b46-9de8-60922ac80e3c tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] 10.222.0.61 "GET /compute/v2.1/servers/563c74e0-060d-49d5-abc5-389cee4bd9d5" status: 200 len: 1508 microversion: 2.1 time: 0.150651 May 14 15:54:28.922946 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: [pid: 128728|app: 0|req: 472/927] 10.222.0.61 () {58 vars in 1235 bytes} [Sat May 14 15:54:28 2022] GET /compute/v2.1/servers/563c74e0-060d-49d5-abc5-389cee4bd9d5 => generated 1508 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 15:54:29.048411 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.policy [None req-34f14ff2-099f-4b9a-a362-fc49ae04e3e7 tempest-TestVolumeBootPattern-2062489882 tempest-TestVolumeBootPattern-2062489882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '568f6783dd4d43398a70a9ffa58ff660', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a3a2b5dee7a404a8445c8aa434b5a43', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128729) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:54:29.055784 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: INFO nova.api.openstack.requestlog [None req-34f14ff2-099f-4b9a-a362-fc49ae04e3e7 tempest-TestVolumeBootPattern-2062489882 tempest-TestVolumeBootPattern-2062489882-project] 10.222.0.61 "GET /compute/v2.1/servers/a3ea9ec3-f9f5-4d5f-81e2-83d33e93a74b" status: 200 len: 1267 microversion: 2.1 time: 0.189113 May 14 15:54:29.056346 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: [pid: 128729|app: 0|req: 456/928] 10.222.0.61 () {58 vars in 1235 bytes} [Sat May 14 15:54:28 2022] GET /compute/v2.1/servers/a3ea9ec3-f9f5-4d5f-81e2-83d33e93a74b => generated 1267 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 15:54:29.939171 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi [None req-73e98dc4-1512-4faa-a112-82c090ecd7fc tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Calling method '>' {{(pid=128728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 15:54:29.939780 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.compute.api [None req-73e98dc4-1512-4faa-a112-82c090ecd7fc tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] [instance: 563c74e0-060d-49d5-abc5-389cee4bd9d5] Fetching instance by UUID {{(pid=128728) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 15:54:29.946028 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-73e98dc4-1512-4faa-a112-82c090ecd7fc tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:54:29.946526 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-73e98dc4-1512-4faa-a112-82c090ecd7fc tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:54:29.947304 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-73e98dc4-1512-4faa-a112-82c090ecd7fc tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:54:29.947718 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-73e98dc4-1512-4faa-a112-82c090ecd7fc tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:54:30.072894 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi [None req-6a3a5203-d5c8-4b8e-9312-87a4011017e4 tempest-TestVolumeBootPattern-2062489882 tempest-TestVolumeBootPattern-2062489882-project] Calling method '>' {{(pid=128729) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 15:54:30.073508 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.compute.api [None req-6a3a5203-d5c8-4b8e-9312-87a4011017e4 tempest-TestVolumeBootPattern-2062489882 tempest-TestVolumeBootPattern-2062489882-project] [instance: a3ea9ec3-f9f5-4d5f-81e2-83d33e93a74b] Fetching instance by UUID {{(pid=128729) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 15:54:30.076934 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.policy [None req-73e98dc4-1512-4faa-a112-82c090ecd7fc tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b896317d96a40d6a137db0dcf5f98f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d2517d5440a4d30949f3dd36a46d813', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128728) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:54:30.080135 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-6a3a5203-d5c8-4b8e-9312-87a4011017e4 tempest-TestVolumeBootPattern-2062489882 tempest-TestVolumeBootPattern-2062489882-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:54:30.080588 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-6a3a5203-d5c8-4b8e-9312-87a4011017e4 tempest-TestVolumeBootPattern-2062489882 tempest-TestVolumeBootPattern-2062489882-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:54:30.081360 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-6a3a5203-d5c8-4b8e-9312-87a4011017e4 tempest-TestVolumeBootPattern-2062489882 tempest-TestVolumeBootPattern-2062489882-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:54:30.081797 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-6a3a5203-d5c8-4b8e-9312-87a4011017e4 tempest-TestVolumeBootPattern-2062489882 tempest-TestVolumeBootPattern-2062489882-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:54:30.084226 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: INFO nova.api.openstack.requestlog [None req-73e98dc4-1512-4faa-a112-82c090ecd7fc tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] 10.222.0.61 "GET /compute/v2.1/servers/563c74e0-060d-49d5-abc5-389cee4bd9d5" status: 200 len: 1508 microversion: 2.1 time: 0.148867 May 14 15:54:30.084791 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: [pid: 128728|app: 0|req: 473/929] 10.222.0.61 () {58 vars in 1235 bytes} [Sat May 14 15:54:29 2022] GET /compute/v2.1/servers/563c74e0-060d-49d5-abc5-389cee4bd9d5 => generated 1508 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 15:54:30.304429 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.policy [None req-6a3a5203-d5c8-4b8e-9312-87a4011017e4 tempest-TestVolumeBootPattern-2062489882 tempest-TestVolumeBootPattern-2062489882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '568f6783dd4d43398a70a9ffa58ff660', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a3a2b5dee7a404a8445c8aa434b5a43', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128729) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:54:30.311634 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: INFO nova.api.openstack.requestlog [None req-6a3a5203-d5c8-4b8e-9312-87a4011017e4 tempest-TestVolumeBootPattern-2062489882 tempest-TestVolumeBootPattern-2062489882-project] 10.222.0.61 "GET /compute/v2.1/servers/a3ea9ec3-f9f5-4d5f-81e2-83d33e93a74b" status: 200 len: 1267 microversion: 2.1 time: 0.242578 May 14 15:54:30.312638 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: [pid: 128729|app: 0|req: 457/930] 10.222.0.61 () {58 vars in 1235 bytes} [Sat May 14 15:54:30 2022] GET /compute/v2.1/servers/a3ea9ec3-f9f5-4d5f-81e2-83d33e93a74b => generated 1267 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 15:54:30.545524 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi [req-78ed7b51-48d4-4257-8011-0b44776eaa02 req-a4f90f6d-0c60-4785-9840-a073de2a3713 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "563c74e0-060d-49d5-abc5-389cee4bd9d5", "name": "network-vif-deleted", "tag": "e71a293a-1d12-4e53-a116-f52bc19b1aa0"}]} {{(pid=128728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 15:54:30.558603 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [req-78ed7b51-48d4-4257-8011-0b44776eaa02 req-a4f90f6d-0c60-4785-9840-a073de2a3713 service nova] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:54:30.559437 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [req-78ed7b51-48d4-4257-8011-0b44776eaa02 req-a4f90f6d-0c60-4785-9840-a073de2a3713 service nova] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:54:30.579070 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: INFO nova.api.openstack.compute.server_external_events [req-78ed7b51-48d4-4257-8011-0b44776eaa02 req-a4f90f6d-0c60-4785-9840-a073de2a3713 service nova] Creating event network-vif-deleted:e71a293a-1d12-4e53-a116-f52bc19b1aa0 for instance 563c74e0-060d-49d5-abc5-389cee4bd9d5 on hv-cinder-83979 May 14 15:54:30.586091 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: INFO nova.api.openstack.requestlog [req-78ed7b51-48d4-4257-8011-0b44776eaa02 req-a4f90f6d-0c60-4785-9840-a073de2a3713 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045257 May 14 15:54:30.587495 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: [pid: 128728|app: 0|req: 474/931] 10.222.0.61 () {64 vars in 1317 bytes} [Sat May 14 15:54:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 14 15:54:31.101540 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi [None req-05014616-3761-446e-95d4-fb1c42e532e4 tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Calling method '>' {{(pid=128729) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 15:54:31.102878 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.compute.api [None req-05014616-3761-446e-95d4-fb1c42e532e4 tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] [instance: 563c74e0-060d-49d5-abc5-389cee4bd9d5] Fetching instance by UUID {{(pid=128729) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 15:54:31.110921 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-05014616-3761-446e-95d4-fb1c42e532e4 tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:54:31.111462 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-05014616-3761-446e-95d4-fb1c42e532e4 tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:54:31.112433 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-05014616-3761-446e-95d4-fb1c42e532e4 tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:54:31.112878 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-05014616-3761-446e-95d4-fb1c42e532e4 tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:54:31.126790 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: INFO nova.api.openstack.wsgi [None req-05014616-3761-446e-95d4-fb1c42e532e4 tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] HTTP exception thrown: Instance 563c74e0-060d-49d5-abc5-389cee4bd9d5 could not be found. May 14 15:54:31.128439 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi [None req-05014616-3761-446e-95d4-fb1c42e532e4 tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Request method failure captured: May 14 15:54:31.128439 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: request: GET /compute/v2.1/servers/563c74e0-060d-49d5-abc5-389cee4bd9d5 HTTP/1.1 May 14 15:54:31.128439 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: Accept: application/json May 14 15:54:31.128439 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: Accept-Encoding: identity May 14 15:54:31.128439 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: Connection: close May 14 15:54:31.128439 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: Content-Length: 0 May 14 15:54:31.128439 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: Content-Type: application/json May 14 15:54:31.128439 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: Host: 10.222.0.61 May 14 15:54:31.128439 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: Openstack-System-Scope: None May 14 15:54:31.128439 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: User-Agent: python-urllib3/1.26.9 May 14 15:54:31.128439 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: X-Auth-Token: gAAAAABif87TjanYsrrU9KpYd5057ovf5TRvtsRqqkrdTWz9P6C_YEs6Yd4CDME33lagxGClN3GtsEEl95Qsg7nFg7CgnMsPohorXTcxxG47tx7yWCVnqL6E-EqIsy7vXURQ6VzDtKaYCpcbPZh6yi-RI8tatcgKoVxklM3PcFb97OQYybSwzGM May 14 15:54:31.128439 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: X-Domain-Id: None May 14 15:54:31.128439 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: X-Domain-Name: None May 14 15:54:31.128439 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: X-Identity-Status: Confirmed May 14 15:54:31.128439 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: X-Is-Admin-Project: True May 14 15:54:31.128439 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: X-Project-Domain-Id: default May 14 15:54:31.128439 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: X-Project-Domain-Name: Default May 14 15:54:31.128439 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: X-Project-Id: 5d2517d5440a4d30949f3dd36a46d813 May 14 15:54:31.128439 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1508904783 May 14 15:54:31.128439 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: X-Role: reader,member May 14 15:54:31.128439 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: X-Roles: reader,member May 14 15:54:31.130888 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/5d2517d5440a4d30949f3dd36a46d813"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/5d2517d5440a4d30949f3dd36a46d813"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/5d2517d5440a4d30949f3dd36a46d813"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_5d2517d5440a4d30949f3dd36a46d813"}]}] May 14 15:54:31.130888 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1508904783 May 14 15:54:31.130888 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: X-Tenant-Id: 5d2517d5440a4d30949f3dd36a46d813 May 14 15:54:31.130888 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1508904783 May 14 15:54:31.130888 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: X-User: tempest-ServerRescueNegativeTestJSON-1508904783-project May 14 15:54:31.130888 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: X-User-Domain-Id: default May 14 15:54:31.130888 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: X-User-Domain-Name: Default May 14 15:54:31.130888 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: X-User-Id: 7b896317d96a40d6a137db0dcf5f98f2 May 14 15:54:31.130888 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1508904783-project May 14 15:54:31.130888 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: method: > May 14 15:54:31.130888 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: exception: Instance 563c74e0-060d-49d5-abc5-389cee4bd9d5 could not be found. May 14 15:54:31.130888 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: action_args: {'id': '563c74e0-060d-49d5-abc5-389cee4bd9d5'} May 14 15:54:31.132509 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: {{(pid=128729) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 14 15:54:31.132509 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 15:54:31.132509 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 14 15:54:31.132509 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 14 15:54:31.132509 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 14 15:54:31.132509 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 14 15:54:31.132509 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 14 15:54:31.132509 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 14 15:54:31.132509 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 14 15:54:31.132509 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 14 15:54:31.132509 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 563c74e0-060d-49d5-abc5-389cee4bd9d5 could not be found. May 14 15:54:31.132509 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: ERROR nova.api.openstack.wsgi May 14 15:54:31.132509 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 14 15:54:31.132509 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: ERROR nova.api.openstack.wsgi May 14 15:54:31.132509 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 15:54:31.132509 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 14 15:54:31.132509 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 14 15:54:31.132509 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 14 15:54:31.132509 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 14 15:54:31.132509 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 14 15:54:31.134840 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 14 15:54:31.134840 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 14 15:54:31.134840 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 14 15:54:31.134840 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 14 15:54:31.134840 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 14 15:54:31.134840 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 14 15:54:31.134840 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 14 15:54:31.134840 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 563c74e0-060d-49d5-abc5-389cee4bd9d5 could not be found. May 14 15:54:31.134840 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: ERROR nova.api.openstack.wsgi May 14 15:54:31.134840 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 14 15:54:31.134840 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: ERROR nova.api.openstack.wsgi May 14 15:54:31.134840 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 15:54:31.134840 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 14 15:54:31.134840 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 14 15:54:31.134840 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 14 15:54:31.134840 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 14 15:54:31.134840 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 563c74e0-060d-49d5-abc5-389cee4bd9d5 could not be found. May 14 15:54:31.134840 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: ERROR nova.api.openstack.wsgi May 14 15:54:31.137009 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi [None req-05014616-3761-446e-95d4-fb1c42e532e4 tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Returning 404 to user: Instance 563c74e0-060d-49d5-abc5-389cee4bd9d5 could not be found. {{(pid=128729) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 14 15:54:31.137009 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: INFO nova.api.openstack.requestlog [None req-05014616-3761-446e-95d4-fb1c42e532e4 tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] 10.222.0.61 "GET /compute/v2.1/servers/563c74e0-060d-49d5-abc5-389cee4bd9d5" status: 404 len: 111 microversion: 2.1 time: 0.032171 May 14 15:54:31.137009 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: [pid: 128729|app: 0|req: 458/932] 10.222.0.61 () {58 vars in 1235 bytes} [Sat May 14 15:54:31 2022] GET /compute/v2.1/servers/563c74e0-060d-49d5-abc5-389cee4bd9d5 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 14 15:54:31.139529 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi [None req-edebdef8-72d3-45c0-83c1-97c78cbbcda4 tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Calling method '>' {{(pid=128728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 15:54:31.140717 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.compute.api [None req-edebdef8-72d3-45c0-83c1-97c78cbbcda4 tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] [instance: 9fbb269d-11cd-49ed-81ac-570e721c15cd] Fetching instance by UUID {{(pid=128728) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 15:54:31.147136 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-edebdef8-72d3-45c0-83c1-97c78cbbcda4 tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:54:31.147585 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-edebdef8-72d3-45c0-83c1-97c78cbbcda4 tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:54:31.148350 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-edebdef8-72d3-45c0-83c1-97c78cbbcda4 tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:54:31.148785 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-edebdef8-72d3-45c0-83c1-97c78cbbcda4 tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:54:31.173321 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.compute.api [None req-edebdef8-72d3-45c0-83c1-97c78cbbcda4 tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] [instance: 9fbb269d-11cd-49ed-81ac-570e721c15cd] Going to try to terminate instance {{(pid=128728) delete /opt/stack/nova/nova/compute/api.py:2664}} May 14 15:54:31.248146 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: INFO nova.api.openstack.requestlog [None req-edebdef8-72d3-45c0-83c1-97c78cbbcda4 tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] 10.222.0.61 "DELETE /compute/v2.1/servers/9fbb269d-11cd-49ed-81ac-570e721c15cd" status: 204 len: 0 microversion: 2.1 time: 0.112994 May 14 15:54:31.248863 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: [pid: 128728|app: 0|req: 475/933] 10.222.0.61 () {58 vars in 1238 bytes} [Sat May 14 15:54:31 2022] DELETE /compute/v2.1/servers/9fbb269d-11cd-49ed-81ac-570e721c15cd => generated 0 bytes in 115 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) May 14 15:54:31.257078 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi [None req-ad23dfbe-55c2-40da-8ea5-9ce764c27969 tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Calling method '>' {{(pid=128729) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 15:54:31.257687 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.compute.api [None req-ad23dfbe-55c2-40da-8ea5-9ce764c27969 tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] [instance: 9fbb269d-11cd-49ed-81ac-570e721c15cd] Fetching instance by UUID {{(pid=128729) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 15:54:31.263541 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-ad23dfbe-55c2-40da-8ea5-9ce764c27969 tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:54:31.263988 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-ad23dfbe-55c2-40da-8ea5-9ce764c27969 tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:54:31.264743 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-ad23dfbe-55c2-40da-8ea5-9ce764c27969 tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:54:31.265711 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-ad23dfbe-55c2-40da-8ea5-9ce764c27969 tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:54:31.329678 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi [None req-2f6e2e25-9fe2-4e6e-b9e7-0685639fe952 tempest-TestVolumeBootPattern-2062489882 tempest-TestVolumeBootPattern-2062489882-project] Calling method '>' {{(pid=128728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 15:54:31.330441 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.compute.api [None req-2f6e2e25-9fe2-4e6e-b9e7-0685639fe952 tempest-TestVolumeBootPattern-2062489882 tempest-TestVolumeBootPattern-2062489882-project] [instance: a3ea9ec3-f9f5-4d5f-81e2-83d33e93a74b] Fetching instance by UUID {{(pid=128728) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 15:54:31.336228 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-2f6e2e25-9fe2-4e6e-b9e7-0685639fe952 tempest-TestVolumeBootPattern-2062489882 tempest-TestVolumeBootPattern-2062489882-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:54:31.336686 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-2f6e2e25-9fe2-4e6e-b9e7-0685639fe952 tempest-TestVolumeBootPattern-2062489882 tempest-TestVolumeBootPattern-2062489882-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:54:31.337460 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-2f6e2e25-9fe2-4e6e-b9e7-0685639fe952 tempest-TestVolumeBootPattern-2062489882 tempest-TestVolumeBootPattern-2062489882-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:54:31.337899 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-2f6e2e25-9fe2-4e6e-b9e7-0685639fe952 tempest-TestVolumeBootPattern-2062489882 tempest-TestVolumeBootPattern-2062489882-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:54:31.427661 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.policy [None req-ad23dfbe-55c2-40da-8ea5-9ce764c27969 tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b896317d96a40d6a137db0dcf5f98f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d2517d5440a4d30949f3dd36a46d813', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128729) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:54:31.437716 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: INFO nova.api.openstack.requestlog [None req-ad23dfbe-55c2-40da-8ea5-9ce764c27969 tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] 10.222.0.61 "GET /compute/v2.1/servers/9fbb269d-11cd-49ed-81ac-570e721c15cd" status: 200 len: 1523 microversion: 2.1 time: 0.183769 May 14 15:54:31.439964 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: [pid: 128729|app: 0|req: 459/934] 10.222.0.61 () {58 vars in 1235 bytes} [Sat May 14 15:54:31 2022] GET /compute/v2.1/servers/9fbb269d-11cd-49ed-81ac-570e721c15cd => generated 1523 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 15:54:31.492780 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.policy [None req-2f6e2e25-9fe2-4e6e-b9e7-0685639fe952 tempest-TestVolumeBootPattern-2062489882 tempest-TestVolumeBootPattern-2062489882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '568f6783dd4d43398a70a9ffa58ff660', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a3a2b5dee7a404a8445c8aa434b5a43', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128728) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:54:31.500733 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: INFO nova.api.openstack.requestlog [None req-2f6e2e25-9fe2-4e6e-b9e7-0685639fe952 tempest-TestVolumeBootPattern-2062489882 tempest-TestVolumeBootPattern-2062489882-project] 10.222.0.61 "GET /compute/v2.1/servers/a3ea9ec3-f9f5-4d5f-81e2-83d33e93a74b" status: 200 len: 1267 microversion: 2.1 time: 0.175892 May 14 15:54:31.501226 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: [pid: 128728|app: 0|req: 476/935] 10.222.0.61 () {58 vars in 1235 bytes} [Sat May 14 15:54:31 2022] GET /compute/v2.1/servers/a3ea9ec3-f9f5-4d5f-81e2-83d33e93a74b => generated 1267 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 15:54:32.456732 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi [None req-68acb944-c5f2-4da1-9779-262507e1a5ab tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Calling method '>' {{(pid=128729) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 15:54:32.457409 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.compute.api [None req-68acb944-c5f2-4da1-9779-262507e1a5ab tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] [instance: 9fbb269d-11cd-49ed-81ac-570e721c15cd] Fetching instance by UUID {{(pid=128729) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 15:54:32.463753 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-68acb944-c5f2-4da1-9779-262507e1a5ab tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:54:32.464209 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-68acb944-c5f2-4da1-9779-262507e1a5ab tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:54:32.464988 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-68acb944-c5f2-4da1-9779-262507e1a5ab tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:54:32.465431 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-68acb944-c5f2-4da1-9779-262507e1a5ab tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:54:32.516941 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi [None req-96deecfe-95a4-4096-b05a-22428f365e63 tempest-TestVolumeBootPattern-2062489882 tempest-TestVolumeBootPattern-2062489882-project] Calling method '>' {{(pid=128728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 15:54:32.517644 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.compute.api [None req-96deecfe-95a4-4096-b05a-22428f365e63 tempest-TestVolumeBootPattern-2062489882 tempest-TestVolumeBootPattern-2062489882-project] [instance: a3ea9ec3-f9f5-4d5f-81e2-83d33e93a74b] Fetching instance by UUID {{(pid=128728) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 15:54:32.524005 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-96deecfe-95a4-4096-b05a-22428f365e63 tempest-TestVolumeBootPattern-2062489882 tempest-TestVolumeBootPattern-2062489882-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:54:32.524590 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-96deecfe-95a4-4096-b05a-22428f365e63 tempest-TestVolumeBootPattern-2062489882 tempest-TestVolumeBootPattern-2062489882-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:54:32.525432 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-96deecfe-95a4-4096-b05a-22428f365e63 tempest-TestVolumeBootPattern-2062489882 tempest-TestVolumeBootPattern-2062489882-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:54:32.525997 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-96deecfe-95a4-4096-b05a-22428f365e63 tempest-TestVolumeBootPattern-2062489882 tempest-TestVolumeBootPattern-2062489882-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:54:32.739408 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.policy [None req-68acb944-c5f2-4da1-9779-262507e1a5ab tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b896317d96a40d6a137db0dcf5f98f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d2517d5440a4d30949f3dd36a46d813', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128729) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:54:32.747466 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: INFO nova.api.openstack.requestlog [None req-68acb944-c5f2-4da1-9779-262507e1a5ab tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] 10.222.0.61 "GET /compute/v2.1/servers/9fbb269d-11cd-49ed-81ac-570e721c15cd" status: 200 len: 1523 microversion: 2.1 time: 0.294641 May 14 15:54:32.748031 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: [pid: 128729|app: 0|req: 460/936] 10.222.0.61 () {58 vars in 1235 bytes} [Sat May 14 15:54:32 2022] GET /compute/v2.1/servers/9fbb269d-11cd-49ed-81ac-570e721c15cd => generated 1523 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 15:54:32.783712 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi [req-db417f81-0673-4702-847c-ebd5e76dbc64 req-e0812afe-8062-4efb-9dc8-3f3e947739ab service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9fbb269d-11cd-49ed-81ac-570e721c15cd", "name": "network-vif-deleted", "tag": "3697c0c4-258d-43cd-a608-dec915d0b3e8"}]} {{(pid=128729) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 15:54:32.792103 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [req-db417f81-0673-4702-847c-ebd5e76dbc64 req-e0812afe-8062-4efb-9dc8-3f3e947739ab service nova] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:54:32.792540 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [req-db417f81-0673-4702-847c-ebd5e76dbc64 req-e0812afe-8062-4efb-9dc8-3f3e947739ab service nova] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:54:32.795317 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.policy [None req-96deecfe-95a4-4096-b05a-22428f365e63 tempest-TestVolumeBootPattern-2062489882 tempest-TestVolumeBootPattern-2062489882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '568f6783dd4d43398a70a9ffa58ff660', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a3a2b5dee7a404a8445c8aa434b5a43', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128728) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:54:32.806891 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: INFO nova.api.openstack.requestlog [None req-96deecfe-95a4-4096-b05a-22428f365e63 tempest-TestVolumeBootPattern-2062489882 tempest-TestVolumeBootPattern-2062489882-project] 10.222.0.61 "GET /compute/v2.1/servers/a3ea9ec3-f9f5-4d5f-81e2-83d33e93a74b" status: 200 len: 1267 microversion: 2.1 time: 0.293691 May 14 15:54:32.807869 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: INFO nova.api.openstack.compute.server_external_events [req-db417f81-0673-4702-847c-ebd5e76dbc64 req-e0812afe-8062-4efb-9dc8-3f3e947739ab service nova] Creating event network-vif-deleted:3697c0c4-258d-43cd-a608-dec915d0b3e8 for instance 9fbb269d-11cd-49ed-81ac-570e721c15cd on hv-cinder-83979 May 14 15:54:32.808787 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: [pid: 128728|app: 0|req: 477/937] 10.222.0.61 () {58 vars in 1235 bytes} [Sat May 14 15:54:32 2022] GET /compute/v2.1/servers/a3ea9ec3-f9f5-4d5f-81e2-83d33e93a74b => generated 1267 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 15:54:32.820121 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: INFO nova.api.openstack.requestlog [req-db417f81-0673-4702-847c-ebd5e76dbc64 req-e0812afe-8062-4efb-9dc8-3f3e947739ab service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042809 May 14 15:54:32.820720 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: [pid: 128729|app: 0|req: 461/938] 10.222.0.61 () {64 vars in 1317 bytes} [Sat May 14 15:54:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 14 15:54:33.756159 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi [req-237b5ef0-958e-4493-834e-eefb3bbf928e req-2d343abe-0de2-46e2-b8f9-04c9d74b2bae service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a3ea9ec3-f9f5-4d5f-81e2-83d33e93a74b", "name": "network-vif-plugged", "status": "completed", "tag": "85faf801-1e40-4e72-a22b-f9e9a859f83a"}]} {{(pid=128728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 15:54:33.764090 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi [None req-e73eea48-da50-49f5-b8f6-88d487377b24 tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Calling method '>' {{(pid=128729) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 15:54:33.764782 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.compute.api [None req-e73eea48-da50-49f5-b8f6-88d487377b24 tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] [instance: 9fbb269d-11cd-49ed-81ac-570e721c15cd] Fetching instance by UUID {{(pid=128729) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 15:54:33.765505 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [req-237b5ef0-958e-4493-834e-eefb3bbf928e req-2d343abe-0de2-46e2-b8f9-04c9d74b2bae service nova] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:54:33.766189 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [req-237b5ef0-958e-4493-834e-eefb3bbf928e req-2d343abe-0de2-46e2-b8f9-04c9d74b2bae service nova] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:54:33.771783 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-e73eea48-da50-49f5-b8f6-88d487377b24 tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:54:33.772456 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-e73eea48-da50-49f5-b8f6-88d487377b24 tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:54:33.773248 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-e73eea48-da50-49f5-b8f6-88d487377b24 tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:54:33.773691 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-e73eea48-da50-49f5-b8f6-88d487377b24 tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:54:33.781981 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: INFO nova.api.openstack.compute.server_external_events [req-237b5ef0-958e-4493-834e-eefb3bbf928e req-2d343abe-0de2-46e2-b8f9-04c9d74b2bae service nova] Creating event network-vif-plugged:85faf801-1e40-4e72-a22b-f9e9a859f83a for instance a3ea9ec3-f9f5-4d5f-81e2-83d33e93a74b on hv-cinder-83979 May 14 15:54:33.787363 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: INFO nova.api.openstack.requestlog [req-237b5ef0-958e-4493-834e-eefb3bbf928e req-2d343abe-0de2-46e2-b8f9-04c9d74b2bae service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034610 May 14 15:54:33.788134 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: [pid: 128728|app: 0|req: 478/939] 10.222.0.61 () {64 vars in 1317 bytes} [Sat May 14 15:54:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 14 15:54:33.789856 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: INFO nova.api.openstack.wsgi [None req-e73eea48-da50-49f5-b8f6-88d487377b24 tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] HTTP exception thrown: Instance 9fbb269d-11cd-49ed-81ac-570e721c15cd could not be found. May 14 15:54:33.791639 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi [None req-e73eea48-da50-49f5-b8f6-88d487377b24 tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Request method failure captured: May 14 15:54:33.791639 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: request: GET /compute/v2.1/servers/9fbb269d-11cd-49ed-81ac-570e721c15cd HTTP/1.1 May 14 15:54:33.791639 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: Accept: application/json May 14 15:54:33.791639 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: Accept-Encoding: identity May 14 15:54:33.791639 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: Connection: close May 14 15:54:33.791639 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: Content-Length: 0 May 14 15:54:33.791639 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: Content-Type: application/json May 14 15:54:33.791639 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: Host: 10.222.0.61 May 14 15:54:33.791639 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: Openstack-System-Scope: None May 14 15:54:33.791639 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: User-Agent: python-urllib3/1.26.9 May 14 15:54:33.791639 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: X-Auth-Token: gAAAAABif87TjanYsrrU9KpYd5057ovf5TRvtsRqqkrdTWz9P6C_YEs6Yd4CDME33lagxGClN3GtsEEl95Qsg7nFg7CgnMsPohorXTcxxG47tx7yWCVnqL6E-EqIsy7vXURQ6VzDtKaYCpcbPZh6yi-RI8tatcgKoVxklM3PcFb97OQYybSwzGM May 14 15:54:33.791639 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: X-Domain-Id: None May 14 15:54:33.791639 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: X-Domain-Name: None May 14 15:54:33.791639 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: X-Identity-Status: Confirmed May 14 15:54:33.791639 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: X-Is-Admin-Project: True May 14 15:54:33.791639 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: X-Project-Domain-Id: default May 14 15:54:33.791639 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: X-Project-Domain-Name: Default May 14 15:54:33.791639 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: X-Project-Id: 5d2517d5440a4d30949f3dd36a46d813 May 14 15:54:33.791639 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1508904783 May 14 15:54:33.791639 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: X-Role: reader,member May 14 15:54:33.791639 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: X-Roles: reader,member May 14 15:54:33.793201 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/5d2517d5440a4d30949f3dd36a46d813"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/5d2517d5440a4d30949f3dd36a46d813"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/5d2517d5440a4d30949f3dd36a46d813"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_5d2517d5440a4d30949f3dd36a46d813"}]}] May 14 15:54:33.793201 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1508904783 May 14 15:54:33.793201 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: X-Tenant-Id: 5d2517d5440a4d30949f3dd36a46d813 May 14 15:54:33.793201 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1508904783 May 14 15:54:33.793201 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: X-User: tempest-ServerRescueNegativeTestJSON-1508904783-project May 14 15:54:33.793201 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: X-User-Domain-Id: default May 14 15:54:33.793201 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: X-User-Domain-Name: Default May 14 15:54:33.793201 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: X-User-Id: 7b896317d96a40d6a137db0dcf5f98f2 May 14 15:54:33.793201 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1508904783-project May 14 15:54:33.793201 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: method: > May 14 15:54:33.793201 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: exception: Instance 9fbb269d-11cd-49ed-81ac-570e721c15cd could not be found. May 14 15:54:33.793201 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: action_args: {'id': '9fbb269d-11cd-49ed-81ac-570e721c15cd'} May 14 15:54:33.794071 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: {{(pid=128729) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 14 15:54:33.794071 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 15:54:33.794071 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 14 15:54:33.794071 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 14 15:54:33.794071 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 14 15:54:33.794071 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 14 15:54:33.794071 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 14 15:54:33.794071 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 14 15:54:33.794071 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 14 15:54:33.794071 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 14 15:54:33.794071 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9fbb269d-11cd-49ed-81ac-570e721c15cd could not be found. May 14 15:54:33.794071 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: ERROR nova.api.openstack.wsgi May 14 15:54:33.794071 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 14 15:54:33.794071 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: ERROR nova.api.openstack.wsgi May 14 15:54:33.794071 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 15:54:33.794071 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 14 15:54:33.794071 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 14 15:54:33.794071 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 14 15:54:33.794071 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 14 15:54:33.794071 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 14 15:54:33.795546 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 14 15:54:33.795546 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 14 15:54:33.795546 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 14 15:54:33.795546 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 14 15:54:33.795546 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 14 15:54:33.795546 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 14 15:54:33.795546 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 14 15:54:33.795546 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9fbb269d-11cd-49ed-81ac-570e721c15cd could not be found. May 14 15:54:33.795546 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: ERROR nova.api.openstack.wsgi May 14 15:54:33.795546 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 14 15:54:33.795546 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: ERROR nova.api.openstack.wsgi May 14 15:54:33.795546 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 15:54:33.795546 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 14 15:54:33.795546 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 14 15:54:33.795546 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 14 15:54:33.795546 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 14 15:54:33.795546 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9fbb269d-11cd-49ed-81ac-570e721c15cd could not be found. May 14 15:54:33.795546 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: ERROR nova.api.openstack.wsgi May 14 15:54:33.798090 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi [None req-e73eea48-da50-49f5-b8f6-88d487377b24 tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] Returning 404 to user: Instance 9fbb269d-11cd-49ed-81ac-570e721c15cd could not be found. {{(pid=128729) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 14 15:54:33.799143 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: INFO nova.api.openstack.requestlog [None req-e73eea48-da50-49f5-b8f6-88d487377b24 tempest-ServerRescueNegativeTestJSON-1508904783 tempest-ServerRescueNegativeTestJSON-1508904783-project] 10.222.0.61 "GET /compute/v2.1/servers/9fbb269d-11cd-49ed-81ac-570e721c15cd" status: 404 len: 111 microversion: 2.1 time: 0.039590 May 14 15:54:33.799565 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: [pid: 128729|app: 0|req: 462/940] 10.222.0.61 () {58 vars in 1235 bytes} [Sat May 14 15:54:33 2022] GET /compute/v2.1/servers/9fbb269d-11cd-49ed-81ac-570e721c15cd => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 14 15:54:33.825083 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi [None req-d7325788-441a-446c-a123-0b0385f0c98e tempest-TestVolumeBootPattern-2062489882 tempest-TestVolumeBootPattern-2062489882-project] Calling method '>' {{(pid=128728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 15:54:33.834983 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.compute.api [None req-d7325788-441a-446c-a123-0b0385f0c98e tempest-TestVolumeBootPattern-2062489882 tempest-TestVolumeBootPattern-2062489882-project] [instance: a3ea9ec3-f9f5-4d5f-81e2-83d33e93a74b] Fetching instance by UUID {{(pid=128728) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 15:54:33.843367 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-d7325788-441a-446c-a123-0b0385f0c98e tempest-TestVolumeBootPattern-2062489882 tempest-TestVolumeBootPattern-2062489882-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:54:33.844226 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-d7325788-441a-446c-a123-0b0385f0c98e tempest-TestVolumeBootPattern-2062489882 tempest-TestVolumeBootPattern-2062489882-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:54:33.845441 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-d7325788-441a-446c-a123-0b0385f0c98e tempest-TestVolumeBootPattern-2062489882 tempest-TestVolumeBootPattern-2062489882-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:54:33.845993 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-d7325788-441a-446c-a123-0b0385f0c98e tempest-TestVolumeBootPattern-2062489882 tempest-TestVolumeBootPattern-2062489882-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:54:33.990133 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.policy [None req-d7325788-441a-446c-a123-0b0385f0c98e tempest-TestVolumeBootPattern-2062489882 tempest-TestVolumeBootPattern-2062489882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '568f6783dd4d43398a70a9ffa58ff660', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a3a2b5dee7a404a8445c8aa434b5a43', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128728) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:54:33.998268 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: INFO nova.api.openstack.requestlog [None req-d7325788-441a-446c-a123-0b0385f0c98e tempest-TestVolumeBootPattern-2062489882 tempest-TestVolumeBootPattern-2062489882-project] 10.222.0.61 "GET /compute/v2.1/servers/a3ea9ec3-f9f5-4d5f-81e2-83d33e93a74b" status: 200 len: 1267 microversion: 2.1 time: 0.177614 May 14 15:54:33.998867 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: [pid: 128728|app: 0|req: 479/941] 10.222.0.61 () {58 vars in 1235 bytes} [Sat May 14 15:54:33 2022] GET /compute/v2.1/servers/a3ea9ec3-f9f5-4d5f-81e2-83d33e93a74b => generated 1267 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 15:54:35.016032 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi [None req-e6164ee1-51c7-4a88-98bc-c009e5503ff5 tempest-TestVolumeBootPattern-2062489882 tempest-TestVolumeBootPattern-2062489882-project] Calling method '>' {{(pid=128729) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 15:54:35.017294 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.compute.api [None req-e6164ee1-51c7-4a88-98bc-c009e5503ff5 tempest-TestVolumeBootPattern-2062489882 tempest-TestVolumeBootPattern-2062489882-project] [instance: a3ea9ec3-f9f5-4d5f-81e2-83d33e93a74b] Fetching instance by UUID {{(pid=128729) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 15:54:35.023463 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-e6164ee1-51c7-4a88-98bc-c009e5503ff5 tempest-TestVolumeBootPattern-2062489882 tempest-TestVolumeBootPattern-2062489882-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:54:35.024199 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-e6164ee1-51c7-4a88-98bc-c009e5503ff5 tempest-TestVolumeBootPattern-2062489882 tempest-TestVolumeBootPattern-2062489882-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:54:35.025327 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-e6164ee1-51c7-4a88-98bc-c009e5503ff5 tempest-TestVolumeBootPattern-2062489882 tempest-TestVolumeBootPattern-2062489882-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:54:35.025930 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-e6164ee1-51c7-4a88-98bc-c009e5503ff5 tempest-TestVolumeBootPattern-2062489882 tempest-TestVolumeBootPattern-2062489882-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:54:35.623010 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.policy [None req-e6164ee1-51c7-4a88-98bc-c009e5503ff5 tempest-TestVolumeBootPattern-2062489882 tempest-TestVolumeBootPattern-2062489882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '568f6783dd4d43398a70a9ffa58ff660', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a3a2b5dee7a404a8445c8aa434b5a43', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128729) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:54:35.630641 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: INFO nova.api.openstack.requestlog [None req-e6164ee1-51c7-4a88-98bc-c009e5503ff5 tempest-TestVolumeBootPattern-2062489882 tempest-TestVolumeBootPattern-2062489882-project] 10.222.0.61 "GET /compute/v2.1/servers/a3ea9ec3-f9f5-4d5f-81e2-83d33e93a74b" status: 200 len: 1267 microversion: 2.1 time: 0.619026 May 14 15:54:35.631204 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: [pid: 128729|app: 0|req: 463/942] 10.222.0.61 () {58 vars in 1235 bytes} [Sat May 14 15:54:35 2022] GET /compute/v2.1/servers/a3ea9ec3-f9f5-4d5f-81e2-83d33e93a74b => generated 1267 bytes in 620 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 15:54:36.648193 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi [None req-91d778b2-8885-4b58-974e-4dad2c4985f8 tempest-TestVolumeBootPattern-2062489882 tempest-TestVolumeBootPattern-2062489882-project] Calling method '>' {{(pid=128728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 15:54:36.649287 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.compute.api [None req-91d778b2-8885-4b58-974e-4dad2c4985f8 tempest-TestVolumeBootPattern-2062489882 tempest-TestVolumeBootPattern-2062489882-project] [instance: a3ea9ec3-f9f5-4d5f-81e2-83d33e93a74b] Fetching instance by UUID {{(pid=128728) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 15:54:36.655560 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-91d778b2-8885-4b58-974e-4dad2c4985f8 tempest-TestVolumeBootPattern-2062489882 tempest-TestVolumeBootPattern-2062489882-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:54:36.656020 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-91d778b2-8885-4b58-974e-4dad2c4985f8 tempest-TestVolumeBootPattern-2062489882 tempest-TestVolumeBootPattern-2062489882-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:54:36.656865 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-91d778b2-8885-4b58-974e-4dad2c4985f8 tempest-TestVolumeBootPattern-2062489882 tempest-TestVolumeBootPattern-2062489882-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:54:36.657304 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-91d778b2-8885-4b58-974e-4dad2c4985f8 tempest-TestVolumeBootPattern-2062489882 tempest-TestVolumeBootPattern-2062489882-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:54:36.848110 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.policy [None req-91d778b2-8885-4b58-974e-4dad2c4985f8 tempest-TestVolumeBootPattern-2062489882 tempest-TestVolumeBootPattern-2062489882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '568f6783dd4d43398a70a9ffa58ff660', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a3a2b5dee7a404a8445c8aa434b5a43', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128728) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:54:36.855850 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: INFO nova.api.openstack.requestlog [None req-91d778b2-8885-4b58-974e-4dad2c4985f8 tempest-TestVolumeBootPattern-2062489882 tempest-TestVolumeBootPattern-2062489882-project] 10.222.0.61 "GET /compute/v2.1/servers/a3ea9ec3-f9f5-4d5f-81e2-83d33e93a74b" status: 200 len: 1454 microversion: 2.1 time: 0.212378 May 14 15:54:36.856421 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: [pid: 128728|app: 0|req: 480/943] 10.222.0.61 () {58 vars in 1235 bytes} [Sat May 14 15:54:36 2022] GET /compute/v2.1/servers/a3ea9ec3-f9f5-4d5f-81e2-83d33e93a74b => generated 1454 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 15:54:36.872351 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi [None req-4f7d9289-4083-4cdc-830d-75067e134d4c tempest-TestVolumeBootPattern-2062489882 tempest-TestVolumeBootPattern-2062489882-project] Calling method '>' {{(pid=128729) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 15:54:36.872960 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.compute.api [None req-4f7d9289-4083-4cdc-830d-75067e134d4c tempest-TestVolumeBootPattern-2062489882 tempest-TestVolumeBootPattern-2062489882-project] [instance: a3ea9ec3-f9f5-4d5f-81e2-83d33e93a74b] Fetching instance by UUID {{(pid=128729) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 15:54:36.883090 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-4f7d9289-4083-4cdc-830d-75067e134d4c tempest-TestVolumeBootPattern-2062489882 tempest-TestVolumeBootPattern-2062489882-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:54:36.883789 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-4f7d9289-4083-4cdc-830d-75067e134d4c tempest-TestVolumeBootPattern-2062489882 tempest-TestVolumeBootPattern-2062489882-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:54:36.884578 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-4f7d9289-4083-4cdc-830d-75067e134d4c tempest-TestVolumeBootPattern-2062489882 tempest-TestVolumeBootPattern-2062489882-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:54:36.885223 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-4f7d9289-4083-4cdc-830d-75067e134d4c tempest-TestVolumeBootPattern-2062489882 tempest-TestVolumeBootPattern-2062489882-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:54:37.107631 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.policy [None req-4f7d9289-4083-4cdc-830d-75067e134d4c tempest-TestVolumeBootPattern-2062489882 tempest-TestVolumeBootPattern-2062489882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '568f6783dd4d43398a70a9ffa58ff660', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a3a2b5dee7a404a8445c8aa434b5a43', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128729) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:54:37.127651 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: INFO nova.api.openstack.requestlog [None req-4f7d9289-4083-4cdc-830d-75067e134d4c tempest-TestVolumeBootPattern-2062489882 tempest-TestVolumeBootPattern-2062489882-project] 10.222.0.61 "GET /compute/v2.1/servers/a3ea9ec3-f9f5-4d5f-81e2-83d33e93a74b" status: 200 len: 1454 microversion: 2.1 time: 0.255902 May 14 15:54:37.129066 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: [pid: 128729|app: 0|req: 464/944] 10.222.0.61 () {58 vars in 1235 bytes} [Sat May 14 15:54:36 2022] GET /compute/v2.1/servers/a3ea9ec3-f9f5-4d5f-81e2-83d33e93a74b => generated 1454 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 15:54:38.934815 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi [req-9a24d1db-ae8f-4246-87aa-10547ec8ef8b req-123c9277-88b0-4d5c-a6bd-daa5fb4da466 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a3ea9ec3-f9f5-4d5f-81e2-83d33e93a74b", "tag": "85faf801-1e40-4e72-a22b-f9e9a859f83a"}]} {{(pid=128728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 15:54:38.943465 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [req-9a24d1db-ae8f-4246-87aa-10547ec8ef8b req-123c9277-88b0-4d5c-a6bd-daa5fb4da466 service nova] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:54:38.943919 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [req-9a24d1db-ae8f-4246-87aa-10547ec8ef8b req-123c9277-88b0-4d5c-a6bd-daa5fb4da466 service nova] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:54:38.955114 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: INFO nova.api.openstack.compute.server_external_events [req-9a24d1db-ae8f-4246-87aa-10547ec8ef8b req-123c9277-88b0-4d5c-a6bd-daa5fb4da466 service nova] Creating event network-changed:85faf801-1e40-4e72-a22b-f9e9a859f83a for instance a3ea9ec3-f9f5-4d5f-81e2-83d33e93a74b on hv-cinder-83979 May 14 15:54:38.961248 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: INFO nova.api.openstack.requestlog [req-9a24d1db-ae8f-4246-87aa-10547ec8ef8b req-123c9277-88b0-4d5c-a6bd-daa5fb4da466 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029885 May 14 15:54:38.962280 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: [pid: 128728|app: 0|req: 481/945] 10.222.0.61 () {64 vars in 1317 bytes} [Sat May 14 15:54:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 14 15:54:39.994516 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi [None req-b900560c-b3cb-45c9-986a-062da68e24a2 tempest-VolumesTestJSON-370352101 tempest-VolumesTestJSON-370352101-project] Calling method '.version_select at 0x7f77cb9bf820>' {{(pid=128729) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 15:54:40.041718 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: INFO nova.api.openstack.requestlog [None req-b900560c-b3cb-45c9-986a-062da68e24a2 tempest-VolumesTestJSON-370352101 tempest-VolumesTestJSON-370352101-project] 10.222.0.61 "GET /compute/v2.1/os-volumes/b7332f18-75bc-47d7-8f33-92b19065a9e3" status: 200 len: 351 microversion: 2.1 time: 0.051320 May 14 15:54:40.042394 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: [pid: 128729|app: 0|req: 465/946] 10.222.0.61 () {58 vars in 1244 bytes} [Sat May 14 15:54:39 2022] GET /compute/v2.1/os-volumes/b7332f18-75bc-47d7-8f33-92b19065a9e3 => generated 351 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 14 15:54:41.361331 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi [None req-03f87c2c-144e-4ab6-926a-f0ec0a48f8c8 tempest-VolumesTestJSON-370352101 tempest-VolumesTestJSON-370352101-project] Calling method '.version_select at 0x7f77cb5ae280>' {{(pid=128728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 15:54:41.407066 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: INFO nova.api.openstack.requestlog [None req-03f87c2c-144e-4ab6-926a-f0ec0a48f8c8 tempest-VolumesTestJSON-370352101 tempest-VolumesTestJSON-370352101-project] 10.222.0.61 "GET /compute/v2.1/os-volumes/a74dd6ad-b81e-4bf7-bd6b-64f557cf7413" status: 200 len: 350 microversion: 2.1 time: 0.050264 May 14 15:54:41.407633 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: [pid: 128728|app: 0|req: 482/947] 10.222.0.61 () {58 vars in 1244 bytes} [Sat May 14 15:54:41 2022] GET /compute/v2.1/os-volumes/a74dd6ad-b81e-4bf7-bd6b-64f557cf7413 => generated 350 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 14 15:54:42.711573 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi [None req-9eaacee8-0806-4314-ad4e-a1a9908c5d3d tempest-VolumesTestJSON-370352101 tempest-VolumesTestJSON-370352101-project] Calling method '.version_select at 0x7f77cb9aee50>' {{(pid=128729) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 15:54:42.756924 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: INFO nova.api.openstack.requestlog [None req-9eaacee8-0806-4314-ad4e-a1a9908c5d3d tempest-VolumesTestJSON-370352101 tempest-VolumesTestJSON-370352101-project] 10.222.0.61 "GET /compute/v2.1/os-volumes/913f9efb-6359-4b4d-882f-7843d3935b9d" status: 200 len: 351 microversion: 2.1 time: 0.049546 May 14 15:54:42.757481 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: [pid: 128729|app: 0|req: 466/948] 10.222.0.61 () {58 vars in 1244 bytes} [Sat May 14 15:54:42 2022] GET /compute/v2.1/os-volumes/913f9efb-6359-4b4d-882f-7843d3935b9d => generated 351 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 14 15:54:42.769485 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi [None req-9ba6ba9b-0fb0-4044-94cf-abdbbfd430fd tempest-VolumesTestJSON-370352101 tempest-VolumesTestJSON-370352101-project] Calling method '.version_select at 0x7f77cb69eee0>' {{(pid=128728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 15:54:42.848280 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: INFO nova.api.openstack.requestlog [None req-9ba6ba9b-0fb0-4044-94cf-abdbbfd430fd tempest-VolumesTestJSON-370352101 tempest-VolumesTestJSON-370352101-project] 10.222.0.61 "GET /compute/v2.1/os-volumes" status: 200 len: 1035 microversion: 2.1 time: 0.083583 May 14 15:54:42.848844 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: [pid: 128728|app: 0|req: 483/949] 10.222.0.61 () {58 vars in 1133 bytes} [Sat May 14 15:54:42 2022] GET /compute/v2.1/os-volumes => generated 1035 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 15:54:42.861162 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi [None req-eed81861-cf75-4124-a956-37d325e14228 tempest-VolumesTestJSON-370352101 tempest-VolumesTestJSON-370352101-project] Calling method '.version_select at 0x7f77cba63820>' {{(pid=128729) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 15:54:42.941246 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: INFO nova.api.openstack.requestlog [None req-eed81861-cf75-4124-a956-37d325e14228 tempest-VolumesTestJSON-370352101 tempest-VolumesTestJSON-370352101-project] 10.222.0.61 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.083857 May 14 15:54:42.941800 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: [pid: 128729|app: 0|req: 467/950] 10.222.0.61 () {58 vars in 1148 bytes} [Sat May 14 15:54:42 2022] GET /compute/v2.1/os-volumes?limit=2 => generated 694 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 14 15:54:42.953952 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi [None req-394668a0-614b-4230-bf34-daf6a3e42653 tempest-VolumesTestJSON-370352101 tempest-VolumesTestJSON-370352101-project] Calling method '.version_select at 0x7f77cb59e280>' {{(pid=128728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 15:54:43.037525 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: INFO nova.api.openstack.requestlog [None req-394668a0-614b-4230-bf34-daf6a3e42653 tempest-VolumesTestJSON-370352101 tempest-VolumesTestJSON-370352101-project] 10.222.0.61 "GET /compute/v2.1/os-volumes" status: 200 len: 1035 microversion: 2.1 time: 0.087918 May 14 15:54:43.038096 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: [pid: 128728|app: 0|req: 484/951] 10.222.0.61 () {58 vars in 1133 bytes} [Sat May 14 15:54:42 2022] GET /compute/v2.1/os-volumes => generated 1035 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 15:54:43.049832 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi [None req-7e215936-8efb-4c94-a904-a2cc7ad8e69d tempest-VolumesTestJSON-370352101 tempest-VolumesTestJSON-370352101-project] Calling method '.version_select at 0x7f77dce61280>' {{(pid=128729) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 15:54:43.128924 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: INFO nova.api.openstack.requestlog [None req-7e215936-8efb-4c94-a904-a2cc7ad8e69d tempest-VolumesTestJSON-370352101 tempest-VolumesTestJSON-370352101-project] 10.222.0.61 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 353 microversion: 2.1 time: 0.083568 May 14 15:54:43.129472 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: [pid: 128729|app: 0|req: 468/952] 10.222.0.61 () {58 vars in 1166 bytes} [Sat May 14 15:54:43 2022] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 353 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 14 15:54:43.140867 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi [None req-fa4d13b2-9601-40c2-afae-daa440e0b07f tempest-VolumesTestJSON-370352101 tempest-VolumesTestJSON-370352101-project] Calling method '.version_select at 0x7f77cb60dca0>' {{(pid=128728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 15:54:43.217881 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: INFO nova.api.openstack.requestlog [None req-fa4d13b2-9601-40c2-afae-daa440e0b07f tempest-VolumesTestJSON-370352101 tempest-VolumesTestJSON-370352101-project] 10.222.0.61 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.080658 May 14 15:54:43.218480 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: [pid: 128728|app: 0|req: 485/953] 10.222.0.61 () {58 vars in 1169 bytes} [Sat May 14 15:54:43 2022] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 694 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 14 15:54:43.230152 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi [None req-9985f5b9-4ecb-40c7-be4f-52c9e83c995f tempest-VolumesTestJSON-370352101 tempest-VolumesTestJSON-370352101-project] Calling method '.version_select at 0x7f77cb9bf4c0>' {{(pid=128729) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 15:54:43.308640 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: INFO nova.api.openstack.requestlog [None req-9985f5b9-4ecb-40c7-be4f-52c9e83c995f tempest-VolumesTestJSON-370352101 tempest-VolumesTestJSON-370352101-project] 10.222.0.61 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1035 microversion: 2.1 time: 0.082148 May 14 15:54:43.309202 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: [pid: 128729|app: 0|req: 469/954] 10.222.0.61 () {58 vars in 1154 bytes} [Sat May 14 15:54:43 2022] GET /compute/v2.1/os-volumes/detail => generated 1035 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 15:54:43.321144 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi [None req-1eeadc22-a908-4aff-9ce1-4db3b311112f tempest-VolumesTestJSON-370352101 tempest-VolumesTestJSON-370352101-project] Calling method '.version_select at 0x7f77cb725ee0>' {{(pid=128728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 15:54:43.399401 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: INFO nova.api.openstack.requestlog [None req-1eeadc22-a908-4aff-9ce1-4db3b311112f tempest-VolumesTestJSON-370352101 tempest-VolumesTestJSON-370352101-project] 10.222.0.61 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 353 microversion: 2.1 time: 0.081894 May 14 15:54:43.399969 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: [pid: 128728|app: 0|req: 486/955] 10.222.0.61 () {58 vars in 1187 bytes} [Sat May 14 15:54:43 2022] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 353 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 14 15:54:43.412068 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi [None req-8a62a556-3f56-4101-9977-7d8355c1838b tempest-VolumesTestJSON-370352101 tempest-VolumesTestJSON-370352101-project] Calling method '.version_select at 0x7f77dcec03a0>' {{(pid=128729) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 15:54:43.492813 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: INFO nova.api.openstack.requestlog [None req-8a62a556-3f56-4101-9977-7d8355c1838b tempest-VolumesTestJSON-370352101 tempest-VolumesTestJSON-370352101-project] 10.222.0.61 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1035 microversion: 2.1 time: 0.084435 May 14 15:54:43.493367 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: [pid: 128729|app: 0|req: 470/956] 10.222.0.61 () {58 vars in 1154 bytes} [Sat May 14 15:54:43 2022] GET /compute/v2.1/os-volumes/detail => generated 1035 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 15:54:49.228157 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi [None req-e9fdc035-e80e-4091-ad41-ce2c03256eb1 tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] Calling method '>' {{(pid=128728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 15:54:49.228726 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.compute.api [None req-e9fdc035-e80e-4091-ad41-ce2c03256eb1 tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] [instance: e10cdd60-3aac-4bee-a533-cc02b8d242e2] Fetching instance by UUID {{(pid=128728) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 15:54:49.235638 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-e9fdc035-e80e-4091-ad41-ce2c03256eb1 tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:54:49.236091 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-e9fdc035-e80e-4091-ad41-ce2c03256eb1 tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:54:49.236868 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-e9fdc035-e80e-4091-ad41-ce2c03256eb1 tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:54:49.237313 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-e9fdc035-e80e-4091-ad41-ce2c03256eb1 tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:54:49.259308 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: INFO nova.api.openstack.requestlog [None req-e9fdc035-e80e-4091-ad41-ce2c03256eb1 tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] 10.222.0.61 "GET /compute/v2.1/servers/e10cdd60-3aac-4bee-a533-cc02b8d242e2/ips" status: 200 len: 150 microversion: 2.1 time: 0.035621 May 14 15:54:49.259862 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: [pid: 128728|app: 0|req: 487/957] 10.222.0.61 () {58 vars in 1247 bytes} [Sat May 14 15:54:49 2022] GET /compute/v2.1/servers/e10cdd60-3aac-4bee-a533-cc02b8d242e2/ips => generated 150 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 14 15:54:50.562578 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi [None req-0bd4a3a9-ab52-481a-964a-5b209b099e1f tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "11d158bf-9003-4103-9c3c-11f4141e84f0"}} {{(pid=128729) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 15:54:50.563609 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.compute.api [None req-0bd4a3a9-ab52-481a-964a-5b209b099e1f tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] [instance: e10cdd60-3aac-4bee-a533-cc02b8d242e2] Fetching instance by UUID {{(pid=128729) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 15:54:50.569463 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-0bd4a3a9-ab52-481a-964a-5b209b099e1f tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:54:50.569913 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-0bd4a3a9-ab52-481a-964a-5b209b099e1f tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:54:50.570694 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-0bd4a3a9-ab52-481a-964a-5b209b099e1f tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:54:50.571126 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-0bd4a3a9-ab52-481a-964a-5b209b099e1f tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:54:50.812266 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: INFO nova.api.openstack.requestlog [None req-0bd4a3a9-ab52-481a-964a-5b209b099e1f tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] 10.222.0.61 "POST /compute/v2.1/servers/e10cdd60-3aac-4bee-a533-cc02b8d242e2/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.253423 May 14 15:54:50.813006 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: [pid: 128729|app: 0|req: 471/958] 10.222.0.61 () {60 vars in 1322 bytes} [Sat May 14 15:54:50 2022] POST /compute/v2.1/servers/e10cdd60-3aac-4bee-a533-cc02b8d242e2/os-volume_attachments => generated 194 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 14 15:54:58.293171 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi [None req-cf780af7-6e7c-4a3f-aa87-fdcc41d27f1e tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "11d158bf-9003-4103-9c3c-11f4141e84f0"}} {{(pid=128728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 15:54:58.294228 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.compute.api [None req-cf780af7-6e7c-4a3f-aa87-fdcc41d27f1e tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] [instance: e10cdd60-3aac-4bee-a533-cc02b8d242e2] Fetching instance by UUID {{(pid=128728) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 15:54:58.300732 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-cf780af7-6e7c-4a3f-aa87-fdcc41d27f1e tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:54:58.301185 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-cf780af7-6e7c-4a3f-aa87-fdcc41d27f1e tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:54:58.301962 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-cf780af7-6e7c-4a3f-aa87-fdcc41d27f1e tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:54:58.302535 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-cf780af7-6e7c-4a3f-aa87-fdcc41d27f1e tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:54:58.379095 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: INFO nova.api.openstack.wsgi [None req-cf780af7-6e7c-4a3f-aa87-fdcc41d27f1e tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] HTTP exception thrown: Invalid volume: volume 11d158bf-9003-4103-9c3c-11f4141e84f0 is already attached to instances: e10cdd60-3aac-4bee-a533-cc02b8d242e2 May 14 15:54:58.380899 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi [None req-cf780af7-6e7c-4a3f-aa87-fdcc41d27f1e tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] Request method failure captured: May 14 15:54:58.380899 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: request: POST /compute/v2.1/servers/e10cdd60-3aac-4bee-a533-cc02b8d242e2/os-volume_attachments HTTP/1.1 May 14 15:54:58.380899 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: Accept: application/json May 14 15:54:58.380899 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: Accept-Encoding: identity May 14 15:54:58.380899 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: Connection: close May 14 15:54:58.380899 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: Content-Length: 74 May 14 15:54:58.380899 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: Content-Type: application/json May 14 15:54:58.380899 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: Host: 10.222.0.61 May 14 15:54:58.380899 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: Openstack-System-Scope: None May 14 15:54:58.380899 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: User-Agent: python-urllib3/1.26.9 May 14 15:54:58.380899 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: X-Auth-Token: gAAAAABif87SP_Zwa2IiGvFqsMgjavpLb8KTM6Zjei-leP46wpGTfISEWiNabTSLn_Se4MigqIDtVKHrnJDEVndJObAkvdE7QziqGtKnvzcsAHHCuGZvbOCiZ5Yv_050Eg71rjYT92fMkrLj82GJjq7kUvTbRuW_X-0VLgSk3UstO-oNY0ykSUs May 14 15:54:58.380899 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: X-Domain-Id: None May 14 15:54:58.380899 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: X-Domain-Name: None May 14 15:54:58.380899 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: X-Identity-Status: Confirmed May 14 15:54:58.380899 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: X-Is-Admin-Project: True May 14 15:54:58.380899 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: X-Project-Domain-Id: default May 14 15:54:58.380899 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: X-Project-Domain-Name: Default May 14 15:54:58.380899 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: X-Project-Id: 7905689c95d44a5c9169249c70f7de57 May 14 15:54:58.380899 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: X-Project-Name: tempest-AttachVolumeNegativeTest-1525749350 May 14 15:54:58.380899 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: X-Role: reader,member May 14 15:54:58.380899 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: X-Roles: reader,member May 14 15:54:58.382522 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/7905689c95d44a5c9169249c70f7de57"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/7905689c95d44a5c9169249c70f7de57"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/7905689c95d44a5c9169249c70f7de57"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_7905689c95d44a5c9169249c70f7de57"}]}] May 14 15:54:58.382522 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: X-Tenant: tempest-AttachVolumeNegativeTest-1525749350 May 14 15:54:58.382522 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: X-Tenant-Id: 7905689c95d44a5c9169249c70f7de57 May 14 15:54:58.382522 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1525749350 May 14 15:54:58.382522 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: X-User: tempest-AttachVolumeNegativeTest-1525749350-project May 14 15:54:58.382522 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: X-User-Domain-Id: default May 14 15:54:58.382522 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: X-User-Domain-Name: Default May 14 15:54:58.382522 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: X-User-Id: dc43895177134e9c9c030a9d87f94aaa May 14 15:54:58.382522 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: X-User-Name: tempest-AttachVolumeNegativeTest-1525749350-project May 14 15:54:58.382522 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: May 14 15:54:58.382522 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: {"volumeAttachment": {"volumeId": "11d158bf-9003-4103-9c3c-11f4141e84f0"}} May 14 15:54:58.382522 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: method: > May 14 15:54:58.383451 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: exception: Invalid volume: volume 11d158bf-9003-4103-9c3c-11f4141e84f0 is already attached to instances: e10cdd60-3aac-4bee-a533-cc02b8d242e2 May 14 15:54:58.383451 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: action_args: {'server_id': 'e10cdd60-3aac-4bee-a533-cc02b8d242e2', 'body': {'volumeAttachment': {'volumeId': '11d158bf-9003-4103-9c3c-11f4141e84f0'}}} May 14 15:54:58.383451 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: {{(pid=128728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 14 15:54:58.383451 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 15:54:58.383451 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create May 14 15:54:58.383451 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( May 14 15:54:58.383451 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner May 14 15:54:58.383451 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) May 14 15:54:58.383451 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner May 14 15:54:58.383451 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) May 14 15:54:58.383451 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4985, in attach_volume May 14 15:54:58.383451 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) May 14 15:54:58.383451 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4825, in _check_volume_already_attached May 14 15:54:58.383451 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) May 14 15:54:58.383451 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 11d158bf-9003-4103-9c3c-11f4141e84f0 is already attached to instances: e10cdd60-3aac-4bee-a533-cc02b8d242e2 May 14 15:54:58.383451 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: ERROR nova.api.openstack.wsgi May 14 15:54:58.383451 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 14 15:54:58.383451 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: ERROR nova.api.openstack.wsgi May 14 15:54:58.383451 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 15:54:58.384911 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 14 15:54:58.384911 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 14 15:54:58.384911 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 14 15:54:58.384911 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 14 15:54:58.384911 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 14 15:54:58.384911 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 14 15:54:58.384911 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 14 15:54:58.384911 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 14 15:54:58.384911 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 14 15:54:58.384911 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 14 15:54:58.384911 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 14 15:54:58.384911 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 14 15:54:58.384911 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create May 14 15:54:58.384911 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) May 14 15:54:58.384911 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 11d158bf-9003-4103-9c3c-11f4141e84f0 is already attached to instances: e10cdd60-3aac-4bee-a533-cc02b8d242e2 May 14 15:54:58.384911 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: ERROR nova.api.openstack.wsgi May 14 15:54:58.384911 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 14 15:54:58.384911 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: ERROR nova.api.openstack.wsgi May 14 15:54:58.384911 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 15:54:58.384911 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 14 15:54:58.386473 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 14 15:54:58.386473 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 14 15:54:58.386473 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 14 15:54:58.386473 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 11d158bf-9003-4103-9c3c-11f4141e84f0 is already attached to instances: e10cdd60-3aac-4bee-a533-cc02b8d242e2 May 14 15:54:58.386473 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: ERROR nova.api.openstack.wsgi May 14 15:54:58.386473 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi [None req-cf780af7-6e7c-4a3f-aa87-fdcc41d27f1e tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] Returning 400 to user: Invalid volume: volume 11d158bf-9003-4103-9c3c-11f4141e84f0 is already attached to instances: e10cdd60-3aac-4bee-a533-cc02b8d242e2 {{(pid=128728) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 14 15:54:58.386473 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: INFO nova.api.openstack.requestlog [None req-cf780af7-6e7c-4a3f-aa87-fdcc41d27f1e tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] 10.222.0.61 "POST /compute/v2.1/servers/e10cdd60-3aac-4bee-a533-cc02b8d242e2/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.093170 May 14 15:54:58.386473 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: [pid: 128728|app: 0|req: 488/959] 10.222.0.61 () {60 vars in 1322 bytes} [Sat May 14 15:54:58 2022] POST /compute/v2.1/servers/e10cdd60-3aac-4bee-a533-cc02b8d242e2/os-volume_attachments => generated 174 bytes in 94 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) May 14 15:54:58.447481 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi [None req-685f2019-ba70-4417-9873-7118bcc24b95 tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] Calling method '>' {{(pid=128729) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 15:54:58.447994 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.compute.api [None req-685f2019-ba70-4417-9873-7118bcc24b95 tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] [instance: e10cdd60-3aac-4bee-a533-cc02b8d242e2] Fetching instance by UUID {{(pid=128729) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 15:54:58.455392 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-685f2019-ba70-4417-9873-7118bcc24b95 tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:54:58.455869 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-685f2019-ba70-4417-9873-7118bcc24b95 tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:54:58.456649 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-685f2019-ba70-4417-9873-7118bcc24b95 tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:54:58.457129 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-685f2019-ba70-4417-9873-7118bcc24b95 tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:54:58.537128 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.objects.instance [None req-685f2019-ba70-4417-9873-7118bcc24b95 tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] Lazy-loading 'services' on Instance uuid e10cdd60-3aac-4bee-a533-cc02b8d242e2 {{(pid=128729) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 14 15:54:58.612068 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: INFO nova.api.openstack.requestlog [None req-685f2019-ba70-4417-9873-7118bcc24b95 tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] 10.222.0.61 "DELETE /compute/v2.1/servers/e10cdd60-3aac-4bee-a533-cc02b8d242e2/os-volume_attachments/11d158bf-9003-4103-9c3c-11f4141e84f0" status: 202 len: 0 microversion: 2.1 time: 0.168817 May 14 15:54:58.612678 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: [pid: 128729|app: 0|req: 472/960] 10.222.0.61 () {58 vars in 1415 bytes} [Sat May 14 15:54:58 2022] DELETE /compute/v2.1/servers/e10cdd60-3aac-4bee-a533-cc02b8d242e2/os-volume_attachments/11d158bf-9003-4103-9c3c-11f4141e84f0 => generated 0 bytes in 170 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 14 15:54:58.621373 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi [None req-8ff61f8f-cf0a-4394-8580-69f6fdfe185a tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] Calling method '>' {{(pid=128728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 15:54:58.624467 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.compute.api [None req-8ff61f8f-cf0a-4394-8580-69f6fdfe185a tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] [instance: e10cdd60-3aac-4bee-a533-cc02b8d242e2] Fetching instance by UUID {{(pid=128728) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 15:54:58.630652 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-8ff61f8f-cf0a-4394-8580-69f6fdfe185a tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:54:58.631118 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-8ff61f8f-cf0a-4394-8580-69f6fdfe185a tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:54:58.631929 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-8ff61f8f-cf0a-4394-8580-69f6fdfe185a tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:54:58.632378 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-8ff61f8f-cf0a-4394-8580-69f6fdfe185a tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:54:58.669180 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: INFO nova.api.openstack.requestlog [None req-8ff61f8f-cf0a-4394-8580-69f6fdfe185a tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] 10.222.0.61 "GET /compute/v2.1/servers/e10cdd60-3aac-4bee-a533-cc02b8d242e2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051714 May 14 15:54:58.669957 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: [pid: 128728|app: 0|req: 489/961] 10.222.0.61 () {58 vars in 1301 bytes} [Sat May 14 15:54:58 2022] GET /compute/v2.1/servers/e10cdd60-3aac-4bee-a533-cc02b8d242e2/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 14 15:54:59.682763 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi [None req-0ca31336-c3f3-492d-b233-ce6f38ade3a7 tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] Calling method '>' {{(pid=128729) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 15:54:59.683741 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.compute.api [None req-0ca31336-c3f3-492d-b233-ce6f38ade3a7 tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] [instance: e10cdd60-3aac-4bee-a533-cc02b8d242e2] Fetching instance by UUID {{(pid=128729) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 15:54:59.689992 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-0ca31336-c3f3-492d-b233-ce6f38ade3a7 tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:54:59.690481 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-0ca31336-c3f3-492d-b233-ce6f38ade3a7 tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:54:59.691254 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-0ca31336-c3f3-492d-b233-ce6f38ade3a7 tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:54:59.691693 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-0ca31336-c3f3-492d-b233-ce6f38ade3a7 tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:54:59.722965 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: INFO nova.api.openstack.requestlog [None req-0ca31336-c3f3-492d-b233-ce6f38ade3a7 tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] 10.222.0.61 "GET /compute/v2.1/servers/e10cdd60-3aac-4bee-a533-cc02b8d242e2/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.045183 May 14 15:54:59.724058 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: [pid: 128729|app: 0|req: 473/962] 10.222.0.61 () {58 vars in 1301 bytes} [Sat May 14 15:54:59 2022] GET /compute/v2.1/servers/e10cdd60-3aac-4bee-a533-cc02b8d242e2/os-volume_attachments => generated 25 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 14 15:54:59.783345 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi [None req-e59877db-58df-4630-8e90-c91f808e82c6 tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] Calling method '>' {{(pid=128728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 15:54:59.783836 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.compute.api [None req-e59877db-58df-4630-8e90-c91f808e82c6 tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] [instance: e10cdd60-3aac-4bee-a533-cc02b8d242e2] Fetching instance by UUID {{(pid=128728) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 15:54:59.790128 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-e59877db-58df-4630-8e90-c91f808e82c6 tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:54:59.790529 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-e59877db-58df-4630-8e90-c91f808e82c6 tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:54:59.791315 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-e59877db-58df-4630-8e90-c91f808e82c6 tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:54:59.791736 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-e59877db-58df-4630-8e90-c91f808e82c6 tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:54:59.816192 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.compute.api [None req-e59877db-58df-4630-8e90-c91f808e82c6 tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] [instance: e10cdd60-3aac-4bee-a533-cc02b8d242e2] Going to try to terminate instance {{(pid=128728) delete /opt/stack/nova/nova/compute/api.py:2664}} May 14 15:54:59.893990 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: INFO nova.api.openstack.requestlog [None req-e59877db-58df-4630-8e90-c91f808e82c6 tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] 10.222.0.61 "DELETE /compute/v2.1/servers/e10cdd60-3aac-4bee-a533-cc02b8d242e2" status: 204 len: 0 microversion: 2.1 time: 0.114766 May 14 15:54:59.894674 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: [pid: 128728|app: 0|req: 490/963] 10.222.0.61 () {58 vars in 1238 bytes} [Sat May 14 15:54:59 2022] DELETE /compute/v2.1/servers/e10cdd60-3aac-4bee-a533-cc02b8d242e2 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 14 15:54:59.903009 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi [None req-e2cc0e37-3333-4d17-ad3c-78593fc903b8 tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] Calling method '>' {{(pid=128729) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 15:54:59.903722 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.compute.api [None req-e2cc0e37-3333-4d17-ad3c-78593fc903b8 tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] [instance: e10cdd60-3aac-4bee-a533-cc02b8d242e2] Fetching instance by UUID {{(pid=128729) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 15:54:59.910279 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-e2cc0e37-3333-4d17-ad3c-78593fc903b8 tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:54:59.910768 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-e2cc0e37-3333-4d17-ad3c-78593fc903b8 tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:54:59.911547 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-e2cc0e37-3333-4d17-ad3c-78593fc903b8 tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:54:59.911980 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-e2cc0e37-3333-4d17-ad3c-78593fc903b8 tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:55:00.043513 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.policy [None req-e2cc0e37-3333-4d17-ad3c-78593fc903b8 tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc43895177134e9c9c030a9d87f94aaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7905689c95d44a5c9169249c70f7de57', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128729) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:55:00.051640 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: INFO nova.api.openstack.requestlog [None req-e2cc0e37-3333-4d17-ad3c-78593fc903b8 tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] 10.222.0.61 "GET /compute/v2.1/servers/e10cdd60-3aac-4bee-a533-cc02b8d242e2" status: 200 len: 1680 microversion: 2.1 time: 0.152635 May 14 15:55:00.052198 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: [pid: 128729|app: 0|req: 474/964] 10.222.0.61 () {58 vars in 1235 bytes} [Sat May 14 15:54:59 2022] GET /compute/v2.1/servers/e10cdd60-3aac-4bee-a533-cc02b8d242e2 => generated 1680 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 15:55:01.070167 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi [None req-bf525409-68d9-4f13-b1fd-27c2eb97984a tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] Calling method '>' {{(pid=128728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 15:55:01.070938 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.compute.api [None req-bf525409-68d9-4f13-b1fd-27c2eb97984a tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] [instance: e10cdd60-3aac-4bee-a533-cc02b8d242e2] Fetching instance by UUID {{(pid=128728) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 15:55:01.077228 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-bf525409-68d9-4f13-b1fd-27c2eb97984a tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:55:01.077676 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-bf525409-68d9-4f13-b1fd-27c2eb97984a tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:55:01.078480 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-bf525409-68d9-4f13-b1fd-27c2eb97984a tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:55:01.078984 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-bf525409-68d9-4f13-b1fd-27c2eb97984a tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:55:01.213883 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.policy [None req-bf525409-68d9-4f13-b1fd-27c2eb97984a tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc43895177134e9c9c030a9d87f94aaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7905689c95d44a5c9169249c70f7de57', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128728) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:55:01.221852 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: INFO nova.api.openstack.requestlog [None req-bf525409-68d9-4f13-b1fd-27c2eb97984a tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] 10.222.0.61 "GET /compute/v2.1/servers/e10cdd60-3aac-4bee-a533-cc02b8d242e2" status: 200 len: 1680 microversion: 2.1 time: 0.155779 May 14 15:55:01.222653 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: [pid: 128728|app: 0|req: 491/965] 10.222.0.61 () {58 vars in 1235 bytes} [Sat May 14 15:55:01 2022] GET /compute/v2.1/servers/e10cdd60-3aac-4bee-a533-cc02b8d242e2 => generated 1680 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 15:55:02.239994 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi [None req-fedc87ed-be8d-485f-86fd-a9b4e4ffa74d tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] Calling method '>' {{(pid=128729) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 15:55:02.240639 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.compute.api [None req-fedc87ed-be8d-485f-86fd-a9b4e4ffa74d tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] [instance: e10cdd60-3aac-4bee-a533-cc02b8d242e2] Fetching instance by UUID {{(pid=128729) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 15:55:02.247117 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-fedc87ed-be8d-485f-86fd-a9b4e4ffa74d tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:55:02.247567 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-fedc87ed-be8d-485f-86fd-a9b4e4ffa74d tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:55:02.248370 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-fedc87ed-be8d-485f-86fd-a9b4e4ffa74d tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:55:02.248809 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-fedc87ed-be8d-485f-86fd-a9b4e4ffa74d tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:55:02.449962 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.policy [None req-fedc87ed-be8d-485f-86fd-a9b4e4ffa74d tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc43895177134e9c9c030a9d87f94aaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7905689c95d44a5c9169249c70f7de57', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128729) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:55:02.458204 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: INFO nova.api.openstack.requestlog [None req-fedc87ed-be8d-485f-86fd-a9b4e4ffa74d tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] 10.222.0.61 "GET /compute/v2.1/servers/e10cdd60-3aac-4bee-a533-cc02b8d242e2" status: 200 len: 1680 microversion: 2.1 time: 0.222730 May 14 15:55:02.458635 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: [pid: 128729|app: 0|req: 475/966] 10.222.0.61 () {58 vars in 1235 bytes} [Sat May 14 15:55:02 2022] GET /compute/v2.1/servers/e10cdd60-3aac-4bee-a533-cc02b8d242e2 => generated 1680 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 15:55:03.167504 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi [req-4dbd88fd-4619-4337-9fe6-f59ab2d1a682 req-77ca9185-0685-49db-84ee-b25ddd9f9327 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e10cdd60-3aac-4bee-a533-cc02b8d242e2", "name": "network-vif-deleted", "tag": "31f05ca6-8416-443c-a8bb-aa1aed44741e"}]} {{(pid=128728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 15:55:03.182712 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [req-4dbd88fd-4619-4337-9fe6-f59ab2d1a682 req-77ca9185-0685-49db-84ee-b25ddd9f9327 service nova] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:55:03.183445 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [req-4dbd88fd-4619-4337-9fe6-f59ab2d1a682 req-77ca9185-0685-49db-84ee-b25ddd9f9327 service nova] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:55:03.197239 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: INFO nova.api.openstack.compute.server_external_events [req-4dbd88fd-4619-4337-9fe6-f59ab2d1a682 req-77ca9185-0685-49db-84ee-b25ddd9f9327 service nova] Creating event network-vif-deleted:31f05ca6-8416-443c-a8bb-aa1aed44741e for instance e10cdd60-3aac-4bee-a533-cc02b8d242e2 on hv-cinder-83979 May 14 15:55:03.203190 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: INFO nova.api.openstack.requestlog [req-4dbd88fd-4619-4337-9fe6-f59ab2d1a682 req-77ca9185-0685-49db-84ee-b25ddd9f9327 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039790 May 14 15:55:03.204470 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: [pid: 128728|app: 0|req: 492/967] 10.222.0.61 () {64 vars in 1317 bytes} [Sat May 14 15:55:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 14 15:55:03.475984 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi [None req-e75434c4-6f33-4188-a4f4-812200b8f3e4 tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] Calling method '>' {{(pid=128729) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 15:55:03.476549 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.compute.api [None req-e75434c4-6f33-4188-a4f4-812200b8f3e4 tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] [instance: e10cdd60-3aac-4bee-a533-cc02b8d242e2] Fetching instance by UUID {{(pid=128729) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 15:55:03.483346 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-e75434c4-6f33-4188-a4f4-812200b8f3e4 tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:55:03.483795 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-e75434c4-6f33-4188-a4f4-812200b8f3e4 tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:55:03.484578 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-e75434c4-6f33-4188-a4f4-812200b8f3e4 tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:55:03.485017 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-e75434c4-6f33-4188-a4f4-812200b8f3e4 tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:55:03.515707 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-e75434c4-6f33-4188-a4f4-812200b8f3e4 tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:55:03.516157 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-e75434c4-6f33-4188-a4f4-812200b8f3e4 tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:55:03.517153 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.objects.instance [None req-e75434c4-6f33-4188-a4f4-812200b8f3e4 tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] Lazy-loading 'fault' on Instance uuid e10cdd60-3aac-4bee-a533-cc02b8d242e2 {{(pid=128729) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 14 15:55:03.559506 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.policy [None req-e75434c4-6f33-4188-a4f4-812200b8f3e4 tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc43895177134e9c9c030a9d87f94aaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7905689c95d44a5c9169249c70f7de57', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128729) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:55:03.567494 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: INFO nova.api.openstack.requestlog [None req-e75434c4-6f33-4188-a4f4-812200b8f3e4 tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] 10.222.0.61 "GET /compute/v2.1/servers/e10cdd60-3aac-4bee-a533-cc02b8d242e2" status: 200 len: 1330 microversion: 2.1 time: 0.095507 May 14 15:55:03.568056 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: [pid: 128729|app: 0|req: 476/968] 10.222.0.61 () {58 vars in 1235 bytes} [Sat May 14 15:55:03 2022] GET /compute/v2.1/servers/e10cdd60-3aac-4bee-a533-cc02b8d242e2 => generated 1330 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 15:55:04.585607 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi [None req-6b0689b0-3ffc-4d35-8cdc-bc9e1adaff23 tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] Calling method '>' {{(pid=128728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 15:55:04.586302 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.compute.api [None req-6b0689b0-3ffc-4d35-8cdc-bc9e1adaff23 tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] [instance: e10cdd60-3aac-4bee-a533-cc02b8d242e2] Fetching instance by UUID {{(pid=128728) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 15:55:04.592751 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-6b0689b0-3ffc-4d35-8cdc-bc9e1adaff23 tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:55:04.593196 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-6b0689b0-3ffc-4d35-8cdc-bc9e1adaff23 tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:55:04.593957 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-6b0689b0-3ffc-4d35-8cdc-bc9e1adaff23 tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:55:04.594434 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-6b0689b0-3ffc-4d35-8cdc-bc9e1adaff23 tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:55:04.607411 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: INFO nova.api.openstack.wsgi [None req-6b0689b0-3ffc-4d35-8cdc-bc9e1adaff23 tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] HTTP exception thrown: Instance e10cdd60-3aac-4bee-a533-cc02b8d242e2 could not be found. May 14 15:55:04.609029 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi [None req-6b0689b0-3ffc-4d35-8cdc-bc9e1adaff23 tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] Request method failure captured: May 14 15:55:04.609029 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: request: GET /compute/v2.1/servers/e10cdd60-3aac-4bee-a533-cc02b8d242e2 HTTP/1.1 May 14 15:55:04.609029 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: Accept: application/json May 14 15:55:04.609029 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: Accept-Encoding: identity May 14 15:55:04.609029 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: Connection: close May 14 15:55:04.609029 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: Content-Length: 0 May 14 15:55:04.609029 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: Content-Type: application/json May 14 15:55:04.609029 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: Host: 10.222.0.61 May 14 15:55:04.609029 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: Openstack-System-Scope: None May 14 15:55:04.609029 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: User-Agent: python-urllib3/1.26.9 May 14 15:55:04.609029 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: X-Auth-Token: gAAAAABif87SP_Zwa2IiGvFqsMgjavpLb8KTM6Zjei-leP46wpGTfISEWiNabTSLn_Se4MigqIDtVKHrnJDEVndJObAkvdE7QziqGtKnvzcsAHHCuGZvbOCiZ5Yv_050Eg71rjYT92fMkrLj82GJjq7kUvTbRuW_X-0VLgSk3UstO-oNY0ykSUs May 14 15:55:04.609029 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: X-Domain-Id: None May 14 15:55:04.609029 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: X-Domain-Name: None May 14 15:55:04.609029 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: X-Identity-Status: Confirmed May 14 15:55:04.609029 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: X-Is-Admin-Project: True May 14 15:55:04.609029 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: X-Project-Domain-Id: default May 14 15:55:04.609029 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: X-Project-Domain-Name: Default May 14 15:55:04.609029 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: X-Project-Id: 7905689c95d44a5c9169249c70f7de57 May 14 15:55:04.609029 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: X-Project-Name: tempest-AttachVolumeNegativeTest-1525749350 May 14 15:55:04.609029 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: X-Role: reader,member May 14 15:55:04.609029 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: X-Roles: reader,member May 14 15:55:04.611152 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/7905689c95d44a5c9169249c70f7de57"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/7905689c95d44a5c9169249c70f7de57"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/7905689c95d44a5c9169249c70f7de57"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_7905689c95d44a5c9169249c70f7de57"}]}] May 14 15:55:04.611152 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: X-Tenant: tempest-AttachVolumeNegativeTest-1525749350 May 14 15:55:04.611152 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: X-Tenant-Id: 7905689c95d44a5c9169249c70f7de57 May 14 15:55:04.611152 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1525749350 May 14 15:55:04.611152 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: X-User: tempest-AttachVolumeNegativeTest-1525749350-project May 14 15:55:04.611152 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: X-User-Domain-Id: default May 14 15:55:04.611152 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: X-User-Domain-Name: Default May 14 15:55:04.611152 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: X-User-Id: dc43895177134e9c9c030a9d87f94aaa May 14 15:55:04.611152 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: X-User-Name: tempest-AttachVolumeNegativeTest-1525749350-project May 14 15:55:04.611152 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: method: > May 14 15:55:04.611152 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: exception: Instance e10cdd60-3aac-4bee-a533-cc02b8d242e2 could not be found. May 14 15:55:04.611152 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: action_args: {'id': 'e10cdd60-3aac-4bee-a533-cc02b8d242e2'} May 14 15:55:04.611904 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: {{(pid=128728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 14 15:55:04.611904 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 15:55:04.611904 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 14 15:55:04.611904 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 14 15:55:04.611904 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 14 15:55:04.611904 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 14 15:55:04.611904 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 14 15:55:04.611904 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 14 15:55:04.611904 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 14 15:55:04.611904 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 14 15:55:04.611904 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e10cdd60-3aac-4bee-a533-cc02b8d242e2 could not be found. May 14 15:55:04.611904 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: ERROR nova.api.openstack.wsgi May 14 15:55:04.611904 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 14 15:55:04.611904 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: ERROR nova.api.openstack.wsgi May 14 15:55:04.611904 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 15:55:04.611904 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 14 15:55:04.611904 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 14 15:55:04.611904 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 14 15:55:04.611904 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 14 15:55:04.611904 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 14 15:55:04.613425 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 14 15:55:04.613425 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 14 15:55:04.613425 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 14 15:55:04.613425 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 14 15:55:04.613425 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 14 15:55:04.613425 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 14 15:55:04.613425 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 14 15:55:04.613425 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e10cdd60-3aac-4bee-a533-cc02b8d242e2 could not be found. May 14 15:55:04.613425 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: ERROR nova.api.openstack.wsgi May 14 15:55:04.613425 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 14 15:55:04.613425 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: ERROR nova.api.openstack.wsgi May 14 15:55:04.613425 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 15:55:04.613425 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 14 15:55:04.613425 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 14 15:55:04.613425 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 14 15:55:04.613425 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 14 15:55:04.613425 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e10cdd60-3aac-4bee-a533-cc02b8d242e2 could not be found. May 14 15:55:04.613425 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: ERROR nova.api.openstack.wsgi May 14 15:55:04.614820 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi [None req-6b0689b0-3ffc-4d35-8cdc-bc9e1adaff23 tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] Returning 404 to user: Instance e10cdd60-3aac-4bee-a533-cc02b8d242e2 could not be found. {{(pid=128728) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 14 15:55:04.614820 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: INFO nova.api.openstack.requestlog [None req-6b0689b0-3ffc-4d35-8cdc-bc9e1adaff23 tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] 10.222.0.61 "GET /compute/v2.1/servers/e10cdd60-3aac-4bee-a533-cc02b8d242e2" status: 404 len: 111 microversion: 2.1 time: 0.028989 May 14 15:55:04.614820 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: [pid: 128728|app: 0|req: 493/969] 10.222.0.61 () {58 vars in 1235 bytes} [Sat May 14 15:55:04 2022] GET /compute/v2.1/servers/e10cdd60-3aac-4bee-a533-cc02b8d242e2 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 14 15:55:04.619853 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi [None req-07f4b929-8b0e-4e07-85b0-e50bdc244087 tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] Calling method '.version_select at 0x7f77dcf13940>' {{(pid=128729) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 15:55:04.637327 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: INFO nova.api.openstack.requestlog [None req-07f4b929-8b0e-4e07-85b0-e50bdc244087 tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] 10.222.0.61 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1057710515" status: 202 len: 0 microversion: 2.1 time: 0.021660 May 14 15:55:04.637866 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: [pid: 128729|app: 0|req: 477/970] 10.222.0.61 () {58 vars in 1220 bytes} [Sat May 14 15:55:04 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1057710515 => generated 0 bytes in 23 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 14 15:55:05.534828 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi [None req-a106bb7c-f74f-487b-9084-02b6239675df tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] Action: 'create', calling method: .version_select at 0x7f77cb583820>, body: {"keypair": {"name": "tempest-keypair-807386481", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNx0weBPbXzLnmTal98VEhTCadKL7L6Q1iA8yLC13Z385KrYtc8t/LJQc2zELaO8jceq2KVMU4+cMRM45EJQUhGrWLjF9M7fFpGLt6qB36K3BW67ok57ObYZ043wBsVFXA=="}} {{(pid=128728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 15:55:05.550203 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.quota [None req-a106bb7c-f74f-487b-9084-02b6239675df tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] Getting quotas for project 7905689c95d44a5c9169249c70f7de57. Resources: {'key_pairs'} {{(pid=128728) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 14 15:55:05.553970 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.quota [None req-a106bb7c-f74f-487b-9084-02b6239675df tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] Getting quotas for user dc43895177134e9c9c030a9d87f94aaa and project 7905689c95d44a5c9169249c70f7de57. Resources: {'key_pairs'} {{(pid=128728) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 14 15:55:05.574667 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: INFO nova.api.openstack.requestlog [None req-a106bb7c-f74f-487b-9084-02b6239675df tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] 10.222.0.61 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.044504 May 14 15:55:05.575471 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: [pid: 128728|app: 0|req: 494/971] 10.222.0.61 () {60 vars in 1158 bytes} [Sat May 14 15:55:05 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 14 15:55:06.912378 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi [None req-e76930bf-c232-4a32-86f3-a26e3282c02d tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-980115591", "imageRef": "1381e3d5-fc27-4fa7-ab03-5d86278a0546", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "722d2578-8e0a-4535-bc1b-444c13327ab8"}], "security_groups": [{"name": "tempest-securitygroup--1414523945"}], "key_name": "tempest-keypair-807386481", "user_data": "}} {{(pid=128729) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 15:55:07.015998 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.network.neutron [None req-e76930bf-c232-4a32-86f3-a26e3282c02d tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] validate_networks() for [('722d2578-8e0a-4535-bc1b-444c13327ab8', None, None, None, None, None)] {{(pid=128729) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 14 15:55:07.397757 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.virt.hardware [None req-e76930bf-c232-4a32-86f3-a26e3282c02d tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] Flavor limits 0:0:0 {{(pid=128729) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 14 15:55:07.398188 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.virt.hardware [None req-e76930bf-c232-4a32-86f3-a26e3282c02d tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] Image limits 0:0:0 {{(pid=128729) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 14 15:55:07.398708 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.virt.hardware [None req-e76930bf-c232-4a32-86f3-a26e3282c02d tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] Flavor pref 0:0:0 {{(pid=128729) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 14 15:55:07.399122 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.virt.hardware [None req-e76930bf-c232-4a32-86f3-a26e3282c02d tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] Image pref 0:0:0 {{(pid=128729) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 14 15:55:07.399534 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.virt.hardware [None req-e76930bf-c232-4a32-86f3-a26e3282c02d tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128729) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 14 15:55:07.408180 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-e76930bf-c232-4a32-86f3-a26e3282c02d tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:55:07.408638 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-e76930bf-c232-4a32-86f3-a26e3282c02d tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:55:07.409454 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-e76930bf-c232-4a32-86f3-a26e3282c02d tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:55:07.409896 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-e76930bf-c232-4a32-86f3-a26e3282c02d tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:55:07.426068 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.quota [None req-e76930bf-c232-4a32-86f3-a26e3282c02d tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] Getting quotas for project 7905689c95d44a5c9169249c70f7de57. Resources: {'instances', 'cores', 'ram'} {{(pid=128729) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 14 15:55:07.430683 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.quota [None req-e76930bf-c232-4a32-86f3-a26e3282c02d tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] Getting quotas for user dc43895177134e9c9c030a9d87f94aaa and project 7905689c95d44a5c9169249c70f7de57. Resources: {'instances', 'cores', 'ram'} {{(pid=128729) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 14 15:55:07.442094 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.compute.api [None req-e76930bf-c232-4a32-86f3-a26e3282c02d tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] Going to run 1 instances... {{(pid=128729) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 14 15:55:07.444383 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.compute.api [None req-e76930bf-c232-4a32-86f3-a26e3282c02d tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] [instance: 8ae36099-24d3-40a1-83c6-cf72bb619a57] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='1381e3d5-fc27-4fa7-ab03-5d86278a0546',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128729) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 14 15:55:07.490630 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: INFO nova.api.openstack.requestlog [None req-e76930bf-c232-4a32-86f3-a26e3282c02d tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] 10.222.0.61 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.583066 May 14 15:55:07.491809 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: [pid: 128729|app: 0|req: 478/972] 10.222.0.61 () {60 vars in 1146 bytes} [Sat May 14 15:55:06 2022] POST /compute/v2.1/servers => generated 402 bytes in 585 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 14 15:55:07.502966 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi [None req-ac533849-9c9b-4c03-8927-a78df0d6dc55 tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] Calling method '>' {{(pid=128728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 15:55:07.503721 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.compute.api [None req-ac533849-9c9b-4c03-8927-a78df0d6dc55 tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] [instance: 8ae36099-24d3-40a1-83c6-cf72bb619a57] Fetching instance by UUID {{(pid=128728) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 15:55:07.561969 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.policy [None req-ac533849-9c9b-4c03-8927-a78df0d6dc55 tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc43895177134e9c9c030a9d87f94aaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7905689c95d44a5c9169249c70f7de57', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128728) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:55:07.569049 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: INFO nova.api.openstack.requestlog [None req-ac533849-9c9b-4c03-8927-a78df0d6dc55 tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] 10.222.0.61 "GET /compute/v2.1/servers/8ae36099-24d3-40a1-83c6-cf72bb619a57" status: 200 len: 1240 microversion: 2.1 time: 0.071021 May 14 15:55:07.569616 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: [pid: 128728|app: 0|req: 495/973] 10.222.0.61 () {58 vars in 1235 bytes} [Sat May 14 15:55:07 2022] GET /compute/v2.1/servers/8ae36099-24d3-40a1-83c6-cf72bb619a57 => generated 1240 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 15:55:08.587246 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi [None req-d6c1e6bc-05d6-4a44-b309-e39a1e8ce589 tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] Calling method '>' {{(pid=128729) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 15:55:08.588517 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.compute.api [None req-d6c1e6bc-05d6-4a44-b309-e39a1e8ce589 tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] [instance: 8ae36099-24d3-40a1-83c6-cf72bb619a57] Fetching instance by UUID {{(pid=128729) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 15:55:08.596354 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-d6c1e6bc-05d6-4a44-b309-e39a1e8ce589 tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:55:08.597051 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-d6c1e6bc-05d6-4a44-b309-e39a1e8ce589 tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:55:08.598021 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-d6c1e6bc-05d6-4a44-b309-e39a1e8ce589 tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:55:08.598596 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-d6c1e6bc-05d6-4a44-b309-e39a1e8ce589 tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:55:08.662896 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.policy [None req-d6c1e6bc-05d6-4a44-b309-e39a1e8ce589 tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc43895177134e9c9c030a9d87f94aaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7905689c95d44a5c9169249c70f7de57', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128729) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:55:08.670138 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: INFO nova.api.openstack.requestlog [None req-d6c1e6bc-05d6-4a44-b309-e39a1e8ce589 tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] 10.222.0.61 "GET /compute/v2.1/servers/8ae36099-24d3-40a1-83c6-cf72bb619a57" status: 200 len: 1298 microversion: 2.1 time: 0.088102 May 14 15:55:08.670734 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: [pid: 128729|app: 0|req: 479/974] 10.222.0.61 () {58 vars in 1235 bytes} [Sat May 14 15:55:08 2022] GET /compute/v2.1/servers/8ae36099-24d3-40a1-83c6-cf72bb619a57 => generated 1298 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 15:55:09.488089 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi [None req-cd48a319-7750-4284-ae36-69cc70705828 tempest-TestShelveInstance-1853374188 tempest-TestShelveInstance-1853374188-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=128728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 15:55:09.488603 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.compute.api [None req-cd48a319-7750-4284-ae36-69cc70705828 tempest-TestShelveInstance-1853374188 tempest-TestShelveInstance-1853374188-project] [instance: 08195c98-5b1d-426c-a398-c7e914c14661] Fetching instance by UUID {{(pid=128728) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 15:55:09.495543 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-cd48a319-7750-4284-ae36-69cc70705828 tempest-TestShelveInstance-1853374188 tempest-TestShelveInstance-1853374188-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:55:09.495993 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-cd48a319-7750-4284-ae36-69cc70705828 tempest-TestShelveInstance-1853374188 tempest-TestShelveInstance-1853374188-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:55:09.496761 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-cd48a319-7750-4284-ae36-69cc70705828 tempest-TestShelveInstance-1853374188 tempest-TestShelveInstance-1853374188-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:55:09.497198 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-cd48a319-7750-4284-ae36-69cc70705828 tempest-TestShelveInstance-1853374188 tempest-TestShelveInstance-1853374188-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:55:09.520641 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.objects.instance [None req-cd48a319-7750-4284-ae36-69cc70705828 tempest-TestShelveInstance-1853374188 tempest-TestShelveInstance-1853374188-project] Lazy-loading 'flavor' on Instance uuid 08195c98-5b1d-426c-a398-c7e914c14661 {{(pid=128728) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 14 15:55:09.593342 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: INFO nova.api.openstack.requestlog [None req-cd48a319-7750-4284-ae36-69cc70705828 tempest-TestShelveInstance-1853374188 tempest-TestShelveInstance-1853374188-project] 10.222.0.61 "POST /compute/v2.1/servers/08195c98-5b1d-426c-a398-c7e914c14661/action" status: 202 len: 0 microversion: 2.1 time: 0.109202 May 14 15:55:09.594063 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: [pid: 128728|app: 0|req: 496/975] 10.222.0.61 () {60 vars in 1277 bytes} [Sat May 14 15:55:09 2022] POST /compute/v2.1/servers/08195c98-5b1d-426c-a398-c7e914c14661/action => generated 0 bytes in 111 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) May 14 15:55:09.602881 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi [None req-f954ab08-1f8b-43e2-8918-cdd01ef72b0c tempest-TestShelveInstance-1853374188 tempest-TestShelveInstance-1853374188-project] Calling method '>' {{(pid=128729) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 15:55:09.603495 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.compute.api [None req-f954ab08-1f8b-43e2-8918-cdd01ef72b0c tempest-TestShelveInstance-1853374188 tempest-TestShelveInstance-1853374188-project] [instance: 08195c98-5b1d-426c-a398-c7e914c14661] Fetching instance by UUID {{(pid=128729) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 15:55:09.611690 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-f954ab08-1f8b-43e2-8918-cdd01ef72b0c tempest-TestShelveInstance-1853374188 tempest-TestShelveInstance-1853374188-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:55:09.612460 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-f954ab08-1f8b-43e2-8918-cdd01ef72b0c tempest-TestShelveInstance-1853374188 tempest-TestShelveInstance-1853374188-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:55:09.613321 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-f954ab08-1f8b-43e2-8918-cdd01ef72b0c tempest-TestShelveInstance-1853374188 tempest-TestShelveInstance-1853374188-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:55:09.613954 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-f954ab08-1f8b-43e2-8918-cdd01ef72b0c tempest-TestShelveInstance-1853374188 tempest-TestShelveInstance-1853374188-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:55:09.687220 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi [None req-43f4a610-79b6-46da-99c2-00646a99cbc6 tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] Calling method '>' {{(pid=128728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 15:55:09.688814 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.compute.api [None req-43f4a610-79b6-46da-99c2-00646a99cbc6 tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] [instance: 8ae36099-24d3-40a1-83c6-cf72bb619a57] Fetching instance by UUID {{(pid=128728) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 15:55:09.694866 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-43f4a610-79b6-46da-99c2-00646a99cbc6 tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:55:09.695324 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-43f4a610-79b6-46da-99c2-00646a99cbc6 tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:55:09.696090 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-43f4a610-79b6-46da-99c2-00646a99cbc6 tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:55:09.696524 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-43f4a610-79b6-46da-99c2-00646a99cbc6 tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:55:09.907650 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.policy [None req-f954ab08-1f8b-43e2-8918-cdd01ef72b0c tempest-TestShelveInstance-1853374188 tempest-TestShelveInstance-1853374188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e05ae1c6a054a299e841d008f9d7a09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83d6b6f0aa4f4314811ee80480861958', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128729) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:55:09.915014 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: INFO nova.api.openstack.requestlog [None req-f954ab08-1f8b-43e2-8918-cdd01ef72b0c tempest-TestShelveInstance-1853374188 tempest-TestShelveInstance-1853374188-project] 10.222.0.61 "GET /compute/v2.1/servers/08195c98-5b1d-426c-a398-c7e914c14661" status: 200 len: 1569 microversion: 2.1 time: 0.316136 May 14 15:55:09.915590 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: [pid: 128729|app: 0|req: 480/976] 10.222.0.61 () {58 vars in 1235 bytes} [Sat May 14 15:55:09 2022] GET /compute/v2.1/servers/08195c98-5b1d-426c-a398-c7e914c14661 => generated 1569 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 15:55:09.948798 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.policy [None req-43f4a610-79b6-46da-99c2-00646a99cbc6 tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc43895177134e9c9c030a9d87f94aaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7905689c95d44a5c9169249c70f7de57', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128728) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:55:09.957009 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: INFO nova.api.openstack.requestlog [None req-43f4a610-79b6-46da-99c2-00646a99cbc6 tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] 10.222.0.61 "GET /compute/v2.1/servers/8ae36099-24d3-40a1-83c6-cf72bb619a57" status: 200 len: 1366 microversion: 2.1 time: 0.273811 May 14 15:55:09.966097 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: [pid: 128728|app: 0|req: 497/977] 10.222.0.61 () {58 vars in 1235 bytes} [Sat May 14 15:55:09 2022] GET /compute/v2.1/servers/8ae36099-24d3-40a1-83c6-cf72bb619a57 => generated 1366 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 15:55:10.086083 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi [req-a268f3c3-22b4-4728-85ea-9555c414546c req-cdbc73cd-3cc9-455a-992f-74a7088e8ce8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8ae36099-24d3-40a1-83c6-cf72bb619a57", "tag": "e966a1dd-a29d-4007-a232-3bc32d2f97c5"}]} {{(pid=128729) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 15:55:10.105260 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [req-a268f3c3-22b4-4728-85ea-9555c414546c req-cdbc73cd-3cc9-455a-992f-74a7088e8ce8 service nova] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:55:10.105748 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [req-a268f3c3-22b4-4728-85ea-9555c414546c req-cdbc73cd-3cc9-455a-992f-74a7088e8ce8 service nova] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:55:10.120773 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: INFO nova.api.openstack.compute.server_external_events [req-a268f3c3-22b4-4728-85ea-9555c414546c req-cdbc73cd-3cc9-455a-992f-74a7088e8ce8 service nova] Creating event network-changed:e966a1dd-a29d-4007-a232-3bc32d2f97c5 for instance 8ae36099-24d3-40a1-83c6-cf72bb619a57 on hv-cinder-83979 May 14 15:55:10.127340 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: INFO nova.api.openstack.requestlog [req-a268f3c3-22b4-4728-85ea-9555c414546c req-cdbc73cd-3cc9-455a-992f-74a7088e8ce8 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.053492 May 14 15:55:10.127988 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: [pid: 128729|app: 0|req: 481/978] 10.222.0.61 () {64 vars in 1317 bytes} [Sat May 14 15:55:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 14 15:55:10.268631 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi [None req-aa78edec-6f08-482d-8fca-8be08446d8c3 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Calling method '>' {{(pid=128728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 15:55:10.269136 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.compute.api [None req-aa78edec-6f08-482d-8fca-8be08446d8c3 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] [instance: cca08141-979e-4519-88b3-c77e8a71ae3e] Fetching instance by UUID {{(pid=128728) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 15:55:10.275325 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-aa78edec-6f08-482d-8fca-8be08446d8c3 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:55:10.275788 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-aa78edec-6f08-482d-8fca-8be08446d8c3 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:55:10.276575 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-aa78edec-6f08-482d-8fca-8be08446d8c3 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:55:10.277017 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-aa78edec-6f08-482d-8fca-8be08446d8c3 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:55:10.300707 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: INFO nova.api.openstack.requestlog [None req-aa78edec-6f08-482d-8fca-8be08446d8c3 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] 10.222.0.61 "GET /compute/v2.1/servers/cca08141-979e-4519-88b3-c77e8a71ae3e/ips" status: 200 len: 151 microversion: 2.20 time: 0.035859 May 14 15:55:10.301430 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: [pid: 128728|app: 0|req: 498/979] 10.222.0.61 () {60 vars in 1288 bytes} [Sat May 14 15:55:10 2022] GET /compute/v2.1/servers/cca08141-979e-4519-88b3-c77e8a71ae3e/ips => generated 151 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 14 15:55:10.933066 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi [None req-9df82bd5-adf0-445f-92e2-8cde0bb1d4f4 tempest-TestShelveInstance-1853374188 tempest-TestShelveInstance-1853374188-project] Calling method '>' {{(pid=128729) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 15:55:10.933759 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.compute.api [None req-9df82bd5-adf0-445f-92e2-8cde0bb1d4f4 tempest-TestShelveInstance-1853374188 tempest-TestShelveInstance-1853374188-project] [instance: 08195c98-5b1d-426c-a398-c7e914c14661] Fetching instance by UUID {{(pid=128729) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 15:55:10.940473 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-9df82bd5-adf0-445f-92e2-8cde0bb1d4f4 tempest-TestShelveInstance-1853374188 tempest-TestShelveInstance-1853374188-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:55:10.940946 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-9df82bd5-adf0-445f-92e2-8cde0bb1d4f4 tempest-TestShelveInstance-1853374188 tempest-TestShelveInstance-1853374188-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:55:10.941716 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-9df82bd5-adf0-445f-92e2-8cde0bb1d4f4 tempest-TestShelveInstance-1853374188 tempest-TestShelveInstance-1853374188-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:55:10.942150 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-9df82bd5-adf0-445f-92e2-8cde0bb1d4f4 tempest-TestShelveInstance-1853374188 tempest-TestShelveInstance-1853374188-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:55:10.973512 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi [None req-6bb077e6-0e0b-47bc-82ba-203a769bb88b tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] Calling method '>' {{(pid=128728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 15:55:10.974129 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.compute.api [None req-6bb077e6-0e0b-47bc-82ba-203a769bb88b tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] [instance: 8ae36099-24d3-40a1-83c6-cf72bb619a57] Fetching instance by UUID {{(pid=128728) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 15:55:10.981420 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-6bb077e6-0e0b-47bc-82ba-203a769bb88b tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:55:10.981873 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-6bb077e6-0e0b-47bc-82ba-203a769bb88b tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:55:10.982674 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-6bb077e6-0e0b-47bc-82ba-203a769bb88b tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:55:10.983112 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-6bb077e6-0e0b-47bc-82ba-203a769bb88b tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:55:11.128435 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.policy [None req-9df82bd5-adf0-445f-92e2-8cde0bb1d4f4 tempest-TestShelveInstance-1853374188 tempest-TestShelveInstance-1853374188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e05ae1c6a054a299e841d008f9d7a09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83d6b6f0aa4f4314811ee80480861958', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128729) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:55:11.135924 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: INFO nova.api.openstack.requestlog [None req-9df82bd5-adf0-445f-92e2-8cde0bb1d4f4 tempest-TestShelveInstance-1853374188 tempest-TestShelveInstance-1853374188-project] 10.222.0.61 "GET /compute/v2.1/servers/08195c98-5b1d-426c-a398-c7e914c14661" status: 200 len: 1569 microversion: 2.1 time: 0.207015 May 14 15:55:11.136513 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: [pid: 128729|app: 0|req: 482/980] 10.222.0.61 () {58 vars in 1235 bytes} [Sat May 14 15:55:10 2022] GET /compute/v2.1/servers/08195c98-5b1d-426c-a398-c7e914c14661 => generated 1569 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 15:55:11.148434 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.policy [None req-6bb077e6-0e0b-47bc-82ba-203a769bb88b tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc43895177134e9c9c030a9d87f94aaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7905689c95d44a5c9169249c70f7de57', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128728) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:55:11.155658 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: INFO nova.api.openstack.requestlog [None req-6bb077e6-0e0b-47bc-82ba-203a769bb88b tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] 10.222.0.61 "GET /compute/v2.1/servers/8ae36099-24d3-40a1-83c6-cf72bb619a57" status: 200 len: 1366 microversion: 2.1 time: 0.186484 May 14 15:55:11.156212 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: [pid: 128728|app: 0|req: 499/981] 10.222.0.61 () {58 vars in 1235 bytes} [Sat May 14 15:55:10 2022] GET /compute/v2.1/servers/8ae36099-24d3-40a1-83c6-cf72bb619a57 => generated 1366 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 15:55:12.153234 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi [None req-34d86b86-fc90-4671-bd56-94fcbc8b6142 tempest-TestShelveInstance-1853374188 tempest-TestShelveInstance-1853374188-project] Calling method '>' {{(pid=128729) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 15:55:12.153756 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.compute.api [None req-34d86b86-fc90-4671-bd56-94fcbc8b6142 tempest-TestShelveInstance-1853374188 tempest-TestShelveInstance-1853374188-project] [instance: 08195c98-5b1d-426c-a398-c7e914c14661] Fetching instance by UUID {{(pid=128729) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 15:55:12.160306 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-34d86b86-fc90-4671-bd56-94fcbc8b6142 tempest-TestShelveInstance-1853374188 tempest-TestShelveInstance-1853374188-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:55:12.160755 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-34d86b86-fc90-4671-bd56-94fcbc8b6142 tempest-TestShelveInstance-1853374188 tempest-TestShelveInstance-1853374188-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:55:12.161530 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-34d86b86-fc90-4671-bd56-94fcbc8b6142 tempest-TestShelveInstance-1853374188 tempest-TestShelveInstance-1853374188-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:55:12.161966 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-34d86b86-fc90-4671-bd56-94fcbc8b6142 tempest-TestShelveInstance-1853374188 tempest-TestShelveInstance-1853374188-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:55:12.172705 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi [None req-d5611299-9c5b-4af7-af02-f901bb3f65ba tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] Calling method '>' {{(pid=128728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 15:55:12.173484 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.compute.api [None req-d5611299-9c5b-4af7-af02-f901bb3f65ba tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] [instance: 8ae36099-24d3-40a1-83c6-cf72bb619a57] Fetching instance by UUID {{(pid=128728) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 15:55:12.179729 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-d5611299-9c5b-4af7-af02-f901bb3f65ba tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:55:12.180164 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-d5611299-9c5b-4af7-af02-f901bb3f65ba tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:55:12.180934 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-d5611299-9c5b-4af7-af02-f901bb3f65ba tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:55:12.181371 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-d5611299-9c5b-4af7-af02-f901bb3f65ba tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:55:12.353679 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.policy [None req-34d86b86-fc90-4671-bd56-94fcbc8b6142 tempest-TestShelveInstance-1853374188 tempest-TestShelveInstance-1853374188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e05ae1c6a054a299e841d008f9d7a09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83d6b6f0aa4f4314811ee80480861958', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128729) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:55:12.361721 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: INFO nova.api.openstack.requestlog [None req-34d86b86-fc90-4671-bd56-94fcbc8b6142 tempest-TestShelveInstance-1853374188 tempest-TestShelveInstance-1853374188-project] 10.222.0.61 "GET /compute/v2.1/servers/08195c98-5b1d-426c-a398-c7e914c14661" status: 200 len: 1569 microversion: 2.1 time: 0.212385 May 14 15:55:12.361887 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.policy [None req-d5611299-9c5b-4af7-af02-f901bb3f65ba tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc43895177134e9c9c030a9d87f94aaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7905689c95d44a5c9169249c70f7de57', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128728) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:55:12.362283 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: [pid: 128729|app: 0|req: 483/982] 10.222.0.61 () {58 vars in 1235 bytes} [Sat May 14 15:55:12 2022] GET /compute/v2.1/servers/08195c98-5b1d-426c-a398-c7e914c14661 => generated 1569 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 15:55:12.369376 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: INFO nova.api.openstack.requestlog [None req-d5611299-9c5b-4af7-af02-f901bb3f65ba tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] 10.222.0.61 "GET /compute/v2.1/servers/8ae36099-24d3-40a1-83c6-cf72bb619a57" status: 200 len: 1366 microversion: 2.1 time: 0.200600 May 14 15:55:12.369939 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: [pid: 128728|app: 0|req: 500/983] 10.222.0.61 () {58 vars in 1235 bytes} [Sat May 14 15:55:12 2022] GET /compute/v2.1/servers/8ae36099-24d3-40a1-83c6-cf72bb619a57 => generated 1366 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 15:55:12.405925 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi [None req-925b5e8c-ebea-40fe-b5e5-e72614ab7492 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=128729) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 15:55:12.406417 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.compute.api [None req-925b5e8c-ebea-40fe-b5e5-e72614ab7492 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] [instance: cca08141-979e-4519-88b3-c77e8a71ae3e] Fetching instance by UUID {{(pid=128729) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 15:55:12.413469 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-925b5e8c-ebea-40fe-b5e5-e72614ab7492 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:55:12.413997 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-925b5e8c-ebea-40fe-b5e5-e72614ab7492 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:55:12.414812 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-925b5e8c-ebea-40fe-b5e5-e72614ab7492 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:55:12.415255 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-925b5e8c-ebea-40fe-b5e5-e72614ab7492 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:55:12.437315 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.objects.instance [None req-925b5e8c-ebea-40fe-b5e5-e72614ab7492 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Lazy-loading 'flavor' on Instance uuid cca08141-979e-4519-88b3-c77e8a71ae3e {{(pid=128729) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 14 15:55:12.691688 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: INFO nova.api.openstack.requestlog [None req-925b5e8c-ebea-40fe-b5e5-e72614ab7492 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] 10.222.0.61 "POST /compute/v2.1/servers/cca08141-979e-4519-88b3-c77e8a71ae3e/action" status: 202 len: 0 microversion: 2.20 time: 0.289466 May 14 15:55:12.692310 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: [pid: 128729|app: 0|req: 484/984] 10.222.0.61 () {62 vars in 1318 bytes} [Sat May 14 15:55:12 2022] POST /compute/v2.1/servers/cca08141-979e-4519-88b3-c77e8a71ae3e/action => generated 0 bytes in 291 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) May 14 15:55:12.700483 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi [None req-57274f41-e3f6-4943-83a5-b7cb9b012962 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Calling method '>' {{(pid=128728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 15:55:12.701090 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.compute.api [None req-57274f41-e3f6-4943-83a5-b7cb9b012962 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] [instance: cca08141-979e-4519-88b3-c77e8a71ae3e] Fetching instance by UUID {{(pid=128728) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 15:55:12.708034 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-57274f41-e3f6-4943-83a5-b7cb9b012962 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:55:12.708477 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-57274f41-e3f6-4943-83a5-b7cb9b012962 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:55:12.709240 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-57274f41-e3f6-4943-83a5-b7cb9b012962 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:55:12.709673 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-57274f41-e3f6-4943-83a5-b7cb9b012962 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:55:12.840589 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.policy [None req-57274f41-e3f6-4943-83a5-b7cb9b012962 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58bfb7417bc94583963401ae0fe9d39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0672be3fa3f7414da1c1a5b7300abbe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128728) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:55:12.848376 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.policy [None req-57274f41-e3f6-4943-83a5-b7cb9b012962 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58bfb7417bc94583963401ae0fe9d39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0672be3fa3f7414da1c1a5b7300abbe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128728) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:55:12.849903 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.policy [None req-57274f41-e3f6-4943-83a5-b7cb9b012962 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58bfb7417bc94583963401ae0fe9d39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0672be3fa3f7414da1c1a5b7300abbe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128728) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:55:12.851080 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: INFO nova.api.openstack.requestlog [None req-57274f41-e3f6-4943-83a5-b7cb9b012962 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] 10.222.0.61 "GET /compute/v2.1/servers/cca08141-979e-4519-88b3-c77e8a71ae3e" status: 200 len: 1724 microversion: 2.20 time: 0.154479 May 14 15:55:12.851629 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: [pid: 128728|app: 0|req: 501/985] 10.222.0.61 () {60 vars in 1276 bytes} [Sat May 14 15:55:12 2022] GET /compute/v2.1/servers/cca08141-979e-4519-88b3-c77e8a71ae3e => generated 1724 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 14 15:55:13.379915 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi [None req-e5fd5525-df86-4ea1-9f6c-911ec82cbcd5 tempest-TestShelveInstance-1853374188 tempest-TestShelveInstance-1853374188-project] Calling method '>' {{(pid=128729) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 15:55:13.382851 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.compute.api [None req-e5fd5525-df86-4ea1-9f6c-911ec82cbcd5 tempest-TestShelveInstance-1853374188 tempest-TestShelveInstance-1853374188-project] [instance: 08195c98-5b1d-426c-a398-c7e914c14661] Fetching instance by UUID {{(pid=128729) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 15:55:13.388990 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi [None req-bc20ed26-72d7-4ba4-a08e-be0682a3e8c6 tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] Calling method '>' {{(pid=128728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 15:55:13.389653 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.compute.api [None req-bc20ed26-72d7-4ba4-a08e-be0682a3e8c6 tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] [instance: 8ae36099-24d3-40a1-83c6-cf72bb619a57] Fetching instance by UUID {{(pid=128728) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 15:55:13.389892 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-e5fd5525-df86-4ea1-9f6c-911ec82cbcd5 tempest-TestShelveInstance-1853374188 tempest-TestShelveInstance-1853374188-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:55:13.390300 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-e5fd5525-df86-4ea1-9f6c-911ec82cbcd5 tempest-TestShelveInstance-1853374188 tempest-TestShelveInstance-1853374188-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:55:13.391139 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-e5fd5525-df86-4ea1-9f6c-911ec82cbcd5 tempest-TestShelveInstance-1853374188 tempest-TestShelveInstance-1853374188-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:55:13.391701 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-e5fd5525-df86-4ea1-9f6c-911ec82cbcd5 tempest-TestShelveInstance-1853374188 tempest-TestShelveInstance-1853374188-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:55:13.396533 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-bc20ed26-72d7-4ba4-a08e-be0682a3e8c6 tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:55:13.397389 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-bc20ed26-72d7-4ba4-a08e-be0682a3e8c6 tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:55:13.398478 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-bc20ed26-72d7-4ba4-a08e-be0682a3e8c6 tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:55:13.399074 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-bc20ed26-72d7-4ba4-a08e-be0682a3e8c6 tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:55:13.592284 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.policy [None req-e5fd5525-df86-4ea1-9f6c-911ec82cbcd5 tempest-TestShelveInstance-1853374188 tempest-TestShelveInstance-1853374188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e05ae1c6a054a299e841d008f9d7a09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83d6b6f0aa4f4314811ee80480861958', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128729) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:55:13.599880 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: INFO nova.api.openstack.requestlog [None req-e5fd5525-df86-4ea1-9f6c-911ec82cbcd5 tempest-TestShelveInstance-1853374188 tempest-TestShelveInstance-1853374188-project] 10.222.0.61 "GET /compute/v2.1/servers/08195c98-5b1d-426c-a398-c7e914c14661" status: 200 len: 1569 microversion: 2.1 time: 0.224663 May 14 15:55:13.600453 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: [pid: 128729|app: 0|req: 485/986] 10.222.0.61 () {58 vars in 1235 bytes} [Sat May 14 15:55:13 2022] GET /compute/v2.1/servers/08195c98-5b1d-426c-a398-c7e914c14661 => generated 1569 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 15:55:13.603668 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.policy [None req-bc20ed26-72d7-4ba4-a08e-be0682a3e8c6 tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc43895177134e9c9c030a9d87f94aaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7905689c95d44a5c9169249c70f7de57', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128728) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:55:13.612442 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: INFO nova.api.openstack.requestlog [None req-bc20ed26-72d7-4ba4-a08e-be0682a3e8c6 tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] 10.222.0.61 "GET /compute/v2.1/servers/8ae36099-24d3-40a1-83c6-cf72bb619a57" status: 200 len: 1366 microversion: 2.1 time: 0.229347 May 14 15:55:13.614500 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: [pid: 128728|app: 0|req: 502/987] 10.222.0.61 () {58 vars in 1235 bytes} [Sat May 14 15:55:13 2022] GET /compute/v2.1/servers/8ae36099-24d3-40a1-83c6-cf72bb619a57 => generated 1366 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 15:55:13.869308 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi [None req-9c441ba7-be27-4304-867e-6d03757bd3e2 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Calling method '>' {{(pid=128729) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 15:55:13.869923 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.compute.api [None req-9c441ba7-be27-4304-867e-6d03757bd3e2 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] [instance: cca08141-979e-4519-88b3-c77e8a71ae3e] Fetching instance by UUID {{(pid=128729) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 15:55:13.876337 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-9c441ba7-be27-4304-867e-6d03757bd3e2 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:55:13.876864 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-9c441ba7-be27-4304-867e-6d03757bd3e2 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:55:13.877648 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-9c441ba7-be27-4304-867e-6d03757bd3e2 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:55:13.878089 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-9c441ba7-be27-4304-867e-6d03757bd3e2 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:55:14.009332 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.policy [None req-9c441ba7-be27-4304-867e-6d03757bd3e2 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58bfb7417bc94583963401ae0fe9d39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0672be3fa3f7414da1c1a5b7300abbe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128729) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:55:14.017618 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.policy [None req-9c441ba7-be27-4304-867e-6d03757bd3e2 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58bfb7417bc94583963401ae0fe9d39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0672be3fa3f7414da1c1a5b7300abbe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128729) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:55:14.019140 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.policy [None req-9c441ba7-be27-4304-867e-6d03757bd3e2 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58bfb7417bc94583963401ae0fe9d39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0672be3fa3f7414da1c1a5b7300abbe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128729) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:55:14.020295 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: INFO nova.api.openstack.requestlog [None req-9c441ba7-be27-4304-867e-6d03757bd3e2 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] 10.222.0.61 "GET /compute/v2.1/servers/cca08141-979e-4519-88b3-c77e8a71ae3e" status: 200 len: 1724 microversion: 2.20 time: 0.155169 May 14 15:55:14.020844 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: [pid: 128729|app: 0|req: 486/988] 10.222.0.61 () {60 vars in 1276 bytes} [Sat May 14 15:55:13 2022] GET /compute/v2.1/servers/cca08141-979e-4519-88b3-c77e8a71ae3e => generated 1724 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 14 15:55:14.617306 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi [None req-3b418190-0d3d-4917-886a-c99392d4c571 tempest-TestShelveInstance-1853374188 tempest-TestShelveInstance-1853374188-project] Calling method '>' {{(pid=128728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 15:55:14.617919 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.compute.api [None req-3b418190-0d3d-4917-886a-c99392d4c571 tempest-TestShelveInstance-1853374188 tempest-TestShelveInstance-1853374188-project] [instance: 08195c98-5b1d-426c-a398-c7e914c14661] Fetching instance by UUID {{(pid=128728) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 15:55:14.626479 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-3b418190-0d3d-4917-886a-c99392d4c571 tempest-TestShelveInstance-1853374188 tempest-TestShelveInstance-1853374188-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:55:14.627092 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-3b418190-0d3d-4917-886a-c99392d4c571 tempest-TestShelveInstance-1853374188 tempest-TestShelveInstance-1853374188-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:55:14.627882 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-3b418190-0d3d-4917-886a-c99392d4c571 tempest-TestShelveInstance-1853374188 tempest-TestShelveInstance-1853374188-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:55:14.628320 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-3b418190-0d3d-4917-886a-c99392d4c571 tempest-TestShelveInstance-1853374188 tempest-TestShelveInstance-1853374188-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:55:14.629997 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi [None req-309f504a-f95d-44b7-9bf0-d6d73c07d483 tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] Calling method '>' {{(pid=128729) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 15:55:14.630901 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.compute.api [None req-309f504a-f95d-44b7-9bf0-d6d73c07d483 tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] [instance: 8ae36099-24d3-40a1-83c6-cf72bb619a57] Fetching instance by UUID {{(pid=128729) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 15:55:14.637250 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-309f504a-f95d-44b7-9bf0-d6d73c07d483 tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:55:14.637710 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-309f504a-f95d-44b7-9bf0-d6d73c07d483 tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:55:14.638534 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-309f504a-f95d-44b7-9bf0-d6d73c07d483 tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:55:14.638983 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-309f504a-f95d-44b7-9bf0-d6d73c07d483 tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:55:14.837269 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.policy [None req-3b418190-0d3d-4917-886a-c99392d4c571 tempest-TestShelveInstance-1853374188 tempest-TestShelveInstance-1853374188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e05ae1c6a054a299e841d008f9d7a09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83d6b6f0aa4f4314811ee80480861958', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128728) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:55:14.844168 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.policy [None req-309f504a-f95d-44b7-9bf0-d6d73c07d483 tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc43895177134e9c9c030a9d87f94aaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7905689c95d44a5c9169249c70f7de57', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128729) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:55:14.845207 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: INFO nova.api.openstack.requestlog [None req-3b418190-0d3d-4917-886a-c99392d4c571 tempest-TestShelveInstance-1853374188 tempest-TestShelveInstance-1853374188-project] 10.222.0.61 "GET /compute/v2.1/servers/08195c98-5b1d-426c-a398-c7e914c14661" status: 200 len: 1569 microversion: 2.1 time: 0.231946 May 14 15:55:14.845867 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: [pid: 128728|app: 0|req: 503/989] 10.222.0.61 () {58 vars in 1235 bytes} [Sat May 14 15:55:14 2022] GET /compute/v2.1/servers/08195c98-5b1d-426c-a398-c7e914c14661 => generated 1569 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 15:55:14.851624 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: INFO nova.api.openstack.requestlog [None req-309f504a-f95d-44b7-9bf0-d6d73c07d483 tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] 10.222.0.61 "GET /compute/v2.1/servers/8ae36099-24d3-40a1-83c6-cf72bb619a57" status: 200 len: 1366 microversion: 2.1 time: 0.226643 May 14 15:55:14.852175 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: [pid: 128729|app: 0|req: 487/990] 10.222.0.61 () {58 vars in 1235 bytes} [Sat May 14 15:55:14 2022] GET /compute/v2.1/servers/8ae36099-24d3-40a1-83c6-cf72bb619a57 => generated 1366 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 15:55:15.039399 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi [None req-7e2f3b8c-3f13-44bc-9954-6095d1822317 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Calling method '>' {{(pid=128728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 15:55:15.039927 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.compute.api [None req-7e2f3b8c-3f13-44bc-9954-6095d1822317 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] [instance: cca08141-979e-4519-88b3-c77e8a71ae3e] Fetching instance by UUID {{(pid=128728) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 15:55:15.045949 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-7e2f3b8c-3f13-44bc-9954-6095d1822317 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:55:15.046439 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-7e2f3b8c-3f13-44bc-9954-6095d1822317 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:55:15.047248 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-7e2f3b8c-3f13-44bc-9954-6095d1822317 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:55:15.047696 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-7e2f3b8c-3f13-44bc-9954-6095d1822317 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:55:15.242342 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.policy [None req-7e2f3b8c-3f13-44bc-9954-6095d1822317 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58bfb7417bc94583963401ae0fe9d39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0672be3fa3f7414da1c1a5b7300abbe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128728) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:55:15.250063 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.policy [None req-7e2f3b8c-3f13-44bc-9954-6095d1822317 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58bfb7417bc94583963401ae0fe9d39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0672be3fa3f7414da1c1a5b7300abbe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128728) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:55:15.251668 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.policy [None req-7e2f3b8c-3f13-44bc-9954-6095d1822317 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58bfb7417bc94583963401ae0fe9d39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0672be3fa3f7414da1c1a5b7300abbe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128728) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:55:15.252815 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: INFO nova.api.openstack.requestlog [None req-7e2f3b8c-3f13-44bc-9954-6095d1822317 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] 10.222.0.61 "GET /compute/v2.1/servers/cca08141-979e-4519-88b3-c77e8a71ae3e" status: 200 len: 1724 microversion: 2.20 time: 0.217589 May 14 15:55:15.253365 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: [pid: 128728|app: 0|req: 504/991] 10.222.0.61 () {60 vars in 1276 bytes} [Sat May 14 15:55:15 2022] GET /compute/v2.1/servers/cca08141-979e-4519-88b3-c77e8a71ae3e => generated 1724 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 14 15:55:15.863049 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi [None req-c87ef42b-b5f4-42d9-83a3-0080af89c81c tempest-TestShelveInstance-1853374188 tempest-TestShelveInstance-1853374188-project] Calling method '>' {{(pid=128729) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 15:55:15.864330 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.compute.api [None req-c87ef42b-b5f4-42d9-83a3-0080af89c81c tempest-TestShelveInstance-1853374188 tempest-TestShelveInstance-1853374188-project] [instance: 08195c98-5b1d-426c-a398-c7e914c14661] Fetching instance by UUID {{(pid=128729) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 15:55:15.868809 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi [None req-87e5beb3-196a-47b9-bcc4-255ec59e6105 tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] Calling method '>' {{(pid=128728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 15:55:15.869436 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.compute.api [None req-87e5beb3-196a-47b9-bcc4-255ec59e6105 tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] [instance: 8ae36099-24d3-40a1-83c6-cf72bb619a57] Fetching instance by UUID {{(pid=128728) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 15:55:15.870627 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-c87ef42b-b5f4-42d9-83a3-0080af89c81c tempest-TestShelveInstance-1853374188 tempest-TestShelveInstance-1853374188-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:55:15.871160 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-c87ef42b-b5f4-42d9-83a3-0080af89c81c tempest-TestShelveInstance-1853374188 tempest-TestShelveInstance-1853374188-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:55:15.871887 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-c87ef42b-b5f4-42d9-83a3-0080af89c81c tempest-TestShelveInstance-1853374188 tempest-TestShelveInstance-1853374188-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:55:15.872329 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-c87ef42b-b5f4-42d9-83a3-0080af89c81c tempest-TestShelveInstance-1853374188 tempest-TestShelveInstance-1853374188-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:55:15.878052 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-87e5beb3-196a-47b9-bcc4-255ec59e6105 tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:55:15.878052 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-87e5beb3-196a-47b9-bcc4-255ec59e6105 tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:55:15.878832 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-87e5beb3-196a-47b9-bcc4-255ec59e6105 tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:55:15.879275 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-87e5beb3-196a-47b9-bcc4-255ec59e6105 tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:55:16.071158 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.policy [None req-c87ef42b-b5f4-42d9-83a3-0080af89c81c tempest-TestShelveInstance-1853374188 tempest-TestShelveInstance-1853374188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e05ae1c6a054a299e841d008f9d7a09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83d6b6f0aa4f4314811ee80480861958', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128729) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:55:16.077487 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.policy [None req-87e5beb3-196a-47b9-bcc4-255ec59e6105 tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc43895177134e9c9c030a9d87f94aaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7905689c95d44a5c9169249c70f7de57', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128728) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:55:16.079293 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: INFO nova.api.openstack.requestlog [None req-c87ef42b-b5f4-42d9-83a3-0080af89c81c tempest-TestShelveInstance-1853374188 tempest-TestShelveInstance-1853374188-project] 10.222.0.61 "GET /compute/v2.1/servers/08195c98-5b1d-426c-a398-c7e914c14661" status: 200 len: 1569 microversion: 2.1 time: 0.220271 May 14 15:55:16.087308 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: [pid: 128729|app: 0|req: 488/992] 10.222.0.61 () {58 vars in 1235 bytes} [Sat May 14 15:55:15 2022] GET /compute/v2.1/servers/08195c98-5b1d-426c-a398-c7e914c14661 => generated 1569 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 15:55:16.087308 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi [req-f4941471-7890-4006-9987-391b4ba677fe req-ea5f8ad0-ccc0-4b11-a531-735f775dfb64 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8ae36099-24d3-40a1-83c6-cf72bb619a57", "name": "network-vif-plugged", "status": "completed", "tag": "e966a1dd-a29d-4007-a232-3bc32d2f97c5"}]} {{(pid=128729) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 15:55:16.087553 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: INFO nova.api.openstack.requestlog [None req-87e5beb3-196a-47b9-bcc4-255ec59e6105 tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] 10.222.0.61 "GET /compute/v2.1/servers/8ae36099-24d3-40a1-83c6-cf72bb619a57" status: 200 len: 1366 microversion: 2.1 time: 0.221467 May 14 15:55:16.087553 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: [pid: 128728|app: 0|req: 505/993] 10.222.0.61 () {58 vars in 1235 bytes} [Sat May 14 15:55:15 2022] GET /compute/v2.1/servers/8ae36099-24d3-40a1-83c6-cf72bb619a57 => generated 1366 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 15:55:16.092507 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [req-f4941471-7890-4006-9987-391b4ba677fe req-ea5f8ad0-ccc0-4b11-a531-735f775dfb64 service nova] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:55:16.092947 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [req-f4941471-7890-4006-9987-391b4ba677fe req-ea5f8ad0-ccc0-4b11-a531-735f775dfb64 service nova] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:55:16.104070 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: INFO nova.api.openstack.compute.server_external_events [req-f4941471-7890-4006-9987-391b4ba677fe req-ea5f8ad0-ccc0-4b11-a531-735f775dfb64 service nova] Creating event network-vif-plugged:e966a1dd-a29d-4007-a232-3bc32d2f97c5 for instance 8ae36099-24d3-40a1-83c6-cf72bb619a57 on hv-cinder-83979 May 14 15:55:16.108904 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: INFO nova.api.openstack.requestlog [req-f4941471-7890-4006-9987-391b4ba677fe req-ea5f8ad0-ccc0-4b11-a531-735f775dfb64 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.027524 May 14 15:55:16.109566 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: [pid: 128729|app: 0|req: 489/994] 10.222.0.61 () {64 vars in 1317 bytes} [Sat May 14 15:55:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 14 15:55:16.271945 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi [None req-3620e8ce-3bb9-4d55-be97-b01a88939386 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Calling method '>' {{(pid=128728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 15:55:16.272482 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.compute.api [None req-3620e8ce-3bb9-4d55-be97-b01a88939386 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] [instance: cca08141-979e-4519-88b3-c77e8a71ae3e] Fetching instance by UUID {{(pid=128728) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 15:55:16.278489 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-3620e8ce-3bb9-4d55-be97-b01a88939386 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:55:16.278952 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-3620e8ce-3bb9-4d55-be97-b01a88939386 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:55:16.279729 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-3620e8ce-3bb9-4d55-be97-b01a88939386 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:55:16.280173 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-3620e8ce-3bb9-4d55-be97-b01a88939386 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:55:16.437184 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.policy [None req-3620e8ce-3bb9-4d55-be97-b01a88939386 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58bfb7417bc94583963401ae0fe9d39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0672be3fa3f7414da1c1a5b7300abbe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128728) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:55:16.445369 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.policy [None req-3620e8ce-3bb9-4d55-be97-b01a88939386 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58bfb7417bc94583963401ae0fe9d39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0672be3fa3f7414da1c1a5b7300abbe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128728) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:55:16.446898 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.policy [None req-3620e8ce-3bb9-4d55-be97-b01a88939386 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58bfb7417bc94583963401ae0fe9d39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0672be3fa3f7414da1c1a5b7300abbe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128728) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:55:16.448033 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: INFO nova.api.openstack.requestlog [None req-3620e8ce-3bb9-4d55-be97-b01a88939386 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] 10.222.0.61 "GET /compute/v2.1/servers/cca08141-979e-4519-88b3-c77e8a71ae3e" status: 200 len: 1724 microversion: 2.20 time: 0.180125 May 14 15:55:16.448655 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: [pid: 128728|app: 0|req: 506/995] 10.222.0.61 () {60 vars in 1276 bytes} [Sat May 14 15:55:16 2022] GET /compute/v2.1/servers/cca08141-979e-4519-88b3-c77e8a71ae3e => generated 1724 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 14 15:55:17.098327 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi [None req-06a271a3-7bed-49bb-819a-74b727a700ca tempest-TestShelveInstance-1853374188 tempest-TestShelveInstance-1853374188-project] Calling method '>' {{(pid=128729) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 15:55:17.099052 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.compute.api [None req-06a271a3-7bed-49bb-819a-74b727a700ca tempest-TestShelveInstance-1853374188 tempest-TestShelveInstance-1853374188-project] [instance: 08195c98-5b1d-426c-a398-c7e914c14661] Fetching instance by UUID {{(pid=128729) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 15:55:17.103576 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi [None req-05bcd1ef-2453-4ba7-acb0-997bdff6f92d tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] Calling method '>' {{(pid=128728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 15:55:17.104267 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.compute.api [None req-05bcd1ef-2453-4ba7-acb0-997bdff6f92d tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] [instance: 8ae36099-24d3-40a1-83c6-cf72bb619a57] Fetching instance by UUID {{(pid=128728) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 15:55:17.105204 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-06a271a3-7bed-49bb-819a-74b727a700ca tempest-TestShelveInstance-1853374188 tempest-TestShelveInstance-1853374188-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:55:17.105741 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-06a271a3-7bed-49bb-819a-74b727a700ca tempest-TestShelveInstance-1853374188 tempest-TestShelveInstance-1853374188-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:55:17.106473 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-06a271a3-7bed-49bb-819a-74b727a700ca tempest-TestShelveInstance-1853374188 tempest-TestShelveInstance-1853374188-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:55:17.106918 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-06a271a3-7bed-49bb-819a-74b727a700ca tempest-TestShelveInstance-1853374188 tempest-TestShelveInstance-1853374188-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:55:17.112018 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-05bcd1ef-2453-4ba7-acb0-997bdff6f92d tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:55:17.112850 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-05bcd1ef-2453-4ba7-acb0-997bdff6f92d tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:55:17.113786 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-05bcd1ef-2453-4ba7-acb0-997bdff6f92d tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:55:17.114660 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-05bcd1ef-2453-4ba7-acb0-997bdff6f92d tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:55:17.299894 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.policy [None req-06a271a3-7bed-49bb-819a-74b727a700ca tempest-TestShelveInstance-1853374188 tempest-TestShelveInstance-1853374188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e05ae1c6a054a299e841d008f9d7a09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83d6b6f0aa4f4314811ee80480861958', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128729) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:55:17.303171 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.policy [None req-05bcd1ef-2453-4ba7-acb0-997bdff6f92d tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc43895177134e9c9c030a9d87f94aaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7905689c95d44a5c9169249c70f7de57', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128728) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:55:17.307389 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: INFO nova.api.openstack.requestlog [None req-06a271a3-7bed-49bb-819a-74b727a700ca tempest-TestShelveInstance-1853374188 tempest-TestShelveInstance-1853374188-project] 10.222.0.61 "GET /compute/v2.1/servers/08195c98-5b1d-426c-a398-c7e914c14661" status: 200 len: 1569 microversion: 2.1 time: 0.214460 May 14 15:55:17.308118 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: [pid: 128729|app: 0|req: 490/996] 10.222.0.61 () {58 vars in 1235 bytes} [Sat May 14 15:55:17 2022] GET /compute/v2.1/servers/08195c98-5b1d-426c-a398-c7e914c14661 => generated 1569 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 15:55:17.310419 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: INFO nova.api.openstack.requestlog [None req-05bcd1ef-2453-4ba7-acb0-997bdff6f92d tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] 10.222.0.61 "GET /compute/v2.1/servers/8ae36099-24d3-40a1-83c6-cf72bb619a57" status: 200 len: 1366 microversion: 2.1 time: 0.210590 May 14 15:55:17.311092 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: [pid: 128728|app: 0|req: 507/997] 10.222.0.61 () {58 vars in 1235 bytes} [Sat May 14 15:55:17 2022] GET /compute/v2.1/servers/8ae36099-24d3-40a1-83c6-cf72bb619a57 => generated 1366 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 15:55:17.466806 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi [None req-072b4533-b9c4-4423-98f4-878c24cb4249 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Calling method '>' {{(pid=128729) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 15:55:17.467336 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.compute.api [None req-072b4533-b9c4-4423-98f4-878c24cb4249 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] [instance: cca08141-979e-4519-88b3-c77e8a71ae3e] Fetching instance by UUID {{(pid=128729) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 15:55:17.473316 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-072b4533-b9c4-4423-98f4-878c24cb4249 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:55:17.473761 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-072b4533-b9c4-4423-98f4-878c24cb4249 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:55:17.474562 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-072b4533-b9c4-4423-98f4-878c24cb4249 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:55:17.474989 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-072b4533-b9c4-4423-98f4-878c24cb4249 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:55:17.603710 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.policy [None req-072b4533-b9c4-4423-98f4-878c24cb4249 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58bfb7417bc94583963401ae0fe9d39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0672be3fa3f7414da1c1a5b7300abbe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128729) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:55:17.612200 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.policy [None req-072b4533-b9c4-4423-98f4-878c24cb4249 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58bfb7417bc94583963401ae0fe9d39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0672be3fa3f7414da1c1a5b7300abbe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128729) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:55:17.613697 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.policy [None req-072b4533-b9c4-4423-98f4-878c24cb4249 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58bfb7417bc94583963401ae0fe9d39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0672be3fa3f7414da1c1a5b7300abbe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128729) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:55:17.614925 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: INFO nova.api.openstack.requestlog [None req-072b4533-b9c4-4423-98f4-878c24cb4249 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] 10.222.0.61 "GET /compute/v2.1/servers/cca08141-979e-4519-88b3-c77e8a71ae3e" status: 200 len: 1724 microversion: 2.20 time: 0.152109 May 14 15:55:17.615471 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: [pid: 128729|app: 0|req: 491/998] 10.222.0.61 () {60 vars in 1276 bytes} [Sat May 14 15:55:17 2022] GET /compute/v2.1/servers/cca08141-979e-4519-88b3-c77e8a71ae3e => generated 1724 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 14 15:55:18.325015 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi [None req-1c0c53c0-ff68-4b6a-9248-0f752935c056 tempest-TestShelveInstance-1853374188 tempest-TestShelveInstance-1853374188-project] Calling method '>' {{(pid=128728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 15:55:18.325629 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.compute.api [None req-1c0c53c0-ff68-4b6a-9248-0f752935c056 tempest-TestShelveInstance-1853374188 tempest-TestShelveInstance-1853374188-project] [instance: 08195c98-5b1d-426c-a398-c7e914c14661] Fetching instance by UUID {{(pid=128728) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 15:55:18.327062 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi [None req-2d3be617-fa55-498c-a452-dc05176a490c tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] Calling method '>' {{(pid=128729) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 15:55:18.327780 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.compute.api [None req-2d3be617-fa55-498c-a452-dc05176a490c tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] [instance: 8ae36099-24d3-40a1-83c6-cf72bb619a57] Fetching instance by UUID {{(pid=128729) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 15:55:18.333140 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-1c0c53c0-ff68-4b6a-9248-0f752935c056 tempest-TestShelveInstance-1853374188 tempest-TestShelveInstance-1853374188-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:55:18.333595 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-1c0c53c0-ff68-4b6a-9248-0f752935c056 tempest-TestShelveInstance-1853374188 tempest-TestShelveInstance-1853374188-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:55:18.334411 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-1c0c53c0-ff68-4b6a-9248-0f752935c056 tempest-TestShelveInstance-1853374188 tempest-TestShelveInstance-1853374188-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:55:18.334520 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-2d3be617-fa55-498c-a452-dc05176a490c tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:55:18.334856 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-1c0c53c0-ff68-4b6a-9248-0f752935c056 tempest-TestShelveInstance-1853374188 tempest-TestShelveInstance-1853374188-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:55:18.334956 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-2d3be617-fa55-498c-a452-dc05176a490c tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:55:18.335662 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-2d3be617-fa55-498c-a452-dc05176a490c tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:55:18.336218 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-2d3be617-fa55-498c-a452-dc05176a490c tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:55:18.519260 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.policy [None req-1c0c53c0-ff68-4b6a-9248-0f752935c056 tempest-TestShelveInstance-1853374188 tempest-TestShelveInstance-1853374188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e05ae1c6a054a299e841d008f9d7a09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83d6b6f0aa4f4314811ee80480861958', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128728) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:55:18.526439 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.policy [None req-2d3be617-fa55-498c-a452-dc05176a490c tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc43895177134e9c9c030a9d87f94aaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7905689c95d44a5c9169249c70f7de57', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128729) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:55:18.526630 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: INFO nova.api.openstack.requestlog [None req-1c0c53c0-ff68-4b6a-9248-0f752935c056 tempest-TestShelveInstance-1853374188 tempest-TestShelveInstance-1853374188-project] 10.222.0.61 "GET /compute/v2.1/servers/08195c98-5b1d-426c-a398-c7e914c14661" status: 200 len: 1569 microversion: 2.1 time: 0.205391 May 14 15:55:18.527059 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: [pid: 128728|app: 0|req: 508/999] 10.222.0.61 () {58 vars in 1235 bytes} [Sat May 14 15:55:18 2022] GET /compute/v2.1/servers/08195c98-5b1d-426c-a398-c7e914c14661 => generated 1569 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 15:55:18.534470 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: INFO nova.api.openstack.requestlog [None req-2d3be617-fa55-498c-a452-dc05176a490c tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] 10.222.0.61 "GET /compute/v2.1/servers/8ae36099-24d3-40a1-83c6-cf72bb619a57" status: 200 len: 1556 microversion: 2.1 time: 0.211180 May 14 15:55:18.535032 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: [pid: 128729|app: 0|req: 492/1000] 10.222.0.61 () {58 vars in 1235 bytes} [Sat May 14 15:55:18 2022] GET /compute/v2.1/servers/8ae36099-24d3-40a1-83c6-cf72bb619a57 => generated 1556 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 15:55:18.550607 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi [None req-2ef33a78-53c4-4102-b202-32c48cd1862c tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] Calling method '>' {{(pid=128728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 15:55:18.551093 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.compute.api [None req-2ef33a78-53c4-4102-b202-32c48cd1862c tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] [instance: 8ae36099-24d3-40a1-83c6-cf72bb619a57] Fetching instance by UUID {{(pid=128728) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 15:55:18.556761 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-2ef33a78-53c4-4102-b202-32c48cd1862c tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:55:18.557206 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-2ef33a78-53c4-4102-b202-32c48cd1862c tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:55:18.557991 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-2ef33a78-53c4-4102-b202-32c48cd1862c tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:55:18.558456 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-2ef33a78-53c4-4102-b202-32c48cd1862c tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:55:18.633086 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi [None req-bd6529cb-46ec-4bb6-a6e7-16f8a70aafea tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Calling method '>' {{(pid=128729) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 15:55:18.633892 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.compute.api [None req-bd6529cb-46ec-4bb6-a6e7-16f8a70aafea tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] [instance: cca08141-979e-4519-88b3-c77e8a71ae3e] Fetching instance by UUID {{(pid=128729) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 15:55:18.640558 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-bd6529cb-46ec-4bb6-a6e7-16f8a70aafea tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:55:18.641090 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-bd6529cb-46ec-4bb6-a6e7-16f8a70aafea tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:55:18.641940 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-bd6529cb-46ec-4bb6-a6e7-16f8a70aafea tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:55:18.642417 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-bd6529cb-46ec-4bb6-a6e7-16f8a70aafea tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:55:18.648285 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: INFO nova.api.openstack.requestlog [None req-2ef33a78-53c4-4102-b202-32c48cd1862c tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] 10.222.0.61 "GET /compute/v2.1/servers/8ae36099-24d3-40a1-83c6-cf72bb619a57/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.101891 May 14 15:55:18.654386 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: [pid: 128728|app: 0|req: 509/1001] 10.222.0.61 () {58 vars in 1274 bytes} [Sat May 14 15:55:18 2022] GET /compute/v2.1/servers/8ae36099-24d3-40a1-83c6-cf72bb619a57/os-interface => generated 285 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 14 15:55:18.920740 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.policy [None req-bd6529cb-46ec-4bb6-a6e7-16f8a70aafea tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58bfb7417bc94583963401ae0fe9d39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0672be3fa3f7414da1c1a5b7300abbe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128729) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:55:18.928718 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.policy [None req-bd6529cb-46ec-4bb6-a6e7-16f8a70aafea tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58bfb7417bc94583963401ae0fe9d39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0672be3fa3f7414da1c1a5b7300abbe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128729) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:55:18.930226 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.policy [None req-bd6529cb-46ec-4bb6-a6e7-16f8a70aafea tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58bfb7417bc94583963401ae0fe9d39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0672be3fa3f7414da1c1a5b7300abbe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128729) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:55:18.931422 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: INFO nova.api.openstack.requestlog [None req-bd6529cb-46ec-4bb6-a6e7-16f8a70aafea tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] 10.222.0.61 "GET /compute/v2.1/servers/cca08141-979e-4519-88b3-c77e8a71ae3e" status: 200 len: 1724 microversion: 2.20 time: 0.302464 May 14 15:55:18.931985 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: [pid: 128729|app: 0|req: 493/1002] 10.222.0.61 () {60 vars in 1276 bytes} [Sat May 14 15:55:18 2022] GET /compute/v2.1/servers/cca08141-979e-4519-88b3-c77e8a71ae3e => generated 1724 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 14 15:55:19.545927 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi [None req-956aa83f-2188-4d4f-ad28-e202e6422d55 tempest-TestShelveInstance-1853374188 tempest-TestShelveInstance-1853374188-project] Calling method '>' {{(pid=128728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 15:55:19.546730 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.compute.api [None req-956aa83f-2188-4d4f-ad28-e202e6422d55 tempest-TestShelveInstance-1853374188 tempest-TestShelveInstance-1853374188-project] [instance: 08195c98-5b1d-426c-a398-c7e914c14661] Fetching instance by UUID {{(pid=128728) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 15:55:19.554046 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-956aa83f-2188-4d4f-ad28-e202e6422d55 tempest-TestShelveInstance-1853374188 tempest-TestShelveInstance-1853374188-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:55:19.554570 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-956aa83f-2188-4d4f-ad28-e202e6422d55 tempest-TestShelveInstance-1853374188 tempest-TestShelveInstance-1853374188-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:55:19.555357 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-956aa83f-2188-4d4f-ad28-e202e6422d55 tempest-TestShelveInstance-1853374188 tempest-TestShelveInstance-1853374188-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:55:19.556217 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-956aa83f-2188-4d4f-ad28-e202e6422d55 tempest-TestShelveInstance-1853374188 tempest-TestShelveInstance-1853374188-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:55:19.875171 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.policy [None req-956aa83f-2188-4d4f-ad28-e202e6422d55 tempest-TestShelveInstance-1853374188 tempest-TestShelveInstance-1853374188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e05ae1c6a054a299e841d008f9d7a09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83d6b6f0aa4f4314811ee80480861958', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128728) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:55:19.893960 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: INFO nova.api.openstack.requestlog [None req-956aa83f-2188-4d4f-ad28-e202e6422d55 tempest-TestShelveInstance-1853374188 tempest-TestShelveInstance-1853374188-project] 10.222.0.61 "GET /compute/v2.1/servers/08195c98-5b1d-426c-a398-c7e914c14661" status: 200 len: 1569 microversion: 2.1 time: 0.353034 May 14 15:55:19.903044 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: [pid: 128728|app: 0|req: 510/1003] 10.222.0.61 () {58 vars in 1235 bytes} [Sat May 14 15:55:19 2022] GET /compute/v2.1/servers/08195c98-5b1d-426c-a398-c7e914c14661 => generated 1569 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 15:55:19.952815 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi [None req-53849b4a-a487-477f-b392-ca1bb14f967a tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Calling method '>' {{(pid=128729) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 15:55:19.956156 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.compute.api [None req-53849b4a-a487-477f-b392-ca1bb14f967a tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] [instance: cca08141-979e-4519-88b3-c77e8a71ae3e] Fetching instance by UUID {{(pid=128729) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 15:55:19.966461 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-53849b4a-a487-477f-b392-ca1bb14f967a tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:55:19.967141 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-53849b4a-a487-477f-b392-ca1bb14f967a tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:55:19.968515 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-53849b4a-a487-477f-b392-ca1bb14f967a tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:55:19.970827 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-53849b4a-a487-477f-b392-ca1bb14f967a tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:55:20.206145 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi [req-38a8aff2-6d18-4819-bb39-42670050f6c1 req-ef3db5c7-1071-4219-a6e7-2ff19b006dd7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8ae36099-24d3-40a1-83c6-cf72bb619a57", "tag": "e966a1dd-a29d-4007-a232-3bc32d2f97c5"}]} {{(pid=128728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 15:55:20.218048 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [req-38a8aff2-6d18-4819-bb39-42670050f6c1 req-ef3db5c7-1071-4219-a6e7-2ff19b006dd7 service nova] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:55:20.218523 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [req-38a8aff2-6d18-4819-bb39-42670050f6c1 req-ef3db5c7-1071-4219-a6e7-2ff19b006dd7 service nova] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:55:20.231472 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: INFO nova.api.openstack.compute.server_external_events [req-38a8aff2-6d18-4819-bb39-42670050f6c1 req-ef3db5c7-1071-4219-a6e7-2ff19b006dd7 service nova] Creating event network-changed:e966a1dd-a29d-4007-a232-3bc32d2f97c5 for instance 8ae36099-24d3-40a1-83c6-cf72bb619a57 on hv-cinder-83979 May 14 15:55:20.237398 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: INFO nova.api.openstack.requestlog [req-38a8aff2-6d18-4819-bb39-42670050f6c1 req-ef3db5c7-1071-4219-a6e7-2ff19b006dd7 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035112 May 14 15:55:20.237672 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.policy [None req-53849b4a-a487-477f-b392-ca1bb14f967a tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58bfb7417bc94583963401ae0fe9d39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0672be3fa3f7414da1c1a5b7300abbe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128729) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:55:20.237998 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: [pid: 128728|app: 0|req: 511/1004] 10.222.0.61 () {64 vars in 1317 bytes} [Sat May 14 15:55:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 14 15:55:20.247400 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.policy [None req-53849b4a-a487-477f-b392-ca1bb14f967a tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58bfb7417bc94583963401ae0fe9d39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0672be3fa3f7414da1c1a5b7300abbe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128729) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:55:20.249016 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.policy [None req-53849b4a-a487-477f-b392-ca1bb14f967a tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58bfb7417bc94583963401ae0fe9d39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0672be3fa3f7414da1c1a5b7300abbe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128729) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:55:20.250427 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: INFO nova.api.openstack.requestlog [None req-53849b4a-a487-477f-b392-ca1bb14f967a tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] 10.222.0.61 "GET /compute/v2.1/servers/cca08141-979e-4519-88b3-c77e8a71ae3e" status: 200 len: 1724 microversion: 2.20 time: 0.303656 May 14 15:55:20.251239 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: [pid: 128729|app: 0|req: 494/1005] 10.222.0.61 () {60 vars in 1276 bytes} [Sat May 14 15:55:19 2022] GET /compute/v2.1/servers/cca08141-979e-4519-88b3-c77e8a71ae3e => generated 1724 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 14 15:55:20.914991 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi [None req-17802293-4b14-4208-a91a-84e4ae36e034 tempest-TestShelveInstance-1853374188 tempest-TestShelveInstance-1853374188-project] Calling method '>' {{(pid=128728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 15:55:20.916204 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.compute.api [None req-17802293-4b14-4208-a91a-84e4ae36e034 tempest-TestShelveInstance-1853374188 tempest-TestShelveInstance-1853374188-project] [instance: 08195c98-5b1d-426c-a398-c7e914c14661] Fetching instance by UUID {{(pid=128728) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 15:55:20.922838 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-17802293-4b14-4208-a91a-84e4ae36e034 tempest-TestShelveInstance-1853374188 tempest-TestShelveInstance-1853374188-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:55:20.923377 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-17802293-4b14-4208-a91a-84e4ae36e034 tempest-TestShelveInstance-1853374188 tempest-TestShelveInstance-1853374188-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:55:20.924160 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-17802293-4b14-4208-a91a-84e4ae36e034 tempest-TestShelveInstance-1853374188 tempest-TestShelveInstance-1853374188-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:55:20.924701 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-17802293-4b14-4208-a91a-84e4ae36e034 tempest-TestShelveInstance-1853374188 tempest-TestShelveInstance-1853374188-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:55:21.069647 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.policy [None req-17802293-4b14-4208-a91a-84e4ae36e034 tempest-TestShelveInstance-1853374188 tempest-TestShelveInstance-1853374188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e05ae1c6a054a299e841d008f9d7a09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83d6b6f0aa4f4314811ee80480861958', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128728) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:55:21.077197 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: INFO nova.api.openstack.requestlog [None req-17802293-4b14-4208-a91a-84e4ae36e034 tempest-TestShelveInstance-1853374188 tempest-TestShelveInstance-1853374188-project] 10.222.0.61 "GET /compute/v2.1/servers/08195c98-5b1d-426c-a398-c7e914c14661" status: 200 len: 1569 microversion: 2.1 time: 0.167005 May 14 15:55:21.078171 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: [pid: 128728|app: 0|req: 512/1006] 10.222.0.61 () {58 vars in 1235 bytes} [Sat May 14 15:55:20 2022] GET /compute/v2.1/servers/08195c98-5b1d-426c-a398-c7e914c14661 => generated 1569 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 15:55:21.269867 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi [None req-7b3a5369-e112-47e7-aabb-851d0f53ccb8 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Calling method '>' {{(pid=128729) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 15:55:21.270474 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.compute.api [None req-7b3a5369-e112-47e7-aabb-851d0f53ccb8 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] [instance: cca08141-979e-4519-88b3-c77e8a71ae3e] Fetching instance by UUID {{(pid=128729) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 15:55:21.276951 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-7b3a5369-e112-47e7-aabb-851d0f53ccb8 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:55:21.277401 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-7b3a5369-e112-47e7-aabb-851d0f53ccb8 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:55:21.278183 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-7b3a5369-e112-47e7-aabb-851d0f53ccb8 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:55:21.278640 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-7b3a5369-e112-47e7-aabb-851d0f53ccb8 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:55:21.408846 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.policy [None req-7b3a5369-e112-47e7-aabb-851d0f53ccb8 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58bfb7417bc94583963401ae0fe9d39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0672be3fa3f7414da1c1a5b7300abbe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128729) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:55:21.416737 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.policy [None req-7b3a5369-e112-47e7-aabb-851d0f53ccb8 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58bfb7417bc94583963401ae0fe9d39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0672be3fa3f7414da1c1a5b7300abbe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128729) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:55:21.418239 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.policy [None req-7b3a5369-e112-47e7-aabb-851d0f53ccb8 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58bfb7417bc94583963401ae0fe9d39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0672be3fa3f7414da1c1a5b7300abbe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128729) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:55:21.419438 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: INFO nova.api.openstack.requestlog [None req-7b3a5369-e112-47e7-aabb-851d0f53ccb8 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] 10.222.0.61 "GET /compute/v2.1/servers/cca08141-979e-4519-88b3-c77e8a71ae3e" status: 200 len: 1724 microversion: 2.20 time: 0.154172 May 14 15:55:21.419997 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: [pid: 128729|app: 0|req: 495/1007] 10.222.0.61 () {60 vars in 1276 bytes} [Sat May 14 15:55:21 2022] GET /compute/v2.1/servers/cca08141-979e-4519-88b3-c77e8a71ae3e => generated 1724 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 14 15:55:22.094944 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi [None req-6f79d7ef-f044-48f6-9d91-304ca97d925a tempest-TestShelveInstance-1853374188 tempest-TestShelveInstance-1853374188-project] Calling method '>' {{(pid=128728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 15:55:22.095558 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.compute.api [None req-6f79d7ef-f044-48f6-9d91-304ca97d925a tempest-TestShelveInstance-1853374188 tempest-TestShelveInstance-1853374188-project] [instance: 08195c98-5b1d-426c-a398-c7e914c14661] Fetching instance by UUID {{(pid=128728) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 15:55:22.102184 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-6f79d7ef-f044-48f6-9d91-304ca97d925a tempest-TestShelveInstance-1853374188 tempest-TestShelveInstance-1853374188-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:55:22.102659 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-6f79d7ef-f044-48f6-9d91-304ca97d925a tempest-TestShelveInstance-1853374188 tempest-TestShelveInstance-1853374188-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:55:22.103463 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-6f79d7ef-f044-48f6-9d91-304ca97d925a tempest-TestShelveInstance-1853374188 tempest-TestShelveInstance-1853374188-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:55:22.103896 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-6f79d7ef-f044-48f6-9d91-304ca97d925a tempest-TestShelveInstance-1853374188 tempest-TestShelveInstance-1853374188-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:55:22.236441 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.policy [None req-6f79d7ef-f044-48f6-9d91-304ca97d925a tempest-TestShelveInstance-1853374188 tempest-TestShelveInstance-1853374188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e05ae1c6a054a299e841d008f9d7a09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83d6b6f0aa4f4314811ee80480861958', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128728) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:55:22.244002 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: INFO nova.api.openstack.requestlog [None req-6f79d7ef-f044-48f6-9d91-304ca97d925a tempest-TestShelveInstance-1853374188 tempest-TestShelveInstance-1853374188-project] 10.222.0.61 "GET /compute/v2.1/servers/08195c98-5b1d-426c-a398-c7e914c14661" status: 200 len: 1569 microversion: 2.1 time: 0.152935 May 14 15:55:22.244560 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: [pid: 128728|app: 0|req: 513/1008] 10.222.0.61 () {58 vars in 1235 bytes} [Sat May 14 15:55:22 2022] GET /compute/v2.1/servers/08195c98-5b1d-426c-a398-c7e914c14661 => generated 1569 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 15:55:22.439091 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi [None req-e35521e0-a17a-41d0-a48c-ad5fe5e1249d tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Calling method '>' {{(pid=128729) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 15:55:22.439631 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.compute.api [None req-e35521e0-a17a-41d0-a48c-ad5fe5e1249d tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] [instance: cca08141-979e-4519-88b3-c77e8a71ae3e] Fetching instance by UUID {{(pid=128729) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 15:55:22.445958 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-e35521e0-a17a-41d0-a48c-ad5fe5e1249d tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:55:22.446443 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-e35521e0-a17a-41d0-a48c-ad5fe5e1249d tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:55:22.447218 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-e35521e0-a17a-41d0-a48c-ad5fe5e1249d tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:55:22.447653 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-e35521e0-a17a-41d0-a48c-ad5fe5e1249d tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:55:22.573240 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.policy [None req-e35521e0-a17a-41d0-a48c-ad5fe5e1249d tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58bfb7417bc94583963401ae0fe9d39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0672be3fa3f7414da1c1a5b7300abbe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128729) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:55:22.581611 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.policy [None req-e35521e0-a17a-41d0-a48c-ad5fe5e1249d tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58bfb7417bc94583963401ae0fe9d39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0672be3fa3f7414da1c1a5b7300abbe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128729) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:55:22.583124 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.policy [None req-e35521e0-a17a-41d0-a48c-ad5fe5e1249d tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58bfb7417bc94583963401ae0fe9d39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0672be3fa3f7414da1c1a5b7300abbe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128729) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:55:22.584267 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: INFO nova.api.openstack.requestlog [None req-e35521e0-a17a-41d0-a48c-ad5fe5e1249d tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] 10.222.0.61 "GET /compute/v2.1/servers/cca08141-979e-4519-88b3-c77e8a71ae3e" status: 200 len: 1724 microversion: 2.20 time: 0.150044 May 14 15:55:22.584819 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: [pid: 128729|app: 0|req: 496/1009] 10.222.0.61 () {60 vars in 1276 bytes} [Sat May 14 15:55:22 2022] GET /compute/v2.1/servers/cca08141-979e-4519-88b3-c77e8a71ae3e => generated 1724 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 14 15:55:23.260806 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi [None req-0c1856c8-07cb-4869-a942-35e340c72c36 tempest-TestShelveInstance-1853374188 tempest-TestShelveInstance-1853374188-project] Calling method '>' {{(pid=128728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 15:55:23.261421 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.compute.api [None req-0c1856c8-07cb-4869-a942-35e340c72c36 tempest-TestShelveInstance-1853374188 tempest-TestShelveInstance-1853374188-project] [instance: 08195c98-5b1d-426c-a398-c7e914c14661] Fetching instance by UUID {{(pid=128728) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 15:55:23.267985 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-0c1856c8-07cb-4869-a942-35e340c72c36 tempest-TestShelveInstance-1853374188 tempest-TestShelveInstance-1853374188-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:55:23.268434 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-0c1856c8-07cb-4869-a942-35e340c72c36 tempest-TestShelveInstance-1853374188 tempest-TestShelveInstance-1853374188-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:55:23.269203 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-0c1856c8-07cb-4869-a942-35e340c72c36 tempest-TestShelveInstance-1853374188 tempest-TestShelveInstance-1853374188-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:55:23.269641 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-0c1856c8-07cb-4869-a942-35e340c72c36 tempest-TestShelveInstance-1853374188 tempest-TestShelveInstance-1853374188-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:55:23.399041 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.policy [None req-0c1856c8-07cb-4869-a942-35e340c72c36 tempest-TestShelveInstance-1853374188 tempest-TestShelveInstance-1853374188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e05ae1c6a054a299e841d008f9d7a09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83d6b6f0aa4f4314811ee80480861958', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128728) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:55:23.406276 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: INFO nova.api.openstack.requestlog [None req-0c1856c8-07cb-4869-a942-35e340c72c36 tempest-TestShelveInstance-1853374188 tempest-TestShelveInstance-1853374188-project] 10.222.0.61 "GET /compute/v2.1/servers/08195c98-5b1d-426c-a398-c7e914c14661" status: 200 len: 1569 microversion: 2.1 time: 0.149327 May 14 15:55:23.407489 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: [pid: 128728|app: 0|req: 514/1010] 10.222.0.61 () {58 vars in 1235 bytes} [Sat May 14 15:55:23 2022] GET /compute/v2.1/servers/08195c98-5b1d-426c-a398-c7e914c14661 => generated 1569 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 15:55:23.602627 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi [None req-6ae0b9e3-c056-4bab-8bec-0da515b67f5d tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Calling method '>' {{(pid=128729) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 15:55:23.603234 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.compute.api [None req-6ae0b9e3-c056-4bab-8bec-0da515b67f5d tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] [instance: cca08141-979e-4519-88b3-c77e8a71ae3e] Fetching instance by UUID {{(pid=128729) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 15:55:23.609494 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-6ae0b9e3-c056-4bab-8bec-0da515b67f5d tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:55:23.610215 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-6ae0b9e3-c056-4bab-8bec-0da515b67f5d tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:55:23.611021 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-6ae0b9e3-c056-4bab-8bec-0da515b67f5d tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:55:23.611463 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-6ae0b9e3-c056-4bab-8bec-0da515b67f5d tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:55:23.740570 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.policy [None req-6ae0b9e3-c056-4bab-8bec-0da515b67f5d tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58bfb7417bc94583963401ae0fe9d39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0672be3fa3f7414da1c1a5b7300abbe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128729) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:55:23.748370 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.policy [None req-6ae0b9e3-c056-4bab-8bec-0da515b67f5d tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58bfb7417bc94583963401ae0fe9d39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0672be3fa3f7414da1c1a5b7300abbe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128729) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:55:23.749880 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.policy [None req-6ae0b9e3-c056-4bab-8bec-0da515b67f5d tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58bfb7417bc94583963401ae0fe9d39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0672be3fa3f7414da1c1a5b7300abbe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128729) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:55:23.751077 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: INFO nova.api.openstack.requestlog [None req-6ae0b9e3-c056-4bab-8bec-0da515b67f5d tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] 10.222.0.61 "GET /compute/v2.1/servers/cca08141-979e-4519-88b3-c77e8a71ae3e" status: 200 len: 1724 microversion: 2.20 time: 0.152364 May 14 15:55:23.751631 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: [pid: 128729|app: 0|req: 497/1011] 10.222.0.61 () {60 vars in 1276 bytes} [Sat May 14 15:55:23 2022] GET /compute/v2.1/servers/cca08141-979e-4519-88b3-c77e8a71ae3e => generated 1724 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 14 15:55:24.423103 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi [None req-dccb5d68-e0f1-4d7b-9ff7-cff558792ecd tempest-TestShelveInstance-1853374188 tempest-TestShelveInstance-1853374188-project] Calling method '>' {{(pid=128728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 15:55:24.423760 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.compute.api [None req-dccb5d68-e0f1-4d7b-9ff7-cff558792ecd tempest-TestShelveInstance-1853374188 tempest-TestShelveInstance-1853374188-project] [instance: 08195c98-5b1d-426c-a398-c7e914c14661] Fetching instance by UUID {{(pid=128728) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 15:55:24.429968 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-dccb5d68-e0f1-4d7b-9ff7-cff558792ecd tempest-TestShelveInstance-1853374188 tempest-TestShelveInstance-1853374188-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:55:24.430465 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-dccb5d68-e0f1-4d7b-9ff7-cff558792ecd tempest-TestShelveInstance-1853374188 tempest-TestShelveInstance-1853374188-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:55:24.431239 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-dccb5d68-e0f1-4d7b-9ff7-cff558792ecd tempest-TestShelveInstance-1853374188 tempest-TestShelveInstance-1853374188-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:55:24.431678 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-dccb5d68-e0f1-4d7b-9ff7-cff558792ecd tempest-TestShelveInstance-1853374188 tempest-TestShelveInstance-1853374188-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:55:24.561942 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.policy [None req-dccb5d68-e0f1-4d7b-9ff7-cff558792ecd tempest-TestShelveInstance-1853374188 tempest-TestShelveInstance-1853374188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e05ae1c6a054a299e841d008f9d7a09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83d6b6f0aa4f4314811ee80480861958', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128728) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:55:24.569862 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: INFO nova.api.openstack.requestlog [None req-dccb5d68-e0f1-4d7b-9ff7-cff558792ecd tempest-TestShelveInstance-1853374188 tempest-TestShelveInstance-1853374188-project] 10.222.0.61 "GET /compute/v2.1/servers/08195c98-5b1d-426c-a398-c7e914c14661" status: 200 len: 1569 microversion: 2.1 time: 0.150662 May 14 15:55:24.570446 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: [pid: 128728|app: 0|req: 515/1012] 10.222.0.61 () {58 vars in 1235 bytes} [Sat May 14 15:55:24 2022] GET /compute/v2.1/servers/08195c98-5b1d-426c-a398-c7e914c14661 => generated 1569 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 15:55:24.769091 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi [None req-f43cc2af-1adf-4e54-b5ae-32b7208d43a0 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Calling method '>' {{(pid=128729) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 15:55:24.769619 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.compute.api [None req-f43cc2af-1adf-4e54-b5ae-32b7208d43a0 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] [instance: cca08141-979e-4519-88b3-c77e8a71ae3e] Fetching instance by UUID {{(pid=128729) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 15:55:24.775933 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-f43cc2af-1adf-4e54-b5ae-32b7208d43a0 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:55:24.776390 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-f43cc2af-1adf-4e54-b5ae-32b7208d43a0 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:55:24.777156 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-f43cc2af-1adf-4e54-b5ae-32b7208d43a0 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:55:24.777595 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-f43cc2af-1adf-4e54-b5ae-32b7208d43a0 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:55:24.908963 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.policy [None req-f43cc2af-1adf-4e54-b5ae-32b7208d43a0 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58bfb7417bc94583963401ae0fe9d39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0672be3fa3f7414da1c1a5b7300abbe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128729) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:55:24.916591 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.policy [None req-f43cc2af-1adf-4e54-b5ae-32b7208d43a0 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58bfb7417bc94583963401ae0fe9d39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0672be3fa3f7414da1c1a5b7300abbe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128729) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:55:24.918112 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.policy [None req-f43cc2af-1adf-4e54-b5ae-32b7208d43a0 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58bfb7417bc94583963401ae0fe9d39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0672be3fa3f7414da1c1a5b7300abbe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128729) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:55:24.919322 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: INFO nova.api.openstack.requestlog [None req-f43cc2af-1adf-4e54-b5ae-32b7208d43a0 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] 10.222.0.61 "GET /compute/v2.1/servers/cca08141-979e-4519-88b3-c77e8a71ae3e" status: 200 len: 1724 microversion: 2.20 time: 0.154341 May 14 15:55:24.919874 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: [pid: 128729|app: 0|req: 498/1013] 10.222.0.61 () {60 vars in 1276 bytes} [Sat May 14 15:55:24 2022] GET /compute/v2.1/servers/cca08141-979e-4519-88b3-c77e8a71ae3e => generated 1724 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 14 15:55:25.587145 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi [None req-257711c2-119d-4942-b942-3007dbc65d77 tempest-TestShelveInstance-1853374188 tempest-TestShelveInstance-1853374188-project] Calling method '>' {{(pid=128728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 15:55:25.587756 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.compute.api [None req-257711c2-119d-4942-b942-3007dbc65d77 tempest-TestShelveInstance-1853374188 tempest-TestShelveInstance-1853374188-project] [instance: 08195c98-5b1d-426c-a398-c7e914c14661] Fetching instance by UUID {{(pid=128728) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 15:55:25.594513 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-257711c2-119d-4942-b942-3007dbc65d77 tempest-TestShelveInstance-1853374188 tempest-TestShelveInstance-1853374188-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:55:25.594957 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-257711c2-119d-4942-b942-3007dbc65d77 tempest-TestShelveInstance-1853374188 tempest-TestShelveInstance-1853374188-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:55:25.595721 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-257711c2-119d-4942-b942-3007dbc65d77 tempest-TestShelveInstance-1853374188 tempest-TestShelveInstance-1853374188-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:55:25.596155 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-257711c2-119d-4942-b942-3007dbc65d77 tempest-TestShelveInstance-1853374188 tempest-TestShelveInstance-1853374188-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:55:25.722298 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.policy [None req-257711c2-119d-4942-b942-3007dbc65d77 tempest-TestShelveInstance-1853374188 tempest-TestShelveInstance-1853374188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e05ae1c6a054a299e841d008f9d7a09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83d6b6f0aa4f4314811ee80480861958', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128728) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:55:25.729486 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: INFO nova.api.openstack.requestlog [None req-257711c2-119d-4942-b942-3007dbc65d77 tempest-TestShelveInstance-1853374188 tempest-TestShelveInstance-1853374188-project] 10.222.0.61 "GET /compute/v2.1/servers/08195c98-5b1d-426c-a398-c7e914c14661" status: 200 len: 1569 microversion: 2.1 time: 0.146188 May 14 15:55:25.730049 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: [pid: 128728|app: 0|req: 516/1014] 10.222.0.61 () {58 vars in 1235 bytes} [Sat May 14 15:55:25 2022] GET /compute/v2.1/servers/08195c98-5b1d-426c-a398-c7e914c14661 => generated 1569 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 15:55:25.937243 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi [None req-6a03b984-c575-42e7-a3ee-7a95299f96b7 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Calling method '>' {{(pid=128729) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 15:55:25.938494 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.compute.api [None req-6a03b984-c575-42e7-a3ee-7a95299f96b7 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] [instance: cca08141-979e-4519-88b3-c77e8a71ae3e] Fetching instance by UUID {{(pid=128729) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 15:55:25.944807 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-6a03b984-c575-42e7-a3ee-7a95299f96b7 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:55:25.945262 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-6a03b984-c575-42e7-a3ee-7a95299f96b7 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:55:25.946040 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-6a03b984-c575-42e7-a3ee-7a95299f96b7 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:55:25.946515 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-6a03b984-c575-42e7-a3ee-7a95299f96b7 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:55:26.075921 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.policy [None req-6a03b984-c575-42e7-a3ee-7a95299f96b7 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58bfb7417bc94583963401ae0fe9d39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0672be3fa3f7414da1c1a5b7300abbe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128729) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:55:26.083935 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.policy [None req-6a03b984-c575-42e7-a3ee-7a95299f96b7 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58bfb7417bc94583963401ae0fe9d39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0672be3fa3f7414da1c1a5b7300abbe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128729) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:55:26.087829 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.policy [None req-6a03b984-c575-42e7-a3ee-7a95299f96b7 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58bfb7417bc94583963401ae0fe9d39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0672be3fa3f7414da1c1a5b7300abbe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128729) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:55:26.089158 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: INFO nova.api.openstack.requestlog [None req-6a03b984-c575-42e7-a3ee-7a95299f96b7 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] 10.222.0.61 "GET /compute/v2.1/servers/cca08141-979e-4519-88b3-c77e8a71ae3e" status: 200 len: 1724 microversion: 2.20 time: 0.156010 May 14 15:55:26.089739 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: [pid: 128729|app: 0|req: 499/1015] 10.222.0.61 () {60 vars in 1276 bytes} [Sat May 14 15:55:25 2022] GET /compute/v2.1/servers/cca08141-979e-4519-88b3-c77e8a71ae3e => generated 1724 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 14 15:55:26.746949 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi [None req-dff8c63b-0040-4914-a81f-6006852b2a9a tempest-TestShelveInstance-1853374188 tempest-TestShelveInstance-1853374188-project] Calling method '>' {{(pid=128728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 15:55:26.747567 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.compute.api [None req-dff8c63b-0040-4914-a81f-6006852b2a9a tempest-TestShelveInstance-1853374188 tempest-TestShelveInstance-1853374188-project] [instance: 08195c98-5b1d-426c-a398-c7e914c14661] Fetching instance by UUID {{(pid=128728) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 15:55:26.754627 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-dff8c63b-0040-4914-a81f-6006852b2a9a tempest-TestShelveInstance-1853374188 tempest-TestShelveInstance-1853374188-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:55:26.755162 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-dff8c63b-0040-4914-a81f-6006852b2a9a tempest-TestShelveInstance-1853374188 tempest-TestShelveInstance-1853374188-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:55:26.756178 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-dff8c63b-0040-4914-a81f-6006852b2a9a tempest-TestShelveInstance-1853374188 tempest-TestShelveInstance-1853374188-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:55:26.756746 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-dff8c63b-0040-4914-a81f-6006852b2a9a tempest-TestShelveInstance-1853374188 tempest-TestShelveInstance-1853374188-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:55:26.889933 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.policy [None req-dff8c63b-0040-4914-a81f-6006852b2a9a tempest-TestShelveInstance-1853374188 tempest-TestShelveInstance-1853374188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e05ae1c6a054a299e841d008f9d7a09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83d6b6f0aa4f4314811ee80480861958', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128728) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:55:26.897836 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: INFO nova.api.openstack.requestlog [None req-dff8c63b-0040-4914-a81f-6006852b2a9a tempest-TestShelveInstance-1853374188 tempest-TestShelveInstance-1853374188-project] 10.222.0.61 "GET /compute/v2.1/servers/08195c98-5b1d-426c-a398-c7e914c14661" status: 200 len: 1569 microversion: 2.1 time: 0.154708 May 14 15:55:26.898411 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: [pid: 128728|app: 0|req: 517/1016] 10.222.0.61 () {58 vars in 1235 bytes} [Sat May 14 15:55:26 2022] GET /compute/v2.1/servers/08195c98-5b1d-426c-a398-c7e914c14661 => generated 1569 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 15:55:27.109442 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi [None req-f5db9770-8ec3-412c-af8f-e5a5f890b845 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Calling method '>' {{(pid=128729) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 15:55:27.110063 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.compute.api [None req-f5db9770-8ec3-412c-af8f-e5a5f890b845 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] [instance: cca08141-979e-4519-88b3-c77e8a71ae3e] Fetching instance by UUID {{(pid=128729) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 15:55:27.118291 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-f5db9770-8ec3-412c-af8f-e5a5f890b845 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:55:27.118767 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-f5db9770-8ec3-412c-af8f-e5a5f890b845 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:55:27.119906 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-f5db9770-8ec3-412c-af8f-e5a5f890b845 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:55:27.120343 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-f5db9770-8ec3-412c-af8f-e5a5f890b845 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:55:27.245782 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.policy [None req-f5db9770-8ec3-412c-af8f-e5a5f890b845 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58bfb7417bc94583963401ae0fe9d39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0672be3fa3f7414da1c1a5b7300abbe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128729) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:55:27.254041 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.policy [None req-f5db9770-8ec3-412c-af8f-e5a5f890b845 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58bfb7417bc94583963401ae0fe9d39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0672be3fa3f7414da1c1a5b7300abbe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128729) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:55:27.255573 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.policy [None req-f5db9770-8ec3-412c-af8f-e5a5f890b845 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58bfb7417bc94583963401ae0fe9d39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0672be3fa3f7414da1c1a5b7300abbe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128729) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:55:27.256716 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: INFO nova.api.openstack.requestlog [None req-f5db9770-8ec3-412c-af8f-e5a5f890b845 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] 10.222.0.61 "GET /compute/v2.1/servers/cca08141-979e-4519-88b3-c77e8a71ae3e" status: 200 len: 1724 microversion: 2.20 time: 0.152242 May 14 15:55:27.257287 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: [pid: 128729|app: 0|req: 500/1017] 10.222.0.61 () {60 vars in 1276 bytes} [Sat May 14 15:55:27 2022] GET /compute/v2.1/servers/cca08141-979e-4519-88b3-c77e8a71ae3e => generated 1724 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 14 15:55:27.914689 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi [None req-eff7cfce-cbc0-471e-9e6c-81090558c5de tempest-TestShelveInstance-1853374188 tempest-TestShelveInstance-1853374188-project] Calling method '>' {{(pid=128728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 15:55:27.915332 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.compute.api [None req-eff7cfce-cbc0-471e-9e6c-81090558c5de tempest-TestShelveInstance-1853374188 tempest-TestShelveInstance-1853374188-project] [instance: 08195c98-5b1d-426c-a398-c7e914c14661] Fetching instance by UUID {{(pid=128728) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 15:55:27.921656 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-eff7cfce-cbc0-471e-9e6c-81090558c5de tempest-TestShelveInstance-1853374188 tempest-TestShelveInstance-1853374188-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:55:27.922091 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-eff7cfce-cbc0-471e-9e6c-81090558c5de tempest-TestShelveInstance-1853374188 tempest-TestShelveInstance-1853374188-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:55:27.922905 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-eff7cfce-cbc0-471e-9e6c-81090558c5de tempest-TestShelveInstance-1853374188 tempest-TestShelveInstance-1853374188-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:55:27.923342 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-eff7cfce-cbc0-471e-9e6c-81090558c5de tempest-TestShelveInstance-1853374188 tempest-TestShelveInstance-1853374188-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:55:27.940938 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi [req-47b98f72-d6eb-4d0a-b7c7-074530bf4d3a req-02483df2-d4b9-498e-8a0e-dea7ad007d81 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "08195c98-5b1d-426c-a398-c7e914c14661", "name": "network-vif-unplugged", "status": "completed", "tag": "ff1e7e07-bb51-463a-a362-bc5fcaff458c"}]} {{(pid=128729) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 15:55:27.950258 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [req-47b98f72-d6eb-4d0a-b7c7-074530bf4d3a req-02483df2-d4b9-498e-8a0e-dea7ad007d81 service nova] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:55:27.950746 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [req-47b98f72-d6eb-4d0a-b7c7-074530bf4d3a req-02483df2-d4b9-498e-8a0e-dea7ad007d81 service nova] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:55:27.980186 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: INFO nova.api.openstack.compute.server_external_events [req-47b98f72-d6eb-4d0a-b7c7-074530bf4d3a req-02483df2-d4b9-498e-8a0e-dea7ad007d81 service nova] Creating event network-vif-unplugged:ff1e7e07-bb51-463a-a362-bc5fcaff458c for instance 08195c98-5b1d-426c-a398-c7e914c14661 on hv-cinder-83979 May 14 15:55:27.986516 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: INFO nova.api.openstack.requestlog [req-47b98f72-d6eb-4d0a-b7c7-074530bf4d3a req-02483df2-d4b9-498e-8a0e-dea7ad007d81 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.049762 May 14 15:55:27.987119 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: [pid: 128729|app: 0|req: 501/1018] 10.222.0.61 () {64 vars in 1317 bytes} [Sat May 14 15:55:27 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 14 15:55:28.077898 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.policy [None req-eff7cfce-cbc0-471e-9e6c-81090558c5de tempest-TestShelveInstance-1853374188 tempest-TestShelveInstance-1853374188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e05ae1c6a054a299e841d008f9d7a09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83d6b6f0aa4f4314811ee80480861958', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128728) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:55:28.085305 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: INFO nova.api.openstack.requestlog [None req-eff7cfce-cbc0-471e-9e6c-81090558c5de tempest-TestShelveInstance-1853374188 tempest-TestShelveInstance-1853374188-project] 10.222.0.61 "GET /compute/v2.1/servers/08195c98-5b1d-426c-a398-c7e914c14661" status: 200 len: 1570 microversion: 2.1 time: 0.174486 May 14 15:55:28.085875 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: [pid: 128728|app: 0|req: 518/1019] 10.222.0.61 () {58 vars in 1235 bytes} [Sat May 14 15:55:27 2022] GET /compute/v2.1/servers/08195c98-5b1d-426c-a398-c7e914c14661 => generated 1570 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 15:55:28.103254 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi [None req-88cc8b20-a318-4195-96a6-f226f8befbff tempest-TestShelveInstance-1853374188 tempest-TestShelveInstance-1853374188-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=128729) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 15:55:28.104514 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.compute.api [None req-88cc8b20-a318-4195-96a6-f226f8befbff tempest-TestShelveInstance-1853374188 tempest-TestShelveInstance-1853374188-project] [instance: 08195c98-5b1d-426c-a398-c7e914c14661] Fetching instance by UUID {{(pid=128729) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 15:55:28.116013 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-88cc8b20-a318-4195-96a6-f226f8befbff tempest-TestShelveInstance-1853374188 tempest-TestShelveInstance-1853374188-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:55:28.117063 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-88cc8b20-a318-4195-96a6-f226f8befbff tempest-TestShelveInstance-1853374188 tempest-TestShelveInstance-1853374188-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:55:28.117520 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-88cc8b20-a318-4195-96a6-f226f8befbff tempest-TestShelveInstance-1853374188 tempest-TestShelveInstance-1853374188-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:55:28.117981 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-88cc8b20-a318-4195-96a6-f226f8befbff tempest-TestShelveInstance-1853374188 tempest-TestShelveInstance-1853374188-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:55:28.207450 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: INFO nova.api.openstack.requestlog [None req-88cc8b20-a318-4195-96a6-f226f8befbff tempest-TestShelveInstance-1853374188 tempest-TestShelveInstance-1853374188-project] 10.222.0.61 "POST /compute/v2.1/servers/08195c98-5b1d-426c-a398-c7e914c14661/action" status: 202 len: 0 microversion: 2.1 time: 0.109761 May 14 15:55:28.208178 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: [pid: 128729|app: 0|req: 502/1020] 10.222.0.61 () {60 vars in 1277 bytes} [Sat May 14 15:55:28 2022] POST /compute/v2.1/servers/08195c98-5b1d-426c-a398-c7e914c14661/action => generated 0 bytes in 111 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 14 15:55:28.216276 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi [None req-cca1a3ac-4653-4bd9-814e-38d2b1e593a7 tempest-TestShelveInstance-1853374188 tempest-TestShelveInstance-1853374188-project] Calling method '>' {{(pid=128728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 15:55:28.216882 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.compute.api [None req-cca1a3ac-4653-4bd9-814e-38d2b1e593a7 tempest-TestShelveInstance-1853374188 tempest-TestShelveInstance-1853374188-project] [instance: 08195c98-5b1d-426c-a398-c7e914c14661] Fetching instance by UUID {{(pid=128728) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 15:55:28.222911 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-cca1a3ac-4653-4bd9-814e-38d2b1e593a7 tempest-TestShelveInstance-1853374188 tempest-TestShelveInstance-1853374188-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:55:28.223361 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-cca1a3ac-4653-4bd9-814e-38d2b1e593a7 tempest-TestShelveInstance-1853374188 tempest-TestShelveInstance-1853374188-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:55:28.224126 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-cca1a3ac-4653-4bd9-814e-38d2b1e593a7 tempest-TestShelveInstance-1853374188 tempest-TestShelveInstance-1853374188-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:55:28.224560 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-cca1a3ac-4653-4bd9-814e-38d2b1e593a7 tempest-TestShelveInstance-1853374188 tempest-TestShelveInstance-1853374188-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:55:28.275193 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi [None req-caa3a211-9b14-407f-9e7d-b96119173e44 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Calling method '>' {{(pid=128729) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 15:55:28.275803 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.compute.api [None req-caa3a211-9b14-407f-9e7d-b96119173e44 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] [instance: cca08141-979e-4519-88b3-c77e8a71ae3e] Fetching instance by UUID {{(pid=128729) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 15:55:28.282331 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-caa3a211-9b14-407f-9e7d-b96119173e44 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:55:28.282892 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-caa3a211-9b14-407f-9e7d-b96119173e44 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:55:28.283673 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-caa3a211-9b14-407f-9e7d-b96119173e44 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:55:28.284274 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-caa3a211-9b14-407f-9e7d-b96119173e44 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:55:28.412619 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.policy [None req-cca1a3ac-4653-4bd9-814e-38d2b1e593a7 tempest-TestShelveInstance-1853374188 tempest-TestShelveInstance-1853374188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e05ae1c6a054a299e841d008f9d7a09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83d6b6f0aa4f4314811ee80480861958', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128728) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:55:28.420677 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: INFO nova.api.openstack.requestlog [None req-cca1a3ac-4653-4bd9-814e-38d2b1e593a7 tempest-TestShelveInstance-1853374188 tempest-TestShelveInstance-1853374188-project] 10.222.0.61 "GET /compute/v2.1/servers/08195c98-5b1d-426c-a398-c7e914c14661" status: 200 len: 1518 microversion: 2.1 time: 0.207975 May 14 15:55:28.421465 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: [pid: 128728|app: 0|req: 519/1021] 10.222.0.61 () {58 vars in 1235 bytes} [Sat May 14 15:55:28 2022] GET /compute/v2.1/servers/08195c98-5b1d-426c-a398-c7e914c14661 => generated 1518 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 15:55:28.451333 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.policy [None req-caa3a211-9b14-407f-9e7d-b96119173e44 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58bfb7417bc94583963401ae0fe9d39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0672be3fa3f7414da1c1a5b7300abbe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128729) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:55:28.460331 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.policy [None req-caa3a211-9b14-407f-9e7d-b96119173e44 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58bfb7417bc94583963401ae0fe9d39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0672be3fa3f7414da1c1a5b7300abbe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128729) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:55:28.462137 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.policy [None req-caa3a211-9b14-407f-9e7d-b96119173e44 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58bfb7417bc94583963401ae0fe9d39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0672be3fa3f7414da1c1a5b7300abbe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128729) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:55:28.463356 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: INFO nova.api.openstack.requestlog [None req-caa3a211-9b14-407f-9e7d-b96119173e44 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] 10.222.0.61 "GET /compute/v2.1/servers/cca08141-979e-4519-88b3-c77e8a71ae3e" status: 200 len: 1724 microversion: 2.20 time: 0.192276 May 14 15:55:28.463916 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: [pid: 128729|app: 0|req: 503/1022] 10.222.0.61 () {60 vars in 1276 bytes} [Sat May 14 15:55:28 2022] GET /compute/v2.1/servers/cca08141-979e-4519-88b3-c77e8a71ae3e => generated 1724 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 14 15:55:29.436692 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi [None req-5a598e3a-2178-414d-8bc3-46bb6951f290 tempest-TestShelveInstance-1853374188 tempest-TestShelveInstance-1853374188-project] Calling method '>' {{(pid=128728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 15:55:29.437294 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.compute.api [None req-5a598e3a-2178-414d-8bc3-46bb6951f290 tempest-TestShelveInstance-1853374188 tempest-TestShelveInstance-1853374188-project] [instance: 08195c98-5b1d-426c-a398-c7e914c14661] Fetching instance by UUID {{(pid=128728) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 15:55:29.443880 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-5a598e3a-2178-414d-8bc3-46bb6951f290 tempest-TestShelveInstance-1853374188 tempest-TestShelveInstance-1853374188-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:55:29.444329 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-5a598e3a-2178-414d-8bc3-46bb6951f290 tempest-TestShelveInstance-1853374188 tempest-TestShelveInstance-1853374188-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:55:29.445095 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-5a598e3a-2178-414d-8bc3-46bb6951f290 tempest-TestShelveInstance-1853374188 tempest-TestShelveInstance-1853374188-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:55:29.445525 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-5a598e3a-2178-414d-8bc3-46bb6951f290 tempest-TestShelveInstance-1853374188 tempest-TestShelveInstance-1853374188-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:55:29.480825 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi [None req-1b8e3d3c-74cf-49cd-aa62-e202bb543e0c tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Calling method '>' {{(pid=128729) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 15:55:29.481426 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.compute.api [None req-1b8e3d3c-74cf-49cd-aa62-e202bb543e0c tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] [instance: cca08141-979e-4519-88b3-c77e8a71ae3e] Fetching instance by UUID {{(pid=128729) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 15:55:29.488937 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-1b8e3d3c-74cf-49cd-aa62-e202bb543e0c tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:55:29.489384 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-1b8e3d3c-74cf-49cd-aa62-e202bb543e0c tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:55:29.490274 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-1b8e3d3c-74cf-49cd-aa62-e202bb543e0c tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:55:29.490741 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-1b8e3d3c-74cf-49cd-aa62-e202bb543e0c tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:55:29.619679 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.policy [None req-5a598e3a-2178-414d-8bc3-46bb6951f290 tempest-TestShelveInstance-1853374188 tempest-TestShelveInstance-1853374188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e05ae1c6a054a299e841d008f9d7a09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83d6b6f0aa4f4314811ee80480861958', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128728) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:55:29.627243 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: INFO nova.api.openstack.requestlog [None req-5a598e3a-2178-414d-8bc3-46bb6951f290 tempest-TestShelveInstance-1853374188 tempest-TestShelveInstance-1853374188-project] 10.222.0.61 "GET /compute/v2.1/servers/08195c98-5b1d-426c-a398-c7e914c14661" status: 200 len: 1520 microversion: 2.1 time: 0.194278 May 14 15:55:29.627822 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: [pid: 128728|app: 0|req: 520/1023] 10.222.0.61 () {58 vars in 1235 bytes} [Sat May 14 15:55:29 2022] GET /compute/v2.1/servers/08195c98-5b1d-426c-a398-c7e914c14661 => generated 1520 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 15:55:29.651780 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.policy [None req-1b8e3d3c-74cf-49cd-aa62-e202bb543e0c tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58bfb7417bc94583963401ae0fe9d39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0672be3fa3f7414da1c1a5b7300abbe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128729) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:55:29.659995 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.policy [None req-1b8e3d3c-74cf-49cd-aa62-e202bb543e0c tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58bfb7417bc94583963401ae0fe9d39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0672be3fa3f7414da1c1a5b7300abbe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128729) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:55:29.661486 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.policy [None req-1b8e3d3c-74cf-49cd-aa62-e202bb543e0c tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58bfb7417bc94583963401ae0fe9d39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0672be3fa3f7414da1c1a5b7300abbe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128729) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:55:29.662666 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: INFO nova.api.openstack.requestlog [None req-1b8e3d3c-74cf-49cd-aa62-e202bb543e0c tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] 10.222.0.61 "GET /compute/v2.1/servers/cca08141-979e-4519-88b3-c77e8a71ae3e" status: 200 len: 1724 microversion: 2.20 time: 0.185679 May 14 15:55:29.663215 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: [pid: 128729|app: 0|req: 504/1024] 10.222.0.61 () {60 vars in 1276 bytes} [Sat May 14 15:55:29 2022] GET /compute/v2.1/servers/cca08141-979e-4519-88b3-c77e8a71ae3e => generated 1724 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 14 15:55:30.644553 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi [None req-919e53f6-8550-498b-a405-b7f126fe0b49 tempest-TestShelveInstance-1853374188 tempest-TestShelveInstance-1853374188-project] Calling method '>' {{(pid=128728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 15:55:30.645638 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.compute.api [None req-919e53f6-8550-498b-a405-b7f126fe0b49 tempest-TestShelveInstance-1853374188 tempest-TestShelveInstance-1853374188-project] [instance: 08195c98-5b1d-426c-a398-c7e914c14661] Fetching instance by UUID {{(pid=128728) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 15:55:30.652606 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-919e53f6-8550-498b-a405-b7f126fe0b49 tempest-TestShelveInstance-1853374188 tempest-TestShelveInstance-1853374188-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:55:30.653721 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-919e53f6-8550-498b-a405-b7f126fe0b49 tempest-TestShelveInstance-1853374188 tempest-TestShelveInstance-1853374188-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:55:30.654691 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-919e53f6-8550-498b-a405-b7f126fe0b49 tempest-TestShelveInstance-1853374188 tempest-TestShelveInstance-1853374188-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:55:30.655141 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-919e53f6-8550-498b-a405-b7f126fe0b49 tempest-TestShelveInstance-1853374188 tempest-TestShelveInstance-1853374188-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:55:30.682271 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi [None req-67d7656d-6625-4c00-a9a9-f4480a6da082 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Calling method '>' {{(pid=128729) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 15:55:30.682848 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.compute.api [None req-67d7656d-6625-4c00-a9a9-f4480a6da082 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] [instance: cca08141-979e-4519-88b3-c77e8a71ae3e] Fetching instance by UUID {{(pid=128729) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 15:55:30.692240 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-67d7656d-6625-4c00-a9a9-f4480a6da082 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:55:30.692711 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-67d7656d-6625-4c00-a9a9-f4480a6da082 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:55:30.693718 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-67d7656d-6625-4c00-a9a9-f4480a6da082 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:55:30.694146 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-67d7656d-6625-4c00-a9a9-f4480a6da082 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:55:30.852262 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.policy [None req-919e53f6-8550-498b-a405-b7f126fe0b49 tempest-TestShelveInstance-1853374188 tempest-TestShelveInstance-1853374188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e05ae1c6a054a299e841d008f9d7a09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83d6b6f0aa4f4314811ee80480861958', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128728) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:55:30.861079 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: INFO nova.api.openstack.requestlog [None req-919e53f6-8550-498b-a405-b7f126fe0b49 tempest-TestShelveInstance-1853374188 tempest-TestShelveInstance-1853374188-project] 10.222.0.61 "GET /compute/v2.1/servers/08195c98-5b1d-426c-a398-c7e914c14661" status: 200 len: 1576 microversion: 2.1 time: 0.220843 May 14 15:55:30.861659 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: [pid: 128728|app: 0|req: 521/1025] 10.222.0.61 () {58 vars in 1235 bytes} [Sat May 14 15:55:30 2022] GET /compute/v2.1/servers/08195c98-5b1d-426c-a398-c7e914c14661 => generated 1576 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 15:55:30.877611 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.policy [None req-67d7656d-6625-4c00-a9a9-f4480a6da082 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58bfb7417bc94583963401ae0fe9d39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0672be3fa3f7414da1c1a5b7300abbe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128729) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:55:30.885560 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.policy [None req-67d7656d-6625-4c00-a9a9-f4480a6da082 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58bfb7417bc94583963401ae0fe9d39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0672be3fa3f7414da1c1a5b7300abbe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128729) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:55:30.887100 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.policy [None req-67d7656d-6625-4c00-a9a9-f4480a6da082 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58bfb7417bc94583963401ae0fe9d39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0672be3fa3f7414da1c1a5b7300abbe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128729) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:55:30.888291 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: INFO nova.api.openstack.requestlog [None req-67d7656d-6625-4c00-a9a9-f4480a6da082 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] 10.222.0.61 "GET /compute/v2.1/servers/cca08141-979e-4519-88b3-c77e8a71ae3e" status: 200 len: 1724 microversion: 2.20 time: 0.210989 May 14 15:55:30.888883 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: [pid: 128729|app: 0|req: 505/1026] 10.222.0.61 () {60 vars in 1276 bytes} [Sat May 14 15:55:30 2022] GET /compute/v2.1/servers/cca08141-979e-4519-88b3-c77e8a71ae3e => generated 1724 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 14 15:55:31.881921 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi [None req-44a6e050-8bea-4f93-8d35-68b2d95591fd tempest-TestShelveInstance-1853374188 tempest-TestShelveInstance-1853374188-project] Calling method '>' {{(pid=128728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 15:55:31.888868 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.compute.api [None req-44a6e050-8bea-4f93-8d35-68b2d95591fd tempest-TestShelveInstance-1853374188 tempest-TestShelveInstance-1853374188-project] [instance: 08195c98-5b1d-426c-a398-c7e914c14661] Fetching instance by UUID {{(pid=128728) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 15:55:31.898004 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-44a6e050-8bea-4f93-8d35-68b2d95591fd tempest-TestShelveInstance-1853374188 tempest-TestShelveInstance-1853374188-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:55:31.898492 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-44a6e050-8bea-4f93-8d35-68b2d95591fd tempest-TestShelveInstance-1853374188 tempest-TestShelveInstance-1853374188-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:55:31.899287 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-44a6e050-8bea-4f93-8d35-68b2d95591fd tempest-TestShelveInstance-1853374188 tempest-TestShelveInstance-1853374188-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:55:31.899727 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-44a6e050-8bea-4f93-8d35-68b2d95591fd tempest-TestShelveInstance-1853374188 tempest-TestShelveInstance-1853374188-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:55:31.908762 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi [None req-c95a6a06-3420-49c4-95c7-9f2edfd12609 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Calling method '>' {{(pid=128729) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 15:55:31.909373 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.compute.api [None req-c95a6a06-3420-49c4-95c7-9f2edfd12609 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] [instance: cca08141-979e-4519-88b3-c77e8a71ae3e] Fetching instance by UUID {{(pid=128729) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 15:55:31.918259 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-c95a6a06-3420-49c4-95c7-9f2edfd12609 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:55:31.918752 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-c95a6a06-3420-49c4-95c7-9f2edfd12609 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:55:31.923171 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-c95a6a06-3420-49c4-95c7-9f2edfd12609 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:55:31.924761 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-c95a6a06-3420-49c4-95c7-9f2edfd12609 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:55:32.155876 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.policy [None req-44a6e050-8bea-4f93-8d35-68b2d95591fd tempest-TestShelveInstance-1853374188 tempest-TestShelveInstance-1853374188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e05ae1c6a054a299e841d008f9d7a09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83d6b6f0aa4f4314811ee80480861958', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128728) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:55:32.163332 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: INFO nova.api.openstack.requestlog [None req-44a6e050-8bea-4f93-8d35-68b2d95591fd tempest-TestShelveInstance-1853374188 tempest-TestShelveInstance-1853374188-project] 10.222.0.61 "GET /compute/v2.1/servers/08195c98-5b1d-426c-a398-c7e914c14661" status: 200 len: 1576 microversion: 2.1 time: 0.288814 May 14 15:55:32.169665 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: [pid: 128728|app: 0|req: 522/1027] 10.222.0.61 () {58 vars in 1235 bytes} [Sat May 14 15:55:31 2022] GET /compute/v2.1/servers/08195c98-5b1d-426c-a398-c7e914c14661 => generated 1576 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 15:55:32.181969 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.policy [None req-c95a6a06-3420-49c4-95c7-9f2edfd12609 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58bfb7417bc94583963401ae0fe9d39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0672be3fa3f7414da1c1a5b7300abbe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128729) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:55:32.201751 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.policy [None req-c95a6a06-3420-49c4-95c7-9f2edfd12609 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58bfb7417bc94583963401ae0fe9d39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0672be3fa3f7414da1c1a5b7300abbe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128729) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:55:32.203358 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.policy [None req-c95a6a06-3420-49c4-95c7-9f2edfd12609 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58bfb7417bc94583963401ae0fe9d39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0672be3fa3f7414da1c1a5b7300abbe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128729) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:55:32.205038 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: INFO nova.api.openstack.requestlog [None req-c95a6a06-3420-49c4-95c7-9f2edfd12609 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] 10.222.0.61 "GET /compute/v2.1/servers/cca08141-979e-4519-88b3-c77e8a71ae3e" status: 200 len: 1745 microversion: 2.20 time: 0.300992 May 14 15:55:32.205791 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: [pid: 128729|app: 0|req: 506/1028] 10.222.0.61 () {60 vars in 1276 bytes} [Sat May 14 15:55:31 2022] GET /compute/v2.1/servers/cca08141-979e-4519-88b3-c77e8a71ae3e => generated 1745 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 14 15:55:33.186747 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi [None req-bc3ab7a7-212e-4023-bbd3-c09f6c828edd tempest-TestShelveInstance-1853374188 tempest-TestShelveInstance-1853374188-project] Calling method '>' {{(pid=128728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 15:55:33.187290 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.compute.api [None req-bc3ab7a7-212e-4023-bbd3-c09f6c828edd tempest-TestShelveInstance-1853374188 tempest-TestShelveInstance-1853374188-project] [instance: 08195c98-5b1d-426c-a398-c7e914c14661] Fetching instance by UUID {{(pid=128728) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 15:55:33.193515 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-bc3ab7a7-212e-4023-bbd3-c09f6c828edd tempest-TestShelveInstance-1853374188 tempest-TestShelveInstance-1853374188-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:55:33.193958 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-bc3ab7a7-212e-4023-bbd3-c09f6c828edd tempest-TestShelveInstance-1853374188 tempest-TestShelveInstance-1853374188-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:55:33.194745 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-bc3ab7a7-212e-4023-bbd3-c09f6c828edd tempest-TestShelveInstance-1853374188 tempest-TestShelveInstance-1853374188-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:55:33.195174 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-bc3ab7a7-212e-4023-bbd3-c09f6c828edd tempest-TestShelveInstance-1853374188 tempest-TestShelveInstance-1853374188-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:55:33.224517 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi [None req-7c5e1675-fc0b-47b0-b0d1-254a71f63ef5 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Calling method '>' {{(pid=128729) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 15:55:33.225479 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.compute.api [None req-7c5e1675-fc0b-47b0-b0d1-254a71f63ef5 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] [instance: cca08141-979e-4519-88b3-c77e8a71ae3e] Fetching instance by UUID {{(pid=128729) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 15:55:33.231994 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-7c5e1675-fc0b-47b0-b0d1-254a71f63ef5 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:55:33.232457 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-7c5e1675-fc0b-47b0-b0d1-254a71f63ef5 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:55:33.233243 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-7c5e1675-fc0b-47b0-b0d1-254a71f63ef5 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:55:33.233733 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-7c5e1675-fc0b-47b0-b0d1-254a71f63ef5 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:55:33.386909 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.policy [None req-bc3ab7a7-212e-4023-bbd3-c09f6c828edd tempest-TestShelveInstance-1853374188 tempest-TestShelveInstance-1853374188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e05ae1c6a054a299e841d008f9d7a09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83d6b6f0aa4f4314811ee80480861958', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128728) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:55:33.394907 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: INFO nova.api.openstack.requestlog [None req-bc3ab7a7-212e-4023-bbd3-c09f6c828edd tempest-TestShelveInstance-1853374188 tempest-TestShelveInstance-1853374188-project] 10.222.0.61 "GET /compute/v2.1/servers/08195c98-5b1d-426c-a398-c7e914c14661" status: 200 len: 1576 microversion: 2.1 time: 0.211976 May 14 15:55:33.395479 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: [pid: 128728|app: 0|req: 523/1029] 10.222.0.61 () {58 vars in 1235 bytes} [Sat May 14 15:55:33 2022] GET /compute/v2.1/servers/08195c98-5b1d-426c-a398-c7e914c14661 => generated 1576 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 15:55:33.407744 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.policy [None req-7c5e1675-fc0b-47b0-b0d1-254a71f63ef5 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58bfb7417bc94583963401ae0fe9d39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0672be3fa3f7414da1c1a5b7300abbe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128729) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:55:33.415777 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.policy [None req-7c5e1675-fc0b-47b0-b0d1-254a71f63ef5 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58bfb7417bc94583963401ae0fe9d39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0672be3fa3f7414da1c1a5b7300abbe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128729) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:55:33.417274 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.policy [None req-7c5e1675-fc0b-47b0-b0d1-254a71f63ef5 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58bfb7417bc94583963401ae0fe9d39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0672be3fa3f7414da1c1a5b7300abbe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128729) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:55:33.418455 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: INFO nova.api.openstack.requestlog [None req-7c5e1675-fc0b-47b0-b0d1-254a71f63ef5 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] 10.222.0.61 "GET /compute/v2.1/servers/cca08141-979e-4519-88b3-c77e8a71ae3e" status: 200 len: 1745 microversion: 2.20 time: 0.197983 May 14 15:55:33.419001 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: [pid: 128729|app: 0|req: 507/1030] 10.222.0.61 () {60 vars in 1276 bytes} [Sat May 14 15:55:33 2022] GET /compute/v2.1/servers/cca08141-979e-4519-88b3-c77e8a71ae3e => generated 1745 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 14 15:55:34.411917 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi [None req-3c562302-0043-4667-af78-19206fec0bf0 tempest-TestShelveInstance-1853374188 tempest-TestShelveInstance-1853374188-project] Calling method '>' {{(pid=128728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 15:55:34.412536 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.compute.api [None req-3c562302-0043-4667-af78-19206fec0bf0 tempest-TestShelveInstance-1853374188 tempest-TestShelveInstance-1853374188-project] [instance: 08195c98-5b1d-426c-a398-c7e914c14661] Fetching instance by UUID {{(pid=128728) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 15:55:34.418806 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-3c562302-0043-4667-af78-19206fec0bf0 tempest-TestShelveInstance-1853374188 tempest-TestShelveInstance-1853374188-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:55:34.419262 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-3c562302-0043-4667-af78-19206fec0bf0 tempest-TestShelveInstance-1853374188 tempest-TestShelveInstance-1853374188-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:55:34.420036 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-3c562302-0043-4667-af78-19206fec0bf0 tempest-TestShelveInstance-1853374188 tempest-TestShelveInstance-1853374188-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:55:34.420478 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-3c562302-0043-4667-af78-19206fec0bf0 tempest-TestShelveInstance-1853374188 tempest-TestShelveInstance-1853374188-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:55:34.436539 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi [None req-0fc57c95-47ce-448d-a638-a43bc05fd2a4 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Calling method '>' {{(pid=128729) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 15:55:34.437151 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.compute.api [None req-0fc57c95-47ce-448d-a638-a43bc05fd2a4 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] [instance: cca08141-979e-4519-88b3-c77e8a71ae3e] Fetching instance by UUID {{(pid=128729) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 15:55:34.443214 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-0fc57c95-47ce-448d-a638-a43bc05fd2a4 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:55:34.443666 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-0fc57c95-47ce-448d-a638-a43bc05fd2a4 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:55:34.444445 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-0fc57c95-47ce-448d-a638-a43bc05fd2a4 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:55:34.444884 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-0fc57c95-47ce-448d-a638-a43bc05fd2a4 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:55:34.612654 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.policy [None req-3c562302-0043-4667-af78-19206fec0bf0 tempest-TestShelveInstance-1853374188 tempest-TestShelveInstance-1853374188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e05ae1c6a054a299e841d008f9d7a09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83d6b6f0aa4f4314811ee80480861958', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128728) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:55:34.620472 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: INFO nova.api.openstack.requestlog [None req-3c562302-0043-4667-af78-19206fec0bf0 tempest-TestShelveInstance-1853374188 tempest-TestShelveInstance-1853374188-project] 10.222.0.61 "GET /compute/v2.1/servers/08195c98-5b1d-426c-a398-c7e914c14661" status: 200 len: 1576 microversion: 2.1 time: 0.212340 May 14 15:55:34.621048 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: [pid: 128728|app: 0|req: 524/1031] 10.222.0.61 () {58 vars in 1235 bytes} [Sat May 14 15:55:34 2022] GET /compute/v2.1/servers/08195c98-5b1d-426c-a398-c7e914c14661 => generated 1576 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 15:55:34.623741 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.policy [None req-0fc57c95-47ce-448d-a638-a43bc05fd2a4 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58bfb7417bc94583963401ae0fe9d39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0672be3fa3f7414da1c1a5b7300abbe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128729) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:55:34.631988 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.policy [None req-0fc57c95-47ce-448d-a638-a43bc05fd2a4 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58bfb7417bc94583963401ae0fe9d39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0672be3fa3f7414da1c1a5b7300abbe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128729) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:55:34.633493 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.policy [None req-0fc57c95-47ce-448d-a638-a43bc05fd2a4 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58bfb7417bc94583963401ae0fe9d39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0672be3fa3f7414da1c1a5b7300abbe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128729) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:55:34.634677 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: INFO nova.api.openstack.requestlog [None req-0fc57c95-47ce-448d-a638-a43bc05fd2a4 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] 10.222.0.61 "GET /compute/v2.1/servers/cca08141-979e-4519-88b3-c77e8a71ae3e" status: 200 len: 1745 microversion: 2.20 time: 0.202048 May 14 15:55:34.635234 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: [pid: 128729|app: 0|req: 508/1032] 10.222.0.61 () {60 vars in 1276 bytes} [Sat May 14 15:55:34 2022] GET /compute/v2.1/servers/cca08141-979e-4519-88b3-c77e8a71ae3e => generated 1745 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 14 15:55:35.637194 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi [None req-c6a14c32-dda2-4e5b-be6f-3e59f3326f3e tempest-TestShelveInstance-1853374188 tempest-TestShelveInstance-1853374188-project] Calling method '>' {{(pid=128728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 15:55:35.637801 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.compute.api [None req-c6a14c32-dda2-4e5b-be6f-3e59f3326f3e tempest-TestShelveInstance-1853374188 tempest-TestShelveInstance-1853374188-project] [instance: 08195c98-5b1d-426c-a398-c7e914c14661] Fetching instance by UUID {{(pid=128728) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 15:55:35.644289 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-c6a14c32-dda2-4e5b-be6f-3e59f3326f3e tempest-TestShelveInstance-1853374188 tempest-TestShelveInstance-1853374188-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:55:35.644676 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-c6a14c32-dda2-4e5b-be6f-3e59f3326f3e tempest-TestShelveInstance-1853374188 tempest-TestShelveInstance-1853374188-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:55:35.645438 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-c6a14c32-dda2-4e5b-be6f-3e59f3326f3e tempest-TestShelveInstance-1853374188 tempest-TestShelveInstance-1853374188-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:55:35.645871 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-c6a14c32-dda2-4e5b-be6f-3e59f3326f3e tempest-TestShelveInstance-1853374188 tempest-TestShelveInstance-1853374188-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:55:35.652796 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi [None req-1817cb3d-de31-4934-9d51-6ceba8fb83a4 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Calling method '>' {{(pid=128729) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 15:55:35.653430 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.compute.api [None req-1817cb3d-de31-4934-9d51-6ceba8fb83a4 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] [instance: cca08141-979e-4519-88b3-c77e8a71ae3e] Fetching instance by UUID {{(pid=128729) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 15:55:35.660248 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-1817cb3d-de31-4934-9d51-6ceba8fb83a4 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:55:35.660732 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-1817cb3d-de31-4934-9d51-6ceba8fb83a4 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:55:35.661504 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-1817cb3d-de31-4934-9d51-6ceba8fb83a4 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:55:35.661939 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-1817cb3d-de31-4934-9d51-6ceba8fb83a4 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:55:35.826644 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.policy [None req-c6a14c32-dda2-4e5b-be6f-3e59f3326f3e tempest-TestShelveInstance-1853374188 tempest-TestShelveInstance-1853374188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e05ae1c6a054a299e841d008f9d7a09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83d6b6f0aa4f4314811ee80480861958', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128728) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:55:35.838737 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: INFO nova.api.openstack.requestlog [None req-c6a14c32-dda2-4e5b-be6f-3e59f3326f3e tempest-TestShelveInstance-1853374188 tempest-TestShelveInstance-1853374188-project] 10.222.0.61 "GET /compute/v2.1/servers/08195c98-5b1d-426c-a398-c7e914c14661" status: 200 len: 1576 microversion: 2.1 time: 0.205202 May 14 15:55:35.840482 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: [pid: 128728|app: 0|req: 525/1033] 10.222.0.61 () {58 vars in 1235 bytes} [Sat May 14 15:55:35 2022] GET /compute/v2.1/servers/08195c98-5b1d-426c-a398-c7e914c14661 => generated 1576 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 15:55:35.851253 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.policy [None req-1817cb3d-de31-4934-9d51-6ceba8fb83a4 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58bfb7417bc94583963401ae0fe9d39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0672be3fa3f7414da1c1a5b7300abbe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128729) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:55:35.859009 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.policy [None req-1817cb3d-de31-4934-9d51-6ceba8fb83a4 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58bfb7417bc94583963401ae0fe9d39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0672be3fa3f7414da1c1a5b7300abbe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128729) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:55:35.861130 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.policy [None req-1817cb3d-de31-4934-9d51-6ceba8fb83a4 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58bfb7417bc94583963401ae0fe9d39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0672be3fa3f7414da1c1a5b7300abbe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128729) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:55:35.862283 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: INFO nova.api.openstack.requestlog [None req-1817cb3d-de31-4934-9d51-6ceba8fb83a4 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] 10.222.0.61 "GET /compute/v2.1/servers/cca08141-979e-4519-88b3-c77e8a71ae3e" status: 200 len: 1745 microversion: 2.20 time: 0.213388 May 14 15:55:35.862870 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: [pid: 128729|app: 0|req: 509/1034] 10.222.0.61 () {60 vars in 1276 bytes} [Sat May 14 15:55:35 2022] GET /compute/v2.1/servers/cca08141-979e-4519-88b3-c77e8a71ae3e => generated 1745 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 14 15:55:36.857894 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi [None req-795db4dc-cfd5-45d8-8469-1bc099eda361 tempest-TestShelveInstance-1853374188 tempest-TestShelveInstance-1853374188-project] Calling method '>' {{(pid=128728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 15:55:36.858537 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.compute.api [None req-795db4dc-cfd5-45d8-8469-1bc099eda361 tempest-TestShelveInstance-1853374188 tempest-TestShelveInstance-1853374188-project] [instance: 08195c98-5b1d-426c-a398-c7e914c14661] Fetching instance by UUID {{(pid=128728) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 15:55:36.865081 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-795db4dc-cfd5-45d8-8469-1bc099eda361 tempest-TestShelveInstance-1853374188 tempest-TestShelveInstance-1853374188-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:55:36.865534 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-795db4dc-cfd5-45d8-8469-1bc099eda361 tempest-TestShelveInstance-1853374188 tempest-TestShelveInstance-1853374188-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:55:36.866606 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-795db4dc-cfd5-45d8-8469-1bc099eda361 tempest-TestShelveInstance-1853374188 tempest-TestShelveInstance-1853374188-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:55:36.867049 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-795db4dc-cfd5-45d8-8469-1bc099eda361 tempest-TestShelveInstance-1853374188 tempest-TestShelveInstance-1853374188-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:55:36.880518 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi [None req-0061d310-bb52-4379-88d9-75a0a042a422 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Calling method '>' {{(pid=128729) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 15:55:36.881236 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.compute.api [None req-0061d310-bb52-4379-88d9-75a0a042a422 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] [instance: cca08141-979e-4519-88b3-c77e8a71ae3e] Fetching instance by UUID {{(pid=128729) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 15:55:36.887421 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-0061d310-bb52-4379-88d9-75a0a042a422 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:55:36.887866 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-0061d310-bb52-4379-88d9-75a0a042a422 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:55:36.888629 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-0061d310-bb52-4379-88d9-75a0a042a422 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:55:36.889067 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-0061d310-bb52-4379-88d9-75a0a042a422 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:55:37.066733 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.policy [None req-795db4dc-cfd5-45d8-8469-1bc099eda361 tempest-TestShelveInstance-1853374188 tempest-TestShelveInstance-1853374188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e05ae1c6a054a299e841d008f9d7a09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83d6b6f0aa4f4314811ee80480861958', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128728) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:55:37.068812 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.policy [None req-0061d310-bb52-4379-88d9-75a0a042a422 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58bfb7417bc94583963401ae0fe9d39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0672be3fa3f7414da1c1a5b7300abbe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128729) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:55:37.074047 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: INFO nova.api.openstack.requestlog [None req-795db4dc-cfd5-45d8-8469-1bc099eda361 tempest-TestShelveInstance-1853374188 tempest-TestShelveInstance-1853374188-project] 10.222.0.61 "GET /compute/v2.1/servers/08195c98-5b1d-426c-a398-c7e914c14661" status: 200 len: 1576 microversion: 2.1 time: 0.219937 May 14 15:55:37.074843 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: [pid: 128728|app: 0|req: 526/1035] 10.222.0.61 () {58 vars in 1235 bytes} [Sat May 14 15:55:36 2022] GET /compute/v2.1/servers/08195c98-5b1d-426c-a398-c7e914c14661 => generated 1576 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 15:55:37.077113 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.policy [None req-0061d310-bb52-4379-88d9-75a0a042a422 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58bfb7417bc94583963401ae0fe9d39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0672be3fa3f7414da1c1a5b7300abbe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128729) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:55:37.079612 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.policy [None req-0061d310-bb52-4379-88d9-75a0a042a422 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58bfb7417bc94583963401ae0fe9d39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0672be3fa3f7414da1c1a5b7300abbe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128729) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:55:37.081084 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: INFO nova.api.openstack.requestlog [None req-0061d310-bb52-4379-88d9-75a0a042a422 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] 10.222.0.61 "GET /compute/v2.1/servers/cca08141-979e-4519-88b3-c77e8a71ae3e" status: 200 len: 1745 microversion: 2.20 time: 0.204298 May 14 15:55:37.081733 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: [pid: 128729|app: 0|req: 510/1036] 10.222.0.61 () {60 vars in 1276 bytes} [Sat May 14 15:55:36 2022] GET /compute/v2.1/servers/cca08141-979e-4519-88b3-c77e8a71ae3e => generated 1745 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 14 15:55:37.175208 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi [req-d9a750bd-a8d0-4cc7-aad7-4f9edcfaf88b req-fbf3e13f-4e7c-4866-86d6-c0537d0967b6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cca08141-979e-4519-88b3-c77e8a71ae3e", "name": "network-vif-plugged", "status": "completed", "tag": "e23afae5-7b01-4137-a087-ba1a741fd1f4"}]} {{(pid=128728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 15:55:37.183084 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [req-d9a750bd-a8d0-4cc7-aad7-4f9edcfaf88b req-fbf3e13f-4e7c-4866-86d6-c0537d0967b6 service nova] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:55:37.183527 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [req-d9a750bd-a8d0-4cc7-aad7-4f9edcfaf88b req-fbf3e13f-4e7c-4866-86d6-c0537d0967b6 service nova] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:55:37.195869 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: INFO nova.api.openstack.compute.server_external_events [req-d9a750bd-a8d0-4cc7-aad7-4f9edcfaf88b req-fbf3e13f-4e7c-4866-86d6-c0537d0967b6 service nova] Creating event network-vif-plugged:e23afae5-7b01-4137-a087-ba1a741fd1f4 for instance cca08141-979e-4519-88b3-c77e8a71ae3e on hv-cinder-83979 May 14 15:55:37.200756 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: INFO nova.api.openstack.requestlog [req-d9a750bd-a8d0-4cc7-aad7-4f9edcfaf88b req-fbf3e13f-4e7c-4866-86d6-c0537d0967b6 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029384 May 14 15:55:37.201351 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: [pid: 128728|app: 0|req: 527/1037] 10.222.0.61 () {64 vars in 1317 bytes} [Sat May 14 15:55:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 14 15:55:38.092448 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi [None req-5fa2c301-ac18-4072-bb73-92fbe160d98d tempest-TestShelveInstance-1853374188 tempest-TestShelveInstance-1853374188-project] Calling method '>' {{(pid=128729) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 15:55:38.092960 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.compute.api [None req-5fa2c301-ac18-4072-bb73-92fbe160d98d tempest-TestShelveInstance-1853374188 tempest-TestShelveInstance-1853374188-project] [instance: 08195c98-5b1d-426c-a398-c7e914c14661] Fetching instance by UUID {{(pid=128729) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 15:55:38.099904 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-5fa2c301-ac18-4072-bb73-92fbe160d98d tempest-TestShelveInstance-1853374188 tempest-TestShelveInstance-1853374188-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:55:38.100349 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-5fa2c301-ac18-4072-bb73-92fbe160d98d tempest-TestShelveInstance-1853374188 tempest-TestShelveInstance-1853374188-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:55:38.100792 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi [None req-915e9b6c-aca6-4054-bf4d-bf74e3a6242d tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Calling method '>' {{(pid=128728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 15:55:38.101243 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-5fa2c301-ac18-4072-bb73-92fbe160d98d tempest-TestShelveInstance-1853374188 tempest-TestShelveInstance-1853374188-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:55:38.101485 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.compute.api [None req-915e9b6c-aca6-4054-bf4d-bf74e3a6242d tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] [instance: cca08141-979e-4519-88b3-c77e8a71ae3e] Fetching instance by UUID {{(pid=128728) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 15:55:38.101588 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-5fa2c301-ac18-4072-bb73-92fbe160d98d tempest-TestShelveInstance-1853374188 tempest-TestShelveInstance-1853374188-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:55:38.107423 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-915e9b6c-aca6-4054-bf4d-bf74e3a6242d tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:55:38.107876 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-915e9b6c-aca6-4054-bf4d-bf74e3a6242d tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:55:38.108642 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-915e9b6c-aca6-4054-bf4d-bf74e3a6242d tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:55:38.109078 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-915e9b6c-aca6-4054-bf4d-bf74e3a6242d tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:55:38.300044 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.policy [None req-5fa2c301-ac18-4072-bb73-92fbe160d98d tempest-TestShelveInstance-1853374188 tempest-TestShelveInstance-1853374188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e05ae1c6a054a299e841d008f9d7a09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83d6b6f0aa4f4314811ee80480861958', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128729) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:55:38.303760 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.policy [None req-915e9b6c-aca6-4054-bf4d-bf74e3a6242d tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58bfb7417bc94583963401ae0fe9d39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0672be3fa3f7414da1c1a5b7300abbe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128728) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:55:38.307652 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: INFO nova.api.openstack.requestlog [None req-5fa2c301-ac18-4072-bb73-92fbe160d98d tempest-TestShelveInstance-1853374188 tempest-TestShelveInstance-1853374188-project] 10.222.0.61 "GET /compute/v2.1/servers/08195c98-5b1d-426c-a398-c7e914c14661" status: 200 len: 1576 microversion: 2.1 time: 0.219192 May 14 15:55:38.308230 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: [pid: 128729|app: 0|req: 511/1038] 10.222.0.61 () {58 vars in 1235 bytes} [Sat May 14 15:55:38 2022] GET /compute/v2.1/servers/08195c98-5b1d-426c-a398-c7e914c14661 => generated 1576 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 15:55:38.311870 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.policy [None req-915e9b6c-aca6-4054-bf4d-bf74e3a6242d tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58bfb7417bc94583963401ae0fe9d39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0672be3fa3f7414da1c1a5b7300abbe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128728) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:55:38.313530 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.policy [None req-915e9b6c-aca6-4054-bf4d-bf74e3a6242d tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58bfb7417bc94583963401ae0fe9d39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0672be3fa3f7414da1c1a5b7300abbe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128728) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:55:38.314710 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: INFO nova.api.openstack.requestlog [None req-915e9b6c-aca6-4054-bf4d-bf74e3a6242d tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] 10.222.0.61 "GET /compute/v2.1/servers/cca08141-979e-4519-88b3-c77e8a71ae3e" status: 200 len: 1745 microversion: 2.20 time: 0.218510 May 14 15:55:38.315250 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: [pid: 128728|app: 0|req: 528/1039] 10.222.0.61 () {60 vars in 1276 bytes} [Sat May 14 15:55:38 2022] GET /compute/v2.1/servers/cca08141-979e-4519-88b3-c77e8a71ae3e => generated 1745 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 14 15:55:39.324640 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi [None req-6eb80190-d0d5-4fdd-89c1-967f240ca04b tempest-TestShelveInstance-1853374188 tempest-TestShelveInstance-1853374188-project] Calling method '>' {{(pid=128729) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 15:55:39.325249 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.compute.api [None req-6eb80190-d0d5-4fdd-89c1-967f240ca04b tempest-TestShelveInstance-1853374188 tempest-TestShelveInstance-1853374188-project] [instance: 08195c98-5b1d-426c-a398-c7e914c14661] Fetching instance by UUID {{(pid=128729) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 15:55:39.331601 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-6eb80190-d0d5-4fdd-89c1-967f240ca04b tempest-TestShelveInstance-1853374188 tempest-TestShelveInstance-1853374188-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:55:39.332048 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-6eb80190-d0d5-4fdd-89c1-967f240ca04b tempest-TestShelveInstance-1853374188 tempest-TestShelveInstance-1853374188-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:55:39.332806 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi [None req-246e5712-8a17-48f8-afb3-0122a89cf551 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Calling method '>' {{(pid=128728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 15:55:39.333249 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-6eb80190-d0d5-4fdd-89c1-967f240ca04b tempest-TestShelveInstance-1853374188 tempest-TestShelveInstance-1853374188-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:55:39.333249 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-6eb80190-d0d5-4fdd-89c1-967f240ca04b tempest-TestShelveInstance-1853374188 tempest-TestShelveInstance-1853374188-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:55:39.333431 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.compute.api [None req-246e5712-8a17-48f8-afb3-0122a89cf551 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] [instance: cca08141-979e-4519-88b3-c77e8a71ae3e] Fetching instance by UUID {{(pid=128728) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 15:55:39.339641 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-246e5712-8a17-48f8-afb3-0122a89cf551 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:55:39.340086 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-246e5712-8a17-48f8-afb3-0122a89cf551 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:55:39.340850 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-246e5712-8a17-48f8-afb3-0122a89cf551 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:55:39.341278 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-246e5712-8a17-48f8-afb3-0122a89cf551 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:55:39.522214 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.policy [None req-6eb80190-d0d5-4fdd-89c1-967f240ca04b tempest-TestShelveInstance-1853374188 tempest-TestShelveInstance-1853374188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e05ae1c6a054a299e841d008f9d7a09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83d6b6f0aa4f4314811ee80480861958', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128729) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:55:39.526172 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.policy [None req-246e5712-8a17-48f8-afb3-0122a89cf551 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58bfb7417bc94583963401ae0fe9d39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0672be3fa3f7414da1c1a5b7300abbe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128728) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:55:39.529535 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: INFO nova.api.openstack.requestlog [None req-6eb80190-d0d5-4fdd-89c1-967f240ca04b tempest-TestShelveInstance-1853374188 tempest-TestShelveInstance-1853374188-project] 10.222.0.61 "GET /compute/v2.1/servers/08195c98-5b1d-426c-a398-c7e914c14661" status: 200 len: 1576 microversion: 2.1 time: 0.208778 May 14 15:55:39.530101 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: [pid: 128729|app: 0|req: 512/1040] 10.222.0.61 () {58 vars in 1235 bytes} [Sat May 14 15:55:39 2022] GET /compute/v2.1/servers/08195c98-5b1d-426c-a398-c7e914c14661 => generated 1576 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 15:55:39.535220 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.policy [None req-246e5712-8a17-48f8-afb3-0122a89cf551 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58bfb7417bc94583963401ae0fe9d39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0672be3fa3f7414da1c1a5b7300abbe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128728) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:55:39.536730 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.policy [None req-246e5712-8a17-48f8-afb3-0122a89cf551 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58bfb7417bc94583963401ae0fe9d39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0672be3fa3f7414da1c1a5b7300abbe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128728) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:55:39.537887 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: INFO nova.api.openstack.requestlog [None req-246e5712-8a17-48f8-afb3-0122a89cf551 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] 10.222.0.61 "GET /compute/v2.1/servers/cca08141-979e-4519-88b3-c77e8a71ae3e" status: 200 len: 1745 microversion: 2.20 time: 0.208917 May 14 15:55:39.538470 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: [pid: 128728|app: 0|req: 529/1041] 10.222.0.61 () {60 vars in 1276 bytes} [Sat May 14 15:55:39 2022] GET /compute/v2.1/servers/cca08141-979e-4519-88b3-c77e8a71ae3e => generated 1745 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 14 15:55:40.547119 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi [None req-e98835d3-26b4-4724-b203-79afb34a543d tempest-TestShelveInstance-1853374188 tempest-TestShelveInstance-1853374188-project] Calling method '>' {{(pid=128729) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 15:55:40.547898 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.compute.api [None req-e98835d3-26b4-4724-b203-79afb34a543d tempest-TestShelveInstance-1853374188 tempest-TestShelveInstance-1853374188-project] [instance: 08195c98-5b1d-426c-a398-c7e914c14661] Fetching instance by UUID {{(pid=128729) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 15:55:40.554499 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-e98835d3-26b4-4724-b203-79afb34a543d tempest-TestShelveInstance-1853374188 tempest-TestShelveInstance-1853374188-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:55:40.554948 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-e98835d3-26b4-4724-b203-79afb34a543d tempest-TestShelveInstance-1853374188 tempest-TestShelveInstance-1853374188-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:55:40.555717 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-e98835d3-26b4-4724-b203-79afb34a543d tempest-TestShelveInstance-1853374188 tempest-TestShelveInstance-1853374188-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:55:40.556152 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-e98835d3-26b4-4724-b203-79afb34a543d tempest-TestShelveInstance-1853374188 tempest-TestShelveInstance-1853374188-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:55:40.557621 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi [None req-b22b2c8c-b16c-407b-9ffc-4536f6b38c2d tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Calling method '>' {{(pid=128728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 15:55:40.558229 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.compute.api [None req-b22b2c8c-b16c-407b-9ffc-4536f6b38c2d tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] [instance: cca08141-979e-4519-88b3-c77e8a71ae3e] Fetching instance by UUID {{(pid=128728) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 15:55:40.565848 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-b22b2c8c-b16c-407b-9ffc-4536f6b38c2d tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:55:40.566410 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-b22b2c8c-b16c-407b-9ffc-4536f6b38c2d tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:55:40.567288 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-b22b2c8c-b16c-407b-9ffc-4536f6b38c2d tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:55:40.567826 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-b22b2c8c-b16c-407b-9ffc-4536f6b38c2d tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:55:40.750225 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.policy [None req-e98835d3-26b4-4724-b203-79afb34a543d tempest-TestShelveInstance-1853374188 tempest-TestShelveInstance-1853374188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e05ae1c6a054a299e841d008f9d7a09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83d6b6f0aa4f4314811ee80480861958', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128729) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:55:40.757556 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.policy [None req-b22b2c8c-b16c-407b-9ffc-4536f6b38c2d tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58bfb7417bc94583963401ae0fe9d39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0672be3fa3f7414da1c1a5b7300abbe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128728) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:55:40.757920 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: INFO nova.api.openstack.requestlog [None req-e98835d3-26b4-4724-b203-79afb34a543d tempest-TestShelveInstance-1853374188 tempest-TestShelveInstance-1853374188-project] 10.222.0.61 "GET /compute/v2.1/servers/08195c98-5b1d-426c-a398-c7e914c14661" status: 200 len: 1576 microversion: 2.1 time: 0.215610 May 14 15:55:40.758714 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: [pid: 128729|app: 0|req: 513/1042] 10.222.0.61 () {58 vars in 1235 bytes} [Sat May 14 15:55:40 2022] GET /compute/v2.1/servers/08195c98-5b1d-426c-a398-c7e914c14661 => generated 1576 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 15:55:40.777487 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.policy [None req-b22b2c8c-b16c-407b-9ffc-4536f6b38c2d tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58bfb7417bc94583963401ae0fe9d39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0672be3fa3f7414da1c1a5b7300abbe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128728) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:55:40.779643 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.policy [None req-b22b2c8c-b16c-407b-9ffc-4536f6b38c2d tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58bfb7417bc94583963401ae0fe9d39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0672be3fa3f7414da1c1a5b7300abbe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128728) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:55:40.780875 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: INFO nova.api.openstack.requestlog [None req-b22b2c8c-b16c-407b-9ffc-4536f6b38c2d tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] 10.222.0.61 "GET /compute/v2.1/servers/cca08141-979e-4519-88b3-c77e8a71ae3e" status: 200 len: 1745 microversion: 2.20 time: 0.227096 May 14 15:55:40.782069 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: [pid: 128728|app: 0|req: 530/1043] 10.222.0.61 () {60 vars in 1276 bytes} [Sat May 14 15:55:40 2022] GET /compute/v2.1/servers/cca08141-979e-4519-88b3-c77e8a71ae3e => generated 1745 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 14 15:55:41.775373 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi [None req-865150cc-3b2a-4278-87dc-f0471dd06359 tempest-TestShelveInstance-1853374188 tempest-TestShelveInstance-1853374188-project] Calling method '>' {{(pid=128729) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 15:55:41.777080 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.compute.api [None req-865150cc-3b2a-4278-87dc-f0471dd06359 tempest-TestShelveInstance-1853374188 tempest-TestShelveInstance-1853374188-project] [instance: 08195c98-5b1d-426c-a398-c7e914c14661] Fetching instance by UUID {{(pid=128729) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 15:55:41.784057 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-865150cc-3b2a-4278-87dc-f0471dd06359 tempest-TestShelveInstance-1853374188 tempest-TestShelveInstance-1853374188-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:55:41.784696 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-865150cc-3b2a-4278-87dc-f0471dd06359 tempest-TestShelveInstance-1853374188 tempest-TestShelveInstance-1853374188-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:55:41.785991 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-865150cc-3b2a-4278-87dc-f0471dd06359 tempest-TestShelveInstance-1853374188 tempest-TestShelveInstance-1853374188-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:55:41.786464 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-865150cc-3b2a-4278-87dc-f0471dd06359 tempest-TestShelveInstance-1853374188 tempest-TestShelveInstance-1853374188-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:55:41.811201 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi [None req-dc43abd6-5bbd-4013-97b8-f804d35046f2 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Calling method '>' {{(pid=128728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 15:55:41.815610 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.compute.api [None req-dc43abd6-5bbd-4013-97b8-f804d35046f2 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] [instance: cca08141-979e-4519-88b3-c77e8a71ae3e] Fetching instance by UUID {{(pid=128728) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 15:55:41.839461 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-dc43abd6-5bbd-4013-97b8-f804d35046f2 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:55:41.840233 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-dc43abd6-5bbd-4013-97b8-f804d35046f2 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:55:41.844573 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-dc43abd6-5bbd-4013-97b8-f804d35046f2 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:55:41.845294 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-dc43abd6-5bbd-4013-97b8-f804d35046f2 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:55:42.059922 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.policy [None req-865150cc-3b2a-4278-87dc-f0471dd06359 tempest-TestShelveInstance-1853374188 tempest-TestShelveInstance-1853374188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e05ae1c6a054a299e841d008f9d7a09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83d6b6f0aa4f4314811ee80480861958', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128729) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:55:42.072841 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: INFO nova.api.openstack.requestlog [None req-865150cc-3b2a-4278-87dc-f0471dd06359 tempest-TestShelveInstance-1853374188 tempest-TestShelveInstance-1853374188-project] 10.222.0.61 "GET /compute/v2.1/servers/08195c98-5b1d-426c-a398-c7e914c14661" status: 200 len: 1576 microversion: 2.1 time: 0.301169 May 14 15:55:42.083585 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: [pid: 128729|app: 0|req: 514/1044] 10.222.0.61 () {58 vars in 1235 bytes} [Sat May 14 15:55:41 2022] GET /compute/v2.1/servers/08195c98-5b1d-426c-a398-c7e914c14661 => generated 1576 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 15:55:42.090498 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.policy [None req-dc43abd6-5bbd-4013-97b8-f804d35046f2 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58bfb7417bc94583963401ae0fe9d39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0672be3fa3f7414da1c1a5b7300abbe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128728) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:55:42.099305 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.policy [None req-dc43abd6-5bbd-4013-97b8-f804d35046f2 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58bfb7417bc94583963401ae0fe9d39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0672be3fa3f7414da1c1a5b7300abbe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128728) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:55:42.100943 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.policy [None req-dc43abd6-5bbd-4013-97b8-f804d35046f2 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58bfb7417bc94583963401ae0fe9d39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0672be3fa3f7414da1c1a5b7300abbe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128728) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:55:42.102149 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: INFO nova.api.openstack.requestlog [None req-dc43abd6-5bbd-4013-97b8-f804d35046f2 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] 10.222.0.61 "GET /compute/v2.1/servers/cca08141-979e-4519-88b3-c77e8a71ae3e" status: 200 len: 1740 microversion: 2.20 time: 0.305113 May 14 15:55:42.103085 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: [pid: 128728|app: 0|req: 531/1045] 10.222.0.61 () {60 vars in 1276 bytes} [Sat May 14 15:55:41 2022] GET /compute/v2.1/servers/cca08141-979e-4519-88b3-c77e8a71ae3e => generated 1740 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 14 15:55:43.096221 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi [None req-7048c26f-bdb4-4104-84a9-2326e11988aa tempest-TestShelveInstance-1853374188 tempest-TestShelveInstance-1853374188-project] Calling method '>' {{(pid=128729) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 15:55:43.097693 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.compute.api [None req-7048c26f-bdb4-4104-84a9-2326e11988aa tempest-TestShelveInstance-1853374188 tempest-TestShelveInstance-1853374188-project] [instance: 08195c98-5b1d-426c-a398-c7e914c14661] Fetching instance by UUID {{(pid=128729) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 15:55:43.111164 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-7048c26f-bdb4-4104-84a9-2326e11988aa tempest-TestShelveInstance-1853374188 tempest-TestShelveInstance-1853374188-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:55:43.111877 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-7048c26f-bdb4-4104-84a9-2326e11988aa tempest-TestShelveInstance-1853374188 tempest-TestShelveInstance-1853374188-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:55:43.112981 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-7048c26f-bdb4-4104-84a9-2326e11988aa tempest-TestShelveInstance-1853374188 tempest-TestShelveInstance-1853374188-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:55:43.113737 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-7048c26f-bdb4-4104-84a9-2326e11988aa tempest-TestShelveInstance-1853374188 tempest-TestShelveInstance-1853374188-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:55:43.124014 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi [None req-14dace16-942c-468c-841a-b665108edf0a tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Calling method '>' {{(pid=128728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 15:55:43.126691 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.compute.api [None req-14dace16-942c-468c-841a-b665108edf0a tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] [instance: cca08141-979e-4519-88b3-c77e8a71ae3e] Fetching instance by UUID {{(pid=128728) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 15:55:43.143009 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-14dace16-942c-468c-841a-b665108edf0a tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:55:43.144021 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-14dace16-942c-468c-841a-b665108edf0a tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:55:43.144955 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-14dace16-942c-468c-841a-b665108edf0a tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:55:43.146836 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-14dace16-942c-468c-841a-b665108edf0a tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:55:43.362731 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.policy [None req-7048c26f-bdb4-4104-84a9-2326e11988aa tempest-TestShelveInstance-1853374188 tempest-TestShelveInstance-1853374188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e05ae1c6a054a299e841d008f9d7a09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83d6b6f0aa4f4314811ee80480861958', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128729) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:55:43.371023 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: INFO nova.api.openstack.requestlog [None req-7048c26f-bdb4-4104-84a9-2326e11988aa tempest-TestShelveInstance-1853374188 tempest-TestShelveInstance-1853374188-project] 10.222.0.61 "GET /compute/v2.1/servers/08195c98-5b1d-426c-a398-c7e914c14661" status: 200 len: 1576 microversion: 2.1 time: 0.282550 May 14 15:55:43.381537 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: [pid: 128729|app: 0|req: 515/1046] 10.222.0.61 () {58 vars in 1235 bytes} [Sat May 14 15:55:43 2022] GET /compute/v2.1/servers/08195c98-5b1d-426c-a398-c7e914c14661 => generated 1576 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 15:55:43.398458 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.policy [None req-14dace16-942c-468c-841a-b665108edf0a tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58bfb7417bc94583963401ae0fe9d39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0672be3fa3f7414da1c1a5b7300abbe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128728) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:55:43.407157 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.policy [None req-14dace16-942c-468c-841a-b665108edf0a tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58bfb7417bc94583963401ae0fe9d39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0672be3fa3f7414da1c1a5b7300abbe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128728) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:55:43.408787 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.policy [None req-14dace16-942c-468c-841a-b665108edf0a tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58bfb7417bc94583963401ae0fe9d39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0672be3fa3f7414da1c1a5b7300abbe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128728) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:55:43.410055 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: INFO nova.api.openstack.requestlog [None req-14dace16-942c-468c-841a-b665108edf0a tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] 10.222.0.61 "GET /compute/v2.1/servers/cca08141-979e-4519-88b3-c77e8a71ae3e" status: 200 len: 1740 microversion: 2.20 time: 0.290855 May 14 15:55:43.410720 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: [pid: 128728|app: 0|req: 532/1047] 10.222.0.61 () {60 vars in 1276 bytes} [Sat May 14 15:55:43 2022] GET /compute/v2.1/servers/cca08141-979e-4519-88b3-c77e8a71ae3e => generated 1740 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 14 15:55:44.389062 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi [None req-70b3b5f7-10d8-4e32-81dd-47ffef459871 tempest-TestShelveInstance-1853374188 tempest-TestShelveInstance-1853374188-project] Calling method '>' {{(pid=128729) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 15:55:44.390290 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.compute.api [None req-70b3b5f7-10d8-4e32-81dd-47ffef459871 tempest-TestShelveInstance-1853374188 tempest-TestShelveInstance-1853374188-project] [instance: 08195c98-5b1d-426c-a398-c7e914c14661] Fetching instance by UUID {{(pid=128729) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 15:55:44.397841 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-70b3b5f7-10d8-4e32-81dd-47ffef459871 tempest-TestShelveInstance-1853374188 tempest-TestShelveInstance-1853374188-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:55:44.398611 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-70b3b5f7-10d8-4e32-81dd-47ffef459871 tempest-TestShelveInstance-1853374188 tempest-TestShelveInstance-1853374188-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:55:44.399399 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-70b3b5f7-10d8-4e32-81dd-47ffef459871 tempest-TestShelveInstance-1853374188 tempest-TestShelveInstance-1853374188-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:55:44.399842 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-70b3b5f7-10d8-4e32-81dd-47ffef459871 tempest-TestShelveInstance-1853374188 tempest-TestShelveInstance-1853374188-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:55:44.429148 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi [None req-ae0ca4c5-0d28-4eb1-abe3-0b5305dee146 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Calling method '>' {{(pid=128728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 15:55:44.430621 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.compute.api [None req-ae0ca4c5-0d28-4eb1-abe3-0b5305dee146 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] [instance: cca08141-979e-4519-88b3-c77e8a71ae3e] Fetching instance by UUID {{(pid=128728) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 15:55:44.441633 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-ae0ca4c5-0d28-4eb1-abe3-0b5305dee146 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:55:44.442414 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-ae0ca4c5-0d28-4eb1-abe3-0b5305dee146 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:55:44.443431 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-ae0ca4c5-0d28-4eb1-abe3-0b5305dee146 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:55:44.444090 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-ae0ca4c5-0d28-4eb1-abe3-0b5305dee146 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:55:44.640427 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.policy [None req-70b3b5f7-10d8-4e32-81dd-47ffef459871 tempest-TestShelveInstance-1853374188 tempest-TestShelveInstance-1853374188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e05ae1c6a054a299e841d008f9d7a09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83d6b6f0aa4f4314811ee80480861958', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128729) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:55:44.653433 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: INFO nova.api.openstack.requestlog [None req-70b3b5f7-10d8-4e32-81dd-47ffef459871 tempest-TestShelveInstance-1853374188 tempest-TestShelveInstance-1853374188-project] 10.222.0.61 "GET /compute/v2.1/servers/08195c98-5b1d-426c-a398-c7e914c14661" status: 200 len: 1576 microversion: 2.1 time: 0.268325 May 14 15:55:44.654682 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: [pid: 128729|app: 0|req: 516/1048] 10.222.0.61 () {58 vars in 1235 bytes} [Sat May 14 15:55:44 2022] GET /compute/v2.1/servers/08195c98-5b1d-426c-a398-c7e914c14661 => generated 1576 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 15:55:44.657442 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.policy [None req-ae0ca4c5-0d28-4eb1-abe3-0b5305dee146 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58bfb7417bc94583963401ae0fe9d39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0672be3fa3f7414da1c1a5b7300abbe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128728) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:55:44.666401 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.policy [None req-ae0ca4c5-0d28-4eb1-abe3-0b5305dee146 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58bfb7417bc94583963401ae0fe9d39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0672be3fa3f7414da1c1a5b7300abbe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128728) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:55:44.667942 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.policy [None req-ae0ca4c5-0d28-4eb1-abe3-0b5305dee146 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58bfb7417bc94583963401ae0fe9d39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0672be3fa3f7414da1c1a5b7300abbe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128728) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:55:44.669363 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: INFO nova.api.openstack.requestlog [None req-ae0ca4c5-0d28-4eb1-abe3-0b5305dee146 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] 10.222.0.61 "GET /compute/v2.1/servers/cca08141-979e-4519-88b3-c77e8a71ae3e" status: 200 len: 1740 microversion: 2.20 time: 0.243779 May 14 15:55:44.669664 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: [pid: 128728|app: 0|req: 533/1049] 10.222.0.61 () {60 vars in 1276 bytes} [Sat May 14 15:55:44 2022] GET /compute/v2.1/servers/cca08141-979e-4519-88b3-c77e8a71ae3e => generated 1740 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 14 15:55:45.671067 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi [None req-62ba5279-7263-4096-b54f-6c47d33bba25 tempest-TestShelveInstance-1853374188 tempest-TestShelveInstance-1853374188-project] Calling method '>' {{(pid=128729) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 15:55:45.672644 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.compute.api [None req-62ba5279-7263-4096-b54f-6c47d33bba25 tempest-TestShelveInstance-1853374188 tempest-TestShelveInstance-1853374188-project] [instance: 08195c98-5b1d-426c-a398-c7e914c14661] Fetching instance by UUID {{(pid=128729) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 15:55:45.679388 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-62ba5279-7263-4096-b54f-6c47d33bba25 tempest-TestShelveInstance-1853374188 tempest-TestShelveInstance-1853374188-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:55:45.679915 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-62ba5279-7263-4096-b54f-6c47d33bba25 tempest-TestShelveInstance-1853374188 tempest-TestShelveInstance-1853374188-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:55:45.680781 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-62ba5279-7263-4096-b54f-6c47d33bba25 tempest-TestShelveInstance-1853374188 tempest-TestShelveInstance-1853374188-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:55:45.681267 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-62ba5279-7263-4096-b54f-6c47d33bba25 tempest-TestShelveInstance-1853374188 tempest-TestShelveInstance-1853374188-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:55:45.687511 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi [None req-40190aac-badd-4432-b62d-1eaebebbcaaa tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Calling method '>' {{(pid=128728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 15:55:45.688313 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.compute.api [None req-40190aac-badd-4432-b62d-1eaebebbcaaa tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] [instance: cca08141-979e-4519-88b3-c77e8a71ae3e] Fetching instance by UUID {{(pid=128728) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 15:55:45.697103 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-40190aac-badd-4432-b62d-1eaebebbcaaa tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:55:45.697795 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-40190aac-badd-4432-b62d-1eaebebbcaaa tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:55:45.699619 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-40190aac-badd-4432-b62d-1eaebebbcaaa tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:55:45.700265 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-40190aac-badd-4432-b62d-1eaebebbcaaa tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:55:45.904043 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.policy [None req-62ba5279-7263-4096-b54f-6c47d33bba25 tempest-TestShelveInstance-1853374188 tempest-TestShelveInstance-1853374188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e05ae1c6a054a299e841d008f9d7a09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83d6b6f0aa4f4314811ee80480861958', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128729) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:55:45.913021 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: INFO nova.api.openstack.requestlog [None req-62ba5279-7263-4096-b54f-6c47d33bba25 tempest-TestShelveInstance-1853374188 tempest-TestShelveInstance-1853374188-project] 10.222.0.61 "GET /compute/v2.1/servers/08195c98-5b1d-426c-a398-c7e914c14661" status: 200 len: 1576 microversion: 2.1 time: 0.245665 May 14 15:55:45.913609 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: [pid: 128729|app: 0|req: 517/1050] 10.222.0.61 () {58 vars in 1235 bytes} [Sat May 14 15:55:45 2022] GET /compute/v2.1/servers/08195c98-5b1d-426c-a398-c7e914c14661 => generated 1576 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 15:55:45.949095 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.policy [None req-40190aac-badd-4432-b62d-1eaebebbcaaa tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58bfb7417bc94583963401ae0fe9d39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0672be3fa3f7414da1c1a5b7300abbe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128728) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:55:45.958860 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.policy [None req-40190aac-badd-4432-b62d-1eaebebbcaaa tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58bfb7417bc94583963401ae0fe9d39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0672be3fa3f7414da1c1a5b7300abbe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128728) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:55:45.960714 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.policy [None req-40190aac-badd-4432-b62d-1eaebebbcaaa tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58bfb7417bc94583963401ae0fe9d39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0672be3fa3f7414da1c1a5b7300abbe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128728) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:55:45.962393 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: INFO nova.api.openstack.requestlog [None req-40190aac-badd-4432-b62d-1eaebebbcaaa tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] 10.222.0.61 "GET /compute/v2.1/servers/cca08141-979e-4519-88b3-c77e8a71ae3e" status: 200 len: 1740 microversion: 2.20 time: 0.278327 May 14 15:55:45.975012 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: [pid: 128728|app: 0|req: 534/1051] 10.222.0.61 () {60 vars in 1276 bytes} [Sat May 14 15:55:45 2022] GET /compute/v2.1/servers/cca08141-979e-4519-88b3-c77e8a71ae3e => generated 1740 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 14 15:55:46.930952 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi [None req-4eeff337-99a4-4397-9522-d4c1c560e176 tempest-TestShelveInstance-1853374188 tempest-TestShelveInstance-1853374188-project] Calling method '>' {{(pid=128729) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 15:55:46.932193 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.compute.api [None req-4eeff337-99a4-4397-9522-d4c1c560e176 tempest-TestShelveInstance-1853374188 tempest-TestShelveInstance-1853374188-project] [instance: 08195c98-5b1d-426c-a398-c7e914c14661] Fetching instance by UUID {{(pid=128729) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 15:55:46.939919 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-4eeff337-99a4-4397-9522-d4c1c560e176 tempest-TestShelveInstance-1853374188 tempest-TestShelveInstance-1853374188-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:55:46.940624 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-4eeff337-99a4-4397-9522-d4c1c560e176 tempest-TestShelveInstance-1853374188 tempest-TestShelveInstance-1853374188-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:55:46.942233 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-4eeff337-99a4-4397-9522-d4c1c560e176 tempest-TestShelveInstance-1853374188 tempest-TestShelveInstance-1853374188-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:55:46.943083 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-4eeff337-99a4-4397-9522-d4c1c560e176 tempest-TestShelveInstance-1853374188 tempest-TestShelveInstance-1853374188-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:55:46.993519 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi [None req-ee72ff78-cbe2-47a6-adbd-3df8bf378aa6 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Calling method '>' {{(pid=128728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 15:55:46.994060 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.compute.api [None req-ee72ff78-cbe2-47a6-adbd-3df8bf378aa6 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] [instance: cca08141-979e-4519-88b3-c77e8a71ae3e] Fetching instance by UUID {{(pid=128728) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 15:55:47.002082 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-ee72ff78-cbe2-47a6-adbd-3df8bf378aa6 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:55:47.002892 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-ee72ff78-cbe2-47a6-adbd-3df8bf378aa6 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:55:47.004494 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-ee72ff78-cbe2-47a6-adbd-3df8bf378aa6 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:55:47.005291 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-ee72ff78-cbe2-47a6-adbd-3df8bf378aa6 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:55:47.247696 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.policy [None req-4eeff337-99a4-4397-9522-d4c1c560e176 tempest-TestShelveInstance-1853374188 tempest-TestShelveInstance-1853374188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e05ae1c6a054a299e841d008f9d7a09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83d6b6f0aa4f4314811ee80480861958', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128729) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:55:47.256759 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: INFO nova.api.openstack.requestlog [None req-4eeff337-99a4-4397-9522-d4c1c560e176 tempest-TestShelveInstance-1853374188 tempest-TestShelveInstance-1853374188-project] 10.222.0.61 "GET /compute/v2.1/servers/08195c98-5b1d-426c-a398-c7e914c14661" status: 200 len: 1576 microversion: 2.1 time: 0.330284 May 14 15:55:47.266353 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.policy [None req-ee72ff78-cbe2-47a6-adbd-3df8bf378aa6 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58bfb7417bc94583963401ae0fe9d39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0672be3fa3f7414da1c1a5b7300abbe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128728) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:55:47.279274 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.policy [None req-ee72ff78-cbe2-47a6-adbd-3df8bf378aa6 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58bfb7417bc94583963401ae0fe9d39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0672be3fa3f7414da1c1a5b7300abbe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128728) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:55:47.282867 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: [pid: 128729|app: 0|req: 518/1052] 10.222.0.61 () {58 vars in 1235 bytes} [Sat May 14 15:55:46 2022] GET /compute/v2.1/servers/08195c98-5b1d-426c-a398-c7e914c14661 => generated 1576 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 15:55:47.285523 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.policy [None req-ee72ff78-cbe2-47a6-adbd-3df8bf378aa6 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58bfb7417bc94583963401ae0fe9d39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0672be3fa3f7414da1c1a5b7300abbe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128728) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:55:47.289351 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: INFO nova.api.openstack.requestlog [None req-ee72ff78-cbe2-47a6-adbd-3df8bf378aa6 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] 10.222.0.61 "GET /compute/v2.1/servers/cca08141-979e-4519-88b3-c77e8a71ae3e" status: 200 len: 1740 microversion: 2.20 time: 0.299639 May 14 15:55:47.291031 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: [pid: 128728|app: 0|req: 535/1053] 10.222.0.61 () {60 vars in 1276 bytes} [Sat May 14 15:55:46 2022] GET /compute/v2.1/servers/cca08141-979e-4519-88b3-c77e8a71ae3e => generated 1740 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 14 15:55:48.280740 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi [None req-e1c3d9ea-b3b6-4016-aa41-27b6416f82c8 tempest-TestShelveInstance-1853374188 tempest-TestShelveInstance-1853374188-project] Calling method '>' {{(pid=128729) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 15:55:48.282052 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.compute.api [None req-e1c3d9ea-b3b6-4016-aa41-27b6416f82c8 tempest-TestShelveInstance-1853374188 tempest-TestShelveInstance-1853374188-project] [instance: 08195c98-5b1d-426c-a398-c7e914c14661] Fetching instance by UUID {{(pid=128729) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 15:55:48.291695 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-e1c3d9ea-b3b6-4016-aa41-27b6416f82c8 tempest-TestShelveInstance-1853374188 tempest-TestShelveInstance-1853374188-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:55:48.291695 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-e1c3d9ea-b3b6-4016-aa41-27b6416f82c8 tempest-TestShelveInstance-1853374188 tempest-TestShelveInstance-1853374188-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:55:48.291695 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-e1c3d9ea-b3b6-4016-aa41-27b6416f82c8 tempest-TestShelveInstance-1853374188 tempest-TestShelveInstance-1853374188-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:55:48.291695 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-e1c3d9ea-b3b6-4016-aa41-27b6416f82c8 tempest-TestShelveInstance-1853374188 tempest-TestShelveInstance-1853374188-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:55:48.309438 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi [None req-bca657df-3feb-4f5f-97b3-dab2f549d80c tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Calling method '>' {{(pid=128728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 15:55:48.311868 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.compute.api [None req-bca657df-3feb-4f5f-97b3-dab2f549d80c tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] [instance: cca08141-979e-4519-88b3-c77e8a71ae3e] Fetching instance by UUID {{(pid=128728) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 15:55:48.321446 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-bca657df-3feb-4f5f-97b3-dab2f549d80c tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:55:48.321912 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-bca657df-3feb-4f5f-97b3-dab2f549d80c tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:55:48.322733 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-bca657df-3feb-4f5f-97b3-dab2f549d80c tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:55:48.323172 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-bca657df-3feb-4f5f-97b3-dab2f549d80c tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:55:48.509422 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.policy [None req-e1c3d9ea-b3b6-4016-aa41-27b6416f82c8 tempest-TestShelveInstance-1853374188 tempest-TestShelveInstance-1853374188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e05ae1c6a054a299e841d008f9d7a09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83d6b6f0aa4f4314811ee80480861958', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128729) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:55:48.516994 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: INFO nova.api.openstack.requestlog [None req-e1c3d9ea-b3b6-4016-aa41-27b6416f82c8 tempest-TestShelveInstance-1853374188 tempest-TestShelveInstance-1853374188-project] 10.222.0.61 "GET /compute/v2.1/servers/08195c98-5b1d-426c-a398-c7e914c14661" status: 200 len: 1576 microversion: 2.1 time: 0.240299 May 14 15:55:48.527607 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: [pid: 128729|app: 0|req: 519/1054] 10.222.0.61 () {58 vars in 1235 bytes} [Sat May 14 15:55:48 2022] GET /compute/v2.1/servers/08195c98-5b1d-426c-a398-c7e914c14661 => generated 1576 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 15:55:48.563444 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.policy [None req-bca657df-3feb-4f5f-97b3-dab2f549d80c tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58bfb7417bc94583963401ae0fe9d39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0672be3fa3f7414da1c1a5b7300abbe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128728) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:55:48.572343 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.policy [None req-bca657df-3feb-4f5f-97b3-dab2f549d80c tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58bfb7417bc94583963401ae0fe9d39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0672be3fa3f7414da1c1a5b7300abbe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128728) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:55:48.574590 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.policy [None req-bca657df-3feb-4f5f-97b3-dab2f549d80c tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58bfb7417bc94583963401ae0fe9d39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0672be3fa3f7414da1c1a5b7300abbe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128728) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:55:48.576056 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: INFO nova.api.openstack.requestlog [None req-bca657df-3feb-4f5f-97b3-dab2f549d80c tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] 10.222.0.61 "GET /compute/v2.1/servers/cca08141-979e-4519-88b3-c77e8a71ae3e" status: 200 len: 1740 microversion: 2.20 time: 0.270455 May 14 15:55:48.577262 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: [pid: 128728|app: 0|req: 536/1055] 10.222.0.61 () {60 vars in 1276 bytes} [Sat May 14 15:55:48 2022] GET /compute/v2.1/servers/cca08141-979e-4519-88b3-c77e8a71ae3e => generated 1740 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 14 15:55:49.535158 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi [None req-134831bf-0eba-40ec-84ba-322076699f63 tempest-TestShelveInstance-1853374188 tempest-TestShelveInstance-1853374188-project] Calling method '>' {{(pid=128729) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 15:55:49.536696 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.compute.api [None req-134831bf-0eba-40ec-84ba-322076699f63 tempest-TestShelveInstance-1853374188 tempest-TestShelveInstance-1853374188-project] [instance: 08195c98-5b1d-426c-a398-c7e914c14661] Fetching instance by UUID {{(pid=128729) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 15:55:49.548985 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-134831bf-0eba-40ec-84ba-322076699f63 tempest-TestShelveInstance-1853374188 tempest-TestShelveInstance-1853374188-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:55:49.550088 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-134831bf-0eba-40ec-84ba-322076699f63 tempest-TestShelveInstance-1853374188 tempest-TestShelveInstance-1853374188-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:55:49.551234 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-134831bf-0eba-40ec-84ba-322076699f63 tempest-TestShelveInstance-1853374188 tempest-TestShelveInstance-1853374188-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:55:49.551933 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-134831bf-0eba-40ec-84ba-322076699f63 tempest-TestShelveInstance-1853374188 tempest-TestShelveInstance-1853374188-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:55:49.573910 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi [req-10fd75d3-f7af-468c-a758-4fd228d1d897 req-d0992682-3185-44e3-89c5-d3a3975330b6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "08195c98-5b1d-426c-a398-c7e914c14661", "name": "network-vif-plugged", "status": "completed", "tag": "ff1e7e07-bb51-463a-a362-bc5fcaff458c"}]} {{(pid=128728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 15:55:49.588469 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [req-10fd75d3-f7af-468c-a758-4fd228d1d897 req-d0992682-3185-44e3-89c5-d3a3975330b6 service nova] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:55:49.593363 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [req-10fd75d3-f7af-468c-a758-4fd228d1d897 req-d0992682-3185-44e3-89c5-d3a3975330b6 service nova] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:55:49.638164 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: INFO nova.api.openstack.compute.server_external_events [req-10fd75d3-f7af-468c-a758-4fd228d1d897 req-d0992682-3185-44e3-89c5-d3a3975330b6 service nova] Creating event network-vif-plugged:ff1e7e07-bb51-463a-a362-bc5fcaff458c for instance 08195c98-5b1d-426c-a398-c7e914c14661 on hv-cinder-83979 May 14 15:55:49.645444 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: INFO nova.api.openstack.requestlog [req-10fd75d3-f7af-468c-a758-4fd228d1d897 req-d0992682-3185-44e3-89c5-d3a3975330b6 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.075430 May 14 15:55:49.646383 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: [pid: 128728|app: 0|req: 537/1056] 10.222.0.61 () {64 vars in 1317 bytes} [Sat May 14 15:55:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 14 15:55:49.658213 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi [None req-3ab7805b-236f-4493-8c24-57923160f406 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Calling method '>' {{(pid=128728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 15:55:49.659025 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.compute.api [None req-3ab7805b-236f-4493-8c24-57923160f406 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] [instance: cca08141-979e-4519-88b3-c77e8a71ae3e] Fetching instance by UUID {{(pid=128728) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 15:55:49.678620 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-3ab7805b-236f-4493-8c24-57923160f406 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:55:49.679516 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-3ab7805b-236f-4493-8c24-57923160f406 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:55:49.683611 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-3ab7805b-236f-4493-8c24-57923160f406 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:55:49.684757 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-3ab7805b-236f-4493-8c24-57923160f406 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:55:49.924343 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.policy [None req-134831bf-0eba-40ec-84ba-322076699f63 tempest-TestShelveInstance-1853374188 tempest-TestShelveInstance-1853374188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e05ae1c6a054a299e841d008f9d7a09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83d6b6f0aa4f4314811ee80480861958', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128729) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:55:49.947379 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: INFO nova.api.openstack.requestlog [None req-134831bf-0eba-40ec-84ba-322076699f63 tempest-TestShelveInstance-1853374188 tempest-TestShelveInstance-1853374188-project] 10.222.0.61 "GET /compute/v2.1/servers/08195c98-5b1d-426c-a398-c7e914c14661" status: 200 len: 1576 microversion: 2.1 time: 0.416784 May 14 15:55:49.951691 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: [pid: 128729|app: 0|req: 520/1057] 10.222.0.61 () {58 vars in 1235 bytes} [Sat May 14 15:55:49 2022] GET /compute/v2.1/servers/08195c98-5b1d-426c-a398-c7e914c14661 => generated 1576 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 15:55:49.986779 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.policy [None req-3ab7805b-236f-4493-8c24-57923160f406 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58bfb7417bc94583963401ae0fe9d39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0672be3fa3f7414da1c1a5b7300abbe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128728) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:55:50.001512 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.policy [None req-3ab7805b-236f-4493-8c24-57923160f406 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58bfb7417bc94583963401ae0fe9d39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0672be3fa3f7414da1c1a5b7300abbe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128728) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:55:50.004550 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.policy [None req-3ab7805b-236f-4493-8c24-57923160f406 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58bfb7417bc94583963401ae0fe9d39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0672be3fa3f7414da1c1a5b7300abbe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128728) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:55:50.005740 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: INFO nova.api.openstack.requestlog [None req-3ab7805b-236f-4493-8c24-57923160f406 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] 10.222.0.61 "GET /compute/v2.1/servers/cca08141-979e-4519-88b3-c77e8a71ae3e" status: 200 len: 1740 microversion: 2.20 time: 0.358276 May 14 15:55:50.026817 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: [pid: 128728|app: 0|req: 538/1058] 10.222.0.61 () {60 vars in 1276 bytes} [Sat May 14 15:55:49 2022] GET /compute/v2.1/servers/cca08141-979e-4519-88b3-c77e8a71ae3e => generated 1740 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 14 15:55:50.967771 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi [None req-bdae3cd8-1c3b-4838-9e00-e88f387bdfdd tempest-TestShelveInstance-1853374188 tempest-TestShelveInstance-1853374188-project] Calling method '>' {{(pid=128729) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 15:55:50.968410 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.compute.api [None req-bdae3cd8-1c3b-4838-9e00-e88f387bdfdd tempest-TestShelveInstance-1853374188 tempest-TestShelveInstance-1853374188-project] [instance: 08195c98-5b1d-426c-a398-c7e914c14661] Fetching instance by UUID {{(pid=128729) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 15:55:50.976086 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-bdae3cd8-1c3b-4838-9e00-e88f387bdfdd tempest-TestShelveInstance-1853374188 tempest-TestShelveInstance-1853374188-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:55:50.976516 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-bdae3cd8-1c3b-4838-9e00-e88f387bdfdd tempest-TestShelveInstance-1853374188 tempest-TestShelveInstance-1853374188-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:55:50.977328 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-bdae3cd8-1c3b-4838-9e00-e88f387bdfdd tempest-TestShelveInstance-1853374188 tempest-TestShelveInstance-1853374188-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:55:50.977809 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-bdae3cd8-1c3b-4838-9e00-e88f387bdfdd tempest-TestShelveInstance-1853374188 tempest-TestShelveInstance-1853374188-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:55:51.037510 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi [None req-c2d0a6ec-48ca-404d-a6fd-a073009c43bf tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Calling method '>' {{(pid=128728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 15:55:51.038159 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.compute.api [None req-c2d0a6ec-48ca-404d-a6fd-a073009c43bf tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] [instance: cca08141-979e-4519-88b3-c77e8a71ae3e] Fetching instance by UUID {{(pid=128728) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 15:55:51.044739 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-c2d0a6ec-48ca-404d-a6fd-a073009c43bf tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:55:51.045535 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-c2d0a6ec-48ca-404d-a6fd-a073009c43bf tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:55:51.046385 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-c2d0a6ec-48ca-404d-a6fd-a073009c43bf tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:55:51.046836 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-c2d0a6ec-48ca-404d-a6fd-a073009c43bf tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:55:51.173418 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.policy [None req-bdae3cd8-1c3b-4838-9e00-e88f387bdfdd tempest-TestShelveInstance-1853374188 tempest-TestShelveInstance-1853374188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e05ae1c6a054a299e841d008f9d7a09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83d6b6f0aa4f4314811ee80480861958', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128729) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:55:51.183050 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: INFO nova.api.openstack.requestlog [None req-bdae3cd8-1c3b-4838-9e00-e88f387bdfdd tempest-TestShelveInstance-1853374188 tempest-TestShelveInstance-1853374188-project] 10.222.0.61 "GET /compute/v2.1/servers/08195c98-5b1d-426c-a398-c7e914c14661" status: 200 len: 1576 microversion: 2.1 time: 0.219316 May 14 15:55:51.194706 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: [pid: 128729|app: 0|req: 521/1059] 10.222.0.61 () {58 vars in 1235 bytes} [Sat May 14 15:55:50 2022] GET /compute/v2.1/servers/08195c98-5b1d-426c-a398-c7e914c14661 => generated 1576 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 15:55:51.261076 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.policy [None req-c2d0a6ec-48ca-404d-a6fd-a073009c43bf tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58bfb7417bc94583963401ae0fe9d39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0672be3fa3f7414da1c1a5b7300abbe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128728) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:55:51.270105 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.policy [None req-c2d0a6ec-48ca-404d-a6fd-a073009c43bf tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58bfb7417bc94583963401ae0fe9d39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0672be3fa3f7414da1c1a5b7300abbe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128728) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:55:51.271669 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.policy [None req-c2d0a6ec-48ca-404d-a6fd-a073009c43bf tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58bfb7417bc94583963401ae0fe9d39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0672be3fa3f7414da1c1a5b7300abbe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128728) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:55:51.272840 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: INFO nova.api.openstack.requestlog [None req-c2d0a6ec-48ca-404d-a6fd-a073009c43bf tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] 10.222.0.61 "GET /compute/v2.1/servers/cca08141-979e-4519-88b3-c77e8a71ae3e" status: 200 len: 1740 microversion: 2.20 time: 0.240801 May 14 15:55:51.273593 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: [pid: 128728|app: 0|req: 539/1060] 10.222.0.61 () {60 vars in 1276 bytes} [Sat May 14 15:55:51 2022] GET /compute/v2.1/servers/cca08141-979e-4519-88b3-c77e8a71ae3e => generated 1740 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 14 15:55:51.488551 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi [None req-34a3ed9d-5e75-4da5-b0be-c43697c5c789 tempest-VolumesSnapshotTestJSON-671752898 tempest-VolumesSnapshotTestJSON-671752898-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1215441600", "imageRef": "1381e3d5-fc27-4fa7-ab03-5d86278a0546", "flavorRef": "452", "networks": [{"uuid": "5bc2cada-443d-44ab-8881-81867ee93960"}]}} {{(pid=128729) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 15:55:51.543872 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.network.neutron [None req-34a3ed9d-5e75-4da5-b0be-c43697c5c789 tempest-VolumesSnapshotTestJSON-671752898 tempest-VolumesSnapshotTestJSON-671752898-project] validate_networks() for [('5bc2cada-443d-44ab-8881-81867ee93960', None, None, None, None, None)] {{(pid=128729) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 14 15:55:51.940357 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.virt.hardware [None req-34a3ed9d-5e75-4da5-b0be-c43697c5c789 tempest-VolumesSnapshotTestJSON-671752898 tempest-VolumesSnapshotTestJSON-671752898-project] Flavor limits 0:0:0 {{(pid=128729) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 14 15:55:51.940820 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.virt.hardware [None req-34a3ed9d-5e75-4da5-b0be-c43697c5c789 tempest-VolumesSnapshotTestJSON-671752898 tempest-VolumesSnapshotTestJSON-671752898-project] Image limits 0:0:0 {{(pid=128729) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 14 15:55:51.941392 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.virt.hardware [None req-34a3ed9d-5e75-4da5-b0be-c43697c5c789 tempest-VolumesSnapshotTestJSON-671752898 tempest-VolumesSnapshotTestJSON-671752898-project] Flavor pref 0:0:0 {{(pid=128729) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 14 15:55:51.941897 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.virt.hardware [None req-34a3ed9d-5e75-4da5-b0be-c43697c5c789 tempest-VolumesSnapshotTestJSON-671752898 tempest-VolumesSnapshotTestJSON-671752898-project] Image pref 0:0:0 {{(pid=128729) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 14 15:55:51.942664 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.virt.hardware [None req-34a3ed9d-5e75-4da5-b0be-c43697c5c789 tempest-VolumesSnapshotTestJSON-671752898 tempest-VolumesSnapshotTestJSON-671752898-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128729) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 14 15:55:51.951660 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-34a3ed9d-5e75-4da5-b0be-c43697c5c789 tempest-VolumesSnapshotTestJSON-671752898 tempest-VolumesSnapshotTestJSON-671752898-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:55:51.952341 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-34a3ed9d-5e75-4da5-b0be-c43697c5c789 tempest-VolumesSnapshotTestJSON-671752898 tempest-VolumesSnapshotTestJSON-671752898-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:55:51.953921 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-34a3ed9d-5e75-4da5-b0be-c43697c5c789 tempest-VolumesSnapshotTestJSON-671752898 tempest-VolumesSnapshotTestJSON-671752898-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:55:51.954572 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-34a3ed9d-5e75-4da5-b0be-c43697c5c789 tempest-VolumesSnapshotTestJSON-671752898 tempest-VolumesSnapshotTestJSON-671752898-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:55:51.974208 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.quota [None req-34a3ed9d-5e75-4da5-b0be-c43697c5c789 tempest-VolumesSnapshotTestJSON-671752898 tempest-VolumesSnapshotTestJSON-671752898-project] Getting quotas for project 4ad8088ecb8a4f72a98ad70fa8be02b3. Resources: {'instances', 'cores', 'ram'} {{(pid=128729) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 14 15:55:51.978262 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.quota [None req-34a3ed9d-5e75-4da5-b0be-c43697c5c789 tempest-VolumesSnapshotTestJSON-671752898 tempest-VolumesSnapshotTestJSON-671752898-project] Getting quotas for user d3e4193c9d9043c99ee5bee59f79f7a8 and project 4ad8088ecb8a4f72a98ad70fa8be02b3. Resources: {'instances', 'cores', 'ram'} {{(pid=128729) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 14 15:55:51.989363 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.compute.api [None req-34a3ed9d-5e75-4da5-b0be-c43697c5c789 tempest-VolumesSnapshotTestJSON-671752898 tempest-VolumesSnapshotTestJSON-671752898-project] Going to run 1 instances... {{(pid=128729) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 14 15:55:51.991949 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.compute.api [None req-34a3ed9d-5e75-4da5-b0be-c43697c5c789 tempest-VolumesSnapshotTestJSON-671752898 tempest-VolumesSnapshotTestJSON-671752898-project] [instance: a1d28d7f-bade-404d-a453-e09a34fbb232] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='1381e3d5-fc27-4fa7-ab03-5d86278a0546',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128729) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 14 15:55:52.037163 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: INFO nova.api.openstack.requestlog [None req-34a3ed9d-5e75-4da5-b0be-c43697c5c789 tempest-VolumesSnapshotTestJSON-671752898 tempest-VolumesSnapshotTestJSON-671752898-project] 10.222.0.61 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.552572 May 14 15:55:52.038069 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: [pid: 128729|app: 0|req: 522/1061] 10.222.0.61 () {60 vars in 1146 bytes} [Sat May 14 15:55:51 2022] POST /compute/v2.1/servers => generated 380 bytes in 554 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 14 15:55:52.049162 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi [None req-303b82cf-d811-42fb-9a47-30e9c4c2490a tempest-VolumesSnapshotTestJSON-671752898 tempest-VolumesSnapshotTestJSON-671752898-project] Calling method '>' {{(pid=128728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 15:55:52.049789 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.compute.api [None req-303b82cf-d811-42fb-9a47-30e9c4c2490a tempest-VolumesSnapshotTestJSON-671752898 tempest-VolumesSnapshotTestJSON-671752898-project] [instance: a1d28d7f-bade-404d-a453-e09a34fbb232] Fetching instance by UUID {{(pid=128728) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 15:55:52.106422 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.policy [None req-303b82cf-d811-42fb-9a47-30e9c4c2490a tempest-VolumesSnapshotTestJSON-671752898 tempest-VolumesSnapshotTestJSON-671752898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3e4193c9d9043c99ee5bee59f79f7a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ad8088ecb8a4f72a98ad70fa8be02b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128728) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:55:52.113112 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: INFO nova.api.openstack.requestlog [None req-303b82cf-d811-42fb-9a47-30e9c4c2490a tempest-VolumesSnapshotTestJSON-671752898 tempest-VolumesSnapshotTestJSON-671752898-project] 10.222.0.61 "GET /compute/v2.1/servers/a1d28d7f-bade-404d-a453-e09a34fbb232" status: 200 len: 1219 microversion: 2.1 time: 0.068944 May 14 15:55:52.113899 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: [pid: 128728|app: 0|req: 540/1062] 10.222.0.61 () {58 vars in 1235 bytes} [Sat May 14 15:55:52 2022] GET /compute/v2.1/servers/a1d28d7f-bade-404d-a453-e09a34fbb232 => generated 1219 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 15:55:52.202600 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi [None req-5fddd51a-7fc7-4571-abd9-264813d329d7 tempest-TestShelveInstance-1853374188 tempest-TestShelveInstance-1853374188-project] Calling method '>' {{(pid=128729) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 15:55:52.204078 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.compute.api [None req-5fddd51a-7fc7-4571-abd9-264813d329d7 tempest-TestShelveInstance-1853374188 tempest-TestShelveInstance-1853374188-project] [instance: 08195c98-5b1d-426c-a398-c7e914c14661] Fetching instance by UUID {{(pid=128729) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 15:55:52.210163 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-5fddd51a-7fc7-4571-abd9-264813d329d7 tempest-TestShelveInstance-1853374188 tempest-TestShelveInstance-1853374188-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:55:52.210669 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-5fddd51a-7fc7-4571-abd9-264813d329d7 tempest-TestShelveInstance-1853374188 tempest-TestShelveInstance-1853374188-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:55:52.211441 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-5fddd51a-7fc7-4571-abd9-264813d329d7 tempest-TestShelveInstance-1853374188 tempest-TestShelveInstance-1853374188-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:55:52.211976 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-5fddd51a-7fc7-4571-abd9-264813d329d7 tempest-TestShelveInstance-1853374188 tempest-TestShelveInstance-1853374188-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:55:52.292452 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi [None req-1099ac6a-f1a9-4100-b646-0818a500e4a7 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Calling method '>' {{(pid=128728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 15:55:52.293295 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.compute.api [None req-1099ac6a-f1a9-4100-b646-0818a500e4a7 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] [instance: cca08141-979e-4519-88b3-c77e8a71ae3e] Fetching instance by UUID {{(pid=128728) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 15:55:52.300520 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-1099ac6a-f1a9-4100-b646-0818a500e4a7 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:55:52.300966 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-1099ac6a-f1a9-4100-b646-0818a500e4a7 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:55:52.301953 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-1099ac6a-f1a9-4100-b646-0818a500e4a7 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:55:52.302473 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-1099ac6a-f1a9-4100-b646-0818a500e4a7 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:55:52.362947 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.policy [None req-5fddd51a-7fc7-4571-abd9-264813d329d7 tempest-TestShelveInstance-1853374188 tempest-TestShelveInstance-1853374188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e05ae1c6a054a299e841d008f9d7a09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83d6b6f0aa4f4314811ee80480861958', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128729) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:55:52.371172 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: INFO nova.api.openstack.requestlog [None req-5fddd51a-7fc7-4571-abd9-264813d329d7 tempest-TestShelveInstance-1853374188 tempest-TestShelveInstance-1853374188-project] 10.222.0.61 "GET /compute/v2.1/servers/08195c98-5b1d-426c-a398-c7e914c14661" status: 200 len: 1563 microversion: 2.1 time: 0.172925 May 14 15:55:52.372010 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: [pid: 128729|app: 0|req: 523/1063] 10.222.0.61 () {58 vars in 1235 bytes} [Sat May 14 15:55:52 2022] GET /compute/v2.1/servers/08195c98-5b1d-426c-a398-c7e914c14661 => generated 1563 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 15:55:52.451127 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.policy [None req-1099ac6a-f1a9-4100-b646-0818a500e4a7 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58bfb7417bc94583963401ae0fe9d39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0672be3fa3f7414da1c1a5b7300abbe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128728) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:55:52.458906 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.policy [None req-1099ac6a-f1a9-4100-b646-0818a500e4a7 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58bfb7417bc94583963401ae0fe9d39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0672be3fa3f7414da1c1a5b7300abbe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128728) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:55:52.460414 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.policy [None req-1099ac6a-f1a9-4100-b646-0818a500e4a7 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58bfb7417bc94583963401ae0fe9d39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0672be3fa3f7414da1c1a5b7300abbe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128728) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:55:52.461566 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: INFO nova.api.openstack.requestlog [None req-1099ac6a-f1a9-4100-b646-0818a500e4a7 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] 10.222.0.61 "GET /compute/v2.1/servers/cca08141-979e-4519-88b3-c77e8a71ae3e" status: 200 len: 1740 microversion: 2.20 time: 0.173103 May 14 15:55:52.466446 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: [pid: 128728|app: 0|req: 541/1064] 10.222.0.61 () {60 vars in 1276 bytes} [Sat May 14 15:55:52 2022] GET /compute/v2.1/servers/cca08141-979e-4519-88b3-c77e8a71ae3e => generated 1740 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 14 15:55:53.130643 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi [None req-d71f4e91-6919-45a6-96e5-f878348f49fb tempest-VolumesSnapshotTestJSON-671752898 tempest-VolumesSnapshotTestJSON-671752898-project] Calling method '>' {{(pid=128729) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 15:55:53.131204 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.compute.api [None req-d71f4e91-6919-45a6-96e5-f878348f49fb tempest-VolumesSnapshotTestJSON-671752898 tempest-VolumesSnapshotTestJSON-671752898-project] [instance: a1d28d7f-bade-404d-a453-e09a34fbb232] Fetching instance by UUID {{(pid=128729) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 15:55:53.137314 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-d71f4e91-6919-45a6-96e5-f878348f49fb tempest-VolumesSnapshotTestJSON-671752898 tempest-VolumesSnapshotTestJSON-671752898-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:55:53.137764 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-d71f4e91-6919-45a6-96e5-f878348f49fb tempest-VolumesSnapshotTestJSON-671752898 tempest-VolumesSnapshotTestJSON-671752898-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:55:53.138547 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-d71f4e91-6919-45a6-96e5-f878348f49fb tempest-VolumesSnapshotTestJSON-671752898 tempest-VolumesSnapshotTestJSON-671752898-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:55:53.138983 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-d71f4e91-6919-45a6-96e5-f878348f49fb tempest-VolumesSnapshotTestJSON-671752898 tempest-VolumesSnapshotTestJSON-671752898-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:55:53.201646 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.policy [None req-d71f4e91-6919-45a6-96e5-f878348f49fb tempest-VolumesSnapshotTestJSON-671752898 tempest-VolumesSnapshotTestJSON-671752898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3e4193c9d9043c99ee5bee59f79f7a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ad8088ecb8a4f72a98ad70fa8be02b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128729) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:55:53.209323 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: INFO nova.api.openstack.requestlog [None req-d71f4e91-6919-45a6-96e5-f878348f49fb tempest-VolumesSnapshotTestJSON-671752898 tempest-VolumesSnapshotTestJSON-671752898-project] 10.222.0.61 "GET /compute/v2.1/servers/a1d28d7f-bade-404d-a453-e09a34fbb232" status: 200 len: 1271 microversion: 2.1 time: 0.082792 May 14 15:55:53.209883 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: [pid: 128729|app: 0|req: 524/1065] 10.222.0.61 () {58 vars in 1235 bytes} [Sat May 14 15:55:53 2022] GET /compute/v2.1/servers/a1d28d7f-bade-404d-a453-e09a34fbb232 => generated 1271 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 15:55:53.480085 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi [None req-039aaba3-feb1-4941-997c-b150d7e323fe tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Calling method '>' {{(pid=128728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 15:55:53.481453 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.compute.api [None req-039aaba3-feb1-4941-997c-b150d7e323fe tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] [instance: cca08141-979e-4519-88b3-c77e8a71ae3e] Fetching instance by UUID {{(pid=128728) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 15:55:53.487901 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-039aaba3-feb1-4941-997c-b150d7e323fe tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:55:53.488569 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-039aaba3-feb1-4941-997c-b150d7e323fe tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:55:53.489528 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-039aaba3-feb1-4941-997c-b150d7e323fe tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:55:53.490124 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-039aaba3-feb1-4941-997c-b150d7e323fe tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:55:53.667357 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.policy [None req-039aaba3-feb1-4941-997c-b150d7e323fe tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58bfb7417bc94583963401ae0fe9d39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0672be3fa3f7414da1c1a5b7300abbe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128728) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:55:53.694477 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.policy [None req-039aaba3-feb1-4941-997c-b150d7e323fe tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58bfb7417bc94583963401ae0fe9d39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0672be3fa3f7414da1c1a5b7300abbe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128728) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:55:53.695985 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.policy [None req-039aaba3-feb1-4941-997c-b150d7e323fe tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58bfb7417bc94583963401ae0fe9d39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0672be3fa3f7414da1c1a5b7300abbe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128728) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:55:53.697145 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: INFO nova.api.openstack.requestlog [None req-039aaba3-feb1-4941-997c-b150d7e323fe tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] 10.222.0.61 "GET /compute/v2.1/servers/cca08141-979e-4519-88b3-c77e8a71ae3e" status: 200 len: 1722 microversion: 2.20 time: 0.221318 May 14 15:55:53.697710 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: [pid: 128728|app: 0|req: 542/1066] 10.222.0.61 () {60 vars in 1276 bytes} [Sat May 14 15:55:53 2022] GET /compute/v2.1/servers/cca08141-979e-4519-88b3-c77e8a71ae3e => generated 1722 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 14 15:55:54.226934 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi [None req-fcfa9a42-2d80-4f64-a1d8-3b66becb937d tempest-VolumesSnapshotTestJSON-671752898 tempest-VolumesSnapshotTestJSON-671752898-project] Calling method '>' {{(pid=128729) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 15:55:54.227726 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.compute.api [None req-fcfa9a42-2d80-4f64-a1d8-3b66becb937d tempest-VolumesSnapshotTestJSON-671752898 tempest-VolumesSnapshotTestJSON-671752898-project] [instance: a1d28d7f-bade-404d-a453-e09a34fbb232] Fetching instance by UUID {{(pid=128729) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 15:55:54.234268 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-fcfa9a42-2d80-4f64-a1d8-3b66becb937d tempest-VolumesSnapshotTestJSON-671752898 tempest-VolumesSnapshotTestJSON-671752898-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:55:54.235487 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-fcfa9a42-2d80-4f64-a1d8-3b66becb937d tempest-VolumesSnapshotTestJSON-671752898 tempest-VolumesSnapshotTestJSON-671752898-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:55:54.236189 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-fcfa9a42-2d80-4f64-a1d8-3b66becb937d tempest-VolumesSnapshotTestJSON-671752898 tempest-VolumesSnapshotTestJSON-671752898-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:55:54.236627 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-fcfa9a42-2d80-4f64-a1d8-3b66becb937d tempest-VolumesSnapshotTestJSON-671752898 tempest-VolumesSnapshotTestJSON-671752898-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:55:54.414734 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.policy [None req-fcfa9a42-2d80-4f64-a1d8-3b66becb937d tempest-VolumesSnapshotTestJSON-671752898 tempest-VolumesSnapshotTestJSON-671752898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3e4193c9d9043c99ee5bee59f79f7a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ad8088ecb8a4f72a98ad70fa8be02b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128729) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:55:54.422553 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: INFO nova.api.openstack.requestlog [None req-fcfa9a42-2d80-4f64-a1d8-3b66becb937d tempest-VolumesSnapshotTestJSON-671752898 tempest-VolumesSnapshotTestJSON-671752898-project] 10.222.0.61 "GET /compute/v2.1/servers/a1d28d7f-bade-404d-a453-e09a34fbb232" status: 200 len: 1319 microversion: 2.1 time: 0.199234 May 14 15:55:54.423110 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: [pid: 128729|app: 0|req: 525/1067] 10.222.0.61 () {58 vars in 1235 bytes} [Sat May 14 15:55:54 2022] GET /compute/v2.1/servers/a1d28d7f-bade-404d-a453-e09a34fbb232 => generated 1319 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 15:55:54.715738 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi [None req-cf611837-592c-4bb7-b1cc-d6ea10cb17f9 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Calling method '>' {{(pid=128728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 15:55:54.716349 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.compute.api [None req-cf611837-592c-4bb7-b1cc-d6ea10cb17f9 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] [instance: cca08141-979e-4519-88b3-c77e8a71ae3e] Fetching instance by UUID {{(pid=128728) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 15:55:54.723385 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-cf611837-592c-4bb7-b1cc-d6ea10cb17f9 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:55:54.723863 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-cf611837-592c-4bb7-b1cc-d6ea10cb17f9 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:55:54.724661 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-cf611837-592c-4bb7-b1cc-d6ea10cb17f9 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:55:54.725098 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-cf611837-592c-4bb7-b1cc-d6ea10cb17f9 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:55:54.850691 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.policy [None req-cf611837-592c-4bb7-b1cc-d6ea10cb17f9 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58bfb7417bc94583963401ae0fe9d39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0672be3fa3f7414da1c1a5b7300abbe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128728) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:55:54.858334 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.policy [None req-cf611837-592c-4bb7-b1cc-d6ea10cb17f9 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58bfb7417bc94583963401ae0fe9d39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0672be3fa3f7414da1c1a5b7300abbe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128728) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:55:54.860066 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.policy [None req-cf611837-592c-4bb7-b1cc-d6ea10cb17f9 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58bfb7417bc94583963401ae0fe9d39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0672be3fa3f7414da1c1a5b7300abbe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128728) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:55:54.861208 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: INFO nova.api.openstack.requestlog [None req-cf611837-592c-4bb7-b1cc-d6ea10cb17f9 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] 10.222.0.61 "GET /compute/v2.1/servers/cca08141-979e-4519-88b3-c77e8a71ae3e" status: 200 len: 1722 microversion: 2.20 time: 0.149406 May 14 15:55:54.861768 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: [pid: 128728|app: 0|req: 543/1068] 10.222.0.61 () {60 vars in 1276 bytes} [Sat May 14 15:55:54 2022] GET /compute/v2.1/servers/cca08141-979e-4519-88b3-c77e8a71ae3e => generated 1722 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 14 15:55:55.440103 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi [None req-c62be095-fcd1-41f8-9b09-dc458c5f5833 tempest-VolumesSnapshotTestJSON-671752898 tempest-VolumesSnapshotTestJSON-671752898-project] Calling method '>' {{(pid=128729) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 15:55:55.440709 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.compute.api [None req-c62be095-fcd1-41f8-9b09-dc458c5f5833 tempest-VolumesSnapshotTestJSON-671752898 tempest-VolumesSnapshotTestJSON-671752898-project] [instance: a1d28d7f-bade-404d-a453-e09a34fbb232] Fetching instance by UUID {{(pid=128729) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 15:55:55.447019 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-c62be095-fcd1-41f8-9b09-dc458c5f5833 tempest-VolumesSnapshotTestJSON-671752898 tempest-VolumesSnapshotTestJSON-671752898-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:55:55.447506 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-c62be095-fcd1-41f8-9b09-dc458c5f5833 tempest-VolumesSnapshotTestJSON-671752898 tempest-VolumesSnapshotTestJSON-671752898-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:55:55.448278 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-c62be095-fcd1-41f8-9b09-dc458c5f5833 tempest-VolumesSnapshotTestJSON-671752898 tempest-VolumesSnapshotTestJSON-671752898-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:55:55.448714 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-c62be095-fcd1-41f8-9b09-dc458c5f5833 tempest-VolumesSnapshotTestJSON-671752898 tempest-VolumesSnapshotTestJSON-671752898-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:55:55.650188 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.policy [None req-c62be095-fcd1-41f8-9b09-dc458c5f5833 tempest-VolumesSnapshotTestJSON-671752898 tempest-VolumesSnapshotTestJSON-671752898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3e4193c9d9043c99ee5bee59f79f7a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ad8088ecb8a4f72a98ad70fa8be02b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128729) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:55:55.660270 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: INFO nova.api.openstack.requestlog [None req-c62be095-fcd1-41f8-9b09-dc458c5f5833 tempest-VolumesSnapshotTestJSON-671752898 tempest-VolumesSnapshotTestJSON-671752898-project] 10.222.0.61 "GET /compute/v2.1/servers/a1d28d7f-bade-404d-a453-e09a34fbb232" status: 200 len: 1319 microversion: 2.1 time: 0.224899 May 14 15:55:55.661102 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: [pid: 128729|app: 0|req: 526/1069] 10.222.0.61 () {58 vars in 1235 bytes} [Sat May 14 15:55:55 2022] GET /compute/v2.1/servers/a1d28d7f-bade-404d-a453-e09a34fbb232 => generated 1319 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 15:55:55.880027 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi [None req-c96fefa1-446f-47d1-8d92-3629f6702e18 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Calling method '>' {{(pid=128728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 15:55:55.880636 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.compute.api [None req-c96fefa1-446f-47d1-8d92-3629f6702e18 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] [instance: cca08141-979e-4519-88b3-c77e8a71ae3e] Fetching instance by UUID {{(pid=128728) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 15:55:55.887057 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-c96fefa1-446f-47d1-8d92-3629f6702e18 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:55:55.887504 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-c96fefa1-446f-47d1-8d92-3629f6702e18 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:55:55.888272 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-c96fefa1-446f-47d1-8d92-3629f6702e18 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:55:55.888703 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-c96fefa1-446f-47d1-8d92-3629f6702e18 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:55:56.082541 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi [req-c3bd0958-9665-4f2f-9221-13f6c0e48f94 req-6b5695cf-57a7-4ef4-a268-649c1bbd6687 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a1d28d7f-bade-404d-a453-e09a34fbb232", "tag": "5a791dcd-9407-4b8e-8d0a-a169fe794020"}]} {{(pid=128729) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 15:55:56.091165 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [req-c3bd0958-9665-4f2f-9221-13f6c0e48f94 req-6b5695cf-57a7-4ef4-a268-649c1bbd6687 service nova] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:55:56.091952 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [req-c3bd0958-9665-4f2f-9221-13f6c0e48f94 req-6b5695cf-57a7-4ef4-a268-649c1bbd6687 service nova] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:55:56.104438 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: INFO nova.api.openstack.compute.server_external_events [req-c3bd0958-9665-4f2f-9221-13f6c0e48f94 req-6b5695cf-57a7-4ef4-a268-649c1bbd6687 service nova] Creating event network-changed:5a791dcd-9407-4b8e-8d0a-a169fe794020 for instance a1d28d7f-bade-404d-a453-e09a34fbb232 on hv-cinder-83979 May 14 15:55:56.109263 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: INFO nova.api.openstack.requestlog [req-c3bd0958-9665-4f2f-9221-13f6c0e48f94 req-6b5695cf-57a7-4ef4-a268-649c1bbd6687 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032974 May 14 15:55:56.109853 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: [pid: 128729|app: 0|req: 527/1070] 10.222.0.61 () {64 vars in 1317 bytes} [Sat May 14 15:55:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 14 15:55:56.123158 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.policy [None req-c96fefa1-446f-47d1-8d92-3629f6702e18 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58bfb7417bc94583963401ae0fe9d39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0672be3fa3f7414da1c1a5b7300abbe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128728) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:55:56.132138 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.policy [None req-c96fefa1-446f-47d1-8d92-3629f6702e18 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58bfb7417bc94583963401ae0fe9d39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0672be3fa3f7414da1c1a5b7300abbe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128728) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:55:56.133951 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.policy [None req-c96fefa1-446f-47d1-8d92-3629f6702e18 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58bfb7417bc94583963401ae0fe9d39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0672be3fa3f7414da1c1a5b7300abbe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128728) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:55:56.135291 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: INFO nova.api.openstack.requestlog [None req-c96fefa1-446f-47d1-8d92-3629f6702e18 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] 10.222.0.61 "GET /compute/v2.1/servers/cca08141-979e-4519-88b3-c77e8a71ae3e" status: 200 len: 1725 microversion: 2.20 time: 0.259393 May 14 15:55:56.135883 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: [pid: 128728|app: 0|req: 544/1071] 10.222.0.61 () {60 vars in 1276 bytes} [Sat May 14 15:55:55 2022] GET /compute/v2.1/servers/cca08141-979e-4519-88b3-c77e8a71ae3e => generated 1725 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 14 15:55:56.157609 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi [None req-953e472f-9779-4bb5-9bf8-faf884560f32 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "1e86b8aa-266e-456a-9e39-eb6ec4b200ce"}} {{(pid=128729) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 15:55:56.158791 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.compute.api [None req-953e472f-9779-4bb5-9bf8-faf884560f32 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] [instance: cca08141-979e-4519-88b3-c77e8a71ae3e] Fetching instance by UUID {{(pid=128729) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 15:55:56.164856 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-953e472f-9779-4bb5-9bf8-faf884560f32 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:55:56.165302 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-953e472f-9779-4bb5-9bf8-faf884560f32 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:55:56.166156 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-953e472f-9779-4bb5-9bf8-faf884560f32 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:55:56.166620 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-953e472f-9779-4bb5-9bf8-faf884560f32 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:55:56.432551 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: INFO nova.api.openstack.requestlog [None req-953e472f-9779-4bb5-9bf8-faf884560f32 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] 10.222.0.61 "POST /compute/v2.1/servers/cca08141-979e-4519-88b3-c77e8a71ae3e/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.280052 May 14 15:55:56.433235 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: [pid: 128729|app: 0|req: 528/1072] 10.222.0.61 () {62 vars in 1363 bytes} [Sat May 14 15:55:56 2022] POST /compute/v2.1/servers/cca08141-979e-4519-88b3-c77e8a71ae3e/os-volume_attachments => generated 188 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) May 14 15:55:56.545451 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi [None req-96071371-1b30-453a-889d-b66775102293 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Calling method '>' {{(pid=128728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 15:55:56.545952 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.compute.api [None req-96071371-1b30-453a-889d-b66775102293 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] [instance: cca08141-979e-4519-88b3-c77e8a71ae3e] Fetching instance by UUID {{(pid=128728) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 15:55:56.552989 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-96071371-1b30-453a-889d-b66775102293 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:55:56.553445 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-96071371-1b30-453a-889d-b66775102293 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:55:56.554252 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-96071371-1b30-453a-889d-b66775102293 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:55:56.554718 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-96071371-1b30-453a-889d-b66775102293 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:55:56.677437 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi [None req-4daabb82-7418-43d5-b3d8-b3b64755108e tempest-VolumesSnapshotTestJSON-671752898 tempest-VolumesSnapshotTestJSON-671752898-project] Calling method '>' {{(pid=128729) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 15:55:56.678056 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.compute.api [None req-4daabb82-7418-43d5-b3d8-b3b64755108e tempest-VolumesSnapshotTestJSON-671752898 tempest-VolumesSnapshotTestJSON-671752898-project] [instance: a1d28d7f-bade-404d-a453-e09a34fbb232] Fetching instance by UUID {{(pid=128729) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 15:55:56.684028 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-4daabb82-7418-43d5-b3d8-b3b64755108e tempest-VolumesSnapshotTestJSON-671752898 tempest-VolumesSnapshotTestJSON-671752898-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:55:56.684506 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-4daabb82-7418-43d5-b3d8-b3b64755108e tempest-VolumesSnapshotTestJSON-671752898 tempest-VolumesSnapshotTestJSON-671752898-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:55:56.685278 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-4daabb82-7418-43d5-b3d8-b3b64755108e tempest-VolumesSnapshotTestJSON-671752898 tempest-VolumesSnapshotTestJSON-671752898-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:55:56.685724 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-4daabb82-7418-43d5-b3d8-b3b64755108e tempest-VolumesSnapshotTestJSON-671752898 tempest-VolumesSnapshotTestJSON-671752898-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:55:56.789862 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: INFO nova.api.openstack.requestlog [None req-96071371-1b30-453a-889d-b66775102293 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] 10.222.0.61 "DELETE /compute/v2.1/servers/cca08141-979e-4519-88b3-c77e8a71ae3e/os-volume_attachments/1e86b8aa-266e-456a-9e39-eb6ec4b200ce" status: 202 len: 0 microversion: 2.20 time: 0.248266 May 14 15:55:56.790493 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: [pid: 128728|app: 0|req: 545/1073] 10.222.0.61 () {60 vars in 1456 bytes} [Sat May 14 15:55:56 2022] DELETE /compute/v2.1/servers/cca08141-979e-4519-88b3-c77e8a71ae3e/os-volume_attachments/1e86b8aa-266e-456a-9e39-eb6ec4b200ce => generated 0 bytes in 250 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) May 14 15:55:56.820717 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.policy [None req-4daabb82-7418-43d5-b3d8-b3b64755108e tempest-VolumesSnapshotTestJSON-671752898 tempest-VolumesSnapshotTestJSON-671752898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3e4193c9d9043c99ee5bee59f79f7a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ad8088ecb8a4f72a98ad70fa8be02b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128729) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:55:56.828520 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: INFO nova.api.openstack.requestlog [None req-4daabb82-7418-43d5-b3d8-b3b64755108e tempest-VolumesSnapshotTestJSON-671752898 tempest-VolumesSnapshotTestJSON-671752898-project] 10.222.0.61 "GET /compute/v2.1/servers/a1d28d7f-bade-404d-a453-e09a34fbb232" status: 200 len: 1319 microversion: 2.1 time: 0.154305 May 14 15:55:56.829094 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: [pid: 128729|app: 0|req: 529/1074] 10.222.0.61 () {58 vars in 1235 bytes} [Sat May 14 15:55:56 2022] GET /compute/v2.1/servers/a1d28d7f-bade-404d-a453-e09a34fbb232 => generated 1319 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 15:55:56.850353 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi [None req-6a478925-2f22-4409-9b51-f81d931d091b tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=128728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 15:55:56.850925 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.compute.api [None req-6a478925-2f22-4409-9b51-f81d931d091b tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] [instance: cca08141-979e-4519-88b3-c77e8a71ae3e] Fetching instance by UUID {{(pid=128728) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 15:55:56.856998 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-6a478925-2f22-4409-9b51-f81d931d091b tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:55:56.857448 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-6a478925-2f22-4409-9b51-f81d931d091b tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:55:56.858209 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-6a478925-2f22-4409-9b51-f81d931d091b tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:55:56.858675 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-6a478925-2f22-4409-9b51-f81d931d091b tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:55:56.931801 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: INFO nova.api.openstack.requestlog [None req-6a478925-2f22-4409-9b51-f81d931d091b tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] 10.222.0.61 "POST /compute/v2.1/servers/cca08141-979e-4519-88b3-c77e8a71ae3e/action" status: 202 len: 0 microversion: 2.20 time: 0.085408 May 14 15:55:56.932471 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: [pid: 128728|app: 0|req: 546/1075] 10.222.0.61 () {62 vars in 1318 bytes} [Sat May 14 15:55:56 2022] POST /compute/v2.1/servers/cca08141-979e-4519-88b3-c77e8a71ae3e/action => generated 0 bytes in 87 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) May 14 15:55:56.940651 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi [None req-f84f09d3-af73-4f8e-bb49-a1c42c2807e0 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Calling method '>' {{(pid=128729) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 15:55:56.941259 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.compute.api [None req-f84f09d3-af73-4f8e-bb49-a1c42c2807e0 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] [instance: cca08141-979e-4519-88b3-c77e8a71ae3e] Fetching instance by UUID {{(pid=128729) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 15:55:56.947071 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-f84f09d3-af73-4f8e-bb49-a1c42c2807e0 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:55:56.947523 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-f84f09d3-af73-4f8e-bb49-a1c42c2807e0 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:55:56.948583 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-f84f09d3-af73-4f8e-bb49-a1c42c2807e0 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:55:56.949031 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-f84f09d3-af73-4f8e-bb49-a1c42c2807e0 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:55:57.084379 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.policy [None req-f84f09d3-af73-4f8e-bb49-a1c42c2807e0 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58bfb7417bc94583963401ae0fe9d39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0672be3fa3f7414da1c1a5b7300abbe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128729) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:55:57.092481 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.policy [None req-f84f09d3-af73-4f8e-bb49-a1c42c2807e0 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58bfb7417bc94583963401ae0fe9d39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0672be3fa3f7414da1c1a5b7300abbe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128729) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:55:57.094142 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.policy [None req-f84f09d3-af73-4f8e-bb49-a1c42c2807e0 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58bfb7417bc94583963401ae0fe9d39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0672be3fa3f7414da1c1a5b7300abbe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128729) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:55:57.095376 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: INFO nova.api.openstack.requestlog [None req-f84f09d3-af73-4f8e-bb49-a1c42c2807e0 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] 10.222.0.61 "GET /compute/v2.1/servers/cca08141-979e-4519-88b3-c77e8a71ae3e" status: 200 len: 1673 microversion: 2.20 time: 0.158718 May 14 15:55:57.095938 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: [pid: 128729|app: 0|req: 530/1076] 10.222.0.61 () {60 vars in 1276 bytes} [Sat May 14 15:55:56 2022] GET /compute/v2.1/servers/cca08141-979e-4519-88b3-c77e8a71ae3e => generated 1673 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 14 15:55:57.495039 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi [req-fa4d59a4-b239-4666-b407-090ea516dad9 req-2f15c0a4-3f81-4cc6-92c8-1cc40f6dc062 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cca08141-979e-4519-88b3-c77e8a71ae3e", "name": "network-vif-unplugged", "status": "completed", "tag": "e23afae5-7b01-4137-a087-ba1a741fd1f4"}]} {{(pid=128728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 15:55:57.503939 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [req-fa4d59a4-b239-4666-b407-090ea516dad9 req-2f15c0a4-3f81-4cc6-92c8-1cc40f6dc062 service nova] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:55:57.504470 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [req-fa4d59a4-b239-4666-b407-090ea516dad9 req-2f15c0a4-3f81-4cc6-92c8-1cc40f6dc062 service nova] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:55:57.516745 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.compute.server_external_events [req-fa4d59a4-b239-4666-b407-090ea516dad9 req-2f15c0a4-3f81-4cc6-92c8-1cc40f6dc062 service nova] Unable to find a host for instance cca08141-979e-4519-88b3-c77e8a71ae3e. Dropping event network-vif-unplugged {{(pid=128728) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} May 14 15:55:57.517631 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: INFO nova.api.openstack.requestlog [req-fa4d59a4-b239-4666-b407-090ea516dad9 req-2f15c0a4-3f81-4cc6-92c8-1cc40f6dc062 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.026652 May 14 15:55:57.518225 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: [pid: 128728|app: 0|req: 547/1077] 10.222.0.61 () {64 vars in 1317 bytes} [Sat May 14 15:55:57 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 28 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) May 14 15:55:57.845511 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi [None req-aeab0244-65c3-4fb8-a555-4af612aa9dd7 tempest-VolumesSnapshotTestJSON-671752898 tempest-VolumesSnapshotTestJSON-671752898-project] Calling method '>' {{(pid=128729) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 15:55:57.846115 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.compute.api [None req-aeab0244-65c3-4fb8-a555-4af612aa9dd7 tempest-VolumesSnapshotTestJSON-671752898 tempest-VolumesSnapshotTestJSON-671752898-project] [instance: a1d28d7f-bade-404d-a453-e09a34fbb232] Fetching instance by UUID {{(pid=128729) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 15:55:57.852580 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-aeab0244-65c3-4fb8-a555-4af612aa9dd7 tempest-VolumesSnapshotTestJSON-671752898 tempest-VolumesSnapshotTestJSON-671752898-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:55:57.853030 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-aeab0244-65c3-4fb8-a555-4af612aa9dd7 tempest-VolumesSnapshotTestJSON-671752898 tempest-VolumesSnapshotTestJSON-671752898-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:55:57.853801 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-aeab0244-65c3-4fb8-a555-4af612aa9dd7 tempest-VolumesSnapshotTestJSON-671752898 tempest-VolumesSnapshotTestJSON-671752898-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:55:57.854235 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-aeab0244-65c3-4fb8-a555-4af612aa9dd7 tempest-VolumesSnapshotTestJSON-671752898 tempest-VolumesSnapshotTestJSON-671752898-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:55:57.979987 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.policy [None req-aeab0244-65c3-4fb8-a555-4af612aa9dd7 tempest-VolumesSnapshotTestJSON-671752898 tempest-VolumesSnapshotTestJSON-671752898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3e4193c9d9043c99ee5bee59f79f7a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ad8088ecb8a4f72a98ad70fa8be02b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128729) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:55:57.987370 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: INFO nova.api.openstack.requestlog [None req-aeab0244-65c3-4fb8-a555-4af612aa9dd7 tempest-VolumesSnapshotTestJSON-671752898 tempest-VolumesSnapshotTestJSON-671752898-project] 10.222.0.61 "GET /compute/v2.1/servers/a1d28d7f-bade-404d-a453-e09a34fbb232" status: 200 len: 1319 microversion: 2.1 time: 0.146336 May 14 15:55:57.987927 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: [pid: 128729|app: 0|req: 531/1078] 10.222.0.61 () {58 vars in 1235 bytes} [Sat May 14 15:55:57 2022] GET /compute/v2.1/servers/a1d28d7f-bade-404d-a453-e09a34fbb232 => generated 1319 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 15:55:58.113952 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi [None req-4b3633b9-c156-4e97-acc8-38352ae9f680 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Calling method '>' {{(pid=128728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 15:55:58.114525 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.compute.api [None req-4b3633b9-c156-4e97-acc8-38352ae9f680 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] [instance: cca08141-979e-4519-88b3-c77e8a71ae3e] Fetching instance by UUID {{(pid=128728) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 15:55:58.121965 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-4b3633b9-c156-4e97-acc8-38352ae9f680 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:55:58.122468 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-4b3633b9-c156-4e97-acc8-38352ae9f680 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:55:58.123236 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-4b3633b9-c156-4e97-acc8-38352ae9f680 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:55:58.123671 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-4b3633b9-c156-4e97-acc8-38352ae9f680 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:55:58.251156 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.policy [None req-4b3633b9-c156-4e97-acc8-38352ae9f680 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58bfb7417bc94583963401ae0fe9d39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0672be3fa3f7414da1c1a5b7300abbe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128728) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:55:58.258872 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.policy [None req-4b3633b9-c156-4e97-acc8-38352ae9f680 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58bfb7417bc94583963401ae0fe9d39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0672be3fa3f7414da1c1a5b7300abbe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128728) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:55:58.260379 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.policy [None req-4b3633b9-c156-4e97-acc8-38352ae9f680 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58bfb7417bc94583963401ae0fe9d39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0672be3fa3f7414da1c1a5b7300abbe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128728) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:55:58.261531 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: INFO nova.api.openstack.requestlog [None req-4b3633b9-c156-4e97-acc8-38352ae9f680 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] 10.222.0.61 "GET /compute/v2.1/servers/cca08141-979e-4519-88b3-c77e8a71ae3e" status: 200 len: 1673 microversion: 2.20 time: 0.151627 May 14 15:55:58.262093 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: [pid: 128728|app: 0|req: 548/1079] 10.222.0.61 () {60 vars in 1276 bytes} [Sat May 14 15:55:58 2022] GET /compute/v2.1/servers/cca08141-979e-4519-88b3-c77e8a71ae3e => generated 1673 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 14 15:55:59.003371 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi [None req-22a9c43d-340f-455c-918f-cc929bb4285e tempest-VolumesSnapshotTestJSON-671752898 tempest-VolumesSnapshotTestJSON-671752898-project] Calling method '>' {{(pid=128729) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 15:55:59.004725 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.compute.api [None req-22a9c43d-340f-455c-918f-cc929bb4285e tempest-VolumesSnapshotTestJSON-671752898 tempest-VolumesSnapshotTestJSON-671752898-project] [instance: a1d28d7f-bade-404d-a453-e09a34fbb232] Fetching instance by UUID {{(pid=128729) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 15:55:59.011438 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-22a9c43d-340f-455c-918f-cc929bb4285e tempest-VolumesSnapshotTestJSON-671752898 tempest-VolumesSnapshotTestJSON-671752898-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:55:59.011961 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-22a9c43d-340f-455c-918f-cc929bb4285e tempest-VolumesSnapshotTestJSON-671752898 tempest-VolumesSnapshotTestJSON-671752898-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:55:59.012816 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-22a9c43d-340f-455c-918f-cc929bb4285e tempest-VolumesSnapshotTestJSON-671752898 tempest-VolumesSnapshotTestJSON-671752898-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:55:59.013331 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-22a9c43d-340f-455c-918f-cc929bb4285e tempest-VolumesSnapshotTestJSON-671752898 tempest-VolumesSnapshotTestJSON-671752898-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:55:59.144253 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.policy [None req-22a9c43d-340f-455c-918f-cc929bb4285e tempest-VolumesSnapshotTestJSON-671752898 tempest-VolumesSnapshotTestJSON-671752898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3e4193c9d9043c99ee5bee59f79f7a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ad8088ecb8a4f72a98ad70fa8be02b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128729) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:55:59.151579 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: INFO nova.api.openstack.requestlog [None req-22a9c43d-340f-455c-918f-cc929bb4285e tempest-VolumesSnapshotTestJSON-671752898 tempest-VolumesSnapshotTestJSON-671752898-project] 10.222.0.61 "GET /compute/v2.1/servers/a1d28d7f-bade-404d-a453-e09a34fbb232" status: 200 len: 1319 microversion: 2.1 time: 0.152157 May 14 15:55:59.152147 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: [pid: 128729|app: 0|req: 532/1080] 10.222.0.61 () {58 vars in 1235 bytes} [Sat May 14 15:55:58 2022] GET /compute/v2.1/servers/a1d28d7f-bade-404d-a453-e09a34fbb232 => generated 1319 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 15:55:59.280700 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi [None req-ed6eece0-23da-43e0-9a70-a48e72542312 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Calling method '>' {{(pid=128728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 15:55:59.282058 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.compute.api [None req-ed6eece0-23da-43e0-9a70-a48e72542312 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] [instance: cca08141-979e-4519-88b3-c77e8a71ae3e] Fetching instance by UUID {{(pid=128728) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 15:55:59.288710 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-ed6eece0-23da-43e0-9a70-a48e72542312 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:55:59.289411 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-ed6eece0-23da-43e0-9a70-a48e72542312 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:55:59.290202 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-ed6eece0-23da-43e0-9a70-a48e72542312 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:55:59.290663 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-ed6eece0-23da-43e0-9a70-a48e72542312 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:55:59.497972 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.policy [None req-ed6eece0-23da-43e0-9a70-a48e72542312 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58bfb7417bc94583963401ae0fe9d39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0672be3fa3f7414da1c1a5b7300abbe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128728) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:55:59.508764 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.policy [None req-ed6eece0-23da-43e0-9a70-a48e72542312 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58bfb7417bc94583963401ae0fe9d39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0672be3fa3f7414da1c1a5b7300abbe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128728) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:55:59.511406 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.policy [None req-ed6eece0-23da-43e0-9a70-a48e72542312 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58bfb7417bc94583963401ae0fe9d39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0672be3fa3f7414da1c1a5b7300abbe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128728) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:55:59.512714 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: INFO nova.api.openstack.requestlog [None req-ed6eece0-23da-43e0-9a70-a48e72542312 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] 10.222.0.61 "GET /compute/v2.1/servers/cca08141-979e-4519-88b3-c77e8a71ae3e" status: 200 len: 1731 microversion: 2.20 time: 0.235928 May 14 15:55:59.513635 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: [pid: 128728|app: 0|req: 549/1081] 10.222.0.61 () {60 vars in 1276 bytes} [Sat May 14 15:55:59 2022] GET /compute/v2.1/servers/cca08141-979e-4519-88b3-c77e8a71ae3e => generated 1731 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 14 15:56:00.169085 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi [None req-93e76d55-f06d-4b13-b310-06db774205b3 tempest-VolumesSnapshotTestJSON-671752898 tempest-VolumesSnapshotTestJSON-671752898-project] Calling method '>' {{(pid=128729) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 15:56:00.169875 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.compute.api [None req-93e76d55-f06d-4b13-b310-06db774205b3 tempest-VolumesSnapshotTestJSON-671752898 tempest-VolumesSnapshotTestJSON-671752898-project] [instance: a1d28d7f-bade-404d-a453-e09a34fbb232] Fetching instance by UUID {{(pid=128729) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 15:56:00.178172 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-93e76d55-f06d-4b13-b310-06db774205b3 tempest-VolumesSnapshotTestJSON-671752898 tempest-VolumesSnapshotTestJSON-671752898-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:56:00.178793 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-93e76d55-f06d-4b13-b310-06db774205b3 tempest-VolumesSnapshotTestJSON-671752898 tempest-VolumesSnapshotTestJSON-671752898-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:56:00.179678 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-93e76d55-f06d-4b13-b310-06db774205b3 tempest-VolumesSnapshotTestJSON-671752898 tempest-VolumesSnapshotTestJSON-671752898-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:56:00.180214 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-93e76d55-f06d-4b13-b310-06db774205b3 tempest-VolumesSnapshotTestJSON-671752898 tempest-VolumesSnapshotTestJSON-671752898-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:56:00.328946 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.policy [None req-93e76d55-f06d-4b13-b310-06db774205b3 tempest-VolumesSnapshotTestJSON-671752898 tempest-VolumesSnapshotTestJSON-671752898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3e4193c9d9043c99ee5bee59f79f7a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ad8088ecb8a4f72a98ad70fa8be02b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128729) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:56:00.336323 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: INFO nova.api.openstack.requestlog [None req-93e76d55-f06d-4b13-b310-06db774205b3 tempest-VolumesSnapshotTestJSON-671752898 tempest-VolumesSnapshotTestJSON-671752898-project] 10.222.0.61 "GET /compute/v2.1/servers/a1d28d7f-bade-404d-a453-e09a34fbb232" status: 200 len: 1319 microversion: 2.1 time: 0.171138 May 14 15:56:00.336907 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: [pid: 128729|app: 0|req: 533/1082] 10.222.0.61 () {58 vars in 1235 bytes} [Sat May 14 15:56:00 2022] GET /compute/v2.1/servers/a1d28d7f-bade-404d-a453-e09a34fbb232 => generated 1319 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 15:56:00.537757 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi [None req-3228224c-fae7-4fed-9270-af695b7c235e tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Calling method '>' {{(pid=128728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 15:56:00.539622 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.compute.api [None req-3228224c-fae7-4fed-9270-af695b7c235e tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] [instance: cca08141-979e-4519-88b3-c77e8a71ae3e] Fetching instance by UUID {{(pid=128728) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 15:56:00.548749 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-3228224c-fae7-4fed-9270-af695b7c235e tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:56:00.550003 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-3228224c-fae7-4fed-9270-af695b7c235e tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:56:00.551216 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-3228224c-fae7-4fed-9270-af695b7c235e tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:56:00.552259 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-3228224c-fae7-4fed-9270-af695b7c235e tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:56:00.705183 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.policy [None req-3228224c-fae7-4fed-9270-af695b7c235e tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58bfb7417bc94583963401ae0fe9d39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0672be3fa3f7414da1c1a5b7300abbe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128728) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:56:00.715064 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.policy [None req-3228224c-fae7-4fed-9270-af695b7c235e tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58bfb7417bc94583963401ae0fe9d39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0672be3fa3f7414da1c1a5b7300abbe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128728) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:56:00.717142 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.policy [None req-3228224c-fae7-4fed-9270-af695b7c235e tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58bfb7417bc94583963401ae0fe9d39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0672be3fa3f7414da1c1a5b7300abbe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128728) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:56:00.719300 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: INFO nova.api.openstack.requestlog [None req-3228224c-fae7-4fed-9270-af695b7c235e tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] 10.222.0.61 "GET /compute/v2.1/servers/cca08141-979e-4519-88b3-c77e8a71ae3e" status: 200 len: 1731 microversion: 2.20 time: 0.189329 May 14 15:56:00.720576 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: [pid: 128728|app: 0|req: 550/1083] 10.222.0.61 () {60 vars in 1276 bytes} [Sat May 14 15:56:00 2022] GET /compute/v2.1/servers/cca08141-979e-4519-88b3-c77e8a71ae3e => generated 1731 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 14 15:56:01.352898 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi [None req-83ff7473-f7fd-472c-9bf3-3ac11ad00be1 tempest-VolumesSnapshotTestJSON-671752898 tempest-VolumesSnapshotTestJSON-671752898-project] Calling method '>' {{(pid=128729) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 15:56:01.353511 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.compute.api [None req-83ff7473-f7fd-472c-9bf3-3ac11ad00be1 tempest-VolumesSnapshotTestJSON-671752898 tempest-VolumesSnapshotTestJSON-671752898-project] [instance: a1d28d7f-bade-404d-a453-e09a34fbb232] Fetching instance by UUID {{(pid=128729) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 15:56:01.360755 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-83ff7473-f7fd-472c-9bf3-3ac11ad00be1 tempest-VolumesSnapshotTestJSON-671752898 tempest-VolumesSnapshotTestJSON-671752898-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:56:01.361519 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-83ff7473-f7fd-472c-9bf3-3ac11ad00be1 tempest-VolumesSnapshotTestJSON-671752898 tempest-VolumesSnapshotTestJSON-671752898-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:56:01.362526 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-83ff7473-f7fd-472c-9bf3-3ac11ad00be1 tempest-VolumesSnapshotTestJSON-671752898 tempest-VolumesSnapshotTestJSON-671752898-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:56:01.363121 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-83ff7473-f7fd-472c-9bf3-3ac11ad00be1 tempest-VolumesSnapshotTestJSON-671752898 tempest-VolumesSnapshotTestJSON-671752898-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:56:01.517827 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.policy [None req-83ff7473-f7fd-472c-9bf3-3ac11ad00be1 tempest-VolumesSnapshotTestJSON-671752898 tempest-VolumesSnapshotTestJSON-671752898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3e4193c9d9043c99ee5bee59f79f7a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ad8088ecb8a4f72a98ad70fa8be02b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128729) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:56:01.525634 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: INFO nova.api.openstack.requestlog [None req-83ff7473-f7fd-472c-9bf3-3ac11ad00be1 tempest-VolumesSnapshotTestJSON-671752898 tempest-VolumesSnapshotTestJSON-671752898-project] 10.222.0.61 "GET /compute/v2.1/servers/a1d28d7f-bade-404d-a453-e09a34fbb232" status: 200 len: 1319 microversion: 2.1 time: 0.176503 May 14 15:56:01.526382 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: [pid: 128729|app: 0|req: 534/1084] 10.222.0.61 () {58 vars in 1235 bytes} [Sat May 14 15:56:01 2022] GET /compute/v2.1/servers/a1d28d7f-bade-404d-a453-e09a34fbb232 => generated 1319 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 15:56:01.558792 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi [req-7bf036f7-0567-4698-9518-7e95a473ef87 req-733f9e76-7b85-47fd-95aa-e5a38cd6cc63 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a1d28d7f-bade-404d-a453-e09a34fbb232", "name": "network-vif-plugged", "status": "completed", "tag": "5a791dcd-9407-4b8e-8d0a-a169fe794020"}]} {{(pid=128728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 15:56:01.569251 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [req-7bf036f7-0567-4698-9518-7e95a473ef87 req-733f9e76-7b85-47fd-95aa-e5a38cd6cc63 service nova] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:56:01.570198 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [req-7bf036f7-0567-4698-9518-7e95a473ef87 req-733f9e76-7b85-47fd-95aa-e5a38cd6cc63 service nova] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:56:01.583707 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: INFO nova.api.openstack.compute.server_external_events [req-7bf036f7-0567-4698-9518-7e95a473ef87 req-733f9e76-7b85-47fd-95aa-e5a38cd6cc63 service nova] Creating event network-vif-plugged:5a791dcd-9407-4b8e-8d0a-a169fe794020 for instance a1d28d7f-bade-404d-a453-e09a34fbb232 on hv-cinder-83979 May 14 15:56:01.590084 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: INFO nova.api.openstack.requestlog [req-7bf036f7-0567-4698-9518-7e95a473ef87 req-733f9e76-7b85-47fd-95aa-e5a38cd6cc63 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035202 May 14 15:56:01.591317 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: [pid: 128728|app: 0|req: 551/1085] 10.222.0.61 () {64 vars in 1317 bytes} [Sat May 14 15:56:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 14 15:56:01.737589 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi [None req-48493481-1460-454b-8c6e-1008a3d3fc29 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Calling method '>' {{(pid=128729) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 15:56:01.738189 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.compute.api [None req-48493481-1460-454b-8c6e-1008a3d3fc29 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] [instance: cca08141-979e-4519-88b3-c77e8a71ae3e] Fetching instance by UUID {{(pid=128729) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 15:56:01.744380 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-48493481-1460-454b-8c6e-1008a3d3fc29 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:56:01.744829 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-48493481-1460-454b-8c6e-1008a3d3fc29 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:56:01.745589 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-48493481-1460-454b-8c6e-1008a3d3fc29 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:56:01.746023 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-48493481-1460-454b-8c6e-1008a3d3fc29 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:56:01.883434 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.policy [None req-48493481-1460-454b-8c6e-1008a3d3fc29 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58bfb7417bc94583963401ae0fe9d39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0672be3fa3f7414da1c1a5b7300abbe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128729) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:56:01.892292 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.policy [None req-48493481-1460-454b-8c6e-1008a3d3fc29 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58bfb7417bc94583963401ae0fe9d39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0672be3fa3f7414da1c1a5b7300abbe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128729) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:56:01.894251 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.policy [None req-48493481-1460-454b-8c6e-1008a3d3fc29 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58bfb7417bc94583963401ae0fe9d39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0672be3fa3f7414da1c1a5b7300abbe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128729) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:56:01.895670 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: INFO nova.api.openstack.requestlog [None req-48493481-1460-454b-8c6e-1008a3d3fc29 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] 10.222.0.61 "GET /compute/v2.1/servers/cca08141-979e-4519-88b3-c77e8a71ae3e" status: 200 len: 1731 microversion: 2.20 time: 0.162598 May 14 15:56:01.906359 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: [pid: 128729|app: 0|req: 535/1086] 10.222.0.61 () {60 vars in 1276 bytes} [Sat May 14 15:56:01 2022] GET /compute/v2.1/servers/cca08141-979e-4519-88b3-c77e8a71ae3e => generated 1731 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 14 15:56:02.543127 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi [None req-dcb56c61-8b4c-40b5-a2be-5195ef9d743b tempest-VolumesSnapshotTestJSON-671752898 tempest-VolumesSnapshotTestJSON-671752898-project] Calling method '>' {{(pid=128728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 15:56:02.544121 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.compute.api [None req-dcb56c61-8b4c-40b5-a2be-5195ef9d743b tempest-VolumesSnapshotTestJSON-671752898 tempest-VolumesSnapshotTestJSON-671752898-project] [instance: a1d28d7f-bade-404d-a453-e09a34fbb232] Fetching instance by UUID {{(pid=128728) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 15:56:02.551078 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-dcb56c61-8b4c-40b5-a2be-5195ef9d743b tempest-VolumesSnapshotTestJSON-671752898 tempest-VolumesSnapshotTestJSON-671752898-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:56:02.551526 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-dcb56c61-8b4c-40b5-a2be-5195ef9d743b tempest-VolumesSnapshotTestJSON-671752898 tempest-VolumesSnapshotTestJSON-671752898-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:56:02.552307 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-dcb56c61-8b4c-40b5-a2be-5195ef9d743b tempest-VolumesSnapshotTestJSON-671752898 tempest-VolumesSnapshotTestJSON-671752898-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:56:02.552739 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-dcb56c61-8b4c-40b5-a2be-5195ef9d743b tempest-VolumesSnapshotTestJSON-671752898 tempest-VolumesSnapshotTestJSON-671752898-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:56:02.693101 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.policy [None req-dcb56c61-8b4c-40b5-a2be-5195ef9d743b tempest-VolumesSnapshotTestJSON-671752898 tempest-VolumesSnapshotTestJSON-671752898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3e4193c9d9043c99ee5bee59f79f7a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ad8088ecb8a4f72a98ad70fa8be02b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128728) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:56:02.700570 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: INFO nova.api.openstack.requestlog [None req-dcb56c61-8b4c-40b5-a2be-5195ef9d743b tempest-VolumesSnapshotTestJSON-671752898 tempest-VolumesSnapshotTestJSON-671752898-project] 10.222.0.61 "GET /compute/v2.1/servers/a1d28d7f-bade-404d-a453-e09a34fbb232" status: 200 len: 1319 microversion: 2.1 time: 0.161509 May 14 15:56:02.701144 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: [pid: 128728|app: 0|req: 552/1087] 10.222.0.61 () {58 vars in 1235 bytes} [Sat May 14 15:56:02 2022] GET /compute/v2.1/servers/a1d28d7f-bade-404d-a453-e09a34fbb232 => generated 1319 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 15:56:02.914953 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi [None req-7cfc4475-acbe-42fd-bbe4-acb8d3c205fd tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Calling method '>' {{(pid=128729) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 15:56:02.915563 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.compute.api [None req-7cfc4475-acbe-42fd-bbe4-acb8d3c205fd tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] [instance: cca08141-979e-4519-88b3-c77e8a71ae3e] Fetching instance by UUID {{(pid=128729) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 15:56:02.921860 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-7cfc4475-acbe-42fd-bbe4-acb8d3c205fd tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:56:02.922322 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-7cfc4475-acbe-42fd-bbe4-acb8d3c205fd tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:56:02.923145 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-7cfc4475-acbe-42fd-bbe4-acb8d3c205fd tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:56:02.923584 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-7cfc4475-acbe-42fd-bbe4-acb8d3c205fd tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:56:03.057570 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.policy [None req-7cfc4475-acbe-42fd-bbe4-acb8d3c205fd tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58bfb7417bc94583963401ae0fe9d39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0672be3fa3f7414da1c1a5b7300abbe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128729) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:56:03.066921 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.policy [None req-7cfc4475-acbe-42fd-bbe4-acb8d3c205fd tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58bfb7417bc94583963401ae0fe9d39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0672be3fa3f7414da1c1a5b7300abbe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128729) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:56:03.068509 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.policy [None req-7cfc4475-acbe-42fd-bbe4-acb8d3c205fd tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58bfb7417bc94583963401ae0fe9d39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0672be3fa3f7414da1c1a5b7300abbe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128729) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:56:03.069689 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: INFO nova.api.openstack.requestlog [None req-7cfc4475-acbe-42fd-bbe4-acb8d3c205fd tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] 10.222.0.61 "GET /compute/v2.1/servers/cca08141-979e-4519-88b3-c77e8a71ae3e" status: 200 len: 1731 microversion: 2.20 time: 0.158659 May 14 15:56:03.070249 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: [pid: 128729|app: 0|req: 536/1088] 10.222.0.61 () {60 vars in 1276 bytes} [Sat May 14 15:56:02 2022] GET /compute/v2.1/servers/cca08141-979e-4519-88b3-c77e8a71ae3e => generated 1731 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 14 15:56:03.718799 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi [None req-c1f94cea-440b-465f-add4-1ef46099dace tempest-VolumesSnapshotTestJSON-671752898 tempest-VolumesSnapshotTestJSON-671752898-project] Calling method '>' {{(pid=128728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 15:56:03.719345 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.compute.api [None req-c1f94cea-440b-465f-add4-1ef46099dace tempest-VolumesSnapshotTestJSON-671752898 tempest-VolumesSnapshotTestJSON-671752898-project] [instance: a1d28d7f-bade-404d-a453-e09a34fbb232] Fetching instance by UUID {{(pid=128728) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 15:56:03.732476 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-c1f94cea-440b-465f-add4-1ef46099dace tempest-VolumesSnapshotTestJSON-671752898 tempest-VolumesSnapshotTestJSON-671752898-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:56:03.732934 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-c1f94cea-440b-465f-add4-1ef46099dace tempest-VolumesSnapshotTestJSON-671752898 tempest-VolumesSnapshotTestJSON-671752898-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:56:03.733732 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-c1f94cea-440b-465f-add4-1ef46099dace tempest-VolumesSnapshotTestJSON-671752898 tempest-VolumesSnapshotTestJSON-671752898-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:56:03.734173 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-c1f94cea-440b-465f-add4-1ef46099dace tempest-VolumesSnapshotTestJSON-671752898 tempest-VolumesSnapshotTestJSON-671752898-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:56:03.878548 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.policy [None req-c1f94cea-440b-465f-add4-1ef46099dace tempest-VolumesSnapshotTestJSON-671752898 tempest-VolumesSnapshotTestJSON-671752898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3e4193c9d9043c99ee5bee59f79f7a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ad8088ecb8a4f72a98ad70fa8be02b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128728) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:56:03.885797 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: INFO nova.api.openstack.requestlog [None req-c1f94cea-440b-465f-add4-1ef46099dace tempest-VolumesSnapshotTestJSON-671752898 tempest-VolumesSnapshotTestJSON-671752898-project] 10.222.0.61 "GET /compute/v2.1/servers/a1d28d7f-bade-404d-a453-e09a34fbb232" status: 200 len: 1319 microversion: 2.1 time: 0.170894 May 14 15:56:03.886378 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: [pid: 128728|app: 0|req: 553/1089] 10.222.0.61 () {58 vars in 1235 bytes} [Sat May 14 15:56:03 2022] GET /compute/v2.1/servers/a1d28d7f-bade-404d-a453-e09a34fbb232 => generated 1319 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 15:56:04.088658 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi [None req-28e2ef2a-4286-4ebc-a04c-751de5b11c2a tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Calling method '>' {{(pid=128729) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 15:56:04.089261 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.compute.api [None req-28e2ef2a-4286-4ebc-a04c-751de5b11c2a tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] [instance: cca08141-979e-4519-88b3-c77e8a71ae3e] Fetching instance by UUID {{(pid=128729) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 15:56:04.095668 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-28e2ef2a-4286-4ebc-a04c-751de5b11c2a tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:56:04.096109 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-28e2ef2a-4286-4ebc-a04c-751de5b11c2a tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:56:04.096863 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-28e2ef2a-4286-4ebc-a04c-751de5b11c2a tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:56:04.097294 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-28e2ef2a-4286-4ebc-a04c-751de5b11c2a tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:56:04.234208 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.policy [None req-28e2ef2a-4286-4ebc-a04c-751de5b11c2a tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58bfb7417bc94583963401ae0fe9d39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0672be3fa3f7414da1c1a5b7300abbe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128729) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:56:04.243192 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.policy [None req-28e2ef2a-4286-4ebc-a04c-751de5b11c2a tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58bfb7417bc94583963401ae0fe9d39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0672be3fa3f7414da1c1a5b7300abbe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128729) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:56:04.244688 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.policy [None req-28e2ef2a-4286-4ebc-a04c-751de5b11c2a tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58bfb7417bc94583963401ae0fe9d39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0672be3fa3f7414da1c1a5b7300abbe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128729) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:56:04.245837 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: INFO nova.api.openstack.requestlog [None req-28e2ef2a-4286-4ebc-a04c-751de5b11c2a tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] 10.222.0.61 "GET /compute/v2.1/servers/cca08141-979e-4519-88b3-c77e8a71ae3e" status: 200 len: 1731 microversion: 2.20 time: 0.161294 May 14 15:56:04.246413 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: [pid: 128729|app: 0|req: 537/1090] 10.222.0.61 () {60 vars in 1276 bytes} [Sat May 14 15:56:04 2022] GET /compute/v2.1/servers/cca08141-979e-4519-88b3-c77e8a71ae3e => generated 1731 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 14 15:56:04.902628 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi [None req-27a912d0-4776-42fa-b88d-5a5df55aaed3 tempest-VolumesSnapshotTestJSON-671752898 tempest-VolumesSnapshotTestJSON-671752898-project] Calling method '>' {{(pid=128728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 15:56:04.903244 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.compute.api [None req-27a912d0-4776-42fa-b88d-5a5df55aaed3 tempest-VolumesSnapshotTestJSON-671752898 tempest-VolumesSnapshotTestJSON-671752898-project] [instance: a1d28d7f-bade-404d-a453-e09a34fbb232] Fetching instance by UUID {{(pid=128728) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 15:56:04.909593 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-27a912d0-4776-42fa-b88d-5a5df55aaed3 tempest-VolumesSnapshotTestJSON-671752898 tempest-VolumesSnapshotTestJSON-671752898-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:56:04.910058 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-27a912d0-4776-42fa-b88d-5a5df55aaed3 tempest-VolumesSnapshotTestJSON-671752898 tempest-VolumesSnapshotTestJSON-671752898-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:56:04.910856 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-27a912d0-4776-42fa-b88d-5a5df55aaed3 tempest-VolumesSnapshotTestJSON-671752898 tempest-VolumesSnapshotTestJSON-671752898-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:56:04.911299 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-27a912d0-4776-42fa-b88d-5a5df55aaed3 tempest-VolumesSnapshotTestJSON-671752898 tempest-VolumesSnapshotTestJSON-671752898-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:56:05.047627 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.policy [None req-27a912d0-4776-42fa-b88d-5a5df55aaed3 tempest-VolumesSnapshotTestJSON-671752898 tempest-VolumesSnapshotTestJSON-671752898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3e4193c9d9043c99ee5bee59f79f7a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ad8088ecb8a4f72a98ad70fa8be02b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128728) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:56:05.055802 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: INFO nova.api.openstack.requestlog [None req-27a912d0-4776-42fa-b88d-5a5df55aaed3 tempest-VolumesSnapshotTestJSON-671752898 tempest-VolumesSnapshotTestJSON-671752898-project] 10.222.0.61 "GET /compute/v2.1/servers/a1d28d7f-bade-404d-a453-e09a34fbb232" status: 200 len: 1319 microversion: 2.1 time: 0.157010 May 14 15:56:05.056564 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: [pid: 128728|app: 0|req: 554/1091] 10.222.0.61 () {58 vars in 1235 bytes} [Sat May 14 15:56:04 2022] GET /compute/v2.1/servers/a1d28d7f-bade-404d-a453-e09a34fbb232 => generated 1319 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 15:56:05.267417 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi [None req-ab7fc0ef-4af2-4837-9f6a-f00b79596f14 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Calling method '>' {{(pid=128729) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 15:56:05.267994 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.compute.api [None req-ab7fc0ef-4af2-4837-9f6a-f00b79596f14 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] [instance: cca08141-979e-4519-88b3-c77e8a71ae3e] Fetching instance by UUID {{(pid=128729) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 15:56:05.274250 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-ab7fc0ef-4af2-4837-9f6a-f00b79596f14 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:56:05.274732 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-ab7fc0ef-4af2-4837-9f6a-f00b79596f14 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:56:05.275492 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-ab7fc0ef-4af2-4837-9f6a-f00b79596f14 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:56:05.276032 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-ab7fc0ef-4af2-4837-9f6a-f00b79596f14 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:56:05.413730 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.policy [None req-ab7fc0ef-4af2-4837-9f6a-f00b79596f14 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58bfb7417bc94583963401ae0fe9d39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0672be3fa3f7414da1c1a5b7300abbe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128729) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:56:05.422143 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.policy [None req-ab7fc0ef-4af2-4837-9f6a-f00b79596f14 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58bfb7417bc94583963401ae0fe9d39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0672be3fa3f7414da1c1a5b7300abbe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128729) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:56:05.424337 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.policy [None req-ab7fc0ef-4af2-4837-9f6a-f00b79596f14 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58bfb7417bc94583963401ae0fe9d39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0672be3fa3f7414da1c1a5b7300abbe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128729) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:56:05.426411 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: INFO nova.api.openstack.requestlog [None req-ab7fc0ef-4af2-4837-9f6a-f00b79596f14 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] 10.222.0.61 "GET /compute/v2.1/servers/cca08141-979e-4519-88b3-c77e8a71ae3e" status: 200 len: 1731 microversion: 2.20 time: 0.162938 May 14 15:56:05.436729 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: [pid: 128729|app: 0|req: 538/1092] 10.222.0.61 () {60 vars in 1276 bytes} [Sat May 14 15:56:05 2022] GET /compute/v2.1/servers/cca08141-979e-4519-88b3-c77e8a71ae3e => generated 1731 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 14 15:56:06.073184 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi [None req-5e7b4fa3-f74e-4c26-aec1-743e631caa86 tempest-VolumesSnapshotTestJSON-671752898 tempest-VolumesSnapshotTestJSON-671752898-project] Calling method '>' {{(pid=128728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 15:56:06.073797 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.compute.api [None req-5e7b4fa3-f74e-4c26-aec1-743e631caa86 tempest-VolumesSnapshotTestJSON-671752898 tempest-VolumesSnapshotTestJSON-671752898-project] [instance: a1d28d7f-bade-404d-a453-e09a34fbb232] Fetching instance by UUID {{(pid=128728) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 15:56:06.080844 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-5e7b4fa3-f74e-4c26-aec1-743e631caa86 tempest-VolumesSnapshotTestJSON-671752898 tempest-VolumesSnapshotTestJSON-671752898-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:56:06.081298 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-5e7b4fa3-f74e-4c26-aec1-743e631caa86 tempest-VolumesSnapshotTestJSON-671752898 tempest-VolumesSnapshotTestJSON-671752898-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:56:06.082065 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-5e7b4fa3-f74e-4c26-aec1-743e631caa86 tempest-VolumesSnapshotTestJSON-671752898 tempest-VolumesSnapshotTestJSON-671752898-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:56:06.082536 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-5e7b4fa3-f74e-4c26-aec1-743e631caa86 tempest-VolumesSnapshotTestJSON-671752898 tempest-VolumesSnapshotTestJSON-671752898-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:56:06.218114 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.policy [None req-5e7b4fa3-f74e-4c26-aec1-743e631caa86 tempest-VolumesSnapshotTestJSON-671752898 tempest-VolumesSnapshotTestJSON-671752898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3e4193c9d9043c99ee5bee59f79f7a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ad8088ecb8a4f72a98ad70fa8be02b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128728) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:56:06.226238 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: INFO nova.api.openstack.requestlog [None req-5e7b4fa3-f74e-4c26-aec1-743e631caa86 tempest-VolumesSnapshotTestJSON-671752898 tempest-VolumesSnapshotTestJSON-671752898-project] 10.222.0.61 "GET /compute/v2.1/servers/a1d28d7f-bade-404d-a453-e09a34fbb232" status: 200 len: 1319 microversion: 2.1 time: 0.156882 May 14 15:56:06.226836 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: [pid: 128728|app: 0|req: 555/1093] 10.222.0.61 () {58 vars in 1235 bytes} [Sat May 14 15:56:06 2022] GET /compute/v2.1/servers/a1d28d7f-bade-404d-a453-e09a34fbb232 => generated 1319 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 15:56:06.444859 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi [None req-a13a197c-219e-4a32-800f-9b0917c0af91 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Calling method '>' {{(pid=128729) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 15:56:06.445406 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.compute.api [None req-a13a197c-219e-4a32-800f-9b0917c0af91 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] [instance: cca08141-979e-4519-88b3-c77e8a71ae3e] Fetching instance by UUID {{(pid=128729) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 15:56:06.451792 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-a13a197c-219e-4a32-800f-9b0917c0af91 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:56:06.452245 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-a13a197c-219e-4a32-800f-9b0917c0af91 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:56:06.453022 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-a13a197c-219e-4a32-800f-9b0917c0af91 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:56:06.453459 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-a13a197c-219e-4a32-800f-9b0917c0af91 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:56:06.590585 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.policy [None req-a13a197c-219e-4a32-800f-9b0917c0af91 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58bfb7417bc94583963401ae0fe9d39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0672be3fa3f7414da1c1a5b7300abbe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128729) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:56:06.599318 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.policy [None req-a13a197c-219e-4a32-800f-9b0917c0af91 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58bfb7417bc94583963401ae0fe9d39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0672be3fa3f7414da1c1a5b7300abbe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128729) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:56:06.600919 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.policy [None req-a13a197c-219e-4a32-800f-9b0917c0af91 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58bfb7417bc94583963401ae0fe9d39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0672be3fa3f7414da1c1a5b7300abbe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128729) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:56:06.602157 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: INFO nova.api.openstack.requestlog [None req-a13a197c-219e-4a32-800f-9b0917c0af91 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] 10.222.0.61 "GET /compute/v2.1/servers/cca08141-979e-4519-88b3-c77e8a71ae3e" status: 200 len: 1731 microversion: 2.20 time: 0.161264 May 14 15:56:06.602756 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: [pid: 128729|app: 0|req: 539/1094] 10.222.0.61 () {60 vars in 1276 bytes} [Sat May 14 15:56:06 2022] GET /compute/v2.1/servers/cca08141-979e-4519-88b3-c77e8a71ae3e => generated 1731 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 14 15:56:07.245167 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi [None req-8f4255c6-51eb-4473-9e4b-4c4d3a648106 tempest-VolumesSnapshotTestJSON-671752898 tempest-VolumesSnapshotTestJSON-671752898-project] Calling method '>' {{(pid=128728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 15:56:07.245775 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.compute.api [None req-8f4255c6-51eb-4473-9e4b-4c4d3a648106 tempest-VolumesSnapshotTestJSON-671752898 tempest-VolumesSnapshotTestJSON-671752898-project] [instance: a1d28d7f-bade-404d-a453-e09a34fbb232] Fetching instance by UUID {{(pid=128728) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 15:56:07.252710 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-8f4255c6-51eb-4473-9e4b-4c4d3a648106 tempest-VolumesSnapshotTestJSON-671752898 tempest-VolumesSnapshotTestJSON-671752898-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:56:07.253170 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-8f4255c6-51eb-4473-9e4b-4c4d3a648106 tempest-VolumesSnapshotTestJSON-671752898 tempest-VolumesSnapshotTestJSON-671752898-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:56:07.253974 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-8f4255c6-51eb-4473-9e4b-4c4d3a648106 tempest-VolumesSnapshotTestJSON-671752898 tempest-VolumesSnapshotTestJSON-671752898-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:56:07.254429 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-8f4255c6-51eb-4473-9e4b-4c4d3a648106 tempest-VolumesSnapshotTestJSON-671752898 tempest-VolumesSnapshotTestJSON-671752898-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:56:07.399210 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.policy [None req-8f4255c6-51eb-4473-9e4b-4c4d3a648106 tempest-VolumesSnapshotTestJSON-671752898 tempest-VolumesSnapshotTestJSON-671752898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3e4193c9d9043c99ee5bee59f79f7a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ad8088ecb8a4f72a98ad70fa8be02b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128728) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:56:07.407128 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: INFO nova.api.openstack.requestlog [None req-8f4255c6-51eb-4473-9e4b-4c4d3a648106 tempest-VolumesSnapshotTestJSON-671752898 tempest-VolumesSnapshotTestJSON-671752898-project] 10.222.0.61 "GET /compute/v2.1/servers/a1d28d7f-bade-404d-a453-e09a34fbb232" status: 200 len: 1319 microversion: 2.1 time: 0.165959 May 14 15:56:07.411114 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: [pid: 128728|app: 0|req: 556/1095] 10.222.0.61 () {58 vars in 1235 bytes} [Sat May 14 15:56:07 2022] GET /compute/v2.1/servers/a1d28d7f-bade-404d-a453-e09a34fbb232 => generated 1319 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 15:56:07.622890 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi [None req-1d9470d9-7d33-4d29-bae7-b44e32d3eba5 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Calling method '>' {{(pid=128729) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 15:56:07.623541 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.compute.api [None req-1d9470d9-7d33-4d29-bae7-b44e32d3eba5 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] [instance: cca08141-979e-4519-88b3-c77e8a71ae3e] Fetching instance by UUID {{(pid=128729) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 15:56:07.630418 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-1d9470d9-7d33-4d29-bae7-b44e32d3eba5 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:56:07.630879 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-1d9470d9-7d33-4d29-bae7-b44e32d3eba5 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:56:07.631669 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-1d9470d9-7d33-4d29-bae7-b44e32d3eba5 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:56:07.632110 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-1d9470d9-7d33-4d29-bae7-b44e32d3eba5 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:56:07.763967 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.policy [None req-1d9470d9-7d33-4d29-bae7-b44e32d3eba5 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58bfb7417bc94583963401ae0fe9d39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0672be3fa3f7414da1c1a5b7300abbe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128729) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:56:07.773742 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.policy [None req-1d9470d9-7d33-4d29-bae7-b44e32d3eba5 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58bfb7417bc94583963401ae0fe9d39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0672be3fa3f7414da1c1a5b7300abbe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128729) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:56:07.775420 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.policy [None req-1d9470d9-7d33-4d29-bae7-b44e32d3eba5 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58bfb7417bc94583963401ae0fe9d39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0672be3fa3f7414da1c1a5b7300abbe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128729) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:56:07.776675 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: INFO nova.api.openstack.requestlog [None req-1d9470d9-7d33-4d29-bae7-b44e32d3eba5 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] 10.222.0.61 "GET /compute/v2.1/servers/cca08141-979e-4519-88b3-c77e8a71ae3e" status: 200 len: 1731 microversion: 2.20 time: 0.158736 May 14 15:56:07.777547 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: [pid: 128729|app: 0|req: 540/1096] 10.222.0.61 () {60 vars in 1276 bytes} [Sat May 14 15:56:07 2022] GET /compute/v2.1/servers/cca08141-979e-4519-88b3-c77e8a71ae3e => generated 1731 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 14 15:56:08.424417 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi [None req-6f9514b6-ec06-4b6e-809d-327389330af3 tempest-VolumesSnapshotTestJSON-671752898 tempest-VolumesSnapshotTestJSON-671752898-project] Calling method '>' {{(pid=128728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 15:56:08.425029 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.compute.api [None req-6f9514b6-ec06-4b6e-809d-327389330af3 tempest-VolumesSnapshotTestJSON-671752898 tempest-VolumesSnapshotTestJSON-671752898-project] [instance: a1d28d7f-bade-404d-a453-e09a34fbb232] Fetching instance by UUID {{(pid=128728) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 15:56:08.431311 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-6f9514b6-ec06-4b6e-809d-327389330af3 tempest-VolumesSnapshotTestJSON-671752898 tempest-VolumesSnapshotTestJSON-671752898-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:56:08.431765 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-6f9514b6-ec06-4b6e-809d-327389330af3 tempest-VolumesSnapshotTestJSON-671752898 tempest-VolumesSnapshotTestJSON-671752898-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:56:08.432644 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-6f9514b6-ec06-4b6e-809d-327389330af3 tempest-VolumesSnapshotTestJSON-671752898 tempest-VolumesSnapshotTestJSON-671752898-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:56:08.433091 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-6f9514b6-ec06-4b6e-809d-327389330af3 tempest-VolumesSnapshotTestJSON-671752898 tempest-VolumesSnapshotTestJSON-671752898-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:56:08.568579 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.policy [None req-6f9514b6-ec06-4b6e-809d-327389330af3 tempest-VolumesSnapshotTestJSON-671752898 tempest-VolumesSnapshotTestJSON-671752898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3e4193c9d9043c99ee5bee59f79f7a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ad8088ecb8a4f72a98ad70fa8be02b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128728) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:56:08.575818 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: INFO nova.api.openstack.requestlog [None req-6f9514b6-ec06-4b6e-809d-327389330af3 tempest-VolumesSnapshotTestJSON-671752898 tempest-VolumesSnapshotTestJSON-671752898-project] 10.222.0.61 "GET /compute/v2.1/servers/a1d28d7f-bade-404d-a453-e09a34fbb232" status: 200 len: 1319 microversion: 2.1 time: 0.155341 May 14 15:56:08.576387 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: [pid: 128728|app: 0|req: 557/1097] 10.222.0.61 () {58 vars in 1235 bytes} [Sat May 14 15:56:08 2022] GET /compute/v2.1/servers/a1d28d7f-bade-404d-a453-e09a34fbb232 => generated 1319 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 15:56:08.795536 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi [None req-3861d33d-b2fd-44f4-b261-7eb02a9ea9f2 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Calling method '>' {{(pid=128729) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 15:56:08.796160 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.compute.api [None req-3861d33d-b2fd-44f4-b261-7eb02a9ea9f2 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] [instance: cca08141-979e-4519-88b3-c77e8a71ae3e] Fetching instance by UUID {{(pid=128729) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 15:56:08.804228 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-3861d33d-b2fd-44f4-b261-7eb02a9ea9f2 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:56:08.805537 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-3861d33d-b2fd-44f4-b261-7eb02a9ea9f2 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:56:08.807327 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-3861d33d-b2fd-44f4-b261-7eb02a9ea9f2 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:56:08.808558 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-3861d33d-b2fd-44f4-b261-7eb02a9ea9f2 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:56:08.960158 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.policy [None req-3861d33d-b2fd-44f4-b261-7eb02a9ea9f2 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58bfb7417bc94583963401ae0fe9d39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0672be3fa3f7414da1c1a5b7300abbe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128729) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:56:08.968320 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.policy [None req-3861d33d-b2fd-44f4-b261-7eb02a9ea9f2 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58bfb7417bc94583963401ae0fe9d39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0672be3fa3f7414da1c1a5b7300abbe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128729) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:56:08.969844 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.policy [None req-3861d33d-b2fd-44f4-b261-7eb02a9ea9f2 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58bfb7417bc94583963401ae0fe9d39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0672be3fa3f7414da1c1a5b7300abbe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128729) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:56:08.971953 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: INFO nova.api.openstack.requestlog [None req-3861d33d-b2fd-44f4-b261-7eb02a9ea9f2 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] 10.222.0.61 "GET /compute/v2.1/servers/cca08141-979e-4519-88b3-c77e8a71ae3e" status: 200 len: 1731 microversion: 2.20 time: 0.179904 May 14 15:56:08.976726 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: [pid: 128729|app: 0|req: 541/1098] 10.222.0.61 () {60 vars in 1276 bytes} [Sat May 14 15:56:08 2022] GET /compute/v2.1/servers/cca08141-979e-4519-88b3-c77e8a71ae3e => generated 1731 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 14 15:56:09.592922 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi [None req-707f3586-f4e7-4e04-8c49-ad877086c46f tempest-VolumesSnapshotTestJSON-671752898 tempest-VolumesSnapshotTestJSON-671752898-project] Calling method '>' {{(pid=128728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 15:56:09.593776 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.compute.api [None req-707f3586-f4e7-4e04-8c49-ad877086c46f tempest-VolumesSnapshotTestJSON-671752898 tempest-VolumesSnapshotTestJSON-671752898-project] [instance: a1d28d7f-bade-404d-a453-e09a34fbb232] Fetching instance by UUID {{(pid=128728) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 15:56:09.601280 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-707f3586-f4e7-4e04-8c49-ad877086c46f tempest-VolumesSnapshotTestJSON-671752898 tempest-VolumesSnapshotTestJSON-671752898-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:56:09.601894 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-707f3586-f4e7-4e04-8c49-ad877086c46f tempest-VolumesSnapshotTestJSON-671752898 tempest-VolumesSnapshotTestJSON-671752898-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:56:09.602809 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-707f3586-f4e7-4e04-8c49-ad877086c46f tempest-VolumesSnapshotTestJSON-671752898 tempest-VolumesSnapshotTestJSON-671752898-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:56:09.603329 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-707f3586-f4e7-4e04-8c49-ad877086c46f tempest-VolumesSnapshotTestJSON-671752898 tempest-VolumesSnapshotTestJSON-671752898-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:56:09.739143 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.policy [None req-707f3586-f4e7-4e04-8c49-ad877086c46f tempest-VolumesSnapshotTestJSON-671752898 tempest-VolumesSnapshotTestJSON-671752898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3e4193c9d9043c99ee5bee59f79f7a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ad8088ecb8a4f72a98ad70fa8be02b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128728) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:56:09.747400 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: INFO nova.api.openstack.requestlog [None req-707f3586-f4e7-4e04-8c49-ad877086c46f tempest-VolumesSnapshotTestJSON-671752898 tempest-VolumesSnapshotTestJSON-671752898-project] 10.222.0.61 "GET /compute/v2.1/servers/a1d28d7f-bade-404d-a453-e09a34fbb232" status: 200 len: 1319 microversion: 2.1 time: 0.158253 May 14 15:56:09.747973 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: [pid: 128728|app: 0|req: 558/1099] 10.222.0.61 () {58 vars in 1235 bytes} [Sat May 14 15:56:09 2022] GET /compute/v2.1/servers/a1d28d7f-bade-404d-a453-e09a34fbb232 => generated 1319 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 15:56:09.990423 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi [None req-0bfdda95-220f-4ed8-bd60-8c3193f37235 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Calling method '>' {{(pid=128729) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 15:56:09.990984 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.compute.api [None req-0bfdda95-220f-4ed8-bd60-8c3193f37235 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] [instance: cca08141-979e-4519-88b3-c77e8a71ae3e] Fetching instance by UUID {{(pid=128729) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 15:56:09.997847 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-0bfdda95-220f-4ed8-bd60-8c3193f37235 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:56:09.998296 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-0bfdda95-220f-4ed8-bd60-8c3193f37235 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:56:09.999099 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-0bfdda95-220f-4ed8-bd60-8c3193f37235 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:56:09.999534 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-0bfdda95-220f-4ed8-bd60-8c3193f37235 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:56:10.133467 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.policy [None req-0bfdda95-220f-4ed8-bd60-8c3193f37235 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58bfb7417bc94583963401ae0fe9d39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0672be3fa3f7414da1c1a5b7300abbe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128729) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:56:10.141567 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.policy [None req-0bfdda95-220f-4ed8-bd60-8c3193f37235 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58bfb7417bc94583963401ae0fe9d39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0672be3fa3f7414da1c1a5b7300abbe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128729) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:56:10.143833 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.policy [None req-0bfdda95-220f-4ed8-bd60-8c3193f37235 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58bfb7417bc94583963401ae0fe9d39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0672be3fa3f7414da1c1a5b7300abbe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128729) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:56:10.144990 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: INFO nova.api.openstack.requestlog [None req-0bfdda95-220f-4ed8-bd60-8c3193f37235 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] 10.222.0.61 "GET /compute/v2.1/servers/cca08141-979e-4519-88b3-c77e8a71ae3e" status: 200 len: 1731 microversion: 2.20 time: 0.158881 May 14 15:56:10.145544 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: [pid: 128729|app: 0|req: 542/1100] 10.222.0.61 () {60 vars in 1276 bytes} [Sat May 14 15:56:09 2022] GET /compute/v2.1/servers/cca08141-979e-4519-88b3-c77e8a71ae3e => generated 1731 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 14 15:56:10.764210 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi [None req-8b23f884-5af0-43e2-bf5b-dfede52afe68 tempest-VolumesSnapshotTestJSON-671752898 tempest-VolumesSnapshotTestJSON-671752898-project] Calling method '>' {{(pid=128728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 15:56:10.764809 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.compute.api [None req-8b23f884-5af0-43e2-bf5b-dfede52afe68 tempest-VolumesSnapshotTestJSON-671752898 tempest-VolumesSnapshotTestJSON-671752898-project] [instance: a1d28d7f-bade-404d-a453-e09a34fbb232] Fetching instance by UUID {{(pid=128728) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 15:56:10.771807 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-8b23f884-5af0-43e2-bf5b-dfede52afe68 tempest-VolumesSnapshotTestJSON-671752898 tempest-VolumesSnapshotTestJSON-671752898-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:56:10.772253 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-8b23f884-5af0-43e2-bf5b-dfede52afe68 tempest-VolumesSnapshotTestJSON-671752898 tempest-VolumesSnapshotTestJSON-671752898-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:56:10.773025 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-8b23f884-5af0-43e2-bf5b-dfede52afe68 tempest-VolumesSnapshotTestJSON-671752898 tempest-VolumesSnapshotTestJSON-671752898-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:56:10.773456 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-8b23f884-5af0-43e2-bf5b-dfede52afe68 tempest-VolumesSnapshotTestJSON-671752898 tempest-VolumesSnapshotTestJSON-671752898-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:56:10.904846 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.policy [None req-8b23f884-5af0-43e2-bf5b-dfede52afe68 tempest-VolumesSnapshotTestJSON-671752898 tempest-VolumesSnapshotTestJSON-671752898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3e4193c9d9043c99ee5bee59f79f7a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ad8088ecb8a4f72a98ad70fa8be02b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128728) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:56:10.912239 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: INFO nova.api.openstack.requestlog [None req-8b23f884-5af0-43e2-bf5b-dfede52afe68 tempest-VolumesSnapshotTestJSON-671752898 tempest-VolumesSnapshotTestJSON-671752898-project] 10.222.0.61 "GET /compute/v2.1/servers/a1d28d7f-bade-404d-a453-e09a34fbb232" status: 200 len: 1319 microversion: 2.1 time: 0.151828 May 14 15:56:10.912809 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: [pid: 128728|app: 0|req: 559/1101] 10.222.0.61 () {58 vars in 1235 bytes} [Sat May 14 15:56:10 2022] GET /compute/v2.1/servers/a1d28d7f-bade-404d-a453-e09a34fbb232 => generated 1319 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 15:56:11.163758 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi [None req-de2a91bd-b240-4d4a-b713-5ab4c5b8997a tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Calling method '>' {{(pid=128729) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 15:56:11.164396 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.compute.api [None req-de2a91bd-b240-4d4a-b713-5ab4c5b8997a tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] [instance: cca08141-979e-4519-88b3-c77e8a71ae3e] Fetching instance by UUID {{(pid=128729) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 15:56:11.170289 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-de2a91bd-b240-4d4a-b713-5ab4c5b8997a tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:56:11.170765 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-de2a91bd-b240-4d4a-b713-5ab4c5b8997a tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:56:11.171534 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-de2a91bd-b240-4d4a-b713-5ab4c5b8997a tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:56:11.171971 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-de2a91bd-b240-4d4a-b713-5ab4c5b8997a tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:56:11.305265 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.policy [None req-de2a91bd-b240-4d4a-b713-5ab4c5b8997a tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58bfb7417bc94583963401ae0fe9d39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0672be3fa3f7414da1c1a5b7300abbe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128729) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:56:11.312918 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.policy [None req-de2a91bd-b240-4d4a-b713-5ab4c5b8997a tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58bfb7417bc94583963401ae0fe9d39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0672be3fa3f7414da1c1a5b7300abbe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128729) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:56:11.314454 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.policy [None req-de2a91bd-b240-4d4a-b713-5ab4c5b8997a tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58bfb7417bc94583963401ae0fe9d39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0672be3fa3f7414da1c1a5b7300abbe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128729) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:56:11.315619 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: INFO nova.api.openstack.requestlog [None req-de2a91bd-b240-4d4a-b713-5ab4c5b8997a tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] 10.222.0.61 "GET /compute/v2.1/servers/cca08141-979e-4519-88b3-c77e8a71ae3e" status: 200 len: 1731 microversion: 2.20 time: 0.156426 May 14 15:56:11.316198 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: [pid: 128729|app: 0|req: 543/1102] 10.222.0.61 () {60 vars in 1276 bytes} [Sat May 14 15:56:11 2022] GET /compute/v2.1/servers/cca08141-979e-4519-88b3-c77e8a71ae3e => generated 1731 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 14 15:56:11.929455 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi [None req-8d4087b5-e66d-418e-9f76-948dc40f25d7 tempest-VolumesSnapshotTestJSON-671752898 tempest-VolumesSnapshotTestJSON-671752898-project] Calling method '>' {{(pid=128728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 15:56:11.930061 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.compute.api [None req-8d4087b5-e66d-418e-9f76-948dc40f25d7 tempest-VolumesSnapshotTestJSON-671752898 tempest-VolumesSnapshotTestJSON-671752898-project] [instance: a1d28d7f-bade-404d-a453-e09a34fbb232] Fetching instance by UUID {{(pid=128728) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 15:56:11.936393 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-8d4087b5-e66d-418e-9f76-948dc40f25d7 tempest-VolumesSnapshotTestJSON-671752898 tempest-VolumesSnapshotTestJSON-671752898-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:56:11.936934 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-8d4087b5-e66d-418e-9f76-948dc40f25d7 tempest-VolumesSnapshotTestJSON-671752898 tempest-VolumesSnapshotTestJSON-671752898-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:56:11.937699 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-8d4087b5-e66d-418e-9f76-948dc40f25d7 tempest-VolumesSnapshotTestJSON-671752898 tempest-VolumesSnapshotTestJSON-671752898-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:56:11.938137 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-8d4087b5-e66d-418e-9f76-948dc40f25d7 tempest-VolumesSnapshotTestJSON-671752898 tempest-VolumesSnapshotTestJSON-671752898-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:56:12.063569 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.policy [None req-8d4087b5-e66d-418e-9f76-948dc40f25d7 tempest-VolumesSnapshotTestJSON-671752898 tempest-VolumesSnapshotTestJSON-671752898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3e4193c9d9043c99ee5bee59f79f7a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ad8088ecb8a4f72a98ad70fa8be02b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128728) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:56:12.071052 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: INFO nova.api.openstack.requestlog [None req-8d4087b5-e66d-418e-9f76-948dc40f25d7 tempest-VolumesSnapshotTestJSON-671752898 tempest-VolumesSnapshotTestJSON-671752898-project] 10.222.0.61 "GET /compute/v2.1/servers/a1d28d7f-bade-404d-a453-e09a34fbb232" status: 200 len: 1319 microversion: 2.1 time: 0.145900 May 14 15:56:12.071622 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: [pid: 128728|app: 0|req: 560/1103] 10.222.0.61 () {58 vars in 1235 bytes} [Sat May 14 15:56:11 2022] GET /compute/v2.1/servers/a1d28d7f-bade-404d-a453-e09a34fbb232 => generated 1319 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 15:56:12.333765 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi [None req-6dcead11-a564-4a64-88d2-fa466b6e49ad tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Calling method '>' {{(pid=128729) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 15:56:12.334406 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.compute.api [None req-6dcead11-a564-4a64-88d2-fa466b6e49ad tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] [instance: cca08141-979e-4519-88b3-c77e8a71ae3e] Fetching instance by UUID {{(pid=128729) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 15:56:12.340853 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-6dcead11-a564-4a64-88d2-fa466b6e49ad tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:56:12.341307 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-6dcead11-a564-4a64-88d2-fa466b6e49ad tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:56:12.342087 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-6dcead11-a564-4a64-88d2-fa466b6e49ad tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:56:12.342551 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-6dcead11-a564-4a64-88d2-fa466b6e49ad tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:56:12.468435 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.policy [None req-6dcead11-a564-4a64-88d2-fa466b6e49ad tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58bfb7417bc94583963401ae0fe9d39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0672be3fa3f7414da1c1a5b7300abbe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128729) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:56:12.476648 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.policy [None req-6dcead11-a564-4a64-88d2-fa466b6e49ad tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58bfb7417bc94583963401ae0fe9d39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0672be3fa3f7414da1c1a5b7300abbe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128729) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:56:12.478136 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.policy [None req-6dcead11-a564-4a64-88d2-fa466b6e49ad tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58bfb7417bc94583963401ae0fe9d39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0672be3fa3f7414da1c1a5b7300abbe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128729) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:56:12.479325 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: INFO nova.api.openstack.requestlog [None req-6dcead11-a564-4a64-88d2-fa466b6e49ad tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] 10.222.0.61 "GET /compute/v2.1/servers/cca08141-979e-4519-88b3-c77e8a71ae3e" status: 200 len: 1731 microversion: 2.20 time: 0.150028 May 14 15:56:12.479879 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: [pid: 128729|app: 0|req: 544/1104] 10.222.0.61 () {60 vars in 1276 bytes} [Sat May 14 15:56:12 2022] GET /compute/v2.1/servers/cca08141-979e-4519-88b3-c77e8a71ae3e => generated 1731 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 14 15:56:13.088335 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi [None req-1a2c0156-8136-4c7e-9080-db768cd83c25 tempest-VolumesSnapshotTestJSON-671752898 tempest-VolumesSnapshotTestJSON-671752898-project] Calling method '>' {{(pid=128728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 15:56:13.088878 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.compute.api [None req-1a2c0156-8136-4c7e-9080-db768cd83c25 tempest-VolumesSnapshotTestJSON-671752898 tempest-VolumesSnapshotTestJSON-671752898-project] [instance: a1d28d7f-bade-404d-a453-e09a34fbb232] Fetching instance by UUID {{(pid=128728) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 15:56:13.095326 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-1a2c0156-8136-4c7e-9080-db768cd83c25 tempest-VolumesSnapshotTestJSON-671752898 tempest-VolumesSnapshotTestJSON-671752898-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:56:13.095772 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-1a2c0156-8136-4c7e-9080-db768cd83c25 tempest-VolumesSnapshotTestJSON-671752898 tempest-VolumesSnapshotTestJSON-671752898-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:56:13.096533 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-1a2c0156-8136-4c7e-9080-db768cd83c25 tempest-VolumesSnapshotTestJSON-671752898 tempest-VolumesSnapshotTestJSON-671752898-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:56:13.096964 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-1a2c0156-8136-4c7e-9080-db768cd83c25 tempest-VolumesSnapshotTestJSON-671752898 tempest-VolumesSnapshotTestJSON-671752898-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:56:13.227385 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.policy [None req-1a2c0156-8136-4c7e-9080-db768cd83c25 tempest-VolumesSnapshotTestJSON-671752898 tempest-VolumesSnapshotTestJSON-671752898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3e4193c9d9043c99ee5bee59f79f7a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ad8088ecb8a4f72a98ad70fa8be02b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128728) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:56:13.234528 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: INFO nova.api.openstack.requestlog [None req-1a2c0156-8136-4c7e-9080-db768cd83c25 tempest-VolumesSnapshotTestJSON-671752898 tempest-VolumesSnapshotTestJSON-671752898-project] 10.222.0.61 "GET /compute/v2.1/servers/a1d28d7f-bade-404d-a453-e09a34fbb232" status: 200 len: 1319 microversion: 2.1 time: 0.150214 May 14 15:56:13.235092 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: [pid: 128728|app: 0|req: 561/1105] 10.222.0.61 () {58 vars in 1235 bytes} [Sat May 14 15:56:13 2022] GET /compute/v2.1/servers/a1d28d7f-bade-404d-a453-e09a34fbb232 => generated 1319 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 15:56:13.498303 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi [None req-77874802-6994-4e29-a430-a95b18f7992f tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Calling method '>' {{(pid=128729) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 15:56:13.498845 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.compute.api [None req-77874802-6994-4e29-a430-a95b18f7992f tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] [instance: cca08141-979e-4519-88b3-c77e8a71ae3e] Fetching instance by UUID {{(pid=128729) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 15:56:13.505260 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-77874802-6994-4e29-a430-a95b18f7992f tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:56:13.505713 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-77874802-6994-4e29-a430-a95b18f7992f tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:56:13.506520 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-77874802-6994-4e29-a430-a95b18f7992f tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:56:13.506962 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-77874802-6994-4e29-a430-a95b18f7992f tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:56:13.638155 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.policy [None req-77874802-6994-4e29-a430-a95b18f7992f tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58bfb7417bc94583963401ae0fe9d39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0672be3fa3f7414da1c1a5b7300abbe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128729) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:56:13.646211 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.policy [None req-77874802-6994-4e29-a430-a95b18f7992f tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58bfb7417bc94583963401ae0fe9d39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0672be3fa3f7414da1c1a5b7300abbe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128729) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:56:13.647739 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.policy [None req-77874802-6994-4e29-a430-a95b18f7992f tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58bfb7417bc94583963401ae0fe9d39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0672be3fa3f7414da1c1a5b7300abbe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128729) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:56:13.648903 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: INFO nova.api.openstack.requestlog [None req-77874802-6994-4e29-a430-a95b18f7992f tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] 10.222.0.61 "GET /compute/v2.1/servers/cca08141-979e-4519-88b3-c77e8a71ae3e" status: 200 len: 1731 microversion: 2.20 time: 0.154629 May 14 15:56:13.649467 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: [pid: 128729|app: 0|req: 545/1106] 10.222.0.61 () {60 vars in 1276 bytes} [Sat May 14 15:56:13 2022] GET /compute/v2.1/servers/cca08141-979e-4519-88b3-c77e8a71ae3e => generated 1731 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 14 15:56:14.251926 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi [None req-e3070463-98b0-488d-b38d-7e42eac0b32e tempest-VolumesSnapshotTestJSON-671752898 tempest-VolumesSnapshotTestJSON-671752898-project] Calling method '>' {{(pid=128728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 15:56:14.252458 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.compute.api [None req-e3070463-98b0-488d-b38d-7e42eac0b32e tempest-VolumesSnapshotTestJSON-671752898 tempest-VolumesSnapshotTestJSON-671752898-project] [instance: a1d28d7f-bade-404d-a453-e09a34fbb232] Fetching instance by UUID {{(pid=128728) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 15:56:14.259225 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-e3070463-98b0-488d-b38d-7e42eac0b32e tempest-VolumesSnapshotTestJSON-671752898 tempest-VolumesSnapshotTestJSON-671752898-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:56:14.259668 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-e3070463-98b0-488d-b38d-7e42eac0b32e tempest-VolumesSnapshotTestJSON-671752898 tempest-VolumesSnapshotTestJSON-671752898-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:56:14.260428 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-e3070463-98b0-488d-b38d-7e42eac0b32e tempest-VolumesSnapshotTestJSON-671752898 tempest-VolumesSnapshotTestJSON-671752898-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:56:14.260860 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-e3070463-98b0-488d-b38d-7e42eac0b32e tempest-VolumesSnapshotTestJSON-671752898 tempest-VolumesSnapshotTestJSON-671752898-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:56:14.389803 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.policy [None req-e3070463-98b0-488d-b38d-7e42eac0b32e tempest-VolumesSnapshotTestJSON-671752898 tempest-VolumesSnapshotTestJSON-671752898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3e4193c9d9043c99ee5bee59f79f7a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ad8088ecb8a4f72a98ad70fa8be02b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128728) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:56:14.397181 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: INFO nova.api.openstack.requestlog [None req-e3070463-98b0-488d-b38d-7e42eac0b32e tempest-VolumesSnapshotTestJSON-671752898 tempest-VolumesSnapshotTestJSON-671752898-project] 10.222.0.61 "GET /compute/v2.1/servers/a1d28d7f-bade-404d-a453-e09a34fbb232" status: 200 len: 1319 microversion: 2.1 time: 0.149167 May 14 15:56:14.397758 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: [pid: 128728|app: 0|req: 562/1107] 10.222.0.61 () {58 vars in 1235 bytes} [Sat May 14 15:56:14 2022] GET /compute/v2.1/servers/a1d28d7f-bade-404d-a453-e09a34fbb232 => generated 1319 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 15:56:14.666912 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi [None req-cf36dcb9-da96-45a8-9136-21e03084274a tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Calling method '>' {{(pid=128729) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 15:56:14.667520 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.compute.api [None req-cf36dcb9-da96-45a8-9136-21e03084274a tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] [instance: cca08141-979e-4519-88b3-c77e8a71ae3e] Fetching instance by UUID {{(pid=128729) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 15:56:14.673805 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-cf36dcb9-da96-45a8-9136-21e03084274a tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:56:14.674256 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-cf36dcb9-da96-45a8-9136-21e03084274a tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:56:14.675054 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-cf36dcb9-da96-45a8-9136-21e03084274a tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:56:14.676314 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-cf36dcb9-da96-45a8-9136-21e03084274a tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:56:14.802251 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.policy [None req-cf36dcb9-da96-45a8-9136-21e03084274a tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58bfb7417bc94583963401ae0fe9d39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0672be3fa3f7414da1c1a5b7300abbe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128729) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:56:14.809895 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.policy [None req-cf36dcb9-da96-45a8-9136-21e03084274a tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58bfb7417bc94583963401ae0fe9d39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0672be3fa3f7414da1c1a5b7300abbe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128729) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:56:14.811439 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.policy [None req-cf36dcb9-da96-45a8-9136-21e03084274a tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58bfb7417bc94583963401ae0fe9d39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0672be3fa3f7414da1c1a5b7300abbe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128729) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:56:14.812595 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: INFO nova.api.openstack.requestlog [None req-cf36dcb9-da96-45a8-9136-21e03084274a tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] 10.222.0.61 "GET /compute/v2.1/servers/cca08141-979e-4519-88b3-c77e8a71ae3e" status: 200 len: 1731 microversion: 2.20 time: 0.149553 May 14 15:56:14.813157 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: [pid: 128729|app: 0|req: 546/1108] 10.222.0.61 () {60 vars in 1276 bytes} [Sat May 14 15:56:14 2022] GET /compute/v2.1/servers/cca08141-979e-4519-88b3-c77e8a71ae3e => generated 1731 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 14 15:56:15.413848 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi [None req-d1ba4fc0-d73e-4951-b1b9-ca978cd74bb3 tempest-VolumesSnapshotTestJSON-671752898 tempest-VolumesSnapshotTestJSON-671752898-project] Calling method '>' {{(pid=128728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 15:56:15.414490 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.compute.api [None req-d1ba4fc0-d73e-4951-b1b9-ca978cd74bb3 tempest-VolumesSnapshotTestJSON-671752898 tempest-VolumesSnapshotTestJSON-671752898-project] [instance: a1d28d7f-bade-404d-a453-e09a34fbb232] Fetching instance by UUID {{(pid=128728) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 15:56:15.420930 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-d1ba4fc0-d73e-4951-b1b9-ca978cd74bb3 tempest-VolumesSnapshotTestJSON-671752898 tempest-VolumesSnapshotTestJSON-671752898-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:56:15.421376 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-d1ba4fc0-d73e-4951-b1b9-ca978cd74bb3 tempest-VolumesSnapshotTestJSON-671752898 tempest-VolumesSnapshotTestJSON-671752898-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:56:15.422141 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-d1ba4fc0-d73e-4951-b1b9-ca978cd74bb3 tempest-VolumesSnapshotTestJSON-671752898 tempest-VolumesSnapshotTestJSON-671752898-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:56:15.422601 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-d1ba4fc0-d73e-4951-b1b9-ca978cd74bb3 tempest-VolumesSnapshotTestJSON-671752898 tempest-VolumesSnapshotTestJSON-671752898-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:56:15.551748 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.policy [None req-d1ba4fc0-d73e-4951-b1b9-ca978cd74bb3 tempest-VolumesSnapshotTestJSON-671752898 tempest-VolumesSnapshotTestJSON-671752898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3e4193c9d9043c99ee5bee59f79f7a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ad8088ecb8a4f72a98ad70fa8be02b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128728) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:56:15.558828 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: INFO nova.api.openstack.requestlog [None req-d1ba4fc0-d73e-4951-b1b9-ca978cd74bb3 tempest-VolumesSnapshotTestJSON-671752898 tempest-VolumesSnapshotTestJSON-671752898-project] 10.222.0.61 "GET /compute/v2.1/servers/a1d28d7f-bade-404d-a453-e09a34fbb232" status: 200 len: 1319 microversion: 2.1 time: 0.148877 May 14 15:56:15.559392 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: [pid: 128728|app: 0|req: 563/1109] 10.222.0.61 () {58 vars in 1235 bytes} [Sat May 14 15:56:15 2022] GET /compute/v2.1/servers/a1d28d7f-bade-404d-a453-e09a34fbb232 => generated 1319 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 15:56:15.830269 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi [None req-a28d19c0-22e2-4b2c-bf0a-b4ecdc6576a6 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Calling method '>' {{(pid=128729) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 15:56:15.830907 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.compute.api [None req-a28d19c0-22e2-4b2c-bf0a-b4ecdc6576a6 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] [instance: cca08141-979e-4519-88b3-c77e8a71ae3e] Fetching instance by UUID {{(pid=128729) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 15:56:15.837577 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-a28d19c0-22e2-4b2c-bf0a-b4ecdc6576a6 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:56:15.838036 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-a28d19c0-22e2-4b2c-bf0a-b4ecdc6576a6 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:56:15.838844 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-a28d19c0-22e2-4b2c-bf0a-b4ecdc6576a6 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:56:15.839282 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-a28d19c0-22e2-4b2c-bf0a-b4ecdc6576a6 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:56:15.968762 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.policy [None req-a28d19c0-22e2-4b2c-bf0a-b4ecdc6576a6 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58bfb7417bc94583963401ae0fe9d39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0672be3fa3f7414da1c1a5b7300abbe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128729) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:56:15.976912 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.policy [None req-a28d19c0-22e2-4b2c-bf0a-b4ecdc6576a6 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58bfb7417bc94583963401ae0fe9d39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0672be3fa3f7414da1c1a5b7300abbe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128729) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:56:15.978427 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.policy [None req-a28d19c0-22e2-4b2c-bf0a-b4ecdc6576a6 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58bfb7417bc94583963401ae0fe9d39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0672be3fa3f7414da1c1a5b7300abbe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128729) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:56:15.979572 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: INFO nova.api.openstack.requestlog [None req-a28d19c0-22e2-4b2c-bf0a-b4ecdc6576a6 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] 10.222.0.61 "GET /compute/v2.1/servers/cca08141-979e-4519-88b3-c77e8a71ae3e" status: 200 len: 1731 microversion: 2.20 time: 0.153269 May 14 15:56:15.980133 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: [pid: 128729|app: 0|req: 547/1110] 10.222.0.61 () {60 vars in 1276 bytes} [Sat May 14 15:56:15 2022] GET /compute/v2.1/servers/cca08141-979e-4519-88b3-c77e8a71ae3e => generated 1731 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 14 15:56:16.575630 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi [None req-7a607dcc-42e1-43eb-949d-d9d31a36f8e8 tempest-VolumesSnapshotTestJSON-671752898 tempest-VolumesSnapshotTestJSON-671752898-project] Calling method '>' {{(pid=128728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 15:56:16.576242 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.compute.api [None req-7a607dcc-42e1-43eb-949d-d9d31a36f8e8 tempest-VolumesSnapshotTestJSON-671752898 tempest-VolumesSnapshotTestJSON-671752898-project] [instance: a1d28d7f-bade-404d-a453-e09a34fbb232] Fetching instance by UUID {{(pid=128728) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 15:56:16.583609 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-7a607dcc-42e1-43eb-949d-d9d31a36f8e8 tempest-VolumesSnapshotTestJSON-671752898 tempest-VolumesSnapshotTestJSON-671752898-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:56:16.584339 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-7a607dcc-42e1-43eb-949d-d9d31a36f8e8 tempest-VolumesSnapshotTestJSON-671752898 tempest-VolumesSnapshotTestJSON-671752898-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:56:16.585119 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-7a607dcc-42e1-43eb-949d-d9d31a36f8e8 tempest-VolumesSnapshotTestJSON-671752898 tempest-VolumesSnapshotTestJSON-671752898-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:56:16.585559 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-7a607dcc-42e1-43eb-949d-d9d31a36f8e8 tempest-VolumesSnapshotTestJSON-671752898 tempest-VolumesSnapshotTestJSON-671752898-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:56:16.712141 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.policy [None req-7a607dcc-42e1-43eb-949d-d9d31a36f8e8 tempest-VolumesSnapshotTestJSON-671752898 tempest-VolumesSnapshotTestJSON-671752898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3e4193c9d9043c99ee5bee59f79f7a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ad8088ecb8a4f72a98ad70fa8be02b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128728) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:56:16.719329 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: INFO nova.api.openstack.requestlog [None req-7a607dcc-42e1-43eb-949d-d9d31a36f8e8 tempest-VolumesSnapshotTestJSON-671752898 tempest-VolumesSnapshotTestJSON-671752898-project] 10.222.0.61 "GET /compute/v2.1/servers/a1d28d7f-bade-404d-a453-e09a34fbb232" status: 200 len: 1319 microversion: 2.1 time: 0.147500 May 14 15:56:16.719897 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: [pid: 128728|app: 0|req: 564/1111] 10.222.0.61 () {58 vars in 1235 bytes} [Sat May 14 15:56:16 2022] GET /compute/v2.1/servers/a1d28d7f-bade-404d-a453-e09a34fbb232 => generated 1319 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 15:56:16.998414 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi [None req-6cba8dd7-5110-4645-9b3c-ac57fdd51e8c tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Calling method '>' {{(pid=128729) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 15:56:16.999023 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.compute.api [None req-6cba8dd7-5110-4645-9b3c-ac57fdd51e8c tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] [instance: cca08141-979e-4519-88b3-c77e8a71ae3e] Fetching instance by UUID {{(pid=128729) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 15:56:17.005985 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-6cba8dd7-5110-4645-9b3c-ac57fdd51e8c tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:56:17.006463 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-6cba8dd7-5110-4645-9b3c-ac57fdd51e8c tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:56:17.007232 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-6cba8dd7-5110-4645-9b3c-ac57fdd51e8c tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:56:17.007672 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-6cba8dd7-5110-4645-9b3c-ac57fdd51e8c tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:56:17.136129 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.policy [None req-6cba8dd7-5110-4645-9b3c-ac57fdd51e8c tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58bfb7417bc94583963401ae0fe9d39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0672be3fa3f7414da1c1a5b7300abbe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128729) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:56:17.144017 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.policy [None req-6cba8dd7-5110-4645-9b3c-ac57fdd51e8c tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58bfb7417bc94583963401ae0fe9d39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0672be3fa3f7414da1c1a5b7300abbe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128729) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:56:17.145718 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.policy [None req-6cba8dd7-5110-4645-9b3c-ac57fdd51e8c tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58bfb7417bc94583963401ae0fe9d39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0672be3fa3f7414da1c1a5b7300abbe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128729) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:56:17.146902 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: INFO nova.api.openstack.requestlog [None req-6cba8dd7-5110-4645-9b3c-ac57fdd51e8c tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] 10.222.0.61 "GET /compute/v2.1/servers/cca08141-979e-4519-88b3-c77e8a71ae3e" status: 200 len: 1731 microversion: 2.20 time: 0.152398 May 14 15:56:17.147458 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: [pid: 128729|app: 0|req: 548/1112] 10.222.0.61 () {60 vars in 1276 bytes} [Sat May 14 15:56:16 2022] GET /compute/v2.1/servers/cca08141-979e-4519-88b3-c77e8a71ae3e => generated 1731 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 14 15:56:17.735166 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi [None req-fd8c005d-0f5d-4354-80aa-abf0b3b38666 tempest-VolumesSnapshotTestJSON-671752898 tempest-VolumesSnapshotTestJSON-671752898-project] Calling method '>' {{(pid=128728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 15:56:17.735780 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.compute.api [None req-fd8c005d-0f5d-4354-80aa-abf0b3b38666 tempest-VolumesSnapshotTestJSON-671752898 tempest-VolumesSnapshotTestJSON-671752898-project] [instance: a1d28d7f-bade-404d-a453-e09a34fbb232] Fetching instance by UUID {{(pid=128728) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 15:56:17.742327 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-fd8c005d-0f5d-4354-80aa-abf0b3b38666 tempest-VolumesSnapshotTestJSON-671752898 tempest-VolumesSnapshotTestJSON-671752898-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:56:17.742778 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-fd8c005d-0f5d-4354-80aa-abf0b3b38666 tempest-VolumesSnapshotTestJSON-671752898 tempest-VolumesSnapshotTestJSON-671752898-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:56:17.743547 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-fd8c005d-0f5d-4354-80aa-abf0b3b38666 tempest-VolumesSnapshotTestJSON-671752898 tempest-VolumesSnapshotTestJSON-671752898-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:56:17.743985 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-fd8c005d-0f5d-4354-80aa-abf0b3b38666 tempest-VolumesSnapshotTestJSON-671752898 tempest-VolumesSnapshotTestJSON-671752898-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:56:17.869439 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.policy [None req-fd8c005d-0f5d-4354-80aa-abf0b3b38666 tempest-VolumesSnapshotTestJSON-671752898 tempest-VolumesSnapshotTestJSON-671752898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3e4193c9d9043c99ee5bee59f79f7a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ad8088ecb8a4f72a98ad70fa8be02b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128728) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:56:17.876559 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: INFO nova.api.openstack.requestlog [None req-fd8c005d-0f5d-4354-80aa-abf0b3b38666 tempest-VolumesSnapshotTestJSON-671752898 tempest-VolumesSnapshotTestJSON-671752898-project] 10.222.0.61 "GET /compute/v2.1/servers/a1d28d7f-bade-404d-a453-e09a34fbb232" status: 200 len: 1319 microversion: 2.1 time: 0.145246 May 14 15:56:17.877121 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: [pid: 128728|app: 0|req: 565/1113] 10.222.0.61 () {58 vars in 1235 bytes} [Sat May 14 15:56:17 2022] GET /compute/v2.1/servers/a1d28d7f-bade-404d-a453-e09a34fbb232 => generated 1319 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 15:56:18.165340 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi [None req-a589b5d8-de65-4f57-89db-a131e52a9f98 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Calling method '>' {{(pid=128729) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 15:56:18.165877 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.compute.api [None req-a589b5d8-de65-4f57-89db-a131e52a9f98 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] [instance: cca08141-979e-4519-88b3-c77e8a71ae3e] Fetching instance by UUID {{(pid=128729) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 15:56:18.172256 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-a589b5d8-de65-4f57-89db-a131e52a9f98 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:56:18.172705 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-a589b5d8-de65-4f57-89db-a131e52a9f98 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:56:18.173472 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-a589b5d8-de65-4f57-89db-a131e52a9f98 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:56:18.173906 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-a589b5d8-de65-4f57-89db-a131e52a9f98 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:56:18.302183 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.policy [None req-a589b5d8-de65-4f57-89db-a131e52a9f98 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58bfb7417bc94583963401ae0fe9d39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0672be3fa3f7414da1c1a5b7300abbe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128729) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:56:18.309905 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.policy [None req-a589b5d8-de65-4f57-89db-a131e52a9f98 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58bfb7417bc94583963401ae0fe9d39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0672be3fa3f7414da1c1a5b7300abbe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128729) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:56:18.311439 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.policy [None req-a589b5d8-de65-4f57-89db-a131e52a9f98 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58bfb7417bc94583963401ae0fe9d39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0672be3fa3f7414da1c1a5b7300abbe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128729) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:56:18.312595 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: INFO nova.api.openstack.requestlog [None req-a589b5d8-de65-4f57-89db-a131e52a9f98 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] 10.222.0.61 "GET /compute/v2.1/servers/cca08141-979e-4519-88b3-c77e8a71ae3e" status: 200 len: 1731 microversion: 2.20 time: 0.151290 May 14 15:56:18.313157 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: [pid: 128729|app: 0|req: 549/1114] 10.222.0.61 () {60 vars in 1276 bytes} [Sat May 14 15:56:18 2022] GET /compute/v2.1/servers/cca08141-979e-4519-88b3-c77e8a71ae3e => generated 1731 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 14 15:56:18.893246 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi [None req-5c00a67a-5c7b-4178-9b16-6af2f143f6ea tempest-VolumesSnapshotTestJSON-671752898 tempest-VolumesSnapshotTestJSON-671752898-project] Calling method '>' {{(pid=128728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 15:56:18.893858 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.compute.api [None req-5c00a67a-5c7b-4178-9b16-6af2f143f6ea tempest-VolumesSnapshotTestJSON-671752898 tempest-VolumesSnapshotTestJSON-671752898-project] [instance: a1d28d7f-bade-404d-a453-e09a34fbb232] Fetching instance by UUID {{(pid=128728) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 15:56:18.900338 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-5c00a67a-5c7b-4178-9b16-6af2f143f6ea tempest-VolumesSnapshotTestJSON-671752898 tempest-VolumesSnapshotTestJSON-671752898-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:56:18.900786 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-5c00a67a-5c7b-4178-9b16-6af2f143f6ea tempest-VolumesSnapshotTestJSON-671752898 tempest-VolumesSnapshotTestJSON-671752898-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:56:18.901553 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-5c00a67a-5c7b-4178-9b16-6af2f143f6ea tempest-VolumesSnapshotTestJSON-671752898 tempest-VolumesSnapshotTestJSON-671752898-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:56:18.901989 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-5c00a67a-5c7b-4178-9b16-6af2f143f6ea tempest-VolumesSnapshotTestJSON-671752898 tempest-VolumesSnapshotTestJSON-671752898-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:56:19.138833 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.policy [None req-5c00a67a-5c7b-4178-9b16-6af2f143f6ea tempest-VolumesSnapshotTestJSON-671752898 tempest-VolumesSnapshotTestJSON-671752898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3e4193c9d9043c99ee5bee59f79f7a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ad8088ecb8a4f72a98ad70fa8be02b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128728) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:56:19.145946 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: INFO nova.api.openstack.requestlog [None req-5c00a67a-5c7b-4178-9b16-6af2f143f6ea tempest-VolumesSnapshotTestJSON-671752898 tempest-VolumesSnapshotTestJSON-671752898-project] 10.222.0.61 "GET /compute/v2.1/servers/a1d28d7f-bade-404d-a453-e09a34fbb232" status: 200 len: 1319 microversion: 2.1 time: 0.256527 May 14 15:56:19.146547 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: [pid: 128728|app: 0|req: 566/1115] 10.222.0.61 () {58 vars in 1235 bytes} [Sat May 14 15:56:18 2022] GET /compute/v2.1/servers/a1d28d7f-bade-404d-a453-e09a34fbb232 => generated 1319 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 15:56:19.331440 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi [None req-75f2a925-05cd-4981-a624-e2afabaf2bee tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Calling method '>' {{(pid=128729) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 15:56:19.332753 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.compute.api [None req-75f2a925-05cd-4981-a624-e2afabaf2bee tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] [instance: cca08141-979e-4519-88b3-c77e8a71ae3e] Fetching instance by UUID {{(pid=128729) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 15:56:19.339072 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-75f2a925-05cd-4981-a624-e2afabaf2bee tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:56:19.339523 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-75f2a925-05cd-4981-a624-e2afabaf2bee tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:56:19.340285 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-75f2a925-05cd-4981-a624-e2afabaf2bee tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:56:19.340768 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-75f2a925-05cd-4981-a624-e2afabaf2bee tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:56:19.476000 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.policy [None req-75f2a925-05cd-4981-a624-e2afabaf2bee tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58bfb7417bc94583963401ae0fe9d39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0672be3fa3f7414da1c1a5b7300abbe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128729) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:56:19.484212 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.policy [None req-75f2a925-05cd-4981-a624-e2afabaf2bee tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58bfb7417bc94583963401ae0fe9d39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0672be3fa3f7414da1c1a5b7300abbe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128729) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:56:19.485722 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.policy [None req-75f2a925-05cd-4981-a624-e2afabaf2bee tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58bfb7417bc94583963401ae0fe9d39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0672be3fa3f7414da1c1a5b7300abbe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128729) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:56:19.486922 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: INFO nova.api.openstack.requestlog [None req-75f2a925-05cd-4981-a624-e2afabaf2bee tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] 10.222.0.61 "GET /compute/v2.1/servers/cca08141-979e-4519-88b3-c77e8a71ae3e" status: 200 len: 1731 microversion: 2.20 time: 0.159351 May 14 15:56:19.487495 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: [pid: 128729|app: 0|req: 550/1116] 10.222.0.61 () {60 vars in 1276 bytes} [Sat May 14 15:56:19 2022] GET /compute/v2.1/servers/cca08141-979e-4519-88b3-c77e8a71ae3e => generated 1731 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 14 15:56:20.163284 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi [None req-1fc6701b-2e38-48ce-a7e2-6b6b181f24ed tempest-VolumesSnapshotTestJSON-671752898 tempest-VolumesSnapshotTestJSON-671752898-project] Calling method '>' {{(pid=128728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 15:56:20.163868 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.compute.api [None req-1fc6701b-2e38-48ce-a7e2-6b6b181f24ed tempest-VolumesSnapshotTestJSON-671752898 tempest-VolumesSnapshotTestJSON-671752898-project] [instance: a1d28d7f-bade-404d-a453-e09a34fbb232] Fetching instance by UUID {{(pid=128728) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 15:56:20.170006 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-1fc6701b-2e38-48ce-a7e2-6b6b181f24ed tempest-VolumesSnapshotTestJSON-671752898 tempest-VolumesSnapshotTestJSON-671752898-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:56:20.170492 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-1fc6701b-2e38-48ce-a7e2-6b6b181f24ed tempest-VolumesSnapshotTestJSON-671752898 tempest-VolumesSnapshotTestJSON-671752898-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:56:20.171259 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-1fc6701b-2e38-48ce-a7e2-6b6b181f24ed tempest-VolumesSnapshotTestJSON-671752898 tempest-VolumesSnapshotTestJSON-671752898-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:56:20.171690 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-1fc6701b-2e38-48ce-a7e2-6b6b181f24ed tempest-VolumesSnapshotTestJSON-671752898 tempest-VolumesSnapshotTestJSON-671752898-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:56:20.300385 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.policy [None req-1fc6701b-2e38-48ce-a7e2-6b6b181f24ed tempest-VolumesSnapshotTestJSON-671752898 tempest-VolumesSnapshotTestJSON-671752898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3e4193c9d9043c99ee5bee59f79f7a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ad8088ecb8a4f72a98ad70fa8be02b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128728) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:56:20.307540 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: INFO nova.api.openstack.requestlog [None req-1fc6701b-2e38-48ce-a7e2-6b6b181f24ed tempest-VolumesSnapshotTestJSON-671752898 tempest-VolumesSnapshotTestJSON-671752898-project] 10.222.0.61 "GET /compute/v2.1/servers/a1d28d7f-bade-404d-a453-e09a34fbb232" status: 200 len: 1507 microversion: 2.1 time: 0.148832 May 14 15:56:20.308103 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: [pid: 128728|app: 0|req: 567/1117] 10.222.0.61 () {58 vars in 1235 bytes} [Sat May 14 15:56:20 2022] GET /compute/v2.1/servers/a1d28d7f-bade-404d-a453-e09a34fbb232 => generated 1507 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 15:56:20.506793 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi [None req-a3e49064-eb4b-46d2-b63e-4959adf05327 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Calling method '>' {{(pid=128729) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 15:56:20.507407 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.compute.api [None req-a3e49064-eb4b-46d2-b63e-4959adf05327 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] [instance: cca08141-979e-4519-88b3-c77e8a71ae3e] Fetching instance by UUID {{(pid=128729) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 15:56:20.513768 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-a3e49064-eb4b-46d2-b63e-4959adf05327 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:56:20.514230 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-a3e49064-eb4b-46d2-b63e-4959adf05327 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:56:20.515084 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-a3e49064-eb4b-46d2-b63e-4959adf05327 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:56:20.515533 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-a3e49064-eb4b-46d2-b63e-4959adf05327 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:56:20.703596 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.policy [None req-a3e49064-eb4b-46d2-b63e-4959adf05327 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58bfb7417bc94583963401ae0fe9d39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0672be3fa3f7414da1c1a5b7300abbe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128729) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:56:20.714160 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.policy [None req-a3e49064-eb4b-46d2-b63e-4959adf05327 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58bfb7417bc94583963401ae0fe9d39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0672be3fa3f7414da1c1a5b7300abbe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128729) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:56:20.715832 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.policy [None req-a3e49064-eb4b-46d2-b63e-4959adf05327 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58bfb7417bc94583963401ae0fe9d39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0672be3fa3f7414da1c1a5b7300abbe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128729) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:56:20.717053 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: INFO nova.api.openstack.requestlog [None req-a3e49064-eb4b-46d2-b63e-4959adf05327 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] 10.222.0.61 "GET /compute/v2.1/servers/cca08141-979e-4519-88b3-c77e8a71ae3e" status: 200 len: 1731 microversion: 2.20 time: 0.214951 May 14 15:56:20.717598 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: [pid: 128729|app: 0|req: 551/1118] 10.222.0.61 () {60 vars in 1276 bytes} [Sat May 14 15:56:20 2022] GET /compute/v2.1/servers/cca08141-979e-4519-88b3-c77e8a71ae3e => generated 1731 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 14 15:56:21.621047 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi [req-035deb9f-5238-4a92-8e94-10b431e2da27 req-c578d295-a199-4c59-979f-67ec03f3a0d4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cca08141-979e-4519-88b3-c77e8a71ae3e", "name": "network-vif-plugged", "status": "completed", "tag": "e23afae5-7b01-4137-a087-ba1a741fd1f4"}]} {{(pid=128728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 15:56:21.630335 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [req-035deb9f-5238-4a92-8e94-10b431e2da27 req-c578d295-a199-4c59-979f-67ec03f3a0d4 service nova] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:56:21.631705 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [req-035deb9f-5238-4a92-8e94-10b431e2da27 req-c578d295-a199-4c59-979f-67ec03f3a0d4 service nova] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:56:21.644363 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: INFO nova.api.openstack.compute.server_external_events [req-035deb9f-5238-4a92-8e94-10b431e2da27 req-c578d295-a199-4c59-979f-67ec03f3a0d4 service nova] Creating event network-vif-plugged:e23afae5-7b01-4137-a087-ba1a741fd1f4 for instance cca08141-979e-4519-88b3-c77e8a71ae3e on hv-cinder-83979 May 14 15:56:21.649632 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: INFO nova.api.openstack.requestlog [req-035deb9f-5238-4a92-8e94-10b431e2da27 req-c578d295-a199-4c59-979f-67ec03f3a0d4 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032522 May 14 15:56:21.650226 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: [pid: 128728|app: 0|req: 568/1119] 10.222.0.61 () {64 vars in 1317 bytes} [Sat May 14 15:56:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 14 15:56:21.735522 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi [None req-3c4eec4a-d957-4d9e-a151-9cab30ebc13e tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Calling method '>' {{(pid=128729) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 15:56:21.736824 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.compute.api [None req-3c4eec4a-d957-4d9e-a151-9cab30ebc13e tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] [instance: cca08141-979e-4519-88b3-c77e8a71ae3e] Fetching instance by UUID {{(pid=128729) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 15:56:21.744600 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-3c4eec4a-d957-4d9e-a151-9cab30ebc13e tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:56:21.745269 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-3c4eec4a-d957-4d9e-a151-9cab30ebc13e tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:56:21.746196 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-3c4eec4a-d957-4d9e-a151-9cab30ebc13e tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:56:21.746784 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-3c4eec4a-d957-4d9e-a151-9cab30ebc13e tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:56:21.890726 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.policy [None req-3c4eec4a-d957-4d9e-a151-9cab30ebc13e tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58bfb7417bc94583963401ae0fe9d39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0672be3fa3f7414da1c1a5b7300abbe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128729) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:56:21.901796 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.policy [None req-3c4eec4a-d957-4d9e-a151-9cab30ebc13e tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58bfb7417bc94583963401ae0fe9d39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0672be3fa3f7414da1c1a5b7300abbe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128729) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:56:21.903353 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.policy [None req-3c4eec4a-d957-4d9e-a151-9cab30ebc13e tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58bfb7417bc94583963401ae0fe9d39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0672be3fa3f7414da1c1a5b7300abbe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128729) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:56:21.904528 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: INFO nova.api.openstack.requestlog [None req-3c4eec4a-d957-4d9e-a151-9cab30ebc13e tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] 10.222.0.61 "GET /compute/v2.1/servers/cca08141-979e-4519-88b3-c77e8a71ae3e" status: 200 len: 1731 microversion: 2.20 time: 0.172858 May 14 15:56:21.905105 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: [pid: 128729|app: 0|req: 552/1120] 10.222.0.61 () {60 vars in 1276 bytes} [Sat May 14 15:56:21 2022] GET /compute/v2.1/servers/cca08141-979e-4519-88b3-c77e8a71ae3e => generated 1731 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 14 15:56:22.925141 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi [None req-89402fd9-0640-44bc-bd08-2710b48a4265 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Calling method '>' {{(pid=128728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 15:56:22.925843 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.compute.api [None req-89402fd9-0640-44bc-bd08-2710b48a4265 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] [instance: cca08141-979e-4519-88b3-c77e8a71ae3e] Fetching instance by UUID {{(pid=128728) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 15:56:22.932464 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-89402fd9-0640-44bc-bd08-2710b48a4265 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:56:22.932915 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-89402fd9-0640-44bc-bd08-2710b48a4265 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:56:22.933681 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-89402fd9-0640-44bc-bd08-2710b48a4265 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:56:22.934120 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-89402fd9-0640-44bc-bd08-2710b48a4265 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:56:23.065885 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.policy [None req-89402fd9-0640-44bc-bd08-2710b48a4265 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58bfb7417bc94583963401ae0fe9d39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0672be3fa3f7414da1c1a5b7300abbe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128728) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:56:23.074256 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.policy [None req-89402fd9-0640-44bc-bd08-2710b48a4265 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58bfb7417bc94583963401ae0fe9d39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0672be3fa3f7414da1c1a5b7300abbe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128728) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:56:23.075804 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.policy [None req-89402fd9-0640-44bc-bd08-2710b48a4265 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58bfb7417bc94583963401ae0fe9d39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0672be3fa3f7414da1c1a5b7300abbe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128728) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:56:23.076943 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: INFO nova.api.openstack.requestlog [None req-89402fd9-0640-44bc-bd08-2710b48a4265 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] 10.222.0.61 "GET /compute/v2.1/servers/cca08141-979e-4519-88b3-c77e8a71ae3e" status: 200 len: 1731 microversion: 2.20 time: 0.156526 May 14 15:56:23.077532 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: [pid: 128728|app: 0|req: 569/1121] 10.222.0.61 () {60 vars in 1276 bytes} [Sat May 14 15:56:22 2022] GET /compute/v2.1/servers/cca08141-979e-4519-88b3-c77e8a71ae3e => generated 1731 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 14 15:56:24.095413 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi [None req-f87ade58-1788-4ddf-85f1-ccaf40e2734a tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Calling method '>' {{(pid=128729) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 15:56:24.096093 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.compute.api [None req-f87ade58-1788-4ddf-85f1-ccaf40e2734a tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] [instance: cca08141-979e-4519-88b3-c77e8a71ae3e] Fetching instance by UUID {{(pid=128729) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 15:56:24.103201 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-f87ade58-1788-4ddf-85f1-ccaf40e2734a tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:56:24.103743 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-f87ade58-1788-4ddf-85f1-ccaf40e2734a tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:56:24.104818 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-f87ade58-1788-4ddf-85f1-ccaf40e2734a tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:56:24.105135 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-f87ade58-1788-4ddf-85f1-ccaf40e2734a tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:56:24.257922 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.policy [None req-f87ade58-1788-4ddf-85f1-ccaf40e2734a tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58bfb7417bc94583963401ae0fe9d39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0672be3fa3f7414da1c1a5b7300abbe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128729) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:56:24.266360 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.policy [None req-f87ade58-1788-4ddf-85f1-ccaf40e2734a tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58bfb7417bc94583963401ae0fe9d39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0672be3fa3f7414da1c1a5b7300abbe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128729) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:56:24.267858 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.policy [None req-f87ade58-1788-4ddf-85f1-ccaf40e2734a tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58bfb7417bc94583963401ae0fe9d39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0672be3fa3f7414da1c1a5b7300abbe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128729) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:56:24.269032 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: INFO nova.api.openstack.requestlog [None req-f87ade58-1788-4ddf-85f1-ccaf40e2734a tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] 10.222.0.61 "GET /compute/v2.1/servers/cca08141-979e-4519-88b3-c77e8a71ae3e" status: 200 len: 1731 microversion: 2.20 time: 0.177719 May 14 15:56:24.269594 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: [pid: 128729|app: 0|req: 553/1122] 10.222.0.61 () {60 vars in 1276 bytes} [Sat May 14 15:56:24 2022] GET /compute/v2.1/servers/cca08141-979e-4519-88b3-c77e8a71ae3e => generated 1731 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 14 15:56:25.288030 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi [None req-05ca02f1-e4fc-42f4-8bfd-88f32f443dfe tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Calling method '>' {{(pid=128728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 15:56:25.288552 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.compute.api [None req-05ca02f1-e4fc-42f4-8bfd-88f32f443dfe tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] [instance: cca08141-979e-4519-88b3-c77e8a71ae3e] Fetching instance by UUID {{(pid=128728) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 15:56:25.296311 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-05ca02f1-e4fc-42f4-8bfd-88f32f443dfe tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:56:25.296970 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-05ca02f1-e4fc-42f4-8bfd-88f32f443dfe tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:56:25.297784 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-05ca02f1-e4fc-42f4-8bfd-88f32f443dfe tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:56:25.298229 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-05ca02f1-e4fc-42f4-8bfd-88f32f443dfe tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:56:25.430133 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.policy [None req-05ca02f1-e4fc-42f4-8bfd-88f32f443dfe tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58bfb7417bc94583963401ae0fe9d39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0672be3fa3f7414da1c1a5b7300abbe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128728) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:56:25.438280 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.policy [None req-05ca02f1-e4fc-42f4-8bfd-88f32f443dfe tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58bfb7417bc94583963401ae0fe9d39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0672be3fa3f7414da1c1a5b7300abbe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128728) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:56:25.439859 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.policy [None req-05ca02f1-e4fc-42f4-8bfd-88f32f443dfe tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58bfb7417bc94583963401ae0fe9d39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0672be3fa3f7414da1c1a5b7300abbe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128728) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:56:25.441025 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: INFO nova.api.openstack.requestlog [None req-05ca02f1-e4fc-42f4-8bfd-88f32f443dfe tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] 10.222.0.61 "GET /compute/v2.1/servers/cca08141-979e-4519-88b3-c77e8a71ae3e" status: 200 len: 1718 microversion: 2.20 time: 0.157148 May 14 15:56:25.441587 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: [pid: 128728|app: 0|req: 570/1123] 10.222.0.61 () {60 vars in 1276 bytes} [Sat May 14 15:56:25 2022] GET /compute/v2.1/servers/cca08141-979e-4519-88b3-c77e8a71ae3e => generated 1718 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 14 15:56:44.824031 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi [None req-2811c550-a572-4d0c-b3b5-87acbdbd41e3 tempest-VolumesSnapshotTestJSON-671752898 tempest-VolumesSnapshotTestJSON-671752898-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "c26fc895-3da1-456d-ab65-ea6d6261013a", "device": "/dev/sdb"}} {{(pid=128729) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 15:56:44.825641 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.compute.api [None req-2811c550-a572-4d0c-b3b5-87acbdbd41e3 tempest-VolumesSnapshotTestJSON-671752898 tempest-VolumesSnapshotTestJSON-671752898-project] [instance: a1d28d7f-bade-404d-a453-e09a34fbb232] Fetching instance by UUID {{(pid=128729) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 15:56:44.831604 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-2811c550-a572-4d0c-b3b5-87acbdbd41e3 tempest-VolumesSnapshotTestJSON-671752898 tempest-VolumesSnapshotTestJSON-671752898-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:56:44.832060 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-2811c550-a572-4d0c-b3b5-87acbdbd41e3 tempest-VolumesSnapshotTestJSON-671752898 tempest-VolumesSnapshotTestJSON-671752898-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:56:44.832840 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-2811c550-a572-4d0c-b3b5-87acbdbd41e3 tempest-VolumesSnapshotTestJSON-671752898 tempest-VolumesSnapshotTestJSON-671752898-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:56:44.833280 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-2811c550-a572-4d0c-b3b5-87acbdbd41e3 tempest-VolumesSnapshotTestJSON-671752898 tempest-VolumesSnapshotTestJSON-671752898-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:56:45.075080 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: INFO nova.api.openstack.requestlog [None req-2811c550-a572-4d0c-b3b5-87acbdbd41e3 tempest-VolumesSnapshotTestJSON-671752898 tempest-VolumesSnapshotTestJSON-671752898-project] 10.222.0.61 "POST /compute/v2.1/servers/a1d28d7f-bade-404d-a453-e09a34fbb232/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.255202 May 14 15:56:45.081028 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: [pid: 128729|app: 0|req: 554/1124] 10.222.0.61 () {60 vars in 1322 bytes} [Sat May 14 15:56:44 2022] POST /compute/v2.1/servers/a1d28d7f-bade-404d-a453-e09a34fbb232/os-volume_attachments => generated 194 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 14 15:56:58.712661 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi [None req-c0eb54ac-8a60-441b-87b7-bd97f8aed022 tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] Calling method '>' {{(pid=128728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 15:56:58.713213 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.compute.api [None req-c0eb54ac-8a60-441b-87b7-bd97f8aed022 tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] [instance: 8ae36099-24d3-40a1-83c6-cf72bb619a57] Fetching instance by UUID {{(pid=128728) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 15:56:58.720373 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-c0eb54ac-8a60-441b-87b7-bd97f8aed022 tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:56:58.720834 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-c0eb54ac-8a60-441b-87b7-bd97f8aed022 tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:56:58.721619 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-c0eb54ac-8a60-441b-87b7-bd97f8aed022 tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:56:58.722119 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-c0eb54ac-8a60-441b-87b7-bd97f8aed022 tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:56:58.903751 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: INFO nova.api.openstack.requestlog [None req-c0eb54ac-8a60-441b-87b7-bd97f8aed022 tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] 10.222.0.61 "GET /compute/v2.1/servers/8ae36099-24d3-40a1-83c6-cf72bb619a57/ips" status: 200 len: 150 microversion: 2.1 time: 0.195146 May 14 15:56:58.904483 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: [pid: 128728|app: 0|req: 571/1125] 10.222.0.61 () {58 vars in 1247 bytes} [Sat May 14 15:56:58 2022] GET /compute/v2.1/servers/8ae36099-24d3-40a1-83c6-cf72bb619a57/ips => generated 150 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 14 15:57:08.581376 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi [None req-7e7e22dd-2d59-4002-ab5c-4b38b2e9d98c tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "717cabe7-74f0-4dfa-8eb4-23d8389deb42"}} {{(pid=128729) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 15:57:08.582538 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.compute.api [None req-7e7e22dd-2d59-4002-ab5c-4b38b2e9d98c tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] [instance: 8ae36099-24d3-40a1-83c6-cf72bb619a57] Fetching instance by UUID {{(pid=128729) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 15:57:08.588822 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-7e7e22dd-2d59-4002-ab5c-4b38b2e9d98c tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:57:08.589286 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-7e7e22dd-2d59-4002-ab5c-4b38b2e9d98c tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:57:08.590064 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-7e7e22dd-2d59-4002-ab5c-4b38b2e9d98c tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:57:08.590538 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-7e7e22dd-2d59-4002-ab5c-4b38b2e9d98c tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:57:08.842114 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: INFO nova.api.openstack.requestlog [None req-7e7e22dd-2d59-4002-ab5c-4b38b2e9d98c tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] 10.222.0.61 "POST /compute/v2.1/servers/8ae36099-24d3-40a1-83c6-cf72bb619a57/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.265351 May 14 15:57:08.842751 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: [pid: 128729|app: 0|req: 555/1126] 10.222.0.61 () {60 vars in 1322 bytes} [Sat May 14 15:57:08 2022] POST /compute/v2.1/servers/8ae36099-24d3-40a1-83c6-cf72bb619a57/os-volume_attachments => generated 194 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 14 15:57:18.668207 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi [None req-84192c8a-793e-42f2-aff1-b297b7ed7391 tempest-TestVolumeBootPattern-2062489882 tempest-TestVolumeBootPattern-2062489882-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-123016882", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1553604469", "security_groups": [{"name": "tempest-secgroup-smoke-1987363797"}], "block_device_mapping_v2": [{"uuid": "edd95f07-559a-457a-bcaf-c6b68b4e3d00", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "791585d6-2e4a-4237-ab00-9a26c50b495e"}]}} {{(pid=128728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 15:57:18.804021 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.network.neutron [None req-84192c8a-793e-42f2-aff1-b297b7ed7391 tempest-TestVolumeBootPattern-2062489882 tempest-TestVolumeBootPattern-2062489882-project] validate_networks() for [('791585d6-2e4a-4237-ab00-9a26c50b495e', None, None, None, None, None)] {{(pid=128728) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 14 15:57:19.177564 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.virt.hardware [None req-84192c8a-793e-42f2-aff1-b297b7ed7391 tempest-TestVolumeBootPattern-2062489882 tempest-TestVolumeBootPattern-2062489882-project] Flavor limits 0:0:0 {{(pid=128728) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 14 15:57:19.177983 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.virt.hardware [None req-84192c8a-793e-42f2-aff1-b297b7ed7391 tempest-TestVolumeBootPattern-2062489882 tempest-TestVolumeBootPattern-2062489882-project] Image limits 0:0:0 {{(pid=128728) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 14 15:57:19.178492 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.virt.hardware [None req-84192c8a-793e-42f2-aff1-b297b7ed7391 tempest-TestVolumeBootPattern-2062489882 tempest-TestVolumeBootPattern-2062489882-project] Flavor pref 0:0:0 {{(pid=128728) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 14 15:57:19.178898 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.virt.hardware [None req-84192c8a-793e-42f2-aff1-b297b7ed7391 tempest-TestVolumeBootPattern-2062489882 tempest-TestVolumeBootPattern-2062489882-project] Image pref 0:0:0 {{(pid=128728) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 14 15:57:19.179305 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.virt.hardware [None req-84192c8a-793e-42f2-aff1-b297b7ed7391 tempest-TestVolumeBootPattern-2062489882 tempest-TestVolumeBootPattern-2062489882-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128728) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 14 15:57:19.188371 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-84192c8a-793e-42f2-aff1-b297b7ed7391 tempest-TestVolumeBootPattern-2062489882 tempest-TestVolumeBootPattern-2062489882-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:57:19.188819 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-84192c8a-793e-42f2-aff1-b297b7ed7391 tempest-TestVolumeBootPattern-2062489882 tempest-TestVolumeBootPattern-2062489882-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:57:19.189619 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-84192c8a-793e-42f2-aff1-b297b7ed7391 tempest-TestVolumeBootPattern-2062489882 tempest-TestVolumeBootPattern-2062489882-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:57:19.190054 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-84192c8a-793e-42f2-aff1-b297b7ed7391 tempest-TestVolumeBootPattern-2062489882 tempest-TestVolumeBootPattern-2062489882-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:57:19.206225 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.quota [None req-84192c8a-793e-42f2-aff1-b297b7ed7391 tempest-TestVolumeBootPattern-2062489882 tempest-TestVolumeBootPattern-2062489882-project] Getting quotas for project 7a3a2b5dee7a404a8445c8aa434b5a43. Resources: {'instances', 'cores', 'ram'} {{(pid=128728) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 14 15:57:19.209965 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.quota [None req-84192c8a-793e-42f2-aff1-b297b7ed7391 tempest-TestVolumeBootPattern-2062489882 tempest-TestVolumeBootPattern-2062489882-project] Getting quotas for user 568f6783dd4d43398a70a9ffa58ff660 and project 7a3a2b5dee7a404a8445c8aa434b5a43. Resources: {'instances', 'cores', 'ram'} {{(pid=128728) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 14 15:57:19.264591 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.compute.api [None req-84192c8a-793e-42f2-aff1-b297b7ed7391 tempest-TestVolumeBootPattern-2062489882 tempest-TestVolumeBootPattern-2062489882-project] Going to run 1 instances... {{(pid=128728) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 14 15:57:19.266730 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.compute.api [None req-84192c8a-793e-42f2-aff1-b297b7ed7391 tempest-TestVolumeBootPattern-2062489882 tempest-TestVolumeBootPattern-2062489882-project] [instance: 6dd9e299-5776-4848-b4ab-6d07424a3f8e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='edd95f07-559a-457a-bcaf-c6b68b4e3d00',volume_size=None,volume_type=None)] {{(pid=128728) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 14 15:57:19.390475 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: INFO nova.api.openstack.requestlog [None req-84192c8a-793e-42f2-aff1-b297b7ed7391 tempest-TestVolumeBootPattern-2062489882 tempest-TestVolumeBootPattern-2062489882-project] 10.222.0.61 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.726245 May 14 15:57:19.391398 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: [pid: 128728|app: 0|req: 572/1127] 10.222.0.61 () {60 vars in 1146 bytes} [Sat May 14 15:57:18 2022] POST /compute/v2.1/servers => generated 406 bytes in 728 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 14 15:57:19.402373 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi [None req-76867dae-80f1-44d6-9edb-8ed169a662ae tempest-TestVolumeBootPattern-2062489882 tempest-TestVolumeBootPattern-2062489882-project] Calling method '>' {{(pid=128729) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 15:57:19.403078 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.compute.api [None req-76867dae-80f1-44d6-9edb-8ed169a662ae tempest-TestVolumeBootPattern-2062489882 tempest-TestVolumeBootPattern-2062489882-project] [instance: 6dd9e299-5776-4848-b4ab-6d07424a3f8e] Fetching instance by UUID {{(pid=128729) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 15:57:19.464712 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.policy [None req-76867dae-80f1-44d6-9edb-8ed169a662ae tempest-TestVolumeBootPattern-2062489882 tempest-TestVolumeBootPattern-2062489882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '568f6783dd4d43398a70a9ffa58ff660', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a3a2b5dee7a404a8445c8aa434b5a43', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128729) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:57:19.471164 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: INFO nova.api.openstack.requestlog [None req-76867dae-80f1-44d6-9edb-8ed169a662ae tempest-TestVolumeBootPattern-2062489882 tempest-TestVolumeBootPattern-2062489882-project] 10.222.0.61 "GET /compute/v2.1/servers/6dd9e299-5776-4848-b4ab-6d07424a3f8e" status: 200 len: 1094 microversion: 2.1 time: 0.073740 May 14 15:57:19.471728 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: [pid: 128729|app: 0|req: 556/1128] 10.222.0.61 () {58 vars in 1235 bytes} [Sat May 14 15:57:19 2022] GET /compute/v2.1/servers/6dd9e299-5776-4848-b4ab-6d07424a3f8e => generated 1094 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 15:57:20.488433 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi [None req-38d2f627-a137-4585-90b8-077dec123356 tempest-TestVolumeBootPattern-2062489882 tempest-TestVolumeBootPattern-2062489882-project] Calling method '>' {{(pid=128728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 15:57:20.490616 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.compute.api [None req-38d2f627-a137-4585-90b8-077dec123356 tempest-TestVolumeBootPattern-2062489882 tempest-TestVolumeBootPattern-2062489882-project] [instance: 6dd9e299-5776-4848-b4ab-6d07424a3f8e] Fetching instance by UUID {{(pid=128728) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 15:57:20.500158 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-38d2f627-a137-4585-90b8-077dec123356 tempest-TestVolumeBootPattern-2062489882 tempest-TestVolumeBootPattern-2062489882-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:57:20.500752 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-38d2f627-a137-4585-90b8-077dec123356 tempest-TestVolumeBootPattern-2062489882 tempest-TestVolumeBootPattern-2062489882-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:57:20.501775 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-38d2f627-a137-4585-90b8-077dec123356 tempest-TestVolumeBootPattern-2062489882 tempest-TestVolumeBootPattern-2062489882-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:57:20.502337 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-38d2f627-a137-4585-90b8-077dec123356 tempest-TestVolumeBootPattern-2062489882 tempest-TestVolumeBootPattern-2062489882-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:57:20.577167 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.policy [None req-38d2f627-a137-4585-90b8-077dec123356 tempest-TestVolumeBootPattern-2062489882 tempest-TestVolumeBootPattern-2062489882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '568f6783dd4d43398a70a9ffa58ff660', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a3a2b5dee7a404a8445c8aa434b5a43', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128728) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:57:20.584654 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: INFO nova.api.openstack.requestlog [None req-38d2f627-a137-4585-90b8-077dec123356 tempest-TestVolumeBootPattern-2062489882 tempest-TestVolumeBootPattern-2062489882-project] 10.222.0.61 "GET /compute/v2.1/servers/6dd9e299-5776-4848-b4ab-6d07424a3f8e" status: 200 len: 1210 microversion: 2.1 time: 0.100161 May 14 15:57:20.585382 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: [pid: 128728|app: 0|req: 573/1129] 10.222.0.61 () {58 vars in 1235 bytes} [Sat May 14 15:57:20 2022] GET /compute/v2.1/servers/6dd9e299-5776-4848-b4ab-6d07424a3f8e => generated 1210 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 15:57:21.603333 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi [None req-6b3c12ea-5eeb-4916-8525-46c64bd5d149 tempest-TestVolumeBootPattern-2062489882 tempest-TestVolumeBootPattern-2062489882-project] Calling method '>' {{(pid=128729) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 15:57:21.604517 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.compute.api [None req-6b3c12ea-5eeb-4916-8525-46c64bd5d149 tempest-TestVolumeBootPattern-2062489882 tempest-TestVolumeBootPattern-2062489882-project] [instance: 6dd9e299-5776-4848-b4ab-6d07424a3f8e] Fetching instance by UUID {{(pid=128729) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 15:57:21.611863 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-6b3c12ea-5eeb-4916-8525-46c64bd5d149 tempest-TestVolumeBootPattern-2062489882 tempest-TestVolumeBootPattern-2062489882-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:57:21.612315 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-6b3c12ea-5eeb-4916-8525-46c64bd5d149 tempest-TestVolumeBootPattern-2062489882 tempest-TestVolumeBootPattern-2062489882-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:57:21.613089 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-6b3c12ea-5eeb-4916-8525-46c64bd5d149 tempest-TestVolumeBootPattern-2062489882 tempest-TestVolumeBootPattern-2062489882-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:57:21.613530 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-6b3c12ea-5eeb-4916-8525-46c64bd5d149 tempest-TestVolumeBootPattern-2062489882 tempest-TestVolumeBootPattern-2062489882-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:57:21.755496 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.policy [None req-6b3c12ea-5eeb-4916-8525-46c64bd5d149 tempest-TestVolumeBootPattern-2062489882 tempest-TestVolumeBootPattern-2062489882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '568f6783dd4d43398a70a9ffa58ff660', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a3a2b5dee7a404a8445c8aa434b5a43', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128729) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:57:21.763411 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: INFO nova.api.openstack.requestlog [None req-6b3c12ea-5eeb-4916-8525-46c64bd5d149 tempest-TestVolumeBootPattern-2062489882 tempest-TestVolumeBootPattern-2062489882-project] 10.222.0.61 "GET /compute/v2.1/servers/6dd9e299-5776-4848-b4ab-6d07424a3f8e" status: 200 len: 1278 microversion: 2.1 time: 0.163810 May 14 15:57:21.773092 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: [pid: 128729|app: 0|req: 557/1130] 10.222.0.61 () {58 vars in 1235 bytes} [Sat May 14 15:57:21 2022] GET /compute/v2.1/servers/6dd9e299-5776-4848-b4ab-6d07424a3f8e => generated 1278 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 15:57:21.984801 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi [None req-fa5a4b71-f593-4b37-911a-bf5c5394a6eb tempest-VolumesSnapshotTestJSON-671752898 tempest-VolumesSnapshotTestJSON-671752898-project] Calling method '>' {{(pid=128729) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 15:57:21.985369 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.compute.api [None req-fa5a4b71-f593-4b37-911a-bf5c5394a6eb tempest-VolumesSnapshotTestJSON-671752898 tempest-VolumesSnapshotTestJSON-671752898-project] [instance: a1d28d7f-bade-404d-a453-e09a34fbb232] Fetching instance by UUID {{(pid=128729) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 15:57:21.985987 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi [req-4c99901c-d500-46ed-98ad-51e913a327d2 req-da572128-0a12-41db-886f-560fc2196ece service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6dd9e299-5776-4848-b4ab-6d07424a3f8e", "tag": "d761eef1-490d-4627-a1cc-64f2436e7c0c"}]} {{(pid=128728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 15:57:21.992275 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-fa5a4b71-f593-4b37-911a-bf5c5394a6eb tempest-VolumesSnapshotTestJSON-671752898 tempest-VolumesSnapshotTestJSON-671752898-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:57:21.993111 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-fa5a4b71-f593-4b37-911a-bf5c5394a6eb tempest-VolumesSnapshotTestJSON-671752898 tempest-VolumesSnapshotTestJSON-671752898-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:57:21.993969 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-fa5a4b71-f593-4b37-911a-bf5c5394a6eb tempest-VolumesSnapshotTestJSON-671752898 tempest-VolumesSnapshotTestJSON-671752898-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:57:21.994678 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-fa5a4b71-f593-4b37-911a-bf5c5394a6eb tempest-VolumesSnapshotTestJSON-671752898 tempest-VolumesSnapshotTestJSON-671752898-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:57:21.998237 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [req-4c99901c-d500-46ed-98ad-51e913a327d2 req-da572128-0a12-41db-886f-560fc2196ece service nova] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:57:21.998728 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [req-4c99901c-d500-46ed-98ad-51e913a327d2 req-da572128-0a12-41db-886f-560fc2196ece service nova] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:57:22.011919 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: INFO nova.api.openstack.compute.server_external_events [req-4c99901c-d500-46ed-98ad-51e913a327d2 req-da572128-0a12-41db-886f-560fc2196ece service nova] Creating event network-changed:d761eef1-490d-4627-a1cc-64f2436e7c0c for instance 6dd9e299-5776-4848-b4ab-6d07424a3f8e on hv-cinder-83979 May 14 15:57:22.018738 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: INFO nova.api.openstack.requestlog [req-4c99901c-d500-46ed-98ad-51e913a327d2 req-da572128-0a12-41db-886f-560fc2196ece service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.122328 May 14 15:57:22.019540 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: [pid: 128728|app: 0|req: 574/1131] 10.222.0.61 () {64 vars in 1317 bytes} [Sat May 14 15:57:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 14 15:57:22.082225 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.objects.instance [None req-fa5a4b71-f593-4b37-911a-bf5c5394a6eb tempest-VolumesSnapshotTestJSON-671752898 tempest-VolumesSnapshotTestJSON-671752898-project] Lazy-loading 'services' on Instance uuid a1d28d7f-bade-404d-a453-e09a34fbb232 {{(pid=128729) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 14 15:57:22.155583 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: INFO nova.api.openstack.requestlog [None req-fa5a4b71-f593-4b37-911a-bf5c5394a6eb tempest-VolumesSnapshotTestJSON-671752898 tempest-VolumesSnapshotTestJSON-671752898-project] 10.222.0.61 "DELETE /compute/v2.1/servers/a1d28d7f-bade-404d-a453-e09a34fbb232/os-volume_attachments/c26fc895-3da1-456d-ab65-ea6d6261013a" status: 202 len: 0 microversion: 2.1 time: 0.174759 May 14 15:57:22.156181 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: [pid: 128729|app: 0|req: 558/1132] 10.222.0.61 () {58 vars in 1415 bytes} [Sat May 14 15:57:21 2022] DELETE /compute/v2.1/servers/a1d28d7f-bade-404d-a453-e09a34fbb232/os-volume_attachments/c26fc895-3da1-456d-ab65-ea6d6261013a => generated 0 bytes in 176 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 14 15:57:22.781598 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi [None req-48f7eb36-a4c5-4f91-b143-b8e687065547 tempest-TestVolumeBootPattern-2062489882 tempest-TestVolumeBootPattern-2062489882-project] Calling method '>' {{(pid=128728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 15:57:22.782490 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.compute.api [None req-48f7eb36-a4c5-4f91-b143-b8e687065547 tempest-TestVolumeBootPattern-2062489882 tempest-TestVolumeBootPattern-2062489882-project] [instance: 6dd9e299-5776-4848-b4ab-6d07424a3f8e] Fetching instance by UUID {{(pid=128728) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 15:57:22.788411 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-48f7eb36-a4c5-4f91-b143-b8e687065547 tempest-TestVolumeBootPattern-2062489882 tempest-TestVolumeBootPattern-2062489882-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:57:22.788862 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-48f7eb36-a4c5-4f91-b143-b8e687065547 tempest-TestVolumeBootPattern-2062489882 tempest-TestVolumeBootPattern-2062489882-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:57:22.789635 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-48f7eb36-a4c5-4f91-b143-b8e687065547 tempest-TestVolumeBootPattern-2062489882 tempest-TestVolumeBootPattern-2062489882-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:57:22.790079 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-48f7eb36-a4c5-4f91-b143-b8e687065547 tempest-TestVolumeBootPattern-2062489882 tempest-TestVolumeBootPattern-2062489882-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:57:22.921362 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.policy [None req-48f7eb36-a4c5-4f91-b143-b8e687065547 tempest-TestVolumeBootPattern-2062489882 tempest-TestVolumeBootPattern-2062489882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '568f6783dd4d43398a70a9ffa58ff660', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a3a2b5dee7a404a8445c8aa434b5a43', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128728) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:57:22.928587 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: INFO nova.api.openstack.requestlog [None req-48f7eb36-a4c5-4f91-b143-b8e687065547 tempest-TestVolumeBootPattern-2062489882 tempest-TestVolumeBootPattern-2062489882-project] 10.222.0.61 "GET /compute/v2.1/servers/6dd9e299-5776-4848-b4ab-6d07424a3f8e" status: 200 len: 1278 microversion: 2.1 time: 0.151359 May 14 15:57:22.929141 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: [pid: 128728|app: 0|req: 575/1133] 10.222.0.61 () {58 vars in 1235 bytes} [Sat May 14 15:57:22 2022] GET /compute/v2.1/servers/6dd9e299-5776-4848-b4ab-6d07424a3f8e => generated 1278 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 15:57:23.946053 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi [None req-8d981691-cfd5-4f88-9a71-c5df69939cb0 tempest-TestVolumeBootPattern-2062489882 tempest-TestVolumeBootPattern-2062489882-project] Calling method '>' {{(pid=128729) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 15:57:23.946781 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.compute.api [None req-8d981691-cfd5-4f88-9a71-c5df69939cb0 tempest-TestVolumeBootPattern-2062489882 tempest-TestVolumeBootPattern-2062489882-project] [instance: 6dd9e299-5776-4848-b4ab-6d07424a3f8e] Fetching instance by UUID {{(pid=128729) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 15:57:23.953569 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-8d981691-cfd5-4f88-9a71-c5df69939cb0 tempest-TestVolumeBootPattern-2062489882 tempest-TestVolumeBootPattern-2062489882-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:57:23.954024 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-8d981691-cfd5-4f88-9a71-c5df69939cb0 tempest-TestVolumeBootPattern-2062489882 tempest-TestVolumeBootPattern-2062489882-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:57:23.954846 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-8d981691-cfd5-4f88-9a71-c5df69939cb0 tempest-TestVolumeBootPattern-2062489882 tempest-TestVolumeBootPattern-2062489882-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:57:23.955306 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-8d981691-cfd5-4f88-9a71-c5df69939cb0 tempest-TestVolumeBootPattern-2062489882 tempest-TestVolumeBootPattern-2062489882-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:57:24.085683 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.policy [None req-8d981691-cfd5-4f88-9a71-c5df69939cb0 tempest-TestVolumeBootPattern-2062489882 tempest-TestVolumeBootPattern-2062489882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '568f6783dd4d43398a70a9ffa58ff660', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a3a2b5dee7a404a8445c8aa434b5a43', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128729) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:57:24.093806 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: INFO nova.api.openstack.requestlog [None req-8d981691-cfd5-4f88-9a71-c5df69939cb0 tempest-TestVolumeBootPattern-2062489882 tempest-TestVolumeBootPattern-2062489882-project] 10.222.0.61 "GET /compute/v2.1/servers/6dd9e299-5776-4848-b4ab-6d07424a3f8e" status: 200 len: 1278 microversion: 2.1 time: 0.152512 May 14 15:57:24.094332 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: [pid: 128729|app: 0|req: 559/1134] 10.222.0.61 () {58 vars in 1235 bytes} [Sat May 14 15:57:23 2022] GET /compute/v2.1/servers/6dd9e299-5776-4848-b4ab-6d07424a3f8e => generated 1278 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 15:57:25.110440 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi [None req-fa3226ab-6c7f-42b0-a3f3-f54d1a622ac7 tempest-TestVolumeBootPattern-2062489882 tempest-TestVolumeBootPattern-2062489882-project] Calling method '>' {{(pid=128728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 15:57:25.111060 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.compute.api [None req-fa3226ab-6c7f-42b0-a3f3-f54d1a622ac7 tempest-TestVolumeBootPattern-2062489882 tempest-TestVolumeBootPattern-2062489882-project] [instance: 6dd9e299-5776-4848-b4ab-6d07424a3f8e] Fetching instance by UUID {{(pid=128728) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 15:57:25.117383 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-fa3226ab-6c7f-42b0-a3f3-f54d1a622ac7 tempest-TestVolumeBootPattern-2062489882 tempest-TestVolumeBootPattern-2062489882-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:57:25.118096 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-fa3226ab-6c7f-42b0-a3f3-f54d1a622ac7 tempest-TestVolumeBootPattern-2062489882 tempest-TestVolumeBootPattern-2062489882-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:57:25.118903 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-fa3226ab-6c7f-42b0-a3f3-f54d1a622ac7 tempest-TestVolumeBootPattern-2062489882 tempest-TestVolumeBootPattern-2062489882-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:57:25.119352 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-fa3226ab-6c7f-42b0-a3f3-f54d1a622ac7 tempest-TestVolumeBootPattern-2062489882 tempest-TestVolumeBootPattern-2062489882-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:57:25.254819 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.policy [None req-fa3226ab-6c7f-42b0-a3f3-f54d1a622ac7 tempest-TestVolumeBootPattern-2062489882 tempest-TestVolumeBootPattern-2062489882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '568f6783dd4d43398a70a9ffa58ff660', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a3a2b5dee7a404a8445c8aa434b5a43', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128728) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:57:25.264080 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: INFO nova.api.openstack.requestlog [None req-fa3226ab-6c7f-42b0-a3f3-f54d1a622ac7 tempest-TestVolumeBootPattern-2062489882 tempest-TestVolumeBootPattern-2062489882-project] 10.222.0.61 "GET /compute/v2.1/servers/6dd9e299-5776-4848-b4ab-6d07424a3f8e" status: 200 len: 1278 microversion: 2.1 time: 0.157425 May 14 15:57:25.264579 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: [pid: 128728|app: 0|req: 576/1135] 10.222.0.61 () {58 vars in 1235 bytes} [Sat May 14 15:57:25 2022] GET /compute/v2.1/servers/6dd9e299-5776-4848-b4ab-6d07424a3f8e => generated 1278 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 15:57:25.887122 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi [None req-d7139ead-32f2-4016-9d25-0a82b73770bf tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] Calling method '>' {{(pid=128729) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 15:57:25.887645 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.compute.api [None req-d7139ead-32f2-4016-9d25-0a82b73770bf tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] [instance: 8ae36099-24d3-40a1-83c6-cf72bb619a57] Fetching instance by UUID {{(pid=128729) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 15:57:25.894631 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-d7139ead-32f2-4016-9d25-0a82b73770bf tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:57:25.895575 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-d7139ead-32f2-4016-9d25-0a82b73770bf tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:57:25.896362 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-d7139ead-32f2-4016-9d25-0a82b73770bf tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:57:25.896801 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-d7139ead-32f2-4016-9d25-0a82b73770bf tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:57:25.977876 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.objects.instance [None req-d7139ead-32f2-4016-9d25-0a82b73770bf tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] Lazy-loading 'services' on Instance uuid 8ae36099-24d3-40a1-83c6-cf72bb619a57 {{(pid=128729) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 14 15:57:26.049663 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: INFO nova.api.openstack.requestlog [None req-d7139ead-32f2-4016-9d25-0a82b73770bf tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] 10.222.0.61 "DELETE /compute/v2.1/servers/8ae36099-24d3-40a1-83c6-cf72bb619a57/os-volume_attachments/717cabe7-74f0-4dfa-8eb4-23d8389deb42" status: 202 len: 0 microversion: 2.1 time: 0.166587 May 14 15:57:26.050291 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: [pid: 128729|app: 0|req: 560/1136] 10.222.0.61 () {58 vars in 1415 bytes} [Sat May 14 15:57:25 2022] DELETE /compute/v2.1/servers/8ae36099-24d3-40a1-83c6-cf72bb619a57/os-volume_attachments/717cabe7-74f0-4dfa-8eb4-23d8389deb42 => generated 0 bytes in 168 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 14 15:57:26.059239 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi [None req-fa83f895-36c4-449b-8a8f-dfce5709df14 tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] Calling method '>' {{(pid=128728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 15:57:26.060162 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.compute.api [None req-fa83f895-36c4-449b-8a8f-dfce5709df14 tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] [instance: 8ae36099-24d3-40a1-83c6-cf72bb619a57] Fetching instance by UUID {{(pid=128728) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 15:57:26.065942 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-fa83f895-36c4-449b-8a8f-dfce5709df14 tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:57:26.066427 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-fa83f895-36c4-449b-8a8f-dfce5709df14 tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:57:26.067194 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-fa83f895-36c4-449b-8a8f-dfce5709df14 tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:57:26.067634 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-fa83f895-36c4-449b-8a8f-dfce5709df14 tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:57:26.095447 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: INFO nova.api.openstack.requestlog [None req-fa83f895-36c4-449b-8a8f-dfce5709df14 tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] 10.222.0.61 "GET /compute/v2.1/servers/8ae36099-24d3-40a1-83c6-cf72bb619a57/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040875 May 14 15:57:26.095986 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: [pid: 128728|app: 0|req: 577/1137] 10.222.0.61 () {58 vars in 1301 bytes} [Sat May 14 15:57:26 2022] GET /compute/v2.1/servers/8ae36099-24d3-40a1-83c6-cf72bb619a57/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 14 15:57:26.281540 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi [None req-f8db3f1a-b13f-4c86-8de0-f610309f0edb tempest-TestVolumeBootPattern-2062489882 tempest-TestVolumeBootPattern-2062489882-project] Calling method '>' {{(pid=128729) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 15:57:26.282152 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.compute.api [None req-f8db3f1a-b13f-4c86-8de0-f610309f0edb tempest-TestVolumeBootPattern-2062489882 tempest-TestVolumeBootPattern-2062489882-project] [instance: 6dd9e299-5776-4848-b4ab-6d07424a3f8e] Fetching instance by UUID {{(pid=128729) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 15:57:26.288240 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-f8db3f1a-b13f-4c86-8de0-f610309f0edb tempest-TestVolumeBootPattern-2062489882 tempest-TestVolumeBootPattern-2062489882-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:57:26.288681 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-f8db3f1a-b13f-4c86-8de0-f610309f0edb tempest-TestVolumeBootPattern-2062489882 tempest-TestVolumeBootPattern-2062489882-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:57:26.289441 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-f8db3f1a-b13f-4c86-8de0-f610309f0edb tempest-TestVolumeBootPattern-2062489882 tempest-TestVolumeBootPattern-2062489882-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:57:26.289873 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-f8db3f1a-b13f-4c86-8de0-f610309f0edb tempest-TestVolumeBootPattern-2062489882 tempest-TestVolumeBootPattern-2062489882-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:57:26.433076 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.policy [None req-f8db3f1a-b13f-4c86-8de0-f610309f0edb tempest-TestVolumeBootPattern-2062489882 tempest-TestVolumeBootPattern-2062489882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '568f6783dd4d43398a70a9ffa58ff660', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a3a2b5dee7a404a8445c8aa434b5a43', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128729) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:57:26.440780 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: INFO nova.api.openstack.requestlog [None req-f8db3f1a-b13f-4c86-8de0-f610309f0edb tempest-TestVolumeBootPattern-2062489882 tempest-TestVolumeBootPattern-2062489882-project] 10.222.0.61 "GET /compute/v2.1/servers/6dd9e299-5776-4848-b4ab-6d07424a3f8e" status: 200 len: 1278 microversion: 2.1 time: 0.163495 May 14 15:57:26.441427 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: [pid: 128729|app: 0|req: 561/1138] 10.222.0.61 () {58 vars in 1235 bytes} [Sat May 14 15:57:26 2022] GET /compute/v2.1/servers/6dd9e299-5776-4848-b4ab-6d07424a3f8e => generated 1278 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 15:57:27.106970 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi [None req-364b2ea1-3806-41f2-94bd-ebbbab686f2a tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] Calling method '>' {{(pid=128728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 15:57:27.107883 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.compute.api [None req-364b2ea1-3806-41f2-94bd-ebbbab686f2a tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] [instance: 8ae36099-24d3-40a1-83c6-cf72bb619a57] Fetching instance by UUID {{(pid=128728) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 15:57:27.114084 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-364b2ea1-3806-41f2-94bd-ebbbab686f2a tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:57:27.114575 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-364b2ea1-3806-41f2-94bd-ebbbab686f2a tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:57:27.115339 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-364b2ea1-3806-41f2-94bd-ebbbab686f2a tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:57:27.115773 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-364b2ea1-3806-41f2-94bd-ebbbab686f2a tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:57:27.145076 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: INFO nova.api.openstack.requestlog [None req-364b2ea1-3806-41f2-94bd-ebbbab686f2a tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] 10.222.0.61 "GET /compute/v2.1/servers/8ae36099-24d3-40a1-83c6-cf72bb619a57/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042053 May 14 15:57:27.145618 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: [pid: 128728|app: 0|req: 578/1139] 10.222.0.61 () {58 vars in 1301 bytes} [Sat May 14 15:57:27 2022] GET /compute/v2.1/servers/8ae36099-24d3-40a1-83c6-cf72bb619a57/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 14 15:57:27.458159 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi [None req-883446cd-8e23-41d8-9c0c-e87f53d79057 tempest-TestVolumeBootPattern-2062489882 tempest-TestVolumeBootPattern-2062489882-project] Calling method '>' {{(pid=128729) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 15:57:27.458836 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.compute.api [None req-883446cd-8e23-41d8-9c0c-e87f53d79057 tempest-TestVolumeBootPattern-2062489882 tempest-TestVolumeBootPattern-2062489882-project] [instance: 6dd9e299-5776-4848-b4ab-6d07424a3f8e] Fetching instance by UUID {{(pid=128729) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 15:57:27.465466 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-883446cd-8e23-41d8-9c0c-e87f53d79057 tempest-TestVolumeBootPattern-2062489882 tempest-TestVolumeBootPattern-2062489882-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:57:27.465925 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-883446cd-8e23-41d8-9c0c-e87f53d79057 tempest-TestVolumeBootPattern-2062489882 tempest-TestVolumeBootPattern-2062489882-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:57:27.466729 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-883446cd-8e23-41d8-9c0c-e87f53d79057 tempest-TestVolumeBootPattern-2062489882 tempest-TestVolumeBootPattern-2062489882-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:57:27.467173 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-883446cd-8e23-41d8-9c0c-e87f53d79057 tempest-TestVolumeBootPattern-2062489882 tempest-TestVolumeBootPattern-2062489882-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:57:27.596047 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.policy [None req-883446cd-8e23-41d8-9c0c-e87f53d79057 tempest-TestVolumeBootPattern-2062489882 tempest-TestVolumeBootPattern-2062489882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '568f6783dd4d43398a70a9ffa58ff660', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a3a2b5dee7a404a8445c8aa434b5a43', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128729) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:57:27.604760 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: INFO nova.api.openstack.requestlog [None req-883446cd-8e23-41d8-9c0c-e87f53d79057 tempest-TestVolumeBootPattern-2062489882 tempest-TestVolumeBootPattern-2062489882-project] 10.222.0.61 "GET /compute/v2.1/servers/6dd9e299-5776-4848-b4ab-6d07424a3f8e" status: 200 len: 1266 microversion: 2.1 time: 0.149237 May 14 15:57:27.605353 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: [pid: 128729|app: 0|req: 562/1140] 10.222.0.61 () {58 vars in 1235 bytes} [Sat May 14 15:57:27 2022] GET /compute/v2.1/servers/6dd9e299-5776-4848-b4ab-6d07424a3f8e => generated 1266 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 15:57:28.157123 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi [None req-b7f1dedc-9635-4adb-8722-28de51a2a1d5 tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] Calling method '>' {{(pid=128728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 15:57:28.158042 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.compute.api [None req-b7f1dedc-9635-4adb-8722-28de51a2a1d5 tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] [instance: 8ae36099-24d3-40a1-83c6-cf72bb619a57] Fetching instance by UUID {{(pid=128728) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 15:57:28.164278 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-b7f1dedc-9635-4adb-8722-28de51a2a1d5 tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:57:28.164729 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-b7f1dedc-9635-4adb-8722-28de51a2a1d5 tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:57:28.165488 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-b7f1dedc-9635-4adb-8722-28de51a2a1d5 tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:57:28.165973 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-b7f1dedc-9635-4adb-8722-28de51a2a1d5 tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:57:28.195131 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: INFO nova.api.openstack.requestlog [None req-b7f1dedc-9635-4adb-8722-28de51a2a1d5 tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] 10.222.0.61 "GET /compute/v2.1/servers/8ae36099-24d3-40a1-83c6-cf72bb619a57/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041943 May 14 15:57:28.195663 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: [pid: 128728|app: 0|req: 579/1141] 10.222.0.61 () {58 vars in 1301 bytes} [Sat May 14 15:57:28 2022] GET /compute/v2.1/servers/8ae36099-24d3-40a1-83c6-cf72bb619a57/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 14 15:57:28.542868 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi [None req-a340639b-554d-4477-9a16-92331616c246 tempest-VolumesSnapshotTestJSON-671752898 tempest-VolumesSnapshotTestJSON-671752898-project] Calling method '>' {{(pid=128729) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 15:57:28.543382 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.compute.api [None req-a340639b-554d-4477-9a16-92331616c246 tempest-VolumesSnapshotTestJSON-671752898 tempest-VolumesSnapshotTestJSON-671752898-project] [instance: a1d28d7f-bade-404d-a453-e09a34fbb232] Fetching instance by UUID {{(pid=128729) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 15:57:28.549808 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-a340639b-554d-4477-9a16-92331616c246 tempest-VolumesSnapshotTestJSON-671752898 tempest-VolumesSnapshotTestJSON-671752898-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:57:28.550257 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-a340639b-554d-4477-9a16-92331616c246 tempest-VolumesSnapshotTestJSON-671752898 tempest-VolumesSnapshotTestJSON-671752898-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:57:28.551120 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-a340639b-554d-4477-9a16-92331616c246 tempest-VolumesSnapshotTestJSON-671752898 tempest-VolumesSnapshotTestJSON-671752898-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:57:28.551557 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-a340639b-554d-4477-9a16-92331616c246 tempest-VolumesSnapshotTestJSON-671752898 tempest-VolumesSnapshotTestJSON-671752898-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:57:28.579381 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.compute.api [None req-a340639b-554d-4477-9a16-92331616c246 tempest-VolumesSnapshotTestJSON-671752898 tempest-VolumesSnapshotTestJSON-671752898-project] [instance: a1d28d7f-bade-404d-a453-e09a34fbb232] Going to try to terminate instance {{(pid=128729) delete /opt/stack/nova/nova/compute/api.py:2664}} May 14 15:57:28.622203 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi [None req-29c5035e-3689-48f9-bf04-9f2105f3caa6 tempest-TestVolumeBootPattern-2062489882 tempest-TestVolumeBootPattern-2062489882-project] Calling method '>' {{(pid=128728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 15:57:28.622840 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.compute.api [None req-29c5035e-3689-48f9-bf04-9f2105f3caa6 tempest-TestVolumeBootPattern-2062489882 tempest-TestVolumeBootPattern-2062489882-project] [instance: 6dd9e299-5776-4848-b4ab-6d07424a3f8e] Fetching instance by UUID {{(pid=128728) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 15:57:28.628826 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-29c5035e-3689-48f9-bf04-9f2105f3caa6 tempest-TestVolumeBootPattern-2062489882 tempest-TestVolumeBootPattern-2062489882-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:57:28.629272 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-29c5035e-3689-48f9-bf04-9f2105f3caa6 tempest-TestVolumeBootPattern-2062489882 tempest-TestVolumeBootPattern-2062489882-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:57:28.630034 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-29c5035e-3689-48f9-bf04-9f2105f3caa6 tempest-TestVolumeBootPattern-2062489882 tempest-TestVolumeBootPattern-2062489882-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:57:28.630637 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-29c5035e-3689-48f9-bf04-9f2105f3caa6 tempest-TestVolumeBootPattern-2062489882 tempest-TestVolumeBootPattern-2062489882-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:57:28.658295 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: INFO nova.api.openstack.requestlog [None req-a340639b-554d-4477-9a16-92331616c246 tempest-VolumesSnapshotTestJSON-671752898 tempest-VolumesSnapshotTestJSON-671752898-project] 10.222.0.61 "DELETE /compute/v2.1/servers/a1d28d7f-bade-404d-a453-e09a34fbb232" status: 204 len: 0 microversion: 2.1 time: 0.118829 May 14 15:57:28.661958 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: [pid: 128729|app: 0|req: 563/1142] 10.222.0.61 () {58 vars in 1238 bytes} [Sat May 14 15:57:28 2022] DELETE /compute/v2.1/servers/a1d28d7f-bade-404d-a453-e09a34fbb232 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 14 15:57:28.668413 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi [None req-72a3d9a6-deec-401b-9ea4-652c72a7872b tempest-VolumesSnapshotTestJSON-671752898 tempest-VolumesSnapshotTestJSON-671752898-project] Calling method '>' {{(pid=128729) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 15:57:28.669131 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.compute.api [None req-72a3d9a6-deec-401b-9ea4-652c72a7872b tempest-VolumesSnapshotTestJSON-671752898 tempest-VolumesSnapshotTestJSON-671752898-project] [instance: a1d28d7f-bade-404d-a453-e09a34fbb232] Fetching instance by UUID {{(pid=128729) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 15:57:28.675446 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-72a3d9a6-deec-401b-9ea4-652c72a7872b tempest-VolumesSnapshotTestJSON-671752898 tempest-VolumesSnapshotTestJSON-671752898-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:57:28.675904 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-72a3d9a6-deec-401b-9ea4-652c72a7872b tempest-VolumesSnapshotTestJSON-671752898 tempest-VolumesSnapshotTestJSON-671752898-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:57:28.676696 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-72a3d9a6-deec-401b-9ea4-652c72a7872b tempest-VolumesSnapshotTestJSON-671752898 tempest-VolumesSnapshotTestJSON-671752898-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:57:28.677136 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-72a3d9a6-deec-401b-9ea4-652c72a7872b tempest-VolumesSnapshotTestJSON-671752898 tempest-VolumesSnapshotTestJSON-671752898-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:57:28.821107 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.policy [None req-29c5035e-3689-48f9-bf04-9f2105f3caa6 tempest-TestVolumeBootPattern-2062489882 tempest-TestVolumeBootPattern-2062489882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '568f6783dd4d43398a70a9ffa58ff660', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a3a2b5dee7a404a8445c8aa434b5a43', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128728) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:57:28.828394 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: INFO nova.api.openstack.requestlog [None req-29c5035e-3689-48f9-bf04-9f2105f3caa6 tempest-TestVolumeBootPattern-2062489882 tempest-TestVolumeBootPattern-2062489882-project] 10.222.0.61 "GET /compute/v2.1/servers/6dd9e299-5776-4848-b4ab-6d07424a3f8e" status: 200 len: 1266 microversion: 2.1 time: 0.210980 May 14 15:57:28.828952 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: [pid: 128728|app: 0|req: 580/1143] 10.222.0.61 () {58 vars in 1235 bytes} [Sat May 14 15:57:28 2022] GET /compute/v2.1/servers/6dd9e299-5776-4848-b4ab-6d07424a3f8e => generated 1266 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 15:57:28.848208 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.policy [None req-72a3d9a6-deec-401b-9ea4-652c72a7872b tempest-VolumesSnapshotTestJSON-671752898 tempest-VolumesSnapshotTestJSON-671752898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3e4193c9d9043c99ee5bee59f79f7a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ad8088ecb8a4f72a98ad70fa8be02b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128729) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:57:28.856765 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: INFO nova.api.openstack.requestlog [None req-72a3d9a6-deec-401b-9ea4-652c72a7872b tempest-VolumesSnapshotTestJSON-671752898 tempest-VolumesSnapshotTestJSON-671752898-project] 10.222.0.61 "GET /compute/v2.1/servers/a1d28d7f-bade-404d-a453-e09a34fbb232" status: 200 len: 1513 microversion: 2.1 time: 0.193439 May 14 15:57:28.857334 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: [pid: 128729|app: 0|req: 564/1144] 10.222.0.61 () {58 vars in 1235 bytes} [Sat May 14 15:57:28 2022] GET /compute/v2.1/servers/a1d28d7f-bade-404d-a453-e09a34fbb232 => generated 1513 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 15:57:29.207031 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi [None req-6fe16c96-e223-4829-b33a-400c2096105c tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] Calling method '>' {{(pid=128728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 15:57:29.207945 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.compute.api [None req-6fe16c96-e223-4829-b33a-400c2096105c tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] [instance: 8ae36099-24d3-40a1-83c6-cf72bb619a57] Fetching instance by UUID {{(pid=128728) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 15:57:29.214358 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-6fe16c96-e223-4829-b33a-400c2096105c tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:57:29.214806 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-6fe16c96-e223-4829-b33a-400c2096105c tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:57:29.215596 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-6fe16c96-e223-4829-b33a-400c2096105c tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:57:29.216024 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-6fe16c96-e223-4829-b33a-400c2096105c tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:57:29.244339 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: INFO nova.api.openstack.requestlog [None req-6fe16c96-e223-4829-b33a-400c2096105c tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] 10.222.0.61 "GET /compute/v2.1/servers/8ae36099-24d3-40a1-83c6-cf72bb619a57/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040740 May 14 15:57:29.245109 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: [pid: 128728|app: 0|req: 581/1145] 10.222.0.61 () {58 vars in 1301 bytes} [Sat May 14 15:57:29 2022] GET /compute/v2.1/servers/8ae36099-24d3-40a1-83c6-cf72bb619a57/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 14 15:57:29.844935 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi [None req-d2653164-8a6a-4800-9896-c76989e9f570 tempest-TestVolumeBootPattern-2062489882 tempest-TestVolumeBootPattern-2062489882-project] Calling method '>' {{(pid=128729) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 15:57:29.845560 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.compute.api [None req-d2653164-8a6a-4800-9896-c76989e9f570 tempest-TestVolumeBootPattern-2062489882 tempest-TestVolumeBootPattern-2062489882-project] [instance: 6dd9e299-5776-4848-b4ab-6d07424a3f8e] Fetching instance by UUID {{(pid=128729) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 15:57:29.852085 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-d2653164-8a6a-4800-9896-c76989e9f570 tempest-TestVolumeBootPattern-2062489882 tempest-TestVolumeBootPattern-2062489882-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:57:29.852543 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-d2653164-8a6a-4800-9896-c76989e9f570 tempest-TestVolumeBootPattern-2062489882 tempest-TestVolumeBootPattern-2062489882-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:57:29.853958 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-d2653164-8a6a-4800-9896-c76989e9f570 tempest-TestVolumeBootPattern-2062489882 tempest-TestVolumeBootPattern-2062489882-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:57:29.854488 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-d2653164-8a6a-4800-9896-c76989e9f570 tempest-TestVolumeBootPattern-2062489882 tempest-TestVolumeBootPattern-2062489882-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:57:29.873689 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi [None req-9d0aceb9-795b-48ad-891e-856ea1425630 tempest-VolumesSnapshotTestJSON-671752898 tempest-VolumesSnapshotTestJSON-671752898-project] Calling method '>' {{(pid=128728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 15:57:29.874295 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.compute.api [None req-9d0aceb9-795b-48ad-891e-856ea1425630 tempest-VolumesSnapshotTestJSON-671752898 tempest-VolumesSnapshotTestJSON-671752898-project] [instance: a1d28d7f-bade-404d-a453-e09a34fbb232] Fetching instance by UUID {{(pid=128728) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 15:57:29.880019 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-9d0aceb9-795b-48ad-891e-856ea1425630 tempest-VolumesSnapshotTestJSON-671752898 tempest-VolumesSnapshotTestJSON-671752898-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:57:29.880480 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-9d0aceb9-795b-48ad-891e-856ea1425630 tempest-VolumesSnapshotTestJSON-671752898 tempest-VolumesSnapshotTestJSON-671752898-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:57:29.881242 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-9d0aceb9-795b-48ad-891e-856ea1425630 tempest-VolumesSnapshotTestJSON-671752898 tempest-VolumesSnapshotTestJSON-671752898-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:57:29.881682 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-9d0aceb9-795b-48ad-891e-856ea1425630 tempest-VolumesSnapshotTestJSON-671752898 tempest-VolumesSnapshotTestJSON-671752898-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:57:30.048565 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.policy [None req-d2653164-8a6a-4800-9896-c76989e9f570 tempest-TestVolumeBootPattern-2062489882 tempest-TestVolumeBootPattern-2062489882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '568f6783dd4d43398a70a9ffa58ff660', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a3a2b5dee7a404a8445c8aa434b5a43', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128729) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:57:30.055004 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.policy [None req-9d0aceb9-795b-48ad-891e-856ea1425630 tempest-VolumesSnapshotTestJSON-671752898 tempest-VolumesSnapshotTestJSON-671752898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3e4193c9d9043c99ee5bee59f79f7a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ad8088ecb8a4f72a98ad70fa8be02b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128728) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:57:30.055946 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: INFO nova.api.openstack.requestlog [None req-d2653164-8a6a-4800-9896-c76989e9f570 tempest-TestVolumeBootPattern-2062489882 tempest-TestVolumeBootPattern-2062489882-project] 10.222.0.61 "GET /compute/v2.1/servers/6dd9e299-5776-4848-b4ab-6d07424a3f8e" status: 200 len: 1266 microversion: 2.1 time: 0.214843 May 14 15:57:30.056563 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: [pid: 128729|app: 0|req: 565/1146] 10.222.0.61 () {58 vars in 1235 bytes} [Sat May 14 15:57:29 2022] GET /compute/v2.1/servers/6dd9e299-5776-4848-b4ab-6d07424a3f8e => generated 1266 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 15:57:30.062194 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: INFO nova.api.openstack.requestlog [None req-9d0aceb9-795b-48ad-891e-856ea1425630 tempest-VolumesSnapshotTestJSON-671752898 tempest-VolumesSnapshotTestJSON-671752898-project] 10.222.0.61 "GET /compute/v2.1/servers/a1d28d7f-bade-404d-a453-e09a34fbb232" status: 200 len: 1513 microversion: 2.1 time: 0.192970 May 14 15:57:30.062757 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: [pid: 128728|app: 0|req: 582/1147] 10.222.0.61 () {58 vars in 1235 bytes} [Sat May 14 15:57:29 2022] GET /compute/v2.1/servers/a1d28d7f-bade-404d-a453-e09a34fbb232 => generated 1513 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 15:57:30.256016 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi [None req-c172fa95-584e-4ae5-bf0d-7f1a19f58246 tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] Calling method '>' {{(pid=128729) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 15:57:30.257019 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.compute.api [None req-c172fa95-584e-4ae5-bf0d-7f1a19f58246 tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] [instance: 8ae36099-24d3-40a1-83c6-cf72bb619a57] Fetching instance by UUID {{(pid=128729) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 15:57:30.263073 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-c172fa95-584e-4ae5-bf0d-7f1a19f58246 tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:57:30.263546 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-c172fa95-584e-4ae5-bf0d-7f1a19f58246 tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:57:30.264308 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-c172fa95-584e-4ae5-bf0d-7f1a19f58246 tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:57:30.264743 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-c172fa95-584e-4ae5-bf0d-7f1a19f58246 tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:57:30.292849 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: INFO nova.api.openstack.requestlog [None req-c172fa95-584e-4ae5-bf0d-7f1a19f58246 tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] 10.222.0.61 "GET /compute/v2.1/servers/8ae36099-24d3-40a1-83c6-cf72bb619a57/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.040911 May 14 15:57:30.293398 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: [pid: 128729|app: 0|req: 566/1148] 10.222.0.61 () {58 vars in 1301 bytes} [Sat May 14 15:57:30 2022] GET /compute/v2.1/servers/8ae36099-24d3-40a1-83c6-cf72bb619a57/os-volume_attachments => generated 25 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 14 15:57:30.348838 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi [None req-9649f59b-63c5-473e-ab47-056e83e1a191 tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] Calling method '>' {{(pid=128728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 15:57:30.349321 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.compute.api [None req-9649f59b-63c5-473e-ab47-056e83e1a191 tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] [instance: 8ae36099-24d3-40a1-83c6-cf72bb619a57] Fetching instance by UUID {{(pid=128728) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 15:57:30.355622 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-9649f59b-63c5-473e-ab47-056e83e1a191 tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:57:30.356070 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-9649f59b-63c5-473e-ab47-056e83e1a191 tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:57:30.356836 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-9649f59b-63c5-473e-ab47-056e83e1a191 tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:57:30.357272 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-9649f59b-63c5-473e-ab47-056e83e1a191 tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:57:30.381871 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.compute.api [None req-9649f59b-63c5-473e-ab47-056e83e1a191 tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] [instance: 8ae36099-24d3-40a1-83c6-cf72bb619a57] Going to try to terminate instance {{(pid=128728) delete /opt/stack/nova/nova/compute/api.py:2664}} May 14 15:57:30.453638 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: INFO nova.api.openstack.requestlog [None req-9649f59b-63c5-473e-ab47-056e83e1a191 tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] 10.222.0.61 "DELETE /compute/v2.1/servers/8ae36099-24d3-40a1-83c6-cf72bb619a57" status: 204 len: 0 microversion: 2.1 time: 0.108179 May 14 15:57:30.454129 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: [pid: 128728|app: 0|req: 583/1149] 10.222.0.61 () {58 vars in 1238 bytes} [Sat May 14 15:57:30 2022] DELETE /compute/v2.1/servers/8ae36099-24d3-40a1-83c6-cf72bb619a57 => generated 0 bytes in 110 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 14 15:57:30.462198 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi [None req-d0990d5c-c847-4ea2-a79a-ad42c91673fd tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] Calling method '>' {{(pid=128729) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 15:57:30.463457 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.compute.api [None req-d0990d5c-c847-4ea2-a79a-ad42c91673fd tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] [instance: 8ae36099-24d3-40a1-83c6-cf72bb619a57] Fetching instance by UUID {{(pid=128729) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 15:57:30.469393 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-d0990d5c-c847-4ea2-a79a-ad42c91673fd tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:57:30.469844 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-d0990d5c-c847-4ea2-a79a-ad42c91673fd tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:57:30.470640 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-d0990d5c-c847-4ea2-a79a-ad42c91673fd tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:57:30.471080 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-d0990d5c-c847-4ea2-a79a-ad42c91673fd tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:57:30.604379 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.policy [None req-d0990d5c-c847-4ea2-a79a-ad42c91673fd tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc43895177134e9c9c030a9d87f94aaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7905689c95d44a5c9169249c70f7de57', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128729) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:57:30.611685 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: INFO nova.api.openstack.requestlog [None req-d0990d5c-c847-4ea2-a79a-ad42c91673fd tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] 10.222.0.61 "GET /compute/v2.1/servers/8ae36099-24d3-40a1-83c6-cf72bb619a57" status: 200 len: 1681 microversion: 2.1 time: 0.153295 May 14 15:57:30.612245 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: [pid: 128729|app: 0|req: 567/1150] 10.222.0.61 () {58 vars in 1235 bytes} [Sat May 14 15:57:30 2022] GET /compute/v2.1/servers/8ae36099-24d3-40a1-83c6-cf72bb619a57 => generated 1681 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 15:57:31.072773 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi [None req-4faa25f1-ce52-4d0e-930e-061f8c55e627 tempest-TestVolumeBootPattern-2062489882 tempest-TestVolumeBootPattern-2062489882-project] Calling method '>' {{(pid=128728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 15:57:31.073472 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.compute.api [None req-4faa25f1-ce52-4d0e-930e-061f8c55e627 tempest-TestVolumeBootPattern-2062489882 tempest-TestVolumeBootPattern-2062489882-project] [instance: 6dd9e299-5776-4848-b4ab-6d07424a3f8e] Fetching instance by UUID {{(pid=128728) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 15:57:31.079338 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi [None req-1d3453f6-3b93-4be4-afb1-692ef24d3bf6 tempest-VolumesSnapshotTestJSON-671752898 tempest-VolumesSnapshotTestJSON-671752898-project] Calling method '>' {{(pid=128729) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 15:57:31.079794 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-4faa25f1-ce52-4d0e-930e-061f8c55e627 tempest-TestVolumeBootPattern-2062489882 tempest-TestVolumeBootPattern-2062489882-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:57:31.079794 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-4faa25f1-ce52-4d0e-930e-061f8c55e627 tempest-TestVolumeBootPattern-2062489882 tempest-TestVolumeBootPattern-2062489882-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:57:31.079971 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.compute.api [None req-1d3453f6-3b93-4be4-afb1-692ef24d3bf6 tempest-VolumesSnapshotTestJSON-671752898 tempest-VolumesSnapshotTestJSON-671752898-project] [instance: a1d28d7f-bade-404d-a453-e09a34fbb232] Fetching instance by UUID {{(pid=128729) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 15:57:31.080543 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-4faa25f1-ce52-4d0e-930e-061f8c55e627 tempest-TestVolumeBootPattern-2062489882 tempest-TestVolumeBootPattern-2062489882-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:57:31.080972 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-4faa25f1-ce52-4d0e-930e-061f8c55e627 tempest-TestVolumeBootPattern-2062489882 tempest-TestVolumeBootPattern-2062489882-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:57:31.086340 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-1d3453f6-3b93-4be4-afb1-692ef24d3bf6 tempest-VolumesSnapshotTestJSON-671752898 tempest-VolumesSnapshotTestJSON-671752898-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:57:31.086748 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-1d3453f6-3b93-4be4-afb1-692ef24d3bf6 tempest-VolumesSnapshotTestJSON-671752898 tempest-VolumesSnapshotTestJSON-671752898-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:57:31.087528 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-1d3453f6-3b93-4be4-afb1-692ef24d3bf6 tempest-VolumesSnapshotTestJSON-671752898 tempest-VolumesSnapshotTestJSON-671752898-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:57:31.089173 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-1d3453f6-3b93-4be4-afb1-692ef24d3bf6 tempest-VolumesSnapshotTestJSON-671752898 tempest-VolumesSnapshotTestJSON-671752898-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:57:31.272070 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.policy [None req-4faa25f1-ce52-4d0e-930e-061f8c55e627 tempest-TestVolumeBootPattern-2062489882 tempest-TestVolumeBootPattern-2062489882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '568f6783dd4d43398a70a9ffa58ff660', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a3a2b5dee7a404a8445c8aa434b5a43', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128728) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:57:31.276460 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.policy [None req-1d3453f6-3b93-4be4-afb1-692ef24d3bf6 tempest-VolumesSnapshotTestJSON-671752898 tempest-VolumesSnapshotTestJSON-671752898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3e4193c9d9043c99ee5bee59f79f7a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ad8088ecb8a4f72a98ad70fa8be02b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128729) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:57:31.279654 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: INFO nova.api.openstack.requestlog [None req-4faa25f1-ce52-4d0e-930e-061f8c55e627 tempest-TestVolumeBootPattern-2062489882 tempest-TestVolumeBootPattern-2062489882-project] 10.222.0.61 "GET /compute/v2.1/servers/6dd9e299-5776-4848-b4ab-6d07424a3f8e" status: 200 len: 1266 microversion: 2.1 time: 0.211571 May 14 15:57:31.280221 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: [pid: 128728|app: 0|req: 584/1151] 10.222.0.61 () {58 vars in 1235 bytes} [Sat May 14 15:57:31 2022] GET /compute/v2.1/servers/6dd9e299-5776-4848-b4ab-6d07424a3f8e => generated 1266 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 15:57:31.283886 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: INFO nova.api.openstack.requestlog [None req-1d3453f6-3b93-4be4-afb1-692ef24d3bf6 tempest-VolumesSnapshotTestJSON-671752898 tempest-VolumesSnapshotTestJSON-671752898-project] 10.222.0.61 "GET /compute/v2.1/servers/a1d28d7f-bade-404d-a453-e09a34fbb232" status: 200 len: 1513 microversion: 2.1 time: 0.208376 May 14 15:57:31.284453 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: [pid: 128729|app: 0|req: 568/1152] 10.222.0.61 () {58 vars in 1235 bytes} [Sat May 14 15:57:31 2022] GET /compute/v2.1/servers/a1d28d7f-bade-404d-a453-e09a34fbb232 => generated 1513 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 15:57:31.629263 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi [None req-7e0ae954-77e5-4807-8db2-5512dfb44e33 tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] Calling method '>' {{(pid=128728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 15:57:31.629867 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.compute.api [None req-7e0ae954-77e5-4807-8db2-5512dfb44e33 tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] [instance: 8ae36099-24d3-40a1-83c6-cf72bb619a57] Fetching instance by UUID {{(pid=128728) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 15:57:31.636405 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-7e0ae954-77e5-4807-8db2-5512dfb44e33 tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:57:31.636854 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-7e0ae954-77e5-4807-8db2-5512dfb44e33 tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:57:31.637625 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-7e0ae954-77e5-4807-8db2-5512dfb44e33 tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:57:31.638064 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-7e0ae954-77e5-4807-8db2-5512dfb44e33 tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:57:32.032092 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.policy [None req-7e0ae954-77e5-4807-8db2-5512dfb44e33 tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc43895177134e9c9c030a9d87f94aaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7905689c95d44a5c9169249c70f7de57', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128728) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:57:32.039393 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: INFO nova.api.openstack.requestlog [None req-7e0ae954-77e5-4807-8db2-5512dfb44e33 tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] 10.222.0.61 "GET /compute/v2.1/servers/8ae36099-24d3-40a1-83c6-cf72bb619a57" status: 200 len: 1681 microversion: 2.1 time: 0.413920 May 14 15:57:32.039954 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: [pid: 128728|app: 0|req: 585/1153] 10.222.0.61 () {58 vars in 1235 bytes} [Sat May 14 15:57:31 2022] GET /compute/v2.1/servers/8ae36099-24d3-40a1-83c6-cf72bb619a57 => generated 1681 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 15:57:32.297436 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi [None req-8a041502-c7b1-4e7f-8e6c-e9db4170043c tempest-TestVolumeBootPattern-2062489882 tempest-TestVolumeBootPattern-2062489882-project] Calling method '>' {{(pid=128729) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 15:57:32.297965 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.compute.api [None req-8a041502-c7b1-4e7f-8e6c-e9db4170043c tempest-TestVolumeBootPattern-2062489882 tempest-TestVolumeBootPattern-2062489882-project] [instance: 6dd9e299-5776-4848-b4ab-6d07424a3f8e] Fetching instance by UUID {{(pid=128729) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 15:57:32.301103 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi [None req-3b93322f-0036-4281-bd28-c56f1069cbd4 tempest-VolumesSnapshotTestJSON-671752898 tempest-VolumesSnapshotTestJSON-671752898-project] Calling method '>' {{(pid=128728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 15:57:32.301710 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.compute.api [None req-3b93322f-0036-4281-bd28-c56f1069cbd4 tempest-VolumesSnapshotTestJSON-671752898 tempest-VolumesSnapshotTestJSON-671752898-project] [instance: a1d28d7f-bade-404d-a453-e09a34fbb232] Fetching instance by UUID {{(pid=128728) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 15:57:32.304702 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-8a041502-c7b1-4e7f-8e6c-e9db4170043c tempest-TestVolumeBootPattern-2062489882 tempest-TestVolumeBootPattern-2062489882-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:57:32.305055 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-8a041502-c7b1-4e7f-8e6c-e9db4170043c tempest-TestVolumeBootPattern-2062489882 tempest-TestVolumeBootPattern-2062489882-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:57:32.305851 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-8a041502-c7b1-4e7f-8e6c-e9db4170043c tempest-TestVolumeBootPattern-2062489882 tempest-TestVolumeBootPattern-2062489882-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:57:32.306300 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-8a041502-c7b1-4e7f-8e6c-e9db4170043c tempest-TestVolumeBootPattern-2062489882 tempest-TestVolumeBootPattern-2062489882-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:57:32.307761 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-3b93322f-0036-4281-bd28-c56f1069cbd4 tempest-VolumesSnapshotTestJSON-671752898 tempest-VolumesSnapshotTestJSON-671752898-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:57:32.308210 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-3b93322f-0036-4281-bd28-c56f1069cbd4 tempest-VolumesSnapshotTestJSON-671752898 tempest-VolumesSnapshotTestJSON-671752898-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:57:32.308982 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-3b93322f-0036-4281-bd28-c56f1069cbd4 tempest-VolumesSnapshotTestJSON-671752898 tempest-VolumesSnapshotTestJSON-671752898-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:57:32.309496 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-3b93322f-0036-4281-bd28-c56f1069cbd4 tempest-VolumesSnapshotTestJSON-671752898 tempest-VolumesSnapshotTestJSON-671752898-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:57:32.512040 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.policy [None req-8a041502-c7b1-4e7f-8e6c-e9db4170043c tempest-TestVolumeBootPattern-2062489882 tempest-TestVolumeBootPattern-2062489882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '568f6783dd4d43398a70a9ffa58ff660', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a3a2b5dee7a404a8445c8aa434b5a43', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128729) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:57:32.519204 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.policy [None req-3b93322f-0036-4281-bd28-c56f1069cbd4 tempest-VolumesSnapshotTestJSON-671752898 tempest-VolumesSnapshotTestJSON-671752898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3e4193c9d9043c99ee5bee59f79f7a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ad8088ecb8a4f72a98ad70fa8be02b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128728) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:57:32.519748 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: INFO nova.api.openstack.requestlog [None req-8a041502-c7b1-4e7f-8e6c-e9db4170043c tempest-TestVolumeBootPattern-2062489882 tempest-TestVolumeBootPattern-2062489882-project] 10.222.0.61 "GET /compute/v2.1/servers/6dd9e299-5776-4848-b4ab-6d07424a3f8e" status: 200 len: 1266 microversion: 2.1 time: 0.226352 May 14 15:57:32.520496 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: [pid: 128729|app: 0|req: 569/1154] 10.222.0.61 () {58 vars in 1235 bytes} [Sat May 14 15:57:32 2022] GET /compute/v2.1/servers/6dd9e299-5776-4848-b4ab-6d07424a3f8e => generated 1266 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 15:57:32.528329 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: INFO nova.api.openstack.requestlog [None req-3b93322f-0036-4281-bd28-c56f1069cbd4 tempest-VolumesSnapshotTestJSON-671752898 tempest-VolumesSnapshotTestJSON-671752898-project] 10.222.0.61 "GET /compute/v2.1/servers/a1d28d7f-bade-404d-a453-e09a34fbb232" status: 200 len: 1513 microversion: 2.1 time: 0.231341 May 14 15:57:32.529177 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: [pid: 128728|app: 0|req: 586/1155] 10.222.0.61 () {58 vars in 1235 bytes} [Sat May 14 15:57:32 2022] GET /compute/v2.1/servers/a1d28d7f-bade-404d-a453-e09a34fbb232 => generated 1513 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 15:57:32.646492 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi [req-db02a55b-e060-467d-b949-378d9a9c2dfc req-4151fb1d-70ff-4d9d-ae31-334e02ef9001 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a1d28d7f-bade-404d-a453-e09a34fbb232", "name": "network-vif-deleted", "tag": "5a791dcd-9407-4b8e-8d0a-a169fe794020"}]} {{(pid=128729) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 15:57:32.655058 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [req-db02a55b-e060-467d-b949-378d9a9c2dfc req-4151fb1d-70ff-4d9d-ae31-334e02ef9001 service nova] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:57:32.655497 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [req-db02a55b-e060-467d-b949-378d9a9c2dfc req-4151fb1d-70ff-4d9d-ae31-334e02ef9001 service nova] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:57:32.666955 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: INFO nova.api.openstack.compute.server_external_events [req-db02a55b-e060-467d-b949-378d9a9c2dfc req-4151fb1d-70ff-4d9d-ae31-334e02ef9001 service nova] Creating event network-vif-deleted:5a791dcd-9407-4b8e-8d0a-a169fe794020 for instance a1d28d7f-bade-404d-a453-e09a34fbb232 on hv-cinder-83979 May 14 15:57:32.671882 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: INFO nova.api.openstack.requestlog [req-db02a55b-e060-467d-b949-378d9a9c2dfc req-4151fb1d-70ff-4d9d-ae31-334e02ef9001 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029179 May 14 15:57:32.672457 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: [pid: 128729|app: 0|req: 570/1156] 10.222.0.61 () {64 vars in 1317 bytes} [Sat May 14 15:57:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 14 15:57:33.056646 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi [None req-650f65b4-f569-474d-883b-3c7008605d26 tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] Calling method '>' {{(pid=128728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 15:57:33.057237 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.compute.api [None req-650f65b4-f569-474d-883b-3c7008605d26 tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] [instance: 8ae36099-24d3-40a1-83c6-cf72bb619a57] Fetching instance by UUID {{(pid=128728) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 15:57:33.063508 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-650f65b4-f569-474d-883b-3c7008605d26 tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:57:33.063958 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-650f65b4-f569-474d-883b-3c7008605d26 tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:57:33.064725 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-650f65b4-f569-474d-883b-3c7008605d26 tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:57:33.065164 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-650f65b4-f569-474d-883b-3c7008605d26 tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:57:33.199802 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.policy [None req-650f65b4-f569-474d-883b-3c7008605d26 tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc43895177134e9c9c030a9d87f94aaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7905689c95d44a5c9169249c70f7de57', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128728) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:57:33.207057 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: INFO nova.api.openstack.requestlog [None req-650f65b4-f569-474d-883b-3c7008605d26 tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] 10.222.0.61 "GET /compute/v2.1/servers/8ae36099-24d3-40a1-83c6-cf72bb619a57" status: 200 len: 1681 microversion: 2.1 time: 0.154272 May 14 15:57:33.207615 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: [pid: 128728|app: 0|req: 587/1157] 10.222.0.61 () {58 vars in 1235 bytes} [Sat May 14 15:57:33 2022] GET /compute/v2.1/servers/8ae36099-24d3-40a1-83c6-cf72bb619a57 => generated 1681 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 15:57:33.538197 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi [None req-e59bb4ab-738c-45a8-bd09-526f62f88709 tempest-TestVolumeBootPattern-2062489882 tempest-TestVolumeBootPattern-2062489882-project] Calling method '>' {{(pid=128729) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 15:57:33.538851 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.compute.api [None req-e59bb4ab-738c-45a8-bd09-526f62f88709 tempest-TestVolumeBootPattern-2062489882 tempest-TestVolumeBootPattern-2062489882-project] [instance: 6dd9e299-5776-4848-b4ab-6d07424a3f8e] Fetching instance by UUID {{(pid=128729) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 15:57:33.544970 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi [None req-d1283e70-f4cf-422e-9a38-6b1edfaeb80a tempest-VolumesSnapshotTestJSON-671752898 tempest-VolumesSnapshotTestJSON-671752898-project] Calling method '>' {{(pid=128728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 15:57:33.545120 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-e59bb4ab-738c-45a8-bd09-526f62f88709 tempest-TestVolumeBootPattern-2062489882 tempest-TestVolumeBootPattern-2062489882-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:57:33.545443 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-e59bb4ab-738c-45a8-bd09-526f62f88709 tempest-TestVolumeBootPattern-2062489882 tempest-TestVolumeBootPattern-2062489882-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:57:33.545564 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.compute.api [None req-d1283e70-f4cf-422e-9a38-6b1edfaeb80a tempest-VolumesSnapshotTestJSON-671752898 tempest-VolumesSnapshotTestJSON-671752898-project] [instance: a1d28d7f-bade-404d-a453-e09a34fbb232] Fetching instance by UUID {{(pid=128728) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 15:57:33.546213 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-e59bb4ab-738c-45a8-bd09-526f62f88709 tempest-TestVolumeBootPattern-2062489882 tempest-TestVolumeBootPattern-2062489882-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:57:33.546675 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-e59bb4ab-738c-45a8-bd09-526f62f88709 tempest-TestVolumeBootPattern-2062489882 tempest-TestVolumeBootPattern-2062489882-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:57:33.551291 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-d1283e70-f4cf-422e-9a38-6b1edfaeb80a tempest-VolumesSnapshotTestJSON-671752898 tempest-VolumesSnapshotTestJSON-671752898-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:57:33.551743 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-d1283e70-f4cf-422e-9a38-6b1edfaeb80a tempest-VolumesSnapshotTestJSON-671752898 tempest-VolumesSnapshotTestJSON-671752898-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:57:33.552512 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-d1283e70-f4cf-422e-9a38-6b1edfaeb80a tempest-VolumesSnapshotTestJSON-671752898 tempest-VolumesSnapshotTestJSON-671752898-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:57:33.552948 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-d1283e70-f4cf-422e-9a38-6b1edfaeb80a tempest-VolumesSnapshotTestJSON-671752898 tempest-VolumesSnapshotTestJSON-671752898-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:57:33.583215 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-d1283e70-f4cf-422e-9a38-6b1edfaeb80a tempest-VolumesSnapshotTestJSON-671752898 tempest-VolumesSnapshotTestJSON-671752898-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:57:33.583828 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-d1283e70-f4cf-422e-9a38-6b1edfaeb80a tempest-VolumesSnapshotTestJSON-671752898 tempest-VolumesSnapshotTestJSON-671752898-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:57:33.584477 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.objects.instance [None req-d1283e70-f4cf-422e-9a38-6b1edfaeb80a tempest-VolumesSnapshotTestJSON-671752898 tempest-VolumesSnapshotTestJSON-671752898-project] Lazy-loading 'fault' on Instance uuid a1d28d7f-bade-404d-a453-e09a34fbb232 {{(pid=128728) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 14 15:57:33.644004 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.policy [None req-d1283e70-f4cf-422e-9a38-6b1edfaeb80a tempest-VolumesSnapshotTestJSON-671752898 tempest-VolumesSnapshotTestJSON-671752898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3e4193c9d9043c99ee5bee59f79f7a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ad8088ecb8a4f72a98ad70fa8be02b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128728) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:57:33.652222 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: INFO nova.api.openstack.requestlog [None req-d1283e70-f4cf-422e-9a38-6b1edfaeb80a tempest-VolumesSnapshotTestJSON-671752898 tempest-VolumesSnapshotTestJSON-671752898-project] 10.222.0.61 "GET /compute/v2.1/servers/a1d28d7f-bade-404d-a453-e09a34fbb232" status: 200 len: 1309 microversion: 2.1 time: 0.111001 May 14 15:57:33.652790 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: [pid: 128728|app: 0|req: 588/1158] 10.222.0.61 () {58 vars in 1235 bytes} [Sat May 14 15:57:33 2022] GET /compute/v2.1/servers/a1d28d7f-bade-404d-a453-e09a34fbb232 => generated 1309 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 15:57:33.702139 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.policy [None req-e59bb4ab-738c-45a8-bd09-526f62f88709 tempest-TestVolumeBootPattern-2062489882 tempest-TestVolumeBootPattern-2062489882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '568f6783dd4d43398a70a9ffa58ff660', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a3a2b5dee7a404a8445c8aa434b5a43', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128729) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:57:33.709548 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: INFO nova.api.openstack.requestlog [None req-e59bb4ab-738c-45a8-bd09-526f62f88709 tempest-TestVolumeBootPattern-2062489882 tempest-TestVolumeBootPattern-2062489882-project] 10.222.0.61 "GET /compute/v2.1/servers/6dd9e299-5776-4848-b4ab-6d07424a3f8e" status: 200 len: 1266 microversion: 2.1 time: 0.176154 May 14 15:57:33.710103 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: [pid: 128729|app: 0|req: 571/1159] 10.222.0.61 () {58 vars in 1235 bytes} [Sat May 14 15:57:33 2022] GET /compute/v2.1/servers/6dd9e299-5776-4848-b4ab-6d07424a3f8e => generated 1266 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 15:57:34.224849 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi [None req-59602525-e7bf-48c1-9c39-263925cf2c94 tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] Calling method '>' {{(pid=128728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 15:57:34.225527 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.compute.api [None req-59602525-e7bf-48c1-9c39-263925cf2c94 tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] [instance: 8ae36099-24d3-40a1-83c6-cf72bb619a57] Fetching instance by UUID {{(pid=128728) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 15:57:34.232260 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-59602525-e7bf-48c1-9c39-263925cf2c94 tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:57:34.232709 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-59602525-e7bf-48c1-9c39-263925cf2c94 tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:57:34.233473 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-59602525-e7bf-48c1-9c39-263925cf2c94 tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:57:34.233905 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-59602525-e7bf-48c1-9c39-263925cf2c94 tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:57:34.365291 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.policy [None req-59602525-e7bf-48c1-9c39-263925cf2c94 tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc43895177134e9c9c030a9d87f94aaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7905689c95d44a5c9169249c70f7de57', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128728) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:57:34.374060 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: INFO nova.api.openstack.requestlog [None req-59602525-e7bf-48c1-9c39-263925cf2c94 tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] 10.222.0.61 "GET /compute/v2.1/servers/8ae36099-24d3-40a1-83c6-cf72bb619a57" status: 200 len: 1681 microversion: 2.1 time: 0.153165 May 14 15:57:34.374904 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: [pid: 128728|app: 0|req: 589/1160] 10.222.0.61 () {58 vars in 1235 bytes} [Sat May 14 15:57:34 2022] GET /compute/v2.1/servers/8ae36099-24d3-40a1-83c6-cf72bb619a57 => generated 1681 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 15:57:34.669730 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi [None req-189d494c-f7da-4cfa-a995-2621cf91c297 tempest-VolumesSnapshotTestJSON-671752898 tempest-VolumesSnapshotTestJSON-671752898-project] Calling method '>' {{(pid=128729) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 15:57:34.670589 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.compute.api [None req-189d494c-f7da-4cfa-a995-2621cf91c297 tempest-VolumesSnapshotTestJSON-671752898 tempest-VolumesSnapshotTestJSON-671752898-project] [instance: a1d28d7f-bade-404d-a453-e09a34fbb232] Fetching instance by UUID {{(pid=128729) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 15:57:34.676855 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-189d494c-f7da-4cfa-a995-2621cf91c297 tempest-VolumesSnapshotTestJSON-671752898 tempest-VolumesSnapshotTestJSON-671752898-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:57:34.677300 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-189d494c-f7da-4cfa-a995-2621cf91c297 tempest-VolumesSnapshotTestJSON-671752898 tempest-VolumesSnapshotTestJSON-671752898-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:57:34.678055 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-189d494c-f7da-4cfa-a995-2621cf91c297 tempest-VolumesSnapshotTestJSON-671752898 tempest-VolumesSnapshotTestJSON-671752898-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:57:34.678546 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-189d494c-f7da-4cfa-a995-2621cf91c297 tempest-VolumesSnapshotTestJSON-671752898 tempest-VolumesSnapshotTestJSON-671752898-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:57:34.709769 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-189d494c-f7da-4cfa-a995-2621cf91c297 tempest-VolumesSnapshotTestJSON-671752898 tempest-VolumesSnapshotTestJSON-671752898-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:57:34.710237 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-189d494c-f7da-4cfa-a995-2621cf91c297 tempest-VolumesSnapshotTestJSON-671752898 tempest-VolumesSnapshotTestJSON-671752898-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:57:34.710691 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.objects.instance [None req-189d494c-f7da-4cfa-a995-2621cf91c297 tempest-VolumesSnapshotTestJSON-671752898 tempest-VolumesSnapshotTestJSON-671752898-project] Lazy-loading 'fault' on Instance uuid a1d28d7f-bade-404d-a453-e09a34fbb232 {{(pid=128729) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 14 15:57:34.726875 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi [None req-e322aca9-61e4-40f6-8517-ea53430df319 tempest-TestVolumeBootPattern-2062489882 tempest-TestVolumeBootPattern-2062489882-project] Calling method '>' {{(pid=128728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 15:57:34.727845 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.compute.api [None req-e322aca9-61e4-40f6-8517-ea53430df319 tempest-TestVolumeBootPattern-2062489882 tempest-TestVolumeBootPattern-2062489882-project] [instance: 6dd9e299-5776-4848-b4ab-6d07424a3f8e] Fetching instance by UUID {{(pid=128728) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 15:57:34.735310 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-e322aca9-61e4-40f6-8517-ea53430df319 tempest-TestVolumeBootPattern-2062489882 tempest-TestVolumeBootPattern-2062489882-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:57:34.736118 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-e322aca9-61e4-40f6-8517-ea53430df319 tempest-TestVolumeBootPattern-2062489882 tempest-TestVolumeBootPattern-2062489882-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:57:34.737138 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-e322aca9-61e4-40f6-8517-ea53430df319 tempest-TestVolumeBootPattern-2062489882 tempest-TestVolumeBootPattern-2062489882-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:57:34.737814 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-e322aca9-61e4-40f6-8517-ea53430df319 tempest-TestVolumeBootPattern-2062489882 tempest-TestVolumeBootPattern-2062489882-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:57:34.764139 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.policy [None req-189d494c-f7da-4cfa-a995-2621cf91c297 tempest-VolumesSnapshotTestJSON-671752898 tempest-VolumesSnapshotTestJSON-671752898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3e4193c9d9043c99ee5bee59f79f7a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ad8088ecb8a4f72a98ad70fa8be02b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128729) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:57:34.771974 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: INFO nova.api.openstack.requestlog [None req-189d494c-f7da-4cfa-a995-2621cf91c297 tempest-VolumesSnapshotTestJSON-671752898 tempest-VolumesSnapshotTestJSON-671752898-project] 10.222.0.61 "GET /compute/v2.1/servers/a1d28d7f-bade-404d-a453-e09a34fbb232" status: 200 len: 1309 microversion: 2.1 time: 0.106559 May 14 15:57:34.782440 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: [pid: 128729|app: 0|req: 572/1161] 10.222.0.61 () {58 vars in 1235 bytes} [Sat May 14 15:57:34 2022] GET /compute/v2.1/servers/a1d28d7f-bade-404d-a453-e09a34fbb232 => generated 1309 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 15:57:34.907351 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.policy [None req-e322aca9-61e4-40f6-8517-ea53430df319 tempest-TestVolumeBootPattern-2062489882 tempest-TestVolumeBootPattern-2062489882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '568f6783dd4d43398a70a9ffa58ff660', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a3a2b5dee7a404a8445c8aa434b5a43', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128728) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:57:34.914767 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: INFO nova.api.openstack.requestlog [None req-e322aca9-61e4-40f6-8517-ea53430df319 tempest-TestVolumeBootPattern-2062489882 tempest-TestVolumeBootPattern-2062489882-project] 10.222.0.61 "GET /compute/v2.1/servers/6dd9e299-5776-4848-b4ab-6d07424a3f8e" status: 200 len: 1266 microversion: 2.1 time: 0.191816 May 14 15:57:34.915330 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: [pid: 128728|app: 0|req: 590/1162] 10.222.0.61 () {58 vars in 1235 bytes} [Sat May 14 15:57:34 2022] GET /compute/v2.1/servers/6dd9e299-5776-4848-b4ab-6d07424a3f8e => generated 1266 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 15:57:35.258495 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi [req-be15249d-c207-479f-8207-40f9dc4719e9 req-1ad8e7b4-bebe-4536-9c3b-b4305c2834e1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8ae36099-24d3-40a1-83c6-cf72bb619a57", "name": "network-vif-deleted", "tag": "e966a1dd-a29d-4007-a232-3bc32d2f97c5"}]} {{(pid=128729) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 15:57:35.267013 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [req-be15249d-c207-479f-8207-40f9dc4719e9 req-1ad8e7b4-bebe-4536-9c3b-b4305c2834e1 service nova] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:57:35.267452 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [req-be15249d-c207-479f-8207-40f9dc4719e9 req-1ad8e7b4-bebe-4536-9c3b-b4305c2834e1 service nova] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:57:35.280038 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: INFO nova.api.openstack.compute.server_external_events [req-be15249d-c207-479f-8207-40f9dc4719e9 req-1ad8e7b4-bebe-4536-9c3b-b4305c2834e1 service nova] Creating event network-vif-deleted:e966a1dd-a29d-4007-a232-3bc32d2f97c5 for instance 8ae36099-24d3-40a1-83c6-cf72bb619a57 on hv-cinder-83979 May 14 15:57:35.285482 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: INFO nova.api.openstack.requestlog [req-be15249d-c207-479f-8207-40f9dc4719e9 req-1ad8e7b4-bebe-4536-9c3b-b4305c2834e1 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031736 May 14 15:57:35.286288 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: [pid: 128729|app: 0|req: 573/1163] 10.222.0.61 () {64 vars in 1317 bytes} [Sat May 14 15:57:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 14 15:57:35.391491 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi [None req-4f46a8ea-88ad-44af-a857-f74c3001e732 tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] Calling method '>' {{(pid=128728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 15:57:35.392813 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.compute.api [None req-4f46a8ea-88ad-44af-a857-f74c3001e732 tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] [instance: 8ae36099-24d3-40a1-83c6-cf72bb619a57] Fetching instance by UUID {{(pid=128728) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 15:57:35.401466 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-4f46a8ea-88ad-44af-a857-f74c3001e732 tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:57:35.402984 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-4f46a8ea-88ad-44af-a857-f74c3001e732 tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:57:35.404219 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-4f46a8ea-88ad-44af-a857-f74c3001e732 tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:57:35.404920 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-4f46a8ea-88ad-44af-a857-f74c3001e732 tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:57:35.439218 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-4f46a8ea-88ad-44af-a857-f74c3001e732 tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:57:35.439670 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-4f46a8ea-88ad-44af-a857-f74c3001e732 tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:57:35.440132 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.objects.instance [None req-4f46a8ea-88ad-44af-a857-f74c3001e732 tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] Lazy-loading 'fault' on Instance uuid 8ae36099-24d3-40a1-83c6-cf72bb619a57 {{(pid=128728) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 14 15:57:35.484919 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.policy [None req-4f46a8ea-88ad-44af-a857-f74c3001e732 tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc43895177134e9c9c030a9d87f94aaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7905689c95d44a5c9169249c70f7de57', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128728) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:57:35.492941 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: INFO nova.api.openstack.requestlog [None req-4f46a8ea-88ad-44af-a857-f74c3001e732 tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] 10.222.0.61 "GET /compute/v2.1/servers/8ae36099-24d3-40a1-83c6-cf72bb619a57" status: 200 len: 1330 microversion: 2.1 time: 0.105110 May 14 15:57:35.493535 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: [pid: 128728|app: 0|req: 591/1164] 10.222.0.61 () {58 vars in 1235 bytes} [Sat May 14 15:57:35 2022] GET /compute/v2.1/servers/8ae36099-24d3-40a1-83c6-cf72bb619a57 => generated 1330 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 15:57:35.789810 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi [None req-dbb96162-ba3e-470c-85c4-d5bf7e72e06c tempest-VolumesSnapshotTestJSON-671752898 tempest-VolumesSnapshotTestJSON-671752898-project] Calling method '>' {{(pid=128729) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 15:57:35.790628 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.compute.api [None req-dbb96162-ba3e-470c-85c4-d5bf7e72e06c tempest-VolumesSnapshotTestJSON-671752898 tempest-VolumesSnapshotTestJSON-671752898-project] [instance: a1d28d7f-bade-404d-a453-e09a34fbb232] Fetching instance by UUID {{(pid=128729) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 15:57:35.798755 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-dbb96162-ba3e-470c-85c4-d5bf7e72e06c tempest-VolumesSnapshotTestJSON-671752898 tempest-VolumesSnapshotTestJSON-671752898-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:57:35.799329 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-dbb96162-ba3e-470c-85c4-d5bf7e72e06c tempest-VolumesSnapshotTestJSON-671752898 tempest-VolumesSnapshotTestJSON-671752898-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:57:35.800423 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-dbb96162-ba3e-470c-85c4-d5bf7e72e06c tempest-VolumesSnapshotTestJSON-671752898 tempest-VolumesSnapshotTestJSON-671752898-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:57:35.801112 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-dbb96162-ba3e-470c-85c4-d5bf7e72e06c tempest-VolumesSnapshotTestJSON-671752898 tempest-VolumesSnapshotTestJSON-671752898-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:57:35.815945 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: INFO nova.api.openstack.wsgi [None req-dbb96162-ba3e-470c-85c4-d5bf7e72e06c tempest-VolumesSnapshotTestJSON-671752898 tempest-VolumesSnapshotTestJSON-671752898-project] HTTP exception thrown: Instance a1d28d7f-bade-404d-a453-e09a34fbb232 could not be found. May 14 15:57:35.817612 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi [None req-dbb96162-ba3e-470c-85c4-d5bf7e72e06c tempest-VolumesSnapshotTestJSON-671752898 tempest-VolumesSnapshotTestJSON-671752898-project] Request method failure captured: May 14 15:57:35.817612 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: request: GET /compute/v2.1/servers/a1d28d7f-bade-404d-a453-e09a34fbb232 HTTP/1.1 May 14 15:57:35.817612 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: Accept: application/json May 14 15:57:35.817612 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: Accept-Encoding: identity May 14 15:57:35.817612 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: Connection: close May 14 15:57:35.817612 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: Content-Length: 0 May 14 15:57:35.817612 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: Content-Type: application/json May 14 15:57:35.817612 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: Host: 10.222.0.61 May 14 15:57:35.817612 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: Openstack-System-Scope: None May 14 15:57:35.817612 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: User-Agent: python-urllib3/1.26.9 May 14 15:57:35.817612 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: X-Auth-Token: gAAAAABif9EFKhM32DIaQixVsy11oQMnUf6WwnkqQpKJITorRu3Znz-e1VjV_wXnlR5uemGumwkJ-G-fCJWke46_ZFtwHH43E-XIlo8N3VxY-NE0K0L2aNDBNuAbkhA8Hn1B5ks_8T_K0iFN_CX4J2vpIwIRVI_Uttlm9kfqp7_RzI5IaOFcVEg May 14 15:57:35.817612 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: X-Domain-Id: None May 14 15:57:35.817612 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: X-Domain-Name: None May 14 15:57:35.817612 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: X-Identity-Status: Confirmed May 14 15:57:35.817612 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: X-Is-Admin-Project: True May 14 15:57:35.817612 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: X-Project-Domain-Id: default May 14 15:57:35.817612 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: X-Project-Domain-Name: Default May 14 15:57:35.817612 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: X-Project-Id: 4ad8088ecb8a4f72a98ad70fa8be02b3 May 14 15:57:35.817612 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: X-Project-Name: tempest-VolumesSnapshotTestJSON-671752898 May 14 15:57:35.817612 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: X-Role: reader,member May 14 15:57:35.817612 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: X-Roles: reader,member May 14 15:57:35.819063 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/4ad8088ecb8a4f72a98ad70fa8be02b3"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/4ad8088ecb8a4f72a98ad70fa8be02b3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/4ad8088ecb8a4f72a98ad70fa8be02b3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_4ad8088ecb8a4f72a98ad70fa8be02b3"}]}] May 14 15:57:35.819063 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: X-Tenant: tempest-VolumesSnapshotTestJSON-671752898 May 14 15:57:35.819063 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: X-Tenant-Id: 4ad8088ecb8a4f72a98ad70fa8be02b3 May 14 15:57:35.819063 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-671752898 May 14 15:57:35.819063 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: X-User: tempest-VolumesSnapshotTestJSON-671752898-project May 14 15:57:35.819063 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: X-User-Domain-Id: default May 14 15:57:35.819063 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: X-User-Domain-Name: Default May 14 15:57:35.819063 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: X-User-Id: d3e4193c9d9043c99ee5bee59f79f7a8 May 14 15:57:35.819063 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: X-User-Name: tempest-VolumesSnapshotTestJSON-671752898-project May 14 15:57:35.819063 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: method: > May 14 15:57:35.819063 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: exception: Instance a1d28d7f-bade-404d-a453-e09a34fbb232 could not be found. May 14 15:57:35.819063 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: action_args: {'id': 'a1d28d7f-bade-404d-a453-e09a34fbb232'} May 14 15:57:35.819905 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: {{(pid=128729) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 14 15:57:35.819905 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 15:57:35.819905 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 14 15:57:35.819905 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 14 15:57:35.819905 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 14 15:57:35.819905 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 14 15:57:35.819905 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 14 15:57:35.819905 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 14 15:57:35.819905 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 14 15:57:35.819905 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 14 15:57:35.819905 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a1d28d7f-bade-404d-a453-e09a34fbb232 could not be found. May 14 15:57:35.819905 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: ERROR nova.api.openstack.wsgi May 14 15:57:35.819905 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 14 15:57:35.819905 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: ERROR nova.api.openstack.wsgi May 14 15:57:35.819905 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 15:57:35.819905 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 14 15:57:35.819905 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 14 15:57:35.819905 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 14 15:57:35.819905 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 14 15:57:35.819905 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 14 15:57:35.821262 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 14 15:57:35.821262 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 14 15:57:35.821262 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 14 15:57:35.821262 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 14 15:57:35.821262 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 14 15:57:35.821262 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 14 15:57:35.821262 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 14 15:57:35.821262 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a1d28d7f-bade-404d-a453-e09a34fbb232 could not be found. May 14 15:57:35.821262 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: ERROR nova.api.openstack.wsgi May 14 15:57:35.821262 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 14 15:57:35.821262 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: ERROR nova.api.openstack.wsgi May 14 15:57:35.821262 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 15:57:35.821262 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 14 15:57:35.821262 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 14 15:57:35.821262 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 14 15:57:35.821262 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 14 15:57:35.821262 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a1d28d7f-bade-404d-a453-e09a34fbb232 could not be found. May 14 15:57:35.821262 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: ERROR nova.api.openstack.wsgi May 14 15:57:35.822679 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi [None req-dbb96162-ba3e-470c-85c4-d5bf7e72e06c tempest-VolumesSnapshotTestJSON-671752898 tempest-VolumesSnapshotTestJSON-671752898-project] Returning 404 to user: Instance a1d28d7f-bade-404d-a453-e09a34fbb232 could not be found. {{(pid=128729) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 14 15:57:35.822679 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: INFO nova.api.openstack.requestlog [None req-dbb96162-ba3e-470c-85c4-d5bf7e72e06c tempest-VolumesSnapshotTestJSON-671752898 tempest-VolumesSnapshotTestJSON-671752898-project] 10.222.0.61 "GET /compute/v2.1/servers/a1d28d7f-bade-404d-a453-e09a34fbb232" status: 404 len: 111 microversion: 2.1 time: 0.033792 May 14 15:57:35.824083 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: [pid: 128729|app: 0|req: 574/1165] 10.222.0.61 () {58 vars in 1235 bytes} [Sat May 14 15:57:35 2022] GET /compute/v2.1/servers/a1d28d7f-bade-404d-a453-e09a34fbb232 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 14 15:57:35.935606 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi [None req-55548114-8d50-449e-b985-4e4a383719fe tempest-TestVolumeBootPattern-2062489882 tempest-TestVolumeBootPattern-2062489882-project] Calling method '>' {{(pid=128728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 15:57:35.936288 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.compute.api [None req-55548114-8d50-449e-b985-4e4a383719fe tempest-TestVolumeBootPattern-2062489882 tempest-TestVolumeBootPattern-2062489882-project] [instance: 6dd9e299-5776-4848-b4ab-6d07424a3f8e] Fetching instance by UUID {{(pid=128728) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 15:57:35.942748 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-55548114-8d50-449e-b985-4e4a383719fe tempest-TestVolumeBootPattern-2062489882 tempest-TestVolumeBootPattern-2062489882-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:57:35.943400 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-55548114-8d50-449e-b985-4e4a383719fe tempest-TestVolumeBootPattern-2062489882 tempest-TestVolumeBootPattern-2062489882-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:57:35.944429 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-55548114-8d50-449e-b985-4e4a383719fe tempest-TestVolumeBootPattern-2062489882 tempest-TestVolumeBootPattern-2062489882-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:57:35.945220 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-55548114-8d50-449e-b985-4e4a383719fe tempest-TestVolumeBootPattern-2062489882 tempest-TestVolumeBootPattern-2062489882-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:57:36.100360 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.policy [None req-55548114-8d50-449e-b985-4e4a383719fe tempest-TestVolumeBootPattern-2062489882 tempest-TestVolumeBootPattern-2062489882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '568f6783dd4d43398a70a9ffa58ff660', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a3a2b5dee7a404a8445c8aa434b5a43', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128728) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:57:36.110330 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: INFO nova.api.openstack.requestlog [None req-55548114-8d50-449e-b985-4e4a383719fe tempest-TestVolumeBootPattern-2062489882 tempest-TestVolumeBootPattern-2062489882-project] 10.222.0.61 "GET /compute/v2.1/servers/6dd9e299-5776-4848-b4ab-6d07424a3f8e" status: 200 len: 1266 microversion: 2.1 time: 0.183078 May 14 15:57:36.111657 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: [pid: 128728|app: 0|req: 592/1166] 10.222.0.61 () {58 vars in 1235 bytes} [Sat May 14 15:57:35 2022] GET /compute/v2.1/servers/6dd9e299-5776-4848-b4ab-6d07424a3f8e => generated 1266 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 15:57:36.509055 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi [None req-0a2d1d2b-a198-43ef-a50c-394307455918 tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] Calling method '>' {{(pid=128729) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 15:57:36.509661 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.compute.api [None req-0a2d1d2b-a198-43ef-a50c-394307455918 tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] [instance: 8ae36099-24d3-40a1-83c6-cf72bb619a57] Fetching instance by UUID {{(pid=128729) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 15:57:36.516233 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-0a2d1d2b-a198-43ef-a50c-394307455918 tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:57:36.516662 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-0a2d1d2b-a198-43ef-a50c-394307455918 tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:57:36.517425 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-0a2d1d2b-a198-43ef-a50c-394307455918 tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:57:36.517857 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-0a2d1d2b-a198-43ef-a50c-394307455918 tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:57:36.533536 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: INFO nova.api.openstack.wsgi [None req-0a2d1d2b-a198-43ef-a50c-394307455918 tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] HTTP exception thrown: Instance 8ae36099-24d3-40a1-83c6-cf72bb619a57 could not be found. May 14 15:57:36.535074 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi [None req-0a2d1d2b-a198-43ef-a50c-394307455918 tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] Request method failure captured: May 14 15:57:36.535074 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: request: GET /compute/v2.1/servers/8ae36099-24d3-40a1-83c6-cf72bb619a57 HTTP/1.1 May 14 15:57:36.535074 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: Accept: application/json May 14 15:57:36.535074 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: Accept-Encoding: identity May 14 15:57:36.535074 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: Connection: close May 14 15:57:36.535074 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: Content-Length: 0 May 14 15:57:36.535074 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: Content-Type: application/json May 14 15:57:36.535074 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: Host: 10.222.0.61 May 14 15:57:36.535074 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: Openstack-System-Scope: None May 14 15:57:36.535074 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: User-Agent: python-urllib3/1.26.9 May 14 15:57:36.535074 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: X-Auth-Token: gAAAAABif87SP_Zwa2IiGvFqsMgjavpLb8KTM6Zjei-leP46wpGTfISEWiNabTSLn_Se4MigqIDtVKHrnJDEVndJObAkvdE7QziqGtKnvzcsAHHCuGZvbOCiZ5Yv_050Eg71rjYT92fMkrLj82GJjq7kUvTbRuW_X-0VLgSk3UstO-oNY0ykSUs May 14 15:57:36.535074 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: X-Domain-Id: None May 14 15:57:36.535074 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: X-Domain-Name: None May 14 15:57:36.535074 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: X-Identity-Status: Confirmed May 14 15:57:36.535074 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: X-Is-Admin-Project: True May 14 15:57:36.535074 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: X-Project-Domain-Id: default May 14 15:57:36.535074 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: X-Project-Domain-Name: Default May 14 15:57:36.535074 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: X-Project-Id: 7905689c95d44a5c9169249c70f7de57 May 14 15:57:36.535074 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: X-Project-Name: tempest-AttachVolumeNegativeTest-1525749350 May 14 15:57:36.535074 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: X-Role: reader,member May 14 15:57:36.535074 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: X-Roles: reader,member May 14 15:57:36.536661 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/7905689c95d44a5c9169249c70f7de57"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/7905689c95d44a5c9169249c70f7de57"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/7905689c95d44a5c9169249c70f7de57"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_7905689c95d44a5c9169249c70f7de57"}]}] May 14 15:57:36.536661 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: X-Tenant: tempest-AttachVolumeNegativeTest-1525749350 May 14 15:57:36.536661 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: X-Tenant-Id: 7905689c95d44a5c9169249c70f7de57 May 14 15:57:36.536661 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1525749350 May 14 15:57:36.536661 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: X-User: tempest-AttachVolumeNegativeTest-1525749350-project May 14 15:57:36.536661 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: X-User-Domain-Id: default May 14 15:57:36.536661 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: X-User-Domain-Name: Default May 14 15:57:36.536661 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: X-User-Id: dc43895177134e9c9c030a9d87f94aaa May 14 15:57:36.536661 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: X-User-Name: tempest-AttachVolumeNegativeTest-1525749350-project May 14 15:57:36.536661 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: method: > May 14 15:57:36.536661 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: exception: Instance 8ae36099-24d3-40a1-83c6-cf72bb619a57 could not be found. May 14 15:57:36.536661 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: action_args: {'id': '8ae36099-24d3-40a1-83c6-cf72bb619a57'} May 14 15:57:36.537593 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: {{(pid=128729) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 14 15:57:36.537593 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 15:57:36.537593 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 14 15:57:36.537593 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 14 15:57:36.537593 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 14 15:57:36.537593 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 14 15:57:36.537593 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 14 15:57:36.537593 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 14 15:57:36.537593 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 14 15:57:36.537593 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 14 15:57:36.537593 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8ae36099-24d3-40a1-83c6-cf72bb619a57 could not be found. May 14 15:57:36.537593 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: ERROR nova.api.openstack.wsgi May 14 15:57:36.537593 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 14 15:57:36.537593 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: ERROR nova.api.openstack.wsgi May 14 15:57:36.537593 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 15:57:36.537593 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 14 15:57:36.537593 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 14 15:57:36.537593 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 14 15:57:36.537593 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 14 15:57:36.537593 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 14 15:57:36.539062 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 14 15:57:36.539062 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 14 15:57:36.539062 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 14 15:57:36.539062 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 14 15:57:36.539062 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 14 15:57:36.539062 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 14 15:57:36.539062 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 14 15:57:36.539062 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8ae36099-24d3-40a1-83c6-cf72bb619a57 could not be found. May 14 15:57:36.539062 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: ERROR nova.api.openstack.wsgi May 14 15:57:36.539062 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 14 15:57:36.539062 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: ERROR nova.api.openstack.wsgi May 14 15:57:36.539062 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 15:57:36.539062 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 14 15:57:36.539062 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 14 15:57:36.539062 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 14 15:57:36.539062 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 14 15:57:36.539062 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8ae36099-24d3-40a1-83c6-cf72bb619a57 could not be found. May 14 15:57:36.539062 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: ERROR nova.api.openstack.wsgi May 14 15:57:36.540329 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi [None req-0a2d1d2b-a198-43ef-a50c-394307455918 tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] Returning 404 to user: Instance 8ae36099-24d3-40a1-83c6-cf72bb619a57 could not be found. {{(pid=128729) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 14 15:57:36.540329 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: INFO nova.api.openstack.requestlog [None req-0a2d1d2b-a198-43ef-a50c-394307455918 tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] 10.222.0.61 "GET /compute/v2.1/servers/8ae36099-24d3-40a1-83c6-cf72bb619a57" status: 404 len: 111 microversion: 2.1 time: 0.031236 May 14 15:57:36.540329 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: [pid: 128729|app: 0|req: 575/1167] 10.222.0.61 () {58 vars in 1235 bytes} [Sat May 14 15:57:36 2022] GET /compute/v2.1/servers/8ae36099-24d3-40a1-83c6-cf72bb619a57 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 14 15:57:36.545373 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi [None req-defad302-9d4e-469a-bf26-bfadfe9bac6d tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] Calling method '.version_select at 0x7f77d81d80d0>' {{(pid=128728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 15:57:36.562223 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: INFO nova.api.openstack.requestlog [None req-defad302-9d4e-469a-bf26-bfadfe9bac6d tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] 10.222.0.61 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-807386481" status: 202 len: 0 microversion: 2.1 time: 0.020736 May 14 15:57:36.562806 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: [pid: 128728|app: 0|req: 593/1168] 10.222.0.61 () {58 vars in 1217 bytes} [Sat May 14 15:57:36 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-807386481 => generated 0 bytes in 22 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 14 15:57:37.128823 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi [None req-43589d25-63df-4e3b-ab9d-1b3377f2b3ca tempest-TestVolumeBootPattern-2062489882 tempest-TestVolumeBootPattern-2062489882-project] Calling method '>' {{(pid=128729) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 15:57:37.129427 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.compute.api [None req-43589d25-63df-4e3b-ab9d-1b3377f2b3ca tempest-TestVolumeBootPattern-2062489882 tempest-TestVolumeBootPattern-2062489882-project] [instance: 6dd9e299-5776-4848-b4ab-6d07424a3f8e] Fetching instance by UUID {{(pid=128729) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 15:57:37.135668 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-43589d25-63df-4e3b-ab9d-1b3377f2b3ca tempest-TestVolumeBootPattern-2062489882 tempest-TestVolumeBootPattern-2062489882-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:57:37.136218 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-43589d25-63df-4e3b-ab9d-1b3377f2b3ca tempest-TestVolumeBootPattern-2062489882 tempest-TestVolumeBootPattern-2062489882-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:57:37.136982 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-43589d25-63df-4e3b-ab9d-1b3377f2b3ca tempest-TestVolumeBootPattern-2062489882 tempest-TestVolumeBootPattern-2062489882-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:57:37.137415 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-43589d25-63df-4e3b-ab9d-1b3377f2b3ca tempest-TestVolumeBootPattern-2062489882 tempest-TestVolumeBootPattern-2062489882-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:57:37.271334 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.policy [None req-43589d25-63df-4e3b-ab9d-1b3377f2b3ca tempest-TestVolumeBootPattern-2062489882 tempest-TestVolumeBootPattern-2062489882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '568f6783dd4d43398a70a9ffa58ff660', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a3a2b5dee7a404a8445c8aa434b5a43', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128729) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:57:37.278754 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: INFO nova.api.openstack.requestlog [None req-43589d25-63df-4e3b-ab9d-1b3377f2b3ca tempest-TestVolumeBootPattern-2062489882 tempest-TestVolumeBootPattern-2062489882-project] 10.222.0.61 "GET /compute/v2.1/servers/6dd9e299-5776-4848-b4ab-6d07424a3f8e" status: 200 len: 1266 microversion: 2.1 time: 0.153764 May 14 15:57:37.279325 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: [pid: 128729|app: 0|req: 576/1169] 10.222.0.61 () {58 vars in 1235 bytes} [Sat May 14 15:57:37 2022] GET /compute/v2.1/servers/6dd9e299-5776-4848-b4ab-6d07424a3f8e => generated 1266 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 15:57:38.295436 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi [None req-9373a6c1-a10f-403a-acbb-2cdccf7d2ed4 tempest-TestVolumeBootPattern-2062489882 tempest-TestVolumeBootPattern-2062489882-project] Calling method '>' {{(pid=128728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 15:57:38.296057 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.compute.api [None req-9373a6c1-a10f-403a-acbb-2cdccf7d2ed4 tempest-TestVolumeBootPattern-2062489882 tempest-TestVolumeBootPattern-2062489882-project] [instance: 6dd9e299-5776-4848-b4ab-6d07424a3f8e] Fetching instance by UUID {{(pid=128728) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 15:57:38.303207 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-9373a6c1-a10f-403a-acbb-2cdccf7d2ed4 tempest-TestVolumeBootPattern-2062489882 tempest-TestVolumeBootPattern-2062489882-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:57:38.303652 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-9373a6c1-a10f-403a-acbb-2cdccf7d2ed4 tempest-TestVolumeBootPattern-2062489882 tempest-TestVolumeBootPattern-2062489882-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:57:38.304427 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-9373a6c1-a10f-403a-acbb-2cdccf7d2ed4 tempest-TestVolumeBootPattern-2062489882 tempest-TestVolumeBootPattern-2062489882-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:57:38.304859 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-9373a6c1-a10f-403a-acbb-2cdccf7d2ed4 tempest-TestVolumeBootPattern-2062489882 tempest-TestVolumeBootPattern-2062489882-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:57:38.432126 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.policy [None req-9373a6c1-a10f-403a-acbb-2cdccf7d2ed4 tempest-TestVolumeBootPattern-2062489882 tempest-TestVolumeBootPattern-2062489882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '568f6783dd4d43398a70a9ffa58ff660', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a3a2b5dee7a404a8445c8aa434b5a43', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128728) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:57:38.440300 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: INFO nova.api.openstack.requestlog [None req-9373a6c1-a10f-403a-acbb-2cdccf7d2ed4 tempest-TestVolumeBootPattern-2062489882 tempest-TestVolumeBootPattern-2062489882-project] 10.222.0.61 "GET /compute/v2.1/servers/6dd9e299-5776-4848-b4ab-6d07424a3f8e" status: 200 len: 1266 microversion: 2.1 time: 0.149553 May 14 15:57:38.440865 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: [pid: 128728|app: 0|req: 594/1170] 10.222.0.61 () {58 vars in 1235 bytes} [Sat May 14 15:57:38 2022] GET /compute/v2.1/servers/6dd9e299-5776-4848-b4ab-6d07424a3f8e => generated 1266 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 15:57:39.457639 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi [None req-ab5f0789-6dc4-4c8a-b6a0-f359edb81589 tempest-TestVolumeBootPattern-2062489882 tempest-TestVolumeBootPattern-2062489882-project] Calling method '>' {{(pid=128729) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 15:57:39.458252 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.compute.api [None req-ab5f0789-6dc4-4c8a-b6a0-f359edb81589 tempest-TestVolumeBootPattern-2062489882 tempest-TestVolumeBootPattern-2062489882-project] [instance: 6dd9e299-5776-4848-b4ab-6d07424a3f8e] Fetching instance by UUID {{(pid=128729) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 15:57:39.465200 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-ab5f0789-6dc4-4c8a-b6a0-f359edb81589 tempest-TestVolumeBootPattern-2062489882 tempest-TestVolumeBootPattern-2062489882-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:57:39.465652 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-ab5f0789-6dc4-4c8a-b6a0-f359edb81589 tempest-TestVolumeBootPattern-2062489882 tempest-TestVolumeBootPattern-2062489882-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:57:39.466450 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-ab5f0789-6dc4-4c8a-b6a0-f359edb81589 tempest-TestVolumeBootPattern-2062489882 tempest-TestVolumeBootPattern-2062489882-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:57:39.466890 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-ab5f0789-6dc4-4c8a-b6a0-f359edb81589 tempest-TestVolumeBootPattern-2062489882 tempest-TestVolumeBootPattern-2062489882-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:57:39.596921 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.policy [None req-ab5f0789-6dc4-4c8a-b6a0-f359edb81589 tempest-TestVolumeBootPattern-2062489882 tempest-TestVolumeBootPattern-2062489882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '568f6783dd4d43398a70a9ffa58ff660', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a3a2b5dee7a404a8445c8aa434b5a43', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128729) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:57:39.604160 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: INFO nova.api.openstack.requestlog [None req-ab5f0789-6dc4-4c8a-b6a0-f359edb81589 tempest-TestVolumeBootPattern-2062489882 tempest-TestVolumeBootPattern-2062489882-project] 10.222.0.61 "GET /compute/v2.1/servers/6dd9e299-5776-4848-b4ab-6d07424a3f8e" status: 200 len: 1266 microversion: 2.1 time: 0.150553 May 14 15:57:39.604677 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: [pid: 128729|app: 0|req: 577/1171] 10.222.0.61 () {58 vars in 1235 bytes} [Sat May 14 15:57:39 2022] GET /compute/v2.1/servers/6dd9e299-5776-4848-b4ab-6d07424a3f8e => generated 1266 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 15:57:40.620407 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi [None req-f7c02fe3-efe5-4ddc-901f-7e46a3ac1ad4 tempest-TestVolumeBootPattern-2062489882 tempest-TestVolumeBootPattern-2062489882-project] Calling method '>' {{(pid=128728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 15:57:40.621055 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.compute.api [None req-f7c02fe3-efe5-4ddc-901f-7e46a3ac1ad4 tempest-TestVolumeBootPattern-2062489882 tempest-TestVolumeBootPattern-2062489882-project] [instance: 6dd9e299-5776-4848-b4ab-6d07424a3f8e] Fetching instance by UUID {{(pid=128728) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 15:57:40.627286 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-f7c02fe3-efe5-4ddc-901f-7e46a3ac1ad4 tempest-TestVolumeBootPattern-2062489882 tempest-TestVolumeBootPattern-2062489882-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:57:40.627720 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-f7c02fe3-efe5-4ddc-901f-7e46a3ac1ad4 tempest-TestVolumeBootPattern-2062489882 tempest-TestVolumeBootPattern-2062489882-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:57:40.628513 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-f7c02fe3-efe5-4ddc-901f-7e46a3ac1ad4 tempest-TestVolumeBootPattern-2062489882 tempest-TestVolumeBootPattern-2062489882-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:57:40.628949 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-f7c02fe3-efe5-4ddc-901f-7e46a3ac1ad4 tempest-TestVolumeBootPattern-2062489882 tempest-TestVolumeBootPattern-2062489882-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:57:40.764837 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.policy [None req-f7c02fe3-efe5-4ddc-901f-7e46a3ac1ad4 tempest-TestVolumeBootPattern-2062489882 tempest-TestVolumeBootPattern-2062489882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '568f6783dd4d43398a70a9ffa58ff660', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a3a2b5dee7a404a8445c8aa434b5a43', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128728) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:57:40.772097 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: INFO nova.api.openstack.requestlog [None req-f7c02fe3-efe5-4ddc-901f-7e46a3ac1ad4 tempest-TestVolumeBootPattern-2062489882 tempest-TestVolumeBootPattern-2062489882-project] 10.222.0.61 "GET /compute/v2.1/servers/6dd9e299-5776-4848-b4ab-6d07424a3f8e" status: 200 len: 1266 microversion: 2.1 time: 0.155874 May 14 15:57:40.772651 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: [pid: 128728|app: 0|req: 595/1172] 10.222.0.61 () {58 vars in 1235 bytes} [Sat May 14 15:57:40 2022] GET /compute/v2.1/servers/6dd9e299-5776-4848-b4ab-6d07424a3f8e => generated 1266 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 15:57:41.788968 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi [None req-8abfc670-23a8-4716-a3a0-cb47515b1929 tempest-TestVolumeBootPattern-2062489882 tempest-TestVolumeBootPattern-2062489882-project] Calling method '>' {{(pid=128729) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 15:57:41.789580 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.compute.api [None req-8abfc670-23a8-4716-a3a0-cb47515b1929 tempest-TestVolumeBootPattern-2062489882 tempest-TestVolumeBootPattern-2062489882-project] [instance: 6dd9e299-5776-4848-b4ab-6d07424a3f8e] Fetching instance by UUID {{(pid=128729) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 15:57:41.796450 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-8abfc670-23a8-4716-a3a0-cb47515b1929 tempest-TestVolumeBootPattern-2062489882 tempest-TestVolumeBootPattern-2062489882-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:57:41.796900 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-8abfc670-23a8-4716-a3a0-cb47515b1929 tempest-TestVolumeBootPattern-2062489882 tempest-TestVolumeBootPattern-2062489882-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:57:41.797677 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-8abfc670-23a8-4716-a3a0-cb47515b1929 tempest-TestVolumeBootPattern-2062489882 tempest-TestVolumeBootPattern-2062489882-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:57:41.798116 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-8abfc670-23a8-4716-a3a0-cb47515b1929 tempest-TestVolumeBootPattern-2062489882 tempest-TestVolumeBootPattern-2062489882-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:57:41.900508 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi [req-7c7c8df0-5217-47d9-8a84-1f08b1a1bb60 req-979a23cc-9667-46ab-be81-962c4cd0fe23 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6dd9e299-5776-4848-b4ab-6d07424a3f8e", "name": "network-vif-plugged", "status": "completed", "tag": "d761eef1-490d-4627-a1cc-64f2436e7c0c"}]} {{(pid=128728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 15:57:41.910364 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [req-7c7c8df0-5217-47d9-8a84-1f08b1a1bb60 req-979a23cc-9667-46ab-be81-962c4cd0fe23 service nova] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:57:41.910817 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [req-7c7c8df0-5217-47d9-8a84-1f08b1a1bb60 req-979a23cc-9667-46ab-be81-962c4cd0fe23 service nova] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:57:41.921876 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: INFO nova.api.openstack.compute.server_external_events [req-7c7c8df0-5217-47d9-8a84-1f08b1a1bb60 req-979a23cc-9667-46ab-be81-962c4cd0fe23 service nova] Creating event network-vif-plugged:d761eef1-490d-4627-a1cc-64f2436e7c0c for instance 6dd9e299-5776-4848-b4ab-6d07424a3f8e on hv-cinder-83979 May 14 15:57:41.927009 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: INFO nova.api.openstack.requestlog [req-7c7c8df0-5217-47d9-8a84-1f08b1a1bb60 req-979a23cc-9667-46ab-be81-962c4cd0fe23 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.091106 May 14 15:57:41.927598 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: [pid: 128728|app: 0|req: 596/1173] 10.222.0.61 () {64 vars in 1317 bytes} [Sat May 14 15:57:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 14 15:57:41.946528 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.policy [None req-8abfc670-23a8-4716-a3a0-cb47515b1929 tempest-TestVolumeBootPattern-2062489882 tempest-TestVolumeBootPattern-2062489882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '568f6783dd4d43398a70a9ffa58ff660', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a3a2b5dee7a404a8445c8aa434b5a43', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128729) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:57:41.955763 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: INFO nova.api.openstack.requestlog [None req-8abfc670-23a8-4716-a3a0-cb47515b1929 tempest-TestVolumeBootPattern-2062489882 tempest-TestVolumeBootPattern-2062489882-project] 10.222.0.61 "GET /compute/v2.1/servers/6dd9e299-5776-4848-b4ab-6d07424a3f8e" status: 200 len: 1266 microversion: 2.1 time: 0.170663 May 14 15:57:41.956335 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: [pid: 128729|app: 0|req: 578/1174] 10.222.0.61 () {58 vars in 1235 bytes} [Sat May 14 15:57:41 2022] GET /compute/v2.1/servers/6dd9e299-5776-4848-b4ab-6d07424a3f8e => generated 1266 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 15:57:42.502401 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi [None req-ace5ea3f-e2ad-4fdc-bb1a-136911e231f8 tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] Calling method '>' {{(pid=128728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 15:57:42.502992 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.compute.api [None req-ace5ea3f-e2ad-4fdc-bb1a-136911e231f8 tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] [instance: 8ae36099-24d3-40a1-83c6-cf72bb619a57] Fetching instance by UUID {{(pid=128728) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 15:57:42.509071 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-ace5ea3f-e2ad-4fdc-bb1a-136911e231f8 tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:57:42.509517 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-ace5ea3f-e2ad-4fdc-bb1a-136911e231f8 tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:57:42.510288 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-ace5ea3f-e2ad-4fdc-bb1a-136911e231f8 tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:57:42.510756 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-ace5ea3f-e2ad-4fdc-bb1a-136911e231f8 tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:57:42.523779 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: INFO nova.api.openstack.wsgi [None req-ace5ea3f-e2ad-4fdc-bb1a-136911e231f8 tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] HTTP exception thrown: Instance 8ae36099-24d3-40a1-83c6-cf72bb619a57 could not be found. May 14 15:57:42.525491 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi [None req-ace5ea3f-e2ad-4fdc-bb1a-136911e231f8 tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] Request method failure captured: May 14 15:57:42.525491 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: request: DELETE /compute/v2.1/servers/8ae36099-24d3-40a1-83c6-cf72bb619a57 HTTP/1.1 May 14 15:57:42.525491 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: Accept: application/json May 14 15:57:42.525491 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: Accept-Encoding: identity May 14 15:57:42.525491 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: Connection: close May 14 15:57:42.525491 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: Content-Length: 0 May 14 15:57:42.525491 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: Content-Type: application/json May 14 15:57:42.525491 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: Host: 10.222.0.61 May 14 15:57:42.525491 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: Openstack-System-Scope: None May 14 15:57:42.525491 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: User-Agent: python-urllib3/1.26.9 May 14 15:57:42.525491 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: X-Auth-Token: gAAAAABif87SP_Zwa2IiGvFqsMgjavpLb8KTM6Zjei-leP46wpGTfISEWiNabTSLn_Se4MigqIDtVKHrnJDEVndJObAkvdE7QziqGtKnvzcsAHHCuGZvbOCiZ5Yv_050Eg71rjYT92fMkrLj82GJjq7kUvTbRuW_X-0VLgSk3UstO-oNY0ykSUs May 14 15:57:42.525491 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: X-Domain-Id: None May 14 15:57:42.525491 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: X-Domain-Name: None May 14 15:57:42.525491 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: X-Identity-Status: Confirmed May 14 15:57:42.525491 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: X-Is-Admin-Project: True May 14 15:57:42.525491 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: X-Project-Domain-Id: default May 14 15:57:42.525491 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: X-Project-Domain-Name: Default May 14 15:57:42.525491 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: X-Project-Id: 7905689c95d44a5c9169249c70f7de57 May 14 15:57:42.525491 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: X-Project-Name: tempest-AttachVolumeNegativeTest-1525749350 May 14 15:57:42.525491 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: X-Role: reader,member May 14 15:57:42.525491 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: X-Roles: reader,member May 14 15:57:42.527647 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/7905689c95d44a5c9169249c70f7de57"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/7905689c95d44a5c9169249c70f7de57"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/7905689c95d44a5c9169249c70f7de57"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_7905689c95d44a5c9169249c70f7de57"}]}] May 14 15:57:42.527647 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: X-Tenant: tempest-AttachVolumeNegativeTest-1525749350 May 14 15:57:42.527647 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: X-Tenant-Id: 7905689c95d44a5c9169249c70f7de57 May 14 15:57:42.527647 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1525749350 May 14 15:57:42.527647 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: X-User: tempest-AttachVolumeNegativeTest-1525749350-project May 14 15:57:42.527647 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: X-User-Domain-Id: default May 14 15:57:42.527647 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: X-User-Domain-Name: Default May 14 15:57:42.527647 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: X-User-Id: dc43895177134e9c9c030a9d87f94aaa May 14 15:57:42.527647 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: X-User-Name: tempest-AttachVolumeNegativeTest-1525749350-project May 14 15:57:42.527647 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: method: > May 14 15:57:42.527647 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: exception: Instance 8ae36099-24d3-40a1-83c6-cf72bb619a57 could not be found. May 14 15:57:42.527647 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: action_args: {'id': '8ae36099-24d3-40a1-83c6-cf72bb619a57'} May 14 15:57:42.528565 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: {{(pid=128728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 14 15:57:42.528565 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 15:57:42.528565 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 14 15:57:42.528565 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 14 15:57:42.528565 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 14 15:57:42.528565 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 14 15:57:42.528565 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 14 15:57:42.528565 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 14 15:57:42.528565 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 14 15:57:42.528565 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 14 15:57:42.528565 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8ae36099-24d3-40a1-83c6-cf72bb619a57 could not be found. May 14 15:57:42.528565 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: ERROR nova.api.openstack.wsgi May 14 15:57:42.528565 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 14 15:57:42.528565 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: ERROR nova.api.openstack.wsgi May 14 15:57:42.528565 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 15:57:42.528565 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 14 15:57:42.528565 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 14 15:57:42.528565 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 14 15:57:42.528565 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 14 15:57:42.528565 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 14 15:57:42.530020 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 14 15:57:42.530020 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 14 15:57:42.530020 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 14 15:57:42.530020 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 14 15:57:42.530020 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 14 15:57:42.530020 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 14 15:57:42.530020 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 14 15:57:42.530020 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 14 15:57:42.530020 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 14 15:57:42.530020 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8ae36099-24d3-40a1-83c6-cf72bb619a57 could not be found. May 14 15:57:42.530020 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: ERROR nova.api.openstack.wsgi May 14 15:57:42.530020 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 14 15:57:42.530020 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: ERROR nova.api.openstack.wsgi May 14 15:57:42.530020 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 15:57:42.530020 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 14 15:57:42.530020 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 14 15:57:42.530020 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 14 15:57:42.530020 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 14 15:57:42.530020 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8ae36099-24d3-40a1-83c6-cf72bb619a57 could not be found. May 14 15:57:42.530020 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: ERROR nova.api.openstack.wsgi May 14 15:57:42.531508 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi [None req-ace5ea3f-e2ad-4fdc-bb1a-136911e231f8 tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] Returning 404 to user: Instance 8ae36099-24d3-40a1-83c6-cf72bb619a57 could not be found. {{(pid=128728) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 14 15:57:42.531508 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: INFO nova.api.openstack.requestlog [None req-ace5ea3f-e2ad-4fdc-bb1a-136911e231f8 tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] 10.222.0.61 "DELETE /compute/v2.1/servers/8ae36099-24d3-40a1-83c6-cf72bb619a57" status: 404 len: 111 microversion: 2.1 time: 0.028833 May 14 15:57:42.531508 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: [pid: 128728|app: 0|req: 597/1175] 10.222.0.61 () {58 vars in 1238 bytes} [Sat May 14 15:57:42 2022] DELETE /compute/v2.1/servers/8ae36099-24d3-40a1-83c6-cf72bb619a57 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 14 15:57:42.535386 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi [None req-8791e4f9-5fa6-4c58-aff3-3ad07ecdeba7 tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] Calling method '>' {{(pid=128729) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 15:57:42.535990 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.compute.api [None req-8791e4f9-5fa6-4c58-aff3-3ad07ecdeba7 tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] [instance: 8ae36099-24d3-40a1-83c6-cf72bb619a57] Fetching instance by UUID {{(pid=128729) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 15:57:42.541827 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-8791e4f9-5fa6-4c58-aff3-3ad07ecdeba7 tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:57:42.542830 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-8791e4f9-5fa6-4c58-aff3-3ad07ecdeba7 tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:57:42.543588 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-8791e4f9-5fa6-4c58-aff3-3ad07ecdeba7 tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:57:42.544019 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-8791e4f9-5fa6-4c58-aff3-3ad07ecdeba7 tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:57:42.557105 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: INFO nova.api.openstack.wsgi [None req-8791e4f9-5fa6-4c58-aff3-3ad07ecdeba7 tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] HTTP exception thrown: Instance 8ae36099-24d3-40a1-83c6-cf72bb619a57 could not be found. May 14 15:57:42.559625 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi [None req-8791e4f9-5fa6-4c58-aff3-3ad07ecdeba7 tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] Request method failure captured: May 14 15:57:42.559625 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: request: GET /compute/v2.1/servers/8ae36099-24d3-40a1-83c6-cf72bb619a57 HTTP/1.1 May 14 15:57:42.559625 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: Accept: application/json May 14 15:57:42.559625 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: Accept-Encoding: identity May 14 15:57:42.559625 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: Connection: close May 14 15:57:42.559625 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: Content-Length: 0 May 14 15:57:42.559625 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: Content-Type: application/json May 14 15:57:42.559625 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: Host: 10.222.0.61 May 14 15:57:42.559625 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: Openstack-System-Scope: None May 14 15:57:42.559625 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: User-Agent: python-urllib3/1.26.9 May 14 15:57:42.559625 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: X-Auth-Token: gAAAAABif87SP_Zwa2IiGvFqsMgjavpLb8KTM6Zjei-leP46wpGTfISEWiNabTSLn_Se4MigqIDtVKHrnJDEVndJObAkvdE7QziqGtKnvzcsAHHCuGZvbOCiZ5Yv_050Eg71rjYT92fMkrLj82GJjq7kUvTbRuW_X-0VLgSk3UstO-oNY0ykSUs May 14 15:57:42.559625 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: X-Domain-Id: None May 14 15:57:42.559625 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: X-Domain-Name: None May 14 15:57:42.559625 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: X-Identity-Status: Confirmed May 14 15:57:42.559625 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: X-Is-Admin-Project: True May 14 15:57:42.559625 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: X-Project-Domain-Id: default May 14 15:57:42.559625 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: X-Project-Domain-Name: Default May 14 15:57:42.559625 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: X-Project-Id: 7905689c95d44a5c9169249c70f7de57 May 14 15:57:42.559625 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: X-Project-Name: tempest-AttachVolumeNegativeTest-1525749350 May 14 15:57:42.559625 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: X-Role: reader,member May 14 15:57:42.559625 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: X-Roles: reader,member May 14 15:57:42.561285 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/7905689c95d44a5c9169249c70f7de57"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/7905689c95d44a5c9169249c70f7de57"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/7905689c95d44a5c9169249c70f7de57"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_7905689c95d44a5c9169249c70f7de57"}]}] May 14 15:57:42.561285 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: X-Tenant: tempest-AttachVolumeNegativeTest-1525749350 May 14 15:57:42.561285 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: X-Tenant-Id: 7905689c95d44a5c9169249c70f7de57 May 14 15:57:42.561285 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1525749350 May 14 15:57:42.561285 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: X-User: tempest-AttachVolumeNegativeTest-1525749350-project May 14 15:57:42.561285 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: X-User-Domain-Id: default May 14 15:57:42.561285 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: X-User-Domain-Name: Default May 14 15:57:42.561285 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: X-User-Id: dc43895177134e9c9c030a9d87f94aaa May 14 15:57:42.561285 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: X-User-Name: tempest-AttachVolumeNegativeTest-1525749350-project May 14 15:57:42.561285 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: method: > May 14 15:57:42.561285 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: exception: Instance 8ae36099-24d3-40a1-83c6-cf72bb619a57 could not be found. May 14 15:57:42.561285 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: action_args: {'id': '8ae36099-24d3-40a1-83c6-cf72bb619a57'} May 14 15:57:42.562199 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: {{(pid=128729) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 14 15:57:42.562199 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 15:57:42.562199 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 14 15:57:42.562199 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 14 15:57:42.562199 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 14 15:57:42.562199 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 14 15:57:42.562199 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 14 15:57:42.562199 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 14 15:57:42.562199 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 14 15:57:42.562199 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 14 15:57:42.562199 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8ae36099-24d3-40a1-83c6-cf72bb619a57 could not be found. May 14 15:57:42.562199 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: ERROR nova.api.openstack.wsgi May 14 15:57:42.562199 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 14 15:57:42.562199 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: ERROR nova.api.openstack.wsgi May 14 15:57:42.562199 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 15:57:42.562199 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 14 15:57:42.562199 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 14 15:57:42.562199 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 14 15:57:42.562199 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 14 15:57:42.562199 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 14 15:57:42.563713 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 14 15:57:42.563713 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 14 15:57:42.563713 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 14 15:57:42.563713 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 14 15:57:42.563713 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 14 15:57:42.563713 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 14 15:57:42.563713 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 14 15:57:42.563713 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8ae36099-24d3-40a1-83c6-cf72bb619a57 could not be found. May 14 15:57:42.563713 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: ERROR nova.api.openstack.wsgi May 14 15:57:42.563713 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 14 15:57:42.563713 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: ERROR nova.api.openstack.wsgi May 14 15:57:42.563713 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 15:57:42.563713 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 14 15:57:42.563713 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 14 15:57:42.563713 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 14 15:57:42.563713 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 14 15:57:42.563713 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8ae36099-24d3-40a1-83c6-cf72bb619a57 could not be found. May 14 15:57:42.563713 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: ERROR nova.api.openstack.wsgi May 14 15:57:42.565011 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi [None req-8791e4f9-5fa6-4c58-aff3-3ad07ecdeba7 tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] Returning 404 to user: Instance 8ae36099-24d3-40a1-83c6-cf72bb619a57 could not be found. {{(pid=128729) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 14 15:57:42.565011 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: INFO nova.api.openstack.requestlog [None req-8791e4f9-5fa6-4c58-aff3-3ad07ecdeba7 tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] 10.222.0.61 "GET /compute/v2.1/servers/8ae36099-24d3-40a1-83c6-cf72bb619a57" status: 404 len: 111 microversion: 2.1 time: 0.029536 May 14 15:57:42.565011 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: [pid: 128729|app: 0|req: 579/1176] 10.222.0.61 () {58 vars in 1235 bytes} [Sat May 14 15:57:42 2022] GET /compute/v2.1/servers/8ae36099-24d3-40a1-83c6-cf72bb619a57 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 14 15:57:42.972797 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi [None req-695baca6-d9cd-4584-8ee9-a12d10ca7481 tempest-TestVolumeBootPattern-2062489882 tempest-TestVolumeBootPattern-2062489882-project] Calling method '>' {{(pid=128728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 15:57:42.973391 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.compute.api [None req-695baca6-d9cd-4584-8ee9-a12d10ca7481 tempest-TestVolumeBootPattern-2062489882 tempest-TestVolumeBootPattern-2062489882-project] [instance: 6dd9e299-5776-4848-b4ab-6d07424a3f8e] Fetching instance by UUID {{(pid=128728) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 15:57:42.980289 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-695baca6-d9cd-4584-8ee9-a12d10ca7481 tempest-TestVolumeBootPattern-2062489882 tempest-TestVolumeBootPattern-2062489882-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:57:42.980819 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-695baca6-d9cd-4584-8ee9-a12d10ca7481 tempest-TestVolumeBootPattern-2062489882 tempest-TestVolumeBootPattern-2062489882-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:57:42.981580 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-695baca6-d9cd-4584-8ee9-a12d10ca7481 tempest-TestVolumeBootPattern-2062489882 tempest-TestVolumeBootPattern-2062489882-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:57:42.982018 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-695baca6-d9cd-4584-8ee9-a12d10ca7481 tempest-TestVolumeBootPattern-2062489882 tempest-TestVolumeBootPattern-2062489882-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:57:43.116177 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.policy [None req-695baca6-d9cd-4584-8ee9-a12d10ca7481 tempest-TestVolumeBootPattern-2062489882 tempest-TestVolumeBootPattern-2062489882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '568f6783dd4d43398a70a9ffa58ff660', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a3a2b5dee7a404a8445c8aa434b5a43', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128728) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:57:43.125962 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: INFO nova.api.openstack.requestlog [None req-695baca6-d9cd-4584-8ee9-a12d10ca7481 tempest-TestVolumeBootPattern-2062489882 tempest-TestVolumeBootPattern-2062489882-project] 10.222.0.61 "GET /compute/v2.1/servers/6dd9e299-5776-4848-b4ab-6d07424a3f8e" status: 200 len: 1266 microversion: 2.1 time: 0.156270 May 14 15:57:43.126815 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: [pid: 128728|app: 0|req: 598/1177] 10.222.0.61 () {58 vars in 1235 bytes} [Sat May 14 15:57:42 2022] GET /compute/v2.1/servers/6dd9e299-5776-4848-b4ab-6d07424a3f8e => generated 1266 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 15:57:43.695114 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi [None req-fd6ddcc3-4a2c-4223-b3cf-f5069d726511 tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] Calling method '>' {{(pid=128729) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 15:57:43.695627 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.compute.api [None req-fd6ddcc3-4a2c-4223-b3cf-f5069d726511 tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] [instance: e10cdd60-3aac-4bee-a533-cc02b8d242e2] Fetching instance by UUID {{(pid=128729) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 15:57:43.702100 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-fd6ddcc3-4a2c-4223-b3cf-f5069d726511 tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:57:43.702587 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-fd6ddcc3-4a2c-4223-b3cf-f5069d726511 tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:57:43.703365 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-fd6ddcc3-4a2c-4223-b3cf-f5069d726511 tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:57:43.703805 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-fd6ddcc3-4a2c-4223-b3cf-f5069d726511 tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:57:43.717745 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: INFO nova.api.openstack.wsgi [None req-fd6ddcc3-4a2c-4223-b3cf-f5069d726511 tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] HTTP exception thrown: Instance e10cdd60-3aac-4bee-a533-cc02b8d242e2 could not be found. May 14 15:57:43.719306 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi [None req-fd6ddcc3-4a2c-4223-b3cf-f5069d726511 tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] Request method failure captured: May 14 15:57:43.719306 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: request: DELETE /compute/v2.1/servers/e10cdd60-3aac-4bee-a533-cc02b8d242e2 HTTP/1.1 May 14 15:57:43.719306 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: Accept: application/json May 14 15:57:43.719306 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: Accept-Encoding: identity May 14 15:57:43.719306 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: Connection: close May 14 15:57:43.719306 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: Content-Length: 0 May 14 15:57:43.719306 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: Content-Type: application/json May 14 15:57:43.719306 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: Host: 10.222.0.61 May 14 15:57:43.719306 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: Openstack-System-Scope: None May 14 15:57:43.719306 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: User-Agent: python-urllib3/1.26.9 May 14 15:57:43.719306 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: X-Auth-Token: gAAAAABif87SP_Zwa2IiGvFqsMgjavpLb8KTM6Zjei-leP46wpGTfISEWiNabTSLn_Se4MigqIDtVKHrnJDEVndJObAkvdE7QziqGtKnvzcsAHHCuGZvbOCiZ5Yv_050Eg71rjYT92fMkrLj82GJjq7kUvTbRuW_X-0VLgSk3UstO-oNY0ykSUs May 14 15:57:43.719306 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: X-Domain-Id: None May 14 15:57:43.719306 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: X-Domain-Name: None May 14 15:57:43.719306 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: X-Identity-Status: Confirmed May 14 15:57:43.719306 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: X-Is-Admin-Project: True May 14 15:57:43.719306 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: X-Project-Domain-Id: default May 14 15:57:43.719306 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: X-Project-Domain-Name: Default May 14 15:57:43.719306 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: X-Project-Id: 7905689c95d44a5c9169249c70f7de57 May 14 15:57:43.719306 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: X-Project-Name: tempest-AttachVolumeNegativeTest-1525749350 May 14 15:57:43.719306 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: X-Role: reader,member May 14 15:57:43.719306 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: X-Roles: reader,member May 14 15:57:43.721003 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/7905689c95d44a5c9169249c70f7de57"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/7905689c95d44a5c9169249c70f7de57"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/7905689c95d44a5c9169249c70f7de57"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_7905689c95d44a5c9169249c70f7de57"}]}] May 14 15:57:43.721003 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: X-Tenant: tempest-AttachVolumeNegativeTest-1525749350 May 14 15:57:43.721003 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: X-Tenant-Id: 7905689c95d44a5c9169249c70f7de57 May 14 15:57:43.721003 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1525749350 May 14 15:57:43.721003 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: X-User: tempest-AttachVolumeNegativeTest-1525749350-project May 14 15:57:43.721003 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: X-User-Domain-Id: default May 14 15:57:43.721003 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: X-User-Domain-Name: Default May 14 15:57:43.721003 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: X-User-Id: dc43895177134e9c9c030a9d87f94aaa May 14 15:57:43.721003 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: X-User-Name: tempest-AttachVolumeNegativeTest-1525749350-project May 14 15:57:43.721003 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: method: > May 14 15:57:43.721003 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: exception: Instance e10cdd60-3aac-4bee-a533-cc02b8d242e2 could not be found. May 14 15:57:43.721003 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: action_args: {'id': 'e10cdd60-3aac-4bee-a533-cc02b8d242e2'} May 14 15:57:43.721861 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: {{(pid=128729) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 14 15:57:43.721861 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 15:57:43.721861 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 14 15:57:43.721861 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 14 15:57:43.721861 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 14 15:57:43.721861 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 14 15:57:43.721861 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 14 15:57:43.721861 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 14 15:57:43.721861 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 14 15:57:43.721861 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 14 15:57:43.721861 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e10cdd60-3aac-4bee-a533-cc02b8d242e2 could not be found. May 14 15:57:43.721861 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: ERROR nova.api.openstack.wsgi May 14 15:57:43.721861 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 14 15:57:43.721861 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: ERROR nova.api.openstack.wsgi May 14 15:57:43.721861 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 15:57:43.721861 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 14 15:57:43.721861 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 14 15:57:43.721861 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 14 15:57:43.721861 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 14 15:57:43.721861 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 14 15:57:43.723539 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 14 15:57:43.723539 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 14 15:57:43.723539 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 14 15:57:43.723539 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 14 15:57:43.723539 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 14 15:57:43.723539 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 14 15:57:43.723539 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 14 15:57:43.723539 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 14 15:57:43.723539 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 14 15:57:43.723539 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e10cdd60-3aac-4bee-a533-cc02b8d242e2 could not be found. May 14 15:57:43.723539 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: ERROR nova.api.openstack.wsgi May 14 15:57:43.723539 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 14 15:57:43.723539 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: ERROR nova.api.openstack.wsgi May 14 15:57:43.723539 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 15:57:43.723539 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 14 15:57:43.723539 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 14 15:57:43.723539 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 14 15:57:43.723539 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 14 15:57:43.723539 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e10cdd60-3aac-4bee-a533-cc02b8d242e2 could not be found. May 14 15:57:43.723539 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: ERROR nova.api.openstack.wsgi May 14 15:57:43.725122 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi [None req-fd6ddcc3-4a2c-4223-b3cf-f5069d726511 tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] Returning 404 to user: Instance e10cdd60-3aac-4bee-a533-cc02b8d242e2 could not be found. {{(pid=128729) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 14 15:57:43.725122 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: INFO nova.api.openstack.requestlog [None req-fd6ddcc3-4a2c-4223-b3cf-f5069d726511 tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] 10.222.0.61 "DELETE /compute/v2.1/servers/e10cdd60-3aac-4bee-a533-cc02b8d242e2" status: 404 len: 111 microversion: 2.1 time: 0.029519 May 14 15:57:43.725122 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: [pid: 128729|app: 0|req: 580/1178] 10.222.0.61 () {58 vars in 1238 bytes} [Sat May 14 15:57:43 2022] DELETE /compute/v2.1/servers/e10cdd60-3aac-4bee-a533-cc02b8d242e2 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 14 15:57:43.729047 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi [None req-7b971279-6b45-4c34-b190-d501160a3119 tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] Calling method '>' {{(pid=128728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 15:57:43.730419 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.compute.api [None req-7b971279-6b45-4c34-b190-d501160a3119 tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] [instance: e10cdd60-3aac-4bee-a533-cc02b8d242e2] Fetching instance by UUID {{(pid=128728) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 15:57:43.736248 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-7b971279-6b45-4c34-b190-d501160a3119 tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:57:43.736702 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-7b971279-6b45-4c34-b190-d501160a3119 tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:57:43.737468 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-7b971279-6b45-4c34-b190-d501160a3119 tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:57:43.737905 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-7b971279-6b45-4c34-b190-d501160a3119 tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:57:43.751812 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: INFO nova.api.openstack.wsgi [None req-7b971279-6b45-4c34-b190-d501160a3119 tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] HTTP exception thrown: Instance e10cdd60-3aac-4bee-a533-cc02b8d242e2 could not be found. May 14 15:57:43.753411 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi [None req-7b971279-6b45-4c34-b190-d501160a3119 tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] Request method failure captured: May 14 15:57:43.753411 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: request: GET /compute/v2.1/servers/e10cdd60-3aac-4bee-a533-cc02b8d242e2 HTTP/1.1 May 14 15:57:43.753411 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: Accept: application/json May 14 15:57:43.753411 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: Accept-Encoding: identity May 14 15:57:43.753411 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: Connection: close May 14 15:57:43.753411 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: Content-Length: 0 May 14 15:57:43.753411 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: Content-Type: application/json May 14 15:57:43.753411 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: Host: 10.222.0.61 May 14 15:57:43.753411 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: Openstack-System-Scope: None May 14 15:57:43.753411 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: User-Agent: python-urllib3/1.26.9 May 14 15:57:43.753411 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: X-Auth-Token: gAAAAABif87SP_Zwa2IiGvFqsMgjavpLb8KTM6Zjei-leP46wpGTfISEWiNabTSLn_Se4MigqIDtVKHrnJDEVndJObAkvdE7QziqGtKnvzcsAHHCuGZvbOCiZ5Yv_050Eg71rjYT92fMkrLj82GJjq7kUvTbRuW_X-0VLgSk3UstO-oNY0ykSUs May 14 15:57:43.753411 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: X-Domain-Id: None May 14 15:57:43.753411 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: X-Domain-Name: None May 14 15:57:43.753411 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: X-Identity-Status: Confirmed May 14 15:57:43.753411 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: X-Is-Admin-Project: True May 14 15:57:43.753411 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: X-Project-Domain-Id: default May 14 15:57:43.753411 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: X-Project-Domain-Name: Default May 14 15:57:43.753411 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: X-Project-Id: 7905689c95d44a5c9169249c70f7de57 May 14 15:57:43.753411 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: X-Project-Name: tempest-AttachVolumeNegativeTest-1525749350 May 14 15:57:43.753411 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: X-Role: reader,member May 14 15:57:43.753411 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: X-Roles: reader,member May 14 15:57:43.755049 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/7905689c95d44a5c9169249c70f7de57"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/7905689c95d44a5c9169249c70f7de57"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/7905689c95d44a5c9169249c70f7de57"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_7905689c95d44a5c9169249c70f7de57"}]}] May 14 15:57:43.755049 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: X-Tenant: tempest-AttachVolumeNegativeTest-1525749350 May 14 15:57:43.755049 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: X-Tenant-Id: 7905689c95d44a5c9169249c70f7de57 May 14 15:57:43.755049 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1525749350 May 14 15:57:43.755049 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: X-User: tempest-AttachVolumeNegativeTest-1525749350-project May 14 15:57:43.755049 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: X-User-Domain-Id: default May 14 15:57:43.755049 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: X-User-Domain-Name: Default May 14 15:57:43.755049 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: X-User-Id: dc43895177134e9c9c030a9d87f94aaa May 14 15:57:43.755049 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: X-User-Name: tempest-AttachVolumeNegativeTest-1525749350-project May 14 15:57:43.755049 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: method: > May 14 15:57:43.755049 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: exception: Instance e10cdd60-3aac-4bee-a533-cc02b8d242e2 could not be found. May 14 15:57:43.755049 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: action_args: {'id': 'e10cdd60-3aac-4bee-a533-cc02b8d242e2'} May 14 15:57:43.755858 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: {{(pid=128728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 14 15:57:43.755858 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 15:57:43.755858 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 14 15:57:43.755858 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 14 15:57:43.755858 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 14 15:57:43.755858 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 14 15:57:43.755858 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 14 15:57:43.755858 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 14 15:57:43.755858 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 14 15:57:43.755858 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 14 15:57:43.755858 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e10cdd60-3aac-4bee-a533-cc02b8d242e2 could not be found. May 14 15:57:43.755858 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: ERROR nova.api.openstack.wsgi May 14 15:57:43.755858 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 14 15:57:43.755858 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: ERROR nova.api.openstack.wsgi May 14 15:57:43.755858 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 15:57:43.755858 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 14 15:57:43.755858 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 14 15:57:43.755858 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 14 15:57:43.755858 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 14 15:57:43.755858 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 14 15:57:43.757065 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 14 15:57:43.757065 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 14 15:57:43.757065 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 14 15:57:43.757065 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 14 15:57:43.757065 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 14 15:57:43.757065 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 14 15:57:43.757065 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 14 15:57:43.757065 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e10cdd60-3aac-4bee-a533-cc02b8d242e2 could not be found. May 14 15:57:43.757065 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: ERROR nova.api.openstack.wsgi May 14 15:57:43.757065 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 14 15:57:43.757065 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: ERROR nova.api.openstack.wsgi May 14 15:57:43.757065 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 15:57:43.757065 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 14 15:57:43.757065 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 14 15:57:43.757065 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 14 15:57:43.757065 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 14 15:57:43.757065 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e10cdd60-3aac-4bee-a533-cc02b8d242e2 could not be found. May 14 15:57:43.757065 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: ERROR nova.api.openstack.wsgi May 14 15:57:43.758142 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi [None req-7b971279-6b45-4c34-b190-d501160a3119 tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] Returning 404 to user: Instance e10cdd60-3aac-4bee-a533-cc02b8d242e2 could not be found. {{(pid=128728) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 14 15:57:43.758142 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: INFO nova.api.openstack.requestlog [None req-7b971279-6b45-4c34-b190-d501160a3119 tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] 10.222.0.61 "GET /compute/v2.1/servers/e10cdd60-3aac-4bee-a533-cc02b8d242e2" status: 404 len: 111 microversion: 2.1 time: 0.029615 May 14 15:57:43.758142 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: [pid: 128728|app: 0|req: 599/1179] 10.222.0.61 () {58 vars in 1235 bytes} [Sat May 14 15:57:43 2022] GET /compute/v2.1/servers/e10cdd60-3aac-4bee-a533-cc02b8d242e2 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 14 15:57:43.764515 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi [None req-2a1f4b9b-4871-42f5-b20e-e9e51eb53369 tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] Calling method '>' {{(pid=128729) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 15:57:43.765013 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.compute.api [None req-2a1f4b9b-4871-42f5-b20e-e9e51eb53369 tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] [instance: 567fb38a-9c00-4de9-8a01-8070792cde75] Fetching instance by UUID {{(pid=128729) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 15:57:43.770928 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-2a1f4b9b-4871-42f5-b20e-e9e51eb53369 tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:57:43.771370 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-2a1f4b9b-4871-42f5-b20e-e9e51eb53369 tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:57:43.772126 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-2a1f4b9b-4871-42f5-b20e-e9e51eb53369 tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:57:43.772591 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-2a1f4b9b-4871-42f5-b20e-e9e51eb53369 tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:57:43.786170 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: INFO nova.api.openstack.wsgi [None req-2a1f4b9b-4871-42f5-b20e-e9e51eb53369 tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] HTTP exception thrown: Instance 567fb38a-9c00-4de9-8a01-8070792cde75 could not be found. May 14 15:57:43.787711 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi [None req-2a1f4b9b-4871-42f5-b20e-e9e51eb53369 tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] Request method failure captured: May 14 15:57:43.787711 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: request: DELETE /compute/v2.1/servers/567fb38a-9c00-4de9-8a01-8070792cde75 HTTP/1.1 May 14 15:57:43.787711 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: Accept: application/json May 14 15:57:43.787711 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: Accept-Encoding: identity May 14 15:57:43.787711 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: Connection: close May 14 15:57:43.787711 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: Content-Length: 0 May 14 15:57:43.787711 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: Content-Type: application/json May 14 15:57:43.787711 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: Host: 10.222.0.61 May 14 15:57:43.787711 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: Openstack-System-Scope: None May 14 15:57:43.787711 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: User-Agent: python-urllib3/1.26.9 May 14 15:57:43.787711 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: X-Auth-Token: gAAAAABif87SP_Zwa2IiGvFqsMgjavpLb8KTM6Zjei-leP46wpGTfISEWiNabTSLn_Se4MigqIDtVKHrnJDEVndJObAkvdE7QziqGtKnvzcsAHHCuGZvbOCiZ5Yv_050Eg71rjYT92fMkrLj82GJjq7kUvTbRuW_X-0VLgSk3UstO-oNY0ykSUs May 14 15:57:43.787711 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: X-Domain-Id: None May 14 15:57:43.787711 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: X-Domain-Name: None May 14 15:57:43.787711 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: X-Identity-Status: Confirmed May 14 15:57:43.787711 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: X-Is-Admin-Project: True May 14 15:57:43.787711 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: X-Project-Domain-Id: default May 14 15:57:43.787711 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: X-Project-Domain-Name: Default May 14 15:57:43.787711 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: X-Project-Id: 7905689c95d44a5c9169249c70f7de57 May 14 15:57:43.787711 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: X-Project-Name: tempest-AttachVolumeNegativeTest-1525749350 May 14 15:57:43.787711 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: X-Role: reader,member May 14 15:57:43.787711 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: X-Roles: reader,member May 14 15:57:43.789242 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/7905689c95d44a5c9169249c70f7de57"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/7905689c95d44a5c9169249c70f7de57"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/7905689c95d44a5c9169249c70f7de57"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_7905689c95d44a5c9169249c70f7de57"}]}] May 14 15:57:43.789242 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: X-Tenant: tempest-AttachVolumeNegativeTest-1525749350 May 14 15:57:43.789242 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: X-Tenant-Id: 7905689c95d44a5c9169249c70f7de57 May 14 15:57:43.789242 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1525749350 May 14 15:57:43.789242 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: X-User: tempest-AttachVolumeNegativeTest-1525749350-project May 14 15:57:43.789242 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: X-User-Domain-Id: default May 14 15:57:43.789242 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: X-User-Domain-Name: Default May 14 15:57:43.789242 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: X-User-Id: dc43895177134e9c9c030a9d87f94aaa May 14 15:57:43.789242 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: X-User-Name: tempest-AttachVolumeNegativeTest-1525749350-project May 14 15:57:43.789242 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: method: > May 14 15:57:43.789242 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: exception: Instance 567fb38a-9c00-4de9-8a01-8070792cde75 could not be found. May 14 15:57:43.789242 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: action_args: {'id': '567fb38a-9c00-4de9-8a01-8070792cde75'} May 14 15:57:43.790048 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: {{(pid=128729) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 14 15:57:43.790048 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 15:57:43.790048 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 14 15:57:43.790048 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 14 15:57:43.790048 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 14 15:57:43.790048 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 14 15:57:43.790048 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 14 15:57:43.790048 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 14 15:57:43.790048 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 14 15:57:43.790048 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 14 15:57:43.790048 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 567fb38a-9c00-4de9-8a01-8070792cde75 could not be found. May 14 15:57:43.790048 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: ERROR nova.api.openstack.wsgi May 14 15:57:43.790048 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 14 15:57:43.790048 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: ERROR nova.api.openstack.wsgi May 14 15:57:43.790048 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 15:57:43.790048 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 14 15:57:43.790048 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 14 15:57:43.790048 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 14 15:57:43.790048 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 14 15:57:43.790048 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 14 15:57:43.791461 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 14 15:57:43.791461 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 14 15:57:43.791461 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 14 15:57:43.791461 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 14 15:57:43.791461 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 14 15:57:43.791461 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 14 15:57:43.791461 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 14 15:57:43.791461 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 14 15:57:43.791461 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 14 15:57:43.791461 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 567fb38a-9c00-4de9-8a01-8070792cde75 could not be found. May 14 15:57:43.791461 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: ERROR nova.api.openstack.wsgi May 14 15:57:43.791461 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 14 15:57:43.791461 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: ERROR nova.api.openstack.wsgi May 14 15:57:43.791461 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 15:57:43.791461 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 14 15:57:43.791461 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 14 15:57:43.791461 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 14 15:57:43.791461 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 14 15:57:43.791461 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 567fb38a-9c00-4de9-8a01-8070792cde75 could not be found. May 14 15:57:43.791461 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: ERROR nova.api.openstack.wsgi May 14 15:57:43.793416 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi [None req-2a1f4b9b-4871-42f5-b20e-e9e51eb53369 tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] Returning 404 to user: Instance 567fb38a-9c00-4de9-8a01-8070792cde75 could not be found. {{(pid=128729) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 14 15:57:43.793416 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: INFO nova.api.openstack.requestlog [None req-2a1f4b9b-4871-42f5-b20e-e9e51eb53369 tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] 10.222.0.61 "DELETE /compute/v2.1/servers/567fb38a-9c00-4de9-8a01-8070792cde75" status: 404 len: 111 microversion: 2.1 time: 0.029160 May 14 15:57:43.793416 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: [pid: 128729|app: 0|req: 581/1180] 10.222.0.61 () {58 vars in 1238 bytes} [Sat May 14 15:57:43 2022] DELETE /compute/v2.1/servers/567fb38a-9c00-4de9-8a01-8070792cde75 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 14 15:57:43.798713 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi [None req-1590b47f-1b68-4dce-82a8-b68c478c4923 tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] Calling method '>' {{(pid=128728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 15:57:43.799321 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.compute.api [None req-1590b47f-1b68-4dce-82a8-b68c478c4923 tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] [instance: 567fb38a-9c00-4de9-8a01-8070792cde75] Fetching instance by UUID {{(pid=128728) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 15:57:43.805160 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-1590b47f-1b68-4dce-82a8-b68c478c4923 tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:57:43.805608 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-1590b47f-1b68-4dce-82a8-b68c478c4923 tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:57:43.806392 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-1590b47f-1b68-4dce-82a8-b68c478c4923 tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:57:43.806828 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-1590b47f-1b68-4dce-82a8-b68c478c4923 tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:57:43.820504 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: INFO nova.api.openstack.wsgi [None req-1590b47f-1b68-4dce-82a8-b68c478c4923 tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] HTTP exception thrown: Instance 567fb38a-9c00-4de9-8a01-8070792cde75 could not be found. May 14 15:57:43.822007 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi [None req-1590b47f-1b68-4dce-82a8-b68c478c4923 tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] Request method failure captured: May 14 15:57:43.822007 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: request: GET /compute/v2.1/servers/567fb38a-9c00-4de9-8a01-8070792cde75 HTTP/1.1 May 14 15:57:43.822007 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: Accept: application/json May 14 15:57:43.822007 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: Accept-Encoding: identity May 14 15:57:43.822007 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: Connection: close May 14 15:57:43.822007 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: Content-Length: 0 May 14 15:57:43.822007 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: Content-Type: application/json May 14 15:57:43.822007 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: Host: 10.222.0.61 May 14 15:57:43.822007 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: Openstack-System-Scope: None May 14 15:57:43.822007 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: User-Agent: python-urllib3/1.26.9 May 14 15:57:43.822007 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: X-Auth-Token: gAAAAABif87SP_Zwa2IiGvFqsMgjavpLb8KTM6Zjei-leP46wpGTfISEWiNabTSLn_Se4MigqIDtVKHrnJDEVndJObAkvdE7QziqGtKnvzcsAHHCuGZvbOCiZ5Yv_050Eg71rjYT92fMkrLj82GJjq7kUvTbRuW_X-0VLgSk3UstO-oNY0ykSUs May 14 15:57:43.822007 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: X-Domain-Id: None May 14 15:57:43.822007 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: X-Domain-Name: None May 14 15:57:43.822007 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: X-Identity-Status: Confirmed May 14 15:57:43.822007 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: X-Is-Admin-Project: True May 14 15:57:43.822007 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: X-Project-Domain-Id: default May 14 15:57:43.822007 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: X-Project-Domain-Name: Default May 14 15:57:43.822007 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: X-Project-Id: 7905689c95d44a5c9169249c70f7de57 May 14 15:57:43.822007 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: X-Project-Name: tempest-AttachVolumeNegativeTest-1525749350 May 14 15:57:43.822007 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: X-Role: reader,member May 14 15:57:43.822007 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: X-Roles: reader,member May 14 15:57:43.823617 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/7905689c95d44a5c9169249c70f7de57"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/7905689c95d44a5c9169249c70f7de57"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/7905689c95d44a5c9169249c70f7de57"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_7905689c95d44a5c9169249c70f7de57"}]}] May 14 15:57:43.823617 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: X-Tenant: tempest-AttachVolumeNegativeTest-1525749350 May 14 15:57:43.823617 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: X-Tenant-Id: 7905689c95d44a5c9169249c70f7de57 May 14 15:57:43.823617 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1525749350 May 14 15:57:43.823617 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: X-User: tempest-AttachVolumeNegativeTest-1525749350-project May 14 15:57:43.823617 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: X-User-Domain-Id: default May 14 15:57:43.823617 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: X-User-Domain-Name: Default May 14 15:57:43.823617 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: X-User-Id: dc43895177134e9c9c030a9d87f94aaa May 14 15:57:43.823617 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: X-User-Name: tempest-AttachVolumeNegativeTest-1525749350-project May 14 15:57:43.823617 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: method: > May 14 15:57:43.823617 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: exception: Instance 567fb38a-9c00-4de9-8a01-8070792cde75 could not be found. May 14 15:57:43.823617 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: action_args: {'id': '567fb38a-9c00-4de9-8a01-8070792cde75'} May 14 15:57:43.824597 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: {{(pid=128728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 14 15:57:43.824597 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 15:57:43.824597 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 14 15:57:43.824597 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 14 15:57:43.824597 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 14 15:57:43.824597 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 14 15:57:43.824597 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 14 15:57:43.824597 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 14 15:57:43.824597 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 14 15:57:43.824597 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 14 15:57:43.824597 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 567fb38a-9c00-4de9-8a01-8070792cde75 could not be found. May 14 15:57:43.824597 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: ERROR nova.api.openstack.wsgi May 14 15:57:43.824597 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 14 15:57:43.824597 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: ERROR nova.api.openstack.wsgi May 14 15:57:43.824597 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 15:57:43.824597 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 14 15:57:43.824597 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 14 15:57:43.824597 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 14 15:57:43.824597 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 14 15:57:43.824597 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 14 15:57:43.825979 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 14 15:57:43.825979 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 14 15:57:43.825979 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 14 15:57:43.825979 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 14 15:57:43.825979 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 14 15:57:43.825979 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 14 15:57:43.825979 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 14 15:57:43.825979 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 567fb38a-9c00-4de9-8a01-8070792cde75 could not be found. May 14 15:57:43.825979 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: ERROR nova.api.openstack.wsgi May 14 15:57:43.825979 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 14 15:57:43.825979 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: ERROR nova.api.openstack.wsgi May 14 15:57:43.825979 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 15:57:43.825979 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 14 15:57:43.825979 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 14 15:57:43.825979 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 14 15:57:43.825979 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 14 15:57:43.825979 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 567fb38a-9c00-4de9-8a01-8070792cde75 could not be found. May 14 15:57:43.825979 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: ERROR nova.api.openstack.wsgi May 14 15:57:43.827313 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi [None req-1590b47f-1b68-4dce-82a8-b68c478c4923 tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] Returning 404 to user: Instance 567fb38a-9c00-4de9-8a01-8070792cde75 could not be found. {{(pid=128728) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 14 15:57:43.827313 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: INFO nova.api.openstack.requestlog [None req-1590b47f-1b68-4dce-82a8-b68c478c4923 tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] 10.222.0.61 "GET /compute/v2.1/servers/567fb38a-9c00-4de9-8a01-8070792cde75" status: 404 len: 111 microversion: 2.1 time: 0.028428 May 14 15:57:43.827313 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: [pid: 128728|app: 0|req: 600/1181] 10.222.0.61 () {58 vars in 1235 bytes} [Sat May 14 15:57:43 2022] GET /compute/v2.1/servers/567fb38a-9c00-4de9-8a01-8070792cde75 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 14 15:57:44.143079 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi [None req-9f99e336-953b-4af2-89db-b9d932a97b21 tempest-TestVolumeBootPattern-2062489882 tempest-TestVolumeBootPattern-2062489882-project] Calling method '>' {{(pid=128729) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 15:57:44.143694 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.compute.api [None req-9f99e336-953b-4af2-89db-b9d932a97b21 tempest-TestVolumeBootPattern-2062489882 tempest-TestVolumeBootPattern-2062489882-project] [instance: 6dd9e299-5776-4848-b4ab-6d07424a3f8e] Fetching instance by UUID {{(pid=128729) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 15:57:44.149821 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-9f99e336-953b-4af2-89db-b9d932a97b21 tempest-TestVolumeBootPattern-2062489882 tempest-TestVolumeBootPattern-2062489882-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:57:44.150263 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-9f99e336-953b-4af2-89db-b9d932a97b21 tempest-TestVolumeBootPattern-2062489882 tempest-TestVolumeBootPattern-2062489882-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:57:44.151056 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-9f99e336-953b-4af2-89db-b9d932a97b21 tempest-TestVolumeBootPattern-2062489882 tempest-TestVolumeBootPattern-2062489882-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:57:44.152042 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-9f99e336-953b-4af2-89db-b9d932a97b21 tempest-TestVolumeBootPattern-2062489882 tempest-TestVolumeBootPattern-2062489882-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:57:44.301402 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.policy [None req-9f99e336-953b-4af2-89db-b9d932a97b21 tempest-TestVolumeBootPattern-2062489882 tempest-TestVolumeBootPattern-2062489882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '568f6783dd4d43398a70a9ffa58ff660', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a3a2b5dee7a404a8445c8aa434b5a43', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128729) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:57:44.309738 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: INFO nova.api.openstack.requestlog [None req-9f99e336-953b-4af2-89db-b9d932a97b21 tempest-TestVolumeBootPattern-2062489882 tempest-TestVolumeBootPattern-2062489882-project] 10.222.0.61 "GET /compute/v2.1/servers/6dd9e299-5776-4848-b4ab-6d07424a3f8e" status: 200 len: 1266 microversion: 2.1 time: 0.170498 May 14 15:57:44.310348 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: [pid: 128729|app: 0|req: 582/1182] 10.222.0.61 () {58 vars in 1235 bytes} [Sat May 14 15:57:44 2022] GET /compute/v2.1/servers/6dd9e299-5776-4848-b4ab-6d07424a3f8e => generated 1266 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 15:57:45.327422 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi [None req-52e464fa-d1be-4bae-9918-f963178fc364 tempest-TestVolumeBootPattern-2062489882 tempest-TestVolumeBootPattern-2062489882-project] Calling method '>' {{(pid=128728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 15:57:45.328033 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.compute.api [None req-52e464fa-d1be-4bae-9918-f963178fc364 tempest-TestVolumeBootPattern-2062489882 tempest-TestVolumeBootPattern-2062489882-project] [instance: 6dd9e299-5776-4848-b4ab-6d07424a3f8e] Fetching instance by UUID {{(pid=128728) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 15:57:45.334228 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-52e464fa-d1be-4bae-9918-f963178fc364 tempest-TestVolumeBootPattern-2062489882 tempest-TestVolumeBootPattern-2062489882-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:57:45.334703 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-52e464fa-d1be-4bae-9918-f963178fc364 tempest-TestVolumeBootPattern-2062489882 tempest-TestVolumeBootPattern-2062489882-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:57:45.335464 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-52e464fa-d1be-4bae-9918-f963178fc364 tempest-TestVolumeBootPattern-2062489882 tempest-TestVolumeBootPattern-2062489882-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:57:45.335896 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-52e464fa-d1be-4bae-9918-f963178fc364 tempest-TestVolumeBootPattern-2062489882 tempest-TestVolumeBootPattern-2062489882-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:57:45.462416 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.policy [None req-52e464fa-d1be-4bae-9918-f963178fc364 tempest-TestVolumeBootPattern-2062489882 tempest-TestVolumeBootPattern-2062489882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '568f6783dd4d43398a70a9ffa58ff660', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a3a2b5dee7a404a8445c8aa434b5a43', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128728) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:57:45.470352 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: INFO nova.api.openstack.requestlog [None req-52e464fa-d1be-4bae-9918-f963178fc364 tempest-TestVolumeBootPattern-2062489882 tempest-TestVolumeBootPattern-2062489882-project] 10.222.0.61 "GET /compute/v2.1/servers/6dd9e299-5776-4848-b4ab-6d07424a3f8e" status: 200 len: 1266 microversion: 2.1 time: 0.147454 May 14 15:57:45.470918 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: [pid: 128728|app: 0|req: 601/1183] 10.222.0.61 () {58 vars in 1235 bytes} [Sat May 14 15:57:45 2022] GET /compute/v2.1/servers/6dd9e299-5776-4848-b4ab-6d07424a3f8e => generated 1266 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 15:57:46.487294 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi [None req-a67402e3-38a2-4827-8f25-0703600676a0 tempest-TestVolumeBootPattern-2062489882 tempest-TestVolumeBootPattern-2062489882-project] Calling method '>' {{(pid=128729) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 15:57:46.487896 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.compute.api [None req-a67402e3-38a2-4827-8f25-0703600676a0 tempest-TestVolumeBootPattern-2062489882 tempest-TestVolumeBootPattern-2062489882-project] [instance: 6dd9e299-5776-4848-b4ab-6d07424a3f8e] Fetching instance by UUID {{(pid=128729) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 15:57:46.494443 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-a67402e3-38a2-4827-8f25-0703600676a0 tempest-TestVolumeBootPattern-2062489882 tempest-TestVolumeBootPattern-2062489882-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:57:46.494895 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-a67402e3-38a2-4827-8f25-0703600676a0 tempest-TestVolumeBootPattern-2062489882 tempest-TestVolumeBootPattern-2062489882-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:57:46.495657 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-a67402e3-38a2-4827-8f25-0703600676a0 tempest-TestVolumeBootPattern-2062489882 tempest-TestVolumeBootPattern-2062489882-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:57:46.496890 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-a67402e3-38a2-4827-8f25-0703600676a0 tempest-TestVolumeBootPattern-2062489882 tempest-TestVolumeBootPattern-2062489882-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:57:46.625230 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.policy [None req-a67402e3-38a2-4827-8f25-0703600676a0 tempest-TestVolumeBootPattern-2062489882 tempest-TestVolumeBootPattern-2062489882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '568f6783dd4d43398a70a9ffa58ff660', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a3a2b5dee7a404a8445c8aa434b5a43', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128729) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:57:46.632728 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: INFO nova.api.openstack.requestlog [None req-a67402e3-38a2-4827-8f25-0703600676a0 tempest-TestVolumeBootPattern-2062489882 tempest-TestVolumeBootPattern-2062489882-project] 10.222.0.61 "GET /compute/v2.1/servers/6dd9e299-5776-4848-b4ab-6d07424a3f8e" status: 200 len: 1266 microversion: 2.1 time: 0.149322 May 14 15:57:46.633313 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: [pid: 128729|app: 0|req: 583/1184] 10.222.0.61 () {58 vars in 1235 bytes} [Sat May 14 15:57:46 2022] GET /compute/v2.1/servers/6dd9e299-5776-4848-b4ab-6d07424a3f8e => generated 1266 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 15:57:47.650210 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi [None req-a4889a62-a3bd-4662-adb3-792d9dd6ebea tempest-TestVolumeBootPattern-2062489882 tempest-TestVolumeBootPattern-2062489882-project] Calling method '>' {{(pid=128728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 15:57:47.650866 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.compute.api [None req-a4889a62-a3bd-4662-adb3-792d9dd6ebea tempest-TestVolumeBootPattern-2062489882 tempest-TestVolumeBootPattern-2062489882-project] [instance: 6dd9e299-5776-4848-b4ab-6d07424a3f8e] Fetching instance by UUID {{(pid=128728) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 15:57:47.657870 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-a4889a62-a3bd-4662-adb3-792d9dd6ebea tempest-TestVolumeBootPattern-2062489882 tempest-TestVolumeBootPattern-2062489882-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:57:47.658346 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-a4889a62-a3bd-4662-adb3-792d9dd6ebea tempest-TestVolumeBootPattern-2062489882 tempest-TestVolumeBootPattern-2062489882-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:57:47.659126 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-a4889a62-a3bd-4662-adb3-792d9dd6ebea tempest-TestVolumeBootPattern-2062489882 tempest-TestVolumeBootPattern-2062489882-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:57:47.659564 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-a4889a62-a3bd-4662-adb3-792d9dd6ebea tempest-TestVolumeBootPattern-2062489882 tempest-TestVolumeBootPattern-2062489882-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:57:47.804198 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.policy [None req-a4889a62-a3bd-4662-adb3-792d9dd6ebea tempest-TestVolumeBootPattern-2062489882 tempest-TestVolumeBootPattern-2062489882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '568f6783dd4d43398a70a9ffa58ff660', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a3a2b5dee7a404a8445c8aa434b5a43', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128728) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:57:47.814833 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: INFO nova.api.openstack.requestlog [None req-a4889a62-a3bd-4662-adb3-792d9dd6ebea tempest-TestVolumeBootPattern-2062489882 tempest-TestVolumeBootPattern-2062489882-project] 10.222.0.61 "GET /compute/v2.1/servers/6dd9e299-5776-4848-b4ab-6d07424a3f8e" status: 200 len: 1266 microversion: 2.1 time: 0.168214 May 14 15:57:47.815661 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: [pid: 128728|app: 0|req: 602/1185] 10.222.0.61 () {58 vars in 1235 bytes} [Sat May 14 15:57:47 2022] GET /compute/v2.1/servers/6dd9e299-5776-4848-b4ab-6d07424a3f8e => generated 1266 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 15:57:48.680058 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi [None req-0e05a1fd-c1e0-46c7-9477-b20f7c153bae tempest-TestShelveInstance-1853374188 tempest-TestShelveInstance-1853374188-project] Calling method '>' {{(pid=128729) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 15:57:48.680562 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.compute.api [None req-0e05a1fd-c1e0-46c7-9477-b20f7c153bae tempest-TestShelveInstance-1853374188 tempest-TestShelveInstance-1853374188-project] [instance: 08195c98-5b1d-426c-a398-c7e914c14661] Fetching instance by UUID {{(pid=128729) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 15:57:48.688041 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-0e05a1fd-c1e0-46c7-9477-b20f7c153bae tempest-TestShelveInstance-1853374188 tempest-TestShelveInstance-1853374188-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:57:48.688290 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi [req-0f3333b8-ff56-4c08-a5df-a873be681dba req-5f7be3ba-f63d-496f-891b-17487ce29c3e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "08195c98-5b1d-426c-a398-c7e914c14661", "tag": "ff1e7e07-bb51-463a-a362-bc5fcaff458c"}]} {{(pid=128728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 15:57:48.688755 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-0e05a1fd-c1e0-46c7-9477-b20f7c153bae tempest-TestShelveInstance-1853374188 tempest-TestShelveInstance-1853374188-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:57:48.689257 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-0e05a1fd-c1e0-46c7-9477-b20f7c153bae tempest-TestShelveInstance-1853374188 tempest-TestShelveInstance-1853374188-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:57:48.689698 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-0e05a1fd-c1e0-46c7-9477-b20f7c153bae tempest-TestShelveInstance-1853374188 tempest-TestShelveInstance-1853374188-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:57:48.700897 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [req-0f3333b8-ff56-4c08-a5df-a873be681dba req-5f7be3ba-f63d-496f-891b-17487ce29c3e service nova] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:57:48.702516 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [req-0f3333b8-ff56-4c08-a5df-a873be681dba req-5f7be3ba-f63d-496f-891b-17487ce29c3e service nova] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:57:48.714338 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: INFO nova.api.openstack.compute.server_external_events [req-0f3333b8-ff56-4c08-a5df-a873be681dba req-5f7be3ba-f63d-496f-891b-17487ce29c3e service nova] Creating event network-changed:ff1e7e07-bb51-463a-a362-bc5fcaff458c for instance 08195c98-5b1d-426c-a398-c7e914c14661 on hv-cinder-83979 May 14 15:57:48.727266 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.compute.api [None req-0e05a1fd-c1e0-46c7-9477-b20f7c153bae tempest-TestShelveInstance-1853374188 tempest-TestShelveInstance-1853374188-project] [instance: 08195c98-5b1d-426c-a398-c7e914c14661] Going to try to terminate instance {{(pid=128729) delete /opt/stack/nova/nova/compute/api.py:2664}} May 14 15:57:48.732466 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: INFO nova.api.openstack.requestlog [req-0f3333b8-ff56-4c08-a5df-a873be681dba req-5f7be3ba-f63d-496f-891b-17487ce29c3e service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.053108 May 14 15:57:48.733677 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: [pid: 128728|app: 0|req: 603/1186] 10.222.0.61 () {64 vars in 1317 bytes} [Sat May 14 15:57:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 14 15:57:48.771942 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi [None req-c02d6392-fe6e-46b5-ab11-50778a1637b1 tempest-VolumesSnapshotTestJSON-671752898 tempest-VolumesSnapshotTestJSON-671752898-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-814939028", "imageRef": "1381e3d5-fc27-4fa7-ab03-5d86278a0546", "flavorRef": "452", "networks": [{"uuid": "5bc2cada-443d-44ab-8881-81867ee93960"}]}} {{(pid=128728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 15:57:48.851971 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: INFO nova.api.openstack.requestlog [None req-0e05a1fd-c1e0-46c7-9477-b20f7c153bae tempest-TestShelveInstance-1853374188 tempest-TestShelveInstance-1853374188-project] 10.222.0.61 "DELETE /compute/v2.1/servers/08195c98-5b1d-426c-a398-c7e914c14661" status: 204 len: 0 microversion: 2.1 time: 0.175494 May 14 15:57:48.856303 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: [pid: 128729|app: 0|req: 584/1187] 10.222.0.61 () {58 vars in 1238 bytes} [Sat May 14 15:57:48 2022] DELETE /compute/v2.1/servers/08195c98-5b1d-426c-a398-c7e914c14661 => generated 0 bytes in 177 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 14 15:57:48.861913 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.network.neutron [None req-c02d6392-fe6e-46b5-ab11-50778a1637b1 tempest-VolumesSnapshotTestJSON-671752898 tempest-VolumesSnapshotTestJSON-671752898-project] validate_networks() for [('5bc2cada-443d-44ab-8881-81867ee93960', None, None, None, None, None)] {{(pid=128728) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 14 15:57:48.862669 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi [None req-b223bf66-7c29-4d83-b1ae-ab15b99d19e2 tempest-TestVolumeBootPattern-2062489882 tempest-TestVolumeBootPattern-2062489882-project] Calling method '>' {{(pid=128729) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 15:57:48.863554 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.compute.api [None req-b223bf66-7c29-4d83-b1ae-ab15b99d19e2 tempest-TestVolumeBootPattern-2062489882 tempest-TestVolumeBootPattern-2062489882-project] [instance: 6dd9e299-5776-4848-b4ab-6d07424a3f8e] Fetching instance by UUID {{(pid=128729) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 15:57:48.870120 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-b223bf66-7c29-4d83-b1ae-ab15b99d19e2 tempest-TestVolumeBootPattern-2062489882 tempest-TestVolumeBootPattern-2062489882-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:57:48.870609 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-b223bf66-7c29-4d83-b1ae-ab15b99d19e2 tempest-TestVolumeBootPattern-2062489882 tempest-TestVolumeBootPattern-2062489882-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:57:48.872481 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-b223bf66-7c29-4d83-b1ae-ab15b99d19e2 tempest-TestVolumeBootPattern-2062489882 tempest-TestVolumeBootPattern-2062489882-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:57:48.872933 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-b223bf66-7c29-4d83-b1ae-ab15b99d19e2 tempest-TestVolumeBootPattern-2062489882 tempest-TestVolumeBootPattern-2062489882-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:57:49.081393 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.policy [None req-b223bf66-7c29-4d83-b1ae-ab15b99d19e2 tempest-TestVolumeBootPattern-2062489882 tempest-TestVolumeBootPattern-2062489882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '568f6783dd4d43398a70a9ffa58ff660', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a3a2b5dee7a404a8445c8aa434b5a43', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128729) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:57:49.091716 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: INFO nova.api.openstack.requestlog [None req-b223bf66-7c29-4d83-b1ae-ab15b99d19e2 tempest-TestVolumeBootPattern-2062489882 tempest-TestVolumeBootPattern-2062489882-project] 10.222.0.61 "GET /compute/v2.1/servers/6dd9e299-5776-4848-b4ab-6d07424a3f8e" status: 200 len: 1454 microversion: 2.1 time: 0.235463 May 14 15:57:49.092674 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: [pid: 128729|app: 0|req: 585/1188] 10.222.0.61 () {58 vars in 1235 bytes} [Sat May 14 15:57:48 2022] GET /compute/v2.1/servers/6dd9e299-5776-4848-b4ab-6d07424a3f8e => generated 1454 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 15:57:49.097458 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi [None req-3f10de1e-d3fc-4663-acb3-12e8d22baf86 tempest-TestShelveInstance-1853374188 tempest-TestShelveInstance-1853374188-project] Calling method '>' {{(pid=128729) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 15:57:49.098330 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.compute.api [None req-3f10de1e-d3fc-4663-acb3-12e8d22baf86 tempest-TestShelveInstance-1853374188 tempest-TestShelveInstance-1853374188-project] [instance: 08195c98-5b1d-426c-a398-c7e914c14661] Fetching instance by UUID {{(pid=128729) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 15:57:49.108503 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-3f10de1e-d3fc-4663-acb3-12e8d22baf86 tempest-TestShelveInstance-1853374188 tempest-TestShelveInstance-1853374188-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:57:49.108976 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-3f10de1e-d3fc-4663-acb3-12e8d22baf86 tempest-TestShelveInstance-1853374188 tempest-TestShelveInstance-1853374188-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:57:49.109929 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-3f10de1e-d3fc-4663-acb3-12e8d22baf86 tempest-TestShelveInstance-1853374188 tempest-TestShelveInstance-1853374188-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:57:49.110461 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-3f10de1e-d3fc-4663-acb3-12e8d22baf86 tempest-TestShelveInstance-1853374188 tempest-TestShelveInstance-1853374188-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:57:49.320108 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.policy [None req-3f10de1e-d3fc-4663-acb3-12e8d22baf86 tempest-TestShelveInstance-1853374188 tempest-TestShelveInstance-1853374188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e05ae1c6a054a299e841d008f9d7a09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83d6b6f0aa4f4314811ee80480861958', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128729) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:57:49.328097 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: INFO nova.api.openstack.requestlog [None req-3f10de1e-d3fc-4663-acb3-12e8d22baf86 tempest-TestShelveInstance-1853374188 tempest-TestShelveInstance-1853374188-project] 10.222.0.61 "GET /compute/v2.1/servers/08195c98-5b1d-426c-a398-c7e914c14661" status: 200 len: 1569 microversion: 2.1 time: 0.234052 May 14 15:57:49.328779 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: [pid: 128729|app: 0|req: 586/1189] 10.222.0.61 () {58 vars in 1235 bytes} [Sat May 14 15:57:49 2022] GET /compute/v2.1/servers/08195c98-5b1d-426c-a398-c7e914c14661 => generated 1569 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 15:57:49.333748 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi [None req-3a56fc73-f8b0-44ea-a149-dac93af2c502 tempest-TestVolumeBootPattern-2062489882 tempest-TestVolumeBootPattern-2062489882-project] Calling method '>' {{(pid=128729) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 15:57:49.334467 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.compute.api [None req-3a56fc73-f8b0-44ea-a149-dac93af2c502 tempest-TestVolumeBootPattern-2062489882 tempest-TestVolumeBootPattern-2062489882-project] [instance: 6dd9e299-5776-4848-b4ab-6d07424a3f8e] Fetching instance by UUID {{(pid=128729) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 15:57:49.340580 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-3a56fc73-f8b0-44ea-a149-dac93af2c502 tempest-TestVolumeBootPattern-2062489882 tempest-TestVolumeBootPattern-2062489882-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:57:49.341047 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-3a56fc73-f8b0-44ea-a149-dac93af2c502 tempest-TestVolumeBootPattern-2062489882 tempest-TestVolumeBootPattern-2062489882-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:57:49.341832 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-3a56fc73-f8b0-44ea-a149-dac93af2c502 tempest-TestVolumeBootPattern-2062489882 tempest-TestVolumeBootPattern-2062489882-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:57:49.342273 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-3a56fc73-f8b0-44ea-a149-dac93af2c502 tempest-TestVolumeBootPattern-2062489882 tempest-TestVolumeBootPattern-2062489882-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:57:49.380535 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.virt.hardware [None req-c02d6392-fe6e-46b5-ab11-50778a1637b1 tempest-VolumesSnapshotTestJSON-671752898 tempest-VolumesSnapshotTestJSON-671752898-project] Flavor limits 0:0:0 {{(pid=128728) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 14 15:57:49.381194 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.virt.hardware [None req-c02d6392-fe6e-46b5-ab11-50778a1637b1 tempest-VolumesSnapshotTestJSON-671752898 tempest-VolumesSnapshotTestJSON-671752898-project] Image limits 0:0:0 {{(pid=128728) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 14 15:57:49.381890 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.virt.hardware [None req-c02d6392-fe6e-46b5-ab11-50778a1637b1 tempest-VolumesSnapshotTestJSON-671752898 tempest-VolumesSnapshotTestJSON-671752898-project] Flavor pref 0:0:0 {{(pid=128728) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 14 15:57:49.382246 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.virt.hardware [None req-c02d6392-fe6e-46b5-ab11-50778a1637b1 tempest-VolumesSnapshotTestJSON-671752898 tempest-VolumesSnapshotTestJSON-671752898-project] Image pref 0:0:0 {{(pid=128728) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 14 15:57:49.382704 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.virt.hardware [None req-c02d6392-fe6e-46b5-ab11-50778a1637b1 tempest-VolumesSnapshotTestJSON-671752898 tempest-VolumesSnapshotTestJSON-671752898-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128728) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 14 15:57:49.393935 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-c02d6392-fe6e-46b5-ab11-50778a1637b1 tempest-VolumesSnapshotTestJSON-671752898 tempest-VolumesSnapshotTestJSON-671752898-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:57:49.394545 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-c02d6392-fe6e-46b5-ab11-50778a1637b1 tempest-VolumesSnapshotTestJSON-671752898 tempest-VolumesSnapshotTestJSON-671752898-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:57:49.395432 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-c02d6392-fe6e-46b5-ab11-50778a1637b1 tempest-VolumesSnapshotTestJSON-671752898 tempest-VolumesSnapshotTestJSON-671752898-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:57:49.395943 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-c02d6392-fe6e-46b5-ab11-50778a1637b1 tempest-VolumesSnapshotTestJSON-671752898 tempest-VolumesSnapshotTestJSON-671752898-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:57:49.413823 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.quota [None req-c02d6392-fe6e-46b5-ab11-50778a1637b1 tempest-VolumesSnapshotTestJSON-671752898 tempest-VolumesSnapshotTestJSON-671752898-project] Getting quotas for project 4ad8088ecb8a4f72a98ad70fa8be02b3. Resources: {'instances', 'cores', 'ram'} {{(pid=128728) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 14 15:57:49.418917 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.quota [None req-c02d6392-fe6e-46b5-ab11-50778a1637b1 tempest-VolumesSnapshotTestJSON-671752898 tempest-VolumesSnapshotTestJSON-671752898-project] Getting quotas for user d3e4193c9d9043c99ee5bee59f79f7a8 and project 4ad8088ecb8a4f72a98ad70fa8be02b3. Resources: {'instances', 'cores', 'ram'} {{(pid=128728) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 14 15:57:49.430573 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.compute.api [None req-c02d6392-fe6e-46b5-ab11-50778a1637b1 tempest-VolumesSnapshotTestJSON-671752898 tempest-VolumesSnapshotTestJSON-671752898-project] Going to run 1 instances... {{(pid=128728) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 14 15:57:49.433180 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.compute.api [None req-c02d6392-fe6e-46b5-ab11-50778a1637b1 tempest-VolumesSnapshotTestJSON-671752898 tempest-VolumesSnapshotTestJSON-671752898-project] [instance: 25202ac2-6830-4d26-83fc-803adeb71796] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='1381e3d5-fc27-4fa7-ab03-5d86278a0546',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128728) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 14 15:57:49.479540 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: INFO nova.api.openstack.requestlog [None req-c02d6392-fe6e-46b5-ab11-50778a1637b1 tempest-VolumesSnapshotTestJSON-671752898 tempest-VolumesSnapshotTestJSON-671752898-project] 10.222.0.61 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.711590 May 14 15:57:49.481047 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: [pid: 128728|app: 0|req: 604/1190] 10.222.0.61 () {60 vars in 1146 bytes} [Sat May 14 15:57:48 2022] POST /compute/v2.1/servers => generated 380 bytes in 714 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 14 15:57:49.486382 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi [None req-8544a5a4-b51f-4094-b312-4fe6a1d83971 tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] Calling method '>' {{(pid=128728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 15:57:49.486893 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.compute.api [None req-8544a5a4-b51f-4094-b312-4fe6a1d83971 tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] [instance: 113f6b52-519c-45f4-9bc2-37168d644e15] Fetching instance by UUID {{(pid=128728) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 15:57:49.491670 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.policy [None req-3a56fc73-f8b0-44ea-a149-dac93af2c502 tempest-TestVolumeBootPattern-2062489882 tempest-TestVolumeBootPattern-2062489882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '568f6783dd4d43398a70a9ffa58ff660', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a3a2b5dee7a404a8445c8aa434b5a43', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128729) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:57:49.493594 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-8544a5a4-b51f-4094-b312-4fe6a1d83971 tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:57:49.494051 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-8544a5a4-b51f-4094-b312-4fe6a1d83971 tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:57:49.495056 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-8544a5a4-b51f-4094-b312-4fe6a1d83971 tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:57:49.495506 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-8544a5a4-b51f-4094-b312-4fe6a1d83971 tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:57:49.500444 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: INFO nova.api.openstack.requestlog [None req-3a56fc73-f8b0-44ea-a149-dac93af2c502 tempest-TestVolumeBootPattern-2062489882 tempest-TestVolumeBootPattern-2062489882-project] 10.222.0.61 "GET /compute/v2.1/servers/6dd9e299-5776-4848-b4ab-6d07424a3f8e" status: 200 len: 1454 microversion: 2.1 time: 0.170333 May 14 15:57:49.501030 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: [pid: 128729|app: 0|req: 587/1191] 10.222.0.61 () {58 vars in 1235 bytes} [Sat May 14 15:57:49 2022] GET /compute/v2.1/servers/6dd9e299-5776-4848-b4ab-6d07424a3f8e => generated 1454 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 15:57:49.506048 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi [None req-4fdfc1d6-8c2c-4e2d-9e0f-d3436b1c65a5 tempest-VolumesSnapshotTestJSON-671752898 tempest-VolumesSnapshotTestJSON-671752898-project] Calling method '>' {{(pid=128729) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 15:57:49.506621 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.compute.api [None req-4fdfc1d6-8c2c-4e2d-9e0f-d3436b1c65a5 tempest-VolumesSnapshotTestJSON-671752898 tempest-VolumesSnapshotTestJSON-671752898-project] [instance: 25202ac2-6830-4d26-83fc-803adeb71796] Fetching instance by UUID {{(pid=128729) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 15:57:49.511250 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: INFO nova.api.openstack.wsgi [None req-8544a5a4-b51f-4094-b312-4fe6a1d83971 tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] HTTP exception thrown: Instance 113f6b52-519c-45f4-9bc2-37168d644e15 could not be found. May 14 15:57:49.513671 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi [None req-8544a5a4-b51f-4094-b312-4fe6a1d83971 tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] Request method failure captured: May 14 15:57:49.513671 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: request: DELETE /compute/v2.1/servers/113f6b52-519c-45f4-9bc2-37168d644e15 HTTP/1.1 May 14 15:57:49.513671 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: Accept: application/json May 14 15:57:49.513671 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: Accept-Encoding: identity May 14 15:57:49.513671 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: Connection: close May 14 15:57:49.513671 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: Content-Length: 0 May 14 15:57:49.513671 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: Content-Type: application/json May 14 15:57:49.513671 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: Host: 10.222.0.61 May 14 15:57:49.513671 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: Openstack-System-Scope: None May 14 15:57:49.513671 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: User-Agent: python-urllib3/1.26.9 May 14 15:57:49.513671 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: X-Auth-Token: gAAAAABif87SP_Zwa2IiGvFqsMgjavpLb8KTM6Zjei-leP46wpGTfISEWiNabTSLn_Se4MigqIDtVKHrnJDEVndJObAkvdE7QziqGtKnvzcsAHHCuGZvbOCiZ5Yv_050Eg71rjYT92fMkrLj82GJjq7kUvTbRuW_X-0VLgSk3UstO-oNY0ykSUs May 14 15:57:49.513671 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: X-Domain-Id: None May 14 15:57:49.513671 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: X-Domain-Name: None May 14 15:57:49.513671 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: X-Identity-Status: Confirmed May 14 15:57:49.513671 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: X-Is-Admin-Project: True May 14 15:57:49.513671 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: X-Project-Domain-Id: default May 14 15:57:49.513671 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: X-Project-Domain-Name: Default May 14 15:57:49.513671 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: X-Project-Id: 7905689c95d44a5c9169249c70f7de57 May 14 15:57:49.513671 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: X-Project-Name: tempest-AttachVolumeNegativeTest-1525749350 May 14 15:57:49.513671 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: X-Role: reader,member May 14 15:57:49.513671 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: X-Roles: reader,member May 14 15:57:49.515293 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/7905689c95d44a5c9169249c70f7de57"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/7905689c95d44a5c9169249c70f7de57"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/7905689c95d44a5c9169249c70f7de57"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_7905689c95d44a5c9169249c70f7de57"}]}] May 14 15:57:49.515293 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: X-Tenant: tempest-AttachVolumeNegativeTest-1525749350 May 14 15:57:49.515293 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: X-Tenant-Id: 7905689c95d44a5c9169249c70f7de57 May 14 15:57:49.515293 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1525749350 May 14 15:57:49.515293 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: X-User: tempest-AttachVolumeNegativeTest-1525749350-project May 14 15:57:49.515293 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: X-User-Domain-Id: default May 14 15:57:49.515293 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: X-User-Domain-Name: Default May 14 15:57:49.515293 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: X-User-Id: dc43895177134e9c9c030a9d87f94aaa May 14 15:57:49.515293 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: X-User-Name: tempest-AttachVolumeNegativeTest-1525749350-project May 14 15:57:49.515293 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: method: > May 14 15:57:49.515293 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: exception: Instance 113f6b52-519c-45f4-9bc2-37168d644e15 could not be found. May 14 15:57:49.515293 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: action_args: {'id': '113f6b52-519c-45f4-9bc2-37168d644e15'} May 14 15:57:49.516181 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: {{(pid=128728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 14 15:57:49.516181 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 15:57:49.516181 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 14 15:57:49.516181 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 14 15:57:49.516181 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 14 15:57:49.516181 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 14 15:57:49.516181 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 14 15:57:49.516181 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 14 15:57:49.516181 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 14 15:57:49.516181 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 14 15:57:49.516181 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 113f6b52-519c-45f4-9bc2-37168d644e15 could not be found. May 14 15:57:49.516181 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: ERROR nova.api.openstack.wsgi May 14 15:57:49.516181 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 14 15:57:49.516181 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: ERROR nova.api.openstack.wsgi May 14 15:57:49.516181 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 15:57:49.516181 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 14 15:57:49.516181 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 14 15:57:49.516181 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 14 15:57:49.516181 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 14 15:57:49.516181 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 14 15:57:49.517611 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 14 15:57:49.517611 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 14 15:57:49.517611 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 14 15:57:49.517611 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 14 15:57:49.517611 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 14 15:57:49.517611 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 14 15:57:49.517611 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 14 15:57:49.517611 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 14 15:57:49.517611 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 14 15:57:49.517611 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 113f6b52-519c-45f4-9bc2-37168d644e15 could not be found. May 14 15:57:49.517611 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: ERROR nova.api.openstack.wsgi May 14 15:57:49.517611 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 14 15:57:49.517611 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: ERROR nova.api.openstack.wsgi May 14 15:57:49.517611 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 15:57:49.517611 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 14 15:57:49.517611 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 14 15:57:49.517611 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 14 15:57:49.517611 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 14 15:57:49.517611 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 113f6b52-519c-45f4-9bc2-37168d644e15 could not be found. May 14 15:57:49.517611 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: ERROR nova.api.openstack.wsgi May 14 15:57:49.520374 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi [None req-8544a5a4-b51f-4094-b312-4fe6a1d83971 tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] Returning 404 to user: Instance 113f6b52-519c-45f4-9bc2-37168d644e15 could not be found. {{(pid=128728) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 14 15:57:49.521392 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: INFO nova.api.openstack.requestlog [None req-8544a5a4-b51f-4094-b312-4fe6a1d83971 tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] 10.222.0.61 "DELETE /compute/v2.1/servers/113f6b52-519c-45f4-9bc2-37168d644e15" status: 404 len: 111 microversion: 2.1 time: 0.039023 May 14 15:57:49.523700 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: [pid: 128728|app: 0|req: 605/1192] 10.222.0.61 () {58 vars in 1238 bytes} [Sat May 14 15:57:49 2022] DELETE /compute/v2.1/servers/113f6b52-519c-45f4-9bc2-37168d644e15 => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 14 15:57:49.532107 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi [None req-e7536d9c-c43e-4298-b5c7-2329e11a7dcf tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] Calling method '>' {{(pid=128728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 15:57:49.532967 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.compute.api [None req-e7536d9c-c43e-4298-b5c7-2329e11a7dcf tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] [instance: 113f6b52-519c-45f4-9bc2-37168d644e15] Fetching instance by UUID {{(pid=128728) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 15:57:49.539257 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-e7536d9c-c43e-4298-b5c7-2329e11a7dcf tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:57:49.539711 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-e7536d9c-c43e-4298-b5c7-2329e11a7dcf tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:57:49.540496 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-e7536d9c-c43e-4298-b5c7-2329e11a7dcf tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:57:49.540941 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-e7536d9c-c43e-4298-b5c7-2329e11a7dcf tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:57:49.555788 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: INFO nova.api.openstack.wsgi [None req-e7536d9c-c43e-4298-b5c7-2329e11a7dcf tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] HTTP exception thrown: Instance 113f6b52-519c-45f4-9bc2-37168d644e15 could not be found. May 14 15:57:49.564593 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi [None req-e7536d9c-c43e-4298-b5c7-2329e11a7dcf tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] Request method failure captured: May 14 15:57:49.564593 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: request: GET /compute/v2.1/servers/113f6b52-519c-45f4-9bc2-37168d644e15 HTTP/1.1 May 14 15:57:49.564593 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: Accept: application/json May 14 15:57:49.564593 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: Accept-Encoding: identity May 14 15:57:49.564593 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: Connection: close May 14 15:57:49.564593 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: Content-Length: 0 May 14 15:57:49.564593 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: Content-Type: application/json May 14 15:57:49.564593 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: Host: 10.222.0.61 May 14 15:57:49.564593 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: Openstack-System-Scope: None May 14 15:57:49.564593 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: User-Agent: python-urllib3/1.26.9 May 14 15:57:49.564593 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: X-Auth-Token: gAAAAABif87SP_Zwa2IiGvFqsMgjavpLb8KTM6Zjei-leP46wpGTfISEWiNabTSLn_Se4MigqIDtVKHrnJDEVndJObAkvdE7QziqGtKnvzcsAHHCuGZvbOCiZ5Yv_050Eg71rjYT92fMkrLj82GJjq7kUvTbRuW_X-0VLgSk3UstO-oNY0ykSUs May 14 15:57:49.564593 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: X-Domain-Id: None May 14 15:57:49.564593 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: X-Domain-Name: None May 14 15:57:49.564593 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: X-Identity-Status: Confirmed May 14 15:57:49.564593 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: X-Is-Admin-Project: True May 14 15:57:49.564593 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: X-Project-Domain-Id: default May 14 15:57:49.564593 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: X-Project-Domain-Name: Default May 14 15:57:49.564593 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: X-Project-Id: 7905689c95d44a5c9169249c70f7de57 May 14 15:57:49.564593 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: X-Project-Name: tempest-AttachVolumeNegativeTest-1525749350 May 14 15:57:49.564593 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: X-Role: reader,member May 14 15:57:49.564593 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: X-Roles: reader,member May 14 15:57:49.566174 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/7905689c95d44a5c9169249c70f7de57"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/7905689c95d44a5c9169249c70f7de57"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/7905689c95d44a5c9169249c70f7de57"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_7905689c95d44a5c9169249c70f7de57"}]}] May 14 15:57:49.566174 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: X-Tenant: tempest-AttachVolumeNegativeTest-1525749350 May 14 15:57:49.566174 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: X-Tenant-Id: 7905689c95d44a5c9169249c70f7de57 May 14 15:57:49.566174 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1525749350 May 14 15:57:49.566174 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: X-User: tempest-AttachVolumeNegativeTest-1525749350-project May 14 15:57:49.566174 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: X-User-Domain-Id: default May 14 15:57:49.566174 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: X-User-Domain-Name: Default May 14 15:57:49.566174 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: X-User-Id: dc43895177134e9c9c030a9d87f94aaa May 14 15:57:49.566174 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: X-User-Name: tempest-AttachVolumeNegativeTest-1525749350-project May 14 15:57:49.566174 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: method: > May 14 15:57:49.566174 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: exception: Instance 113f6b52-519c-45f4-9bc2-37168d644e15 could not be found. May 14 15:57:49.566174 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: action_args: {'id': '113f6b52-519c-45f4-9bc2-37168d644e15'} May 14 15:57:49.567098 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: {{(pid=128728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 14 15:57:49.567098 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 15:57:49.567098 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 14 15:57:49.567098 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 14 15:57:49.567098 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 14 15:57:49.567098 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 14 15:57:49.567098 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 14 15:57:49.567098 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 14 15:57:49.567098 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 14 15:57:49.567098 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 14 15:57:49.567098 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 113f6b52-519c-45f4-9bc2-37168d644e15 could not be found. May 14 15:57:49.567098 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: ERROR nova.api.openstack.wsgi May 14 15:57:49.567098 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 14 15:57:49.567098 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: ERROR nova.api.openstack.wsgi May 14 15:57:49.567098 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 15:57:49.567098 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 14 15:57:49.567098 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 14 15:57:49.567098 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 14 15:57:49.567098 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 14 15:57:49.567098 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 14 15:57:49.568551 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 14 15:57:49.568551 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 14 15:57:49.568551 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 14 15:57:49.568551 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 14 15:57:49.568551 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 14 15:57:49.568551 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 14 15:57:49.568551 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 14 15:57:49.568551 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 113f6b52-519c-45f4-9bc2-37168d644e15 could not be found. May 14 15:57:49.568551 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: ERROR nova.api.openstack.wsgi May 14 15:57:49.568551 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 14 15:57:49.568551 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: ERROR nova.api.openstack.wsgi May 14 15:57:49.568551 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 15:57:49.568551 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 14 15:57:49.568551 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 14 15:57:49.568551 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 14 15:57:49.568551 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 14 15:57:49.568551 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 113f6b52-519c-45f4-9bc2-37168d644e15 could not be found. May 14 15:57:49.568551 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: ERROR nova.api.openstack.wsgi May 14 15:57:49.569901 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi [None req-e7536d9c-c43e-4298-b5c7-2329e11a7dcf tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] Returning 404 to user: Instance 113f6b52-519c-45f4-9bc2-37168d644e15 could not be found. {{(pid=128728) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 14 15:57:49.569901 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: INFO nova.api.openstack.requestlog [None req-e7536d9c-c43e-4298-b5c7-2329e11a7dcf tempest-AttachVolumeNegativeTest-1525749350 tempest-AttachVolumeNegativeTest-1525749350-project] 10.222.0.61 "GET /compute/v2.1/servers/113f6b52-519c-45f4-9bc2-37168d644e15" status: 404 len: 111 microversion: 2.1 time: 0.037798 May 14 15:57:49.574505 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: [pid: 128728|app: 0|req: 606/1193] 10.222.0.61 () {58 vars in 1235 bytes} [Sat May 14 15:57:49 2022] GET /compute/v2.1/servers/113f6b52-519c-45f4-9bc2-37168d644e15 => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 14 15:57:49.579368 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.policy [None req-4fdfc1d6-8c2c-4e2d-9e0f-d3436b1c65a5 tempest-VolumesSnapshotTestJSON-671752898 tempest-VolumesSnapshotTestJSON-671752898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3e4193c9d9043c99ee5bee59f79f7a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ad8088ecb8a4f72a98ad70fa8be02b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128729) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:57:49.592970 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: INFO nova.api.openstack.requestlog [None req-4fdfc1d6-8c2c-4e2d-9e0f-d3436b1c65a5 tempest-VolumesSnapshotTestJSON-671752898 tempest-VolumesSnapshotTestJSON-671752898-project] 10.222.0.61 "GET /compute/v2.1/servers/25202ac2-6830-4d26-83fc-803adeb71796" status: 200 len: 1218 microversion: 2.1 time: 0.090596 May 14 15:57:49.593657 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: [pid: 128729|app: 0|req: 588/1194] 10.222.0.61 () {58 vars in 1235 bytes} [Sat May 14 15:57:49 2022] GET /compute/v2.1/servers/25202ac2-6830-4d26-83fc-803adeb71796 => generated 1218 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 15:57:50.346026 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi [None req-f536db57-0c02-4449-8eda-0208ef68db3e tempest-TestShelveInstance-1853374188 tempest-TestShelveInstance-1853374188-project] Calling method '>' {{(pid=128728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 15:57:50.346598 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.compute.api [None req-f536db57-0c02-4449-8eda-0208ef68db3e tempest-TestShelveInstance-1853374188 tempest-TestShelveInstance-1853374188-project] [instance: 08195c98-5b1d-426c-a398-c7e914c14661] Fetching instance by UUID {{(pid=128728) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 15:57:50.352792 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-f536db57-0c02-4449-8eda-0208ef68db3e tempest-TestShelveInstance-1853374188 tempest-TestShelveInstance-1853374188-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:57:50.353258 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-f536db57-0c02-4449-8eda-0208ef68db3e tempest-TestShelveInstance-1853374188 tempest-TestShelveInstance-1853374188-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:57:50.354041 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-f536db57-0c02-4449-8eda-0208ef68db3e tempest-TestShelveInstance-1853374188 tempest-TestShelveInstance-1853374188-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:57:50.354509 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-f536db57-0c02-4449-8eda-0208ef68db3e tempest-TestShelveInstance-1853374188 tempest-TestShelveInstance-1853374188-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:57:50.603200 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.policy [None req-f536db57-0c02-4449-8eda-0208ef68db3e tempest-TestShelveInstance-1853374188 tempest-TestShelveInstance-1853374188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e05ae1c6a054a299e841d008f9d7a09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83d6b6f0aa4f4314811ee80480861958', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128728) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:57:50.611079 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi [None req-ad1320c7-aaaa-41b7-888d-0ded174d56ff tempest-VolumesSnapshotTestJSON-671752898 tempest-VolumesSnapshotTestJSON-671752898-project] Calling method '>' {{(pid=128729) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 15:57:50.613166 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.compute.api [None req-ad1320c7-aaaa-41b7-888d-0ded174d56ff tempest-VolumesSnapshotTestJSON-671752898 tempest-VolumesSnapshotTestJSON-671752898-project] [instance: 25202ac2-6830-4d26-83fc-803adeb71796] Fetching instance by UUID {{(pid=128729) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 15:57:50.613317 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: INFO nova.api.openstack.requestlog [None req-f536db57-0c02-4449-8eda-0208ef68db3e tempest-TestShelveInstance-1853374188 tempest-TestShelveInstance-1853374188-project] 10.222.0.61 "GET /compute/v2.1/servers/08195c98-5b1d-426c-a398-c7e914c14661" status: 200 len: 1569 microversion: 2.1 time: 0.271131 May 14 15:57:50.614354 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: [pid: 128728|app: 0|req: 607/1195] 10.222.0.61 () {58 vars in 1235 bytes} [Sat May 14 15:57:50 2022] GET /compute/v2.1/servers/08195c98-5b1d-426c-a398-c7e914c14661 => generated 1569 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 15:57:50.625697 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-ad1320c7-aaaa-41b7-888d-0ded174d56ff tempest-VolumesSnapshotTestJSON-671752898 tempest-VolumesSnapshotTestJSON-671752898-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:57:50.626157 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-ad1320c7-aaaa-41b7-888d-0ded174d56ff tempest-VolumesSnapshotTestJSON-671752898 tempest-VolumesSnapshotTestJSON-671752898-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:57:50.627182 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-ad1320c7-aaaa-41b7-888d-0ded174d56ff tempest-VolumesSnapshotTestJSON-671752898 tempest-VolumesSnapshotTestJSON-671752898-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:57:50.627631 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-ad1320c7-aaaa-41b7-888d-0ded174d56ff tempest-VolumesSnapshotTestJSON-671752898 tempest-VolumesSnapshotTestJSON-671752898-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:57:50.704237 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.policy [None req-ad1320c7-aaaa-41b7-888d-0ded174d56ff tempest-VolumesSnapshotTestJSON-671752898 tempest-VolumesSnapshotTestJSON-671752898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3e4193c9d9043c99ee5bee59f79f7a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ad8088ecb8a4f72a98ad70fa8be02b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128729) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:57:50.711424 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: INFO nova.api.openstack.requestlog [None req-ad1320c7-aaaa-41b7-888d-0ded174d56ff tempest-VolumesSnapshotTestJSON-671752898 tempest-VolumesSnapshotTestJSON-671752898-project] 10.222.0.61 "GET /compute/v2.1/servers/25202ac2-6830-4d26-83fc-803adeb71796" status: 200 len: 1270 microversion: 2.1 time: 0.106143 May 14 15:57:50.712186 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: [pid: 128729|app: 0|req: 589/1196] 10.222.0.61 () {58 vars in 1235 bytes} [Sat May 14 15:57:50 2022] GET /compute/v2.1/servers/25202ac2-6830-4d26-83fc-803adeb71796 => generated 1270 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 15:57:51.635507 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi [None req-4877cea9-8452-4d40-9e87-72db7d5ed20d tempest-TestShelveInstance-1853374188 tempest-TestShelveInstance-1853374188-project] Calling method '>' {{(pid=128728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 15:57:51.637923 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.compute.api [None req-4877cea9-8452-4d40-9e87-72db7d5ed20d tempest-TestShelveInstance-1853374188 tempest-TestShelveInstance-1853374188-project] [instance: 08195c98-5b1d-426c-a398-c7e914c14661] Fetching instance by UUID {{(pid=128728) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 15:57:51.647630 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-4877cea9-8452-4d40-9e87-72db7d5ed20d tempest-TestShelveInstance-1853374188 tempest-TestShelveInstance-1853374188-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:57:51.648087 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-4877cea9-8452-4d40-9e87-72db7d5ed20d tempest-TestShelveInstance-1853374188 tempest-TestShelveInstance-1853374188-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:57:51.649496 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-4877cea9-8452-4d40-9e87-72db7d5ed20d tempest-TestShelveInstance-1853374188 tempest-TestShelveInstance-1853374188-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:57:51.650674 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-4877cea9-8452-4d40-9e87-72db7d5ed20d tempest-TestShelveInstance-1853374188 tempest-TestShelveInstance-1853374188-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:57:51.732622 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi [None req-f5415178-92f9-4725-9605-a6a9aca1efba tempest-VolumesSnapshotTestJSON-671752898 tempest-VolumesSnapshotTestJSON-671752898-project] Calling method '>' {{(pid=128729) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 15:57:51.733977 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.compute.api [None req-f5415178-92f9-4725-9605-a6a9aca1efba tempest-VolumesSnapshotTestJSON-671752898 tempest-VolumesSnapshotTestJSON-671752898-project] [instance: 25202ac2-6830-4d26-83fc-803adeb71796] Fetching instance by UUID {{(pid=128729) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 15:57:51.740531 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-f5415178-92f9-4725-9605-a6a9aca1efba tempest-VolumesSnapshotTestJSON-671752898 tempest-VolumesSnapshotTestJSON-671752898-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:57:51.741190 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-f5415178-92f9-4725-9605-a6a9aca1efba tempest-VolumesSnapshotTestJSON-671752898 tempest-VolumesSnapshotTestJSON-671752898-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:57:51.742122 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-f5415178-92f9-4725-9605-a6a9aca1efba tempest-VolumesSnapshotTestJSON-671752898 tempest-VolumesSnapshotTestJSON-671752898-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:57:51.743413 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-f5415178-92f9-4725-9605-a6a9aca1efba tempest-VolumesSnapshotTestJSON-671752898 tempest-VolumesSnapshotTestJSON-671752898-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:57:51.864183 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.policy [None req-f5415178-92f9-4725-9605-a6a9aca1efba tempest-VolumesSnapshotTestJSON-671752898 tempest-VolumesSnapshotTestJSON-671752898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3e4193c9d9043c99ee5bee59f79f7a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ad8088ecb8a4f72a98ad70fa8be02b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128729) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:57:51.874448 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: INFO nova.api.openstack.requestlog [None req-f5415178-92f9-4725-9605-a6a9aca1efba tempest-VolumesSnapshotTestJSON-671752898 tempest-VolumesSnapshotTestJSON-671752898-project] 10.222.0.61 "GET /compute/v2.1/servers/25202ac2-6830-4d26-83fc-803adeb71796" status: 200 len: 1276 microversion: 2.1 time: 0.149183 May 14 15:57:51.875198 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: [pid: 128729|app: 0|req: 590/1197] 10.222.0.61 () {58 vars in 1235 bytes} [Sat May 14 15:57:51 2022] GET /compute/v2.1/servers/25202ac2-6830-4d26-83fc-803adeb71796 => generated 1276 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 15:57:52.004696 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.policy [None req-4877cea9-8452-4d40-9e87-72db7d5ed20d tempest-TestShelveInstance-1853374188 tempest-TestShelveInstance-1853374188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e05ae1c6a054a299e841d008f9d7a09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83d6b6f0aa4f4314811ee80480861958', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128728) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:57:52.013926 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: INFO nova.api.openstack.requestlog [None req-4877cea9-8452-4d40-9e87-72db7d5ed20d tempest-TestShelveInstance-1853374188 tempest-TestShelveInstance-1853374188-project] 10.222.0.61 "GET /compute/v2.1/servers/08195c98-5b1d-426c-a398-c7e914c14661" status: 200 len: 1450 microversion: 2.1 time: 0.384870 May 14 15:57:52.025293 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: [pid: 128728|app: 0|req: 608/1198] 10.222.0.61 () {58 vars in 1235 bytes} [Sat May 14 15:57:51 2022] GET /compute/v2.1/servers/08195c98-5b1d-426c-a398-c7e914c14661 => generated 1450 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 15:57:52.339528 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi [req-77d2207b-6698-43c1-854b-6e74098a4926 req-3dd51217-146d-4d9a-bd48-f0b7780e98bd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "08195c98-5b1d-426c-a398-c7e914c14661", "name": "network-vif-deleted", "tag": "ff1e7e07-bb51-463a-a362-bc5fcaff458c"}]} {{(pid=128729) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 15:57:52.357236 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [req-77d2207b-6698-43c1-854b-6e74098a4926 req-3dd51217-146d-4d9a-bd48-f0b7780e98bd service nova] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:57:52.357688 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [req-77d2207b-6698-43c1-854b-6e74098a4926 req-3dd51217-146d-4d9a-bd48-f0b7780e98bd service nova] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:57:52.374553 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: INFO nova.api.openstack.compute.server_external_events [req-77d2207b-6698-43c1-854b-6e74098a4926 req-3dd51217-146d-4d9a-bd48-f0b7780e98bd service nova] Creating event network-vif-deleted:ff1e7e07-bb51-463a-a362-bc5fcaff458c for instance 08195c98-5b1d-426c-a398-c7e914c14661 on hv-cinder-83979 May 14 15:57:52.380652 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: INFO nova.api.openstack.requestlog [req-77d2207b-6698-43c1-854b-6e74098a4926 req-3dd51217-146d-4d9a-bd48-f0b7780e98bd service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.130581 May 14 15:57:52.381334 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: [pid: 128729|app: 0|req: 591/1199] 10.222.0.61 () {64 vars in 1317 bytes} [Sat May 14 15:57:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 14 15:57:52.892540 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi [None req-47702d97-2614-408b-b468-bbbd0fc5f1d2 tempest-VolumesSnapshotTestJSON-671752898 tempest-VolumesSnapshotTestJSON-671752898-project] Calling method '>' {{(pid=128728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 15:57:52.893764 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.compute.api [None req-47702d97-2614-408b-b468-bbbd0fc5f1d2 tempest-VolumesSnapshotTestJSON-671752898 tempest-VolumesSnapshotTestJSON-671752898-project] [instance: 25202ac2-6830-4d26-83fc-803adeb71796] Fetching instance by UUID {{(pid=128728) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 15:57:52.900748 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-47702d97-2614-408b-b468-bbbd0fc5f1d2 tempest-VolumesSnapshotTestJSON-671752898 tempest-VolumesSnapshotTestJSON-671752898-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:57:52.901587 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-47702d97-2614-408b-b468-bbbd0fc5f1d2 tempest-VolumesSnapshotTestJSON-671752898 tempest-VolumesSnapshotTestJSON-671752898-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:57:52.903272 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-47702d97-2614-408b-b468-bbbd0fc5f1d2 tempest-VolumesSnapshotTestJSON-671752898 tempest-VolumesSnapshotTestJSON-671752898-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:57:52.903920 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-47702d97-2614-408b-b468-bbbd0fc5f1d2 tempest-VolumesSnapshotTestJSON-671752898 tempest-VolumesSnapshotTestJSON-671752898-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:57:53.033984 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi [None req-caa883a4-4fc9-4909-885c-956804f87fdc tempest-TestShelveInstance-1853374188 tempest-TestShelveInstance-1853374188-project] Calling method '>' {{(pid=128729) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 15:57:53.034817 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.compute.api [None req-caa883a4-4fc9-4909-885c-956804f87fdc tempest-TestShelveInstance-1853374188 tempest-TestShelveInstance-1853374188-project] [instance: 08195c98-5b1d-426c-a398-c7e914c14661] Fetching instance by UUID {{(pid=128729) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 15:57:53.052765 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-caa883a4-4fc9-4909-885c-956804f87fdc tempest-TestShelveInstance-1853374188 tempest-TestShelveInstance-1853374188-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:57:53.062693 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-caa883a4-4fc9-4909-885c-956804f87fdc tempest-TestShelveInstance-1853374188 tempest-TestShelveInstance-1853374188-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:57:53.064138 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-caa883a4-4fc9-4909-885c-956804f87fdc tempest-TestShelveInstance-1853374188 tempest-TestShelveInstance-1853374188-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:57:53.064946 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-caa883a4-4fc9-4909-885c-956804f87fdc tempest-TestShelveInstance-1853374188 tempest-TestShelveInstance-1853374188-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:57:53.103260 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.policy [None req-47702d97-2614-408b-b468-bbbd0fc5f1d2 tempest-VolumesSnapshotTestJSON-671752898 tempest-VolumesSnapshotTestJSON-671752898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3e4193c9d9043c99ee5bee59f79f7a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ad8088ecb8a4f72a98ad70fa8be02b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128728) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:57:53.116354 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-caa883a4-4fc9-4909-885c-956804f87fdc tempest-TestShelveInstance-1853374188 tempest-TestShelveInstance-1853374188-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:57:53.117161 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-caa883a4-4fc9-4909-885c-956804f87fdc tempest-TestShelveInstance-1853374188 tempest-TestShelveInstance-1853374188-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:57:53.118277 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.objects.instance [None req-caa883a4-4fc9-4909-885c-956804f87fdc tempest-TestShelveInstance-1853374188 tempest-TestShelveInstance-1853374188-project] Lazy-loading 'fault' on Instance uuid 08195c98-5b1d-426c-a398-c7e914c14661 {{(pid=128729) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 14 15:57:53.127505 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: INFO nova.api.openstack.requestlog [None req-47702d97-2614-408b-b468-bbbd0fc5f1d2 tempest-VolumesSnapshotTestJSON-671752898 tempest-VolumesSnapshotTestJSON-671752898-project] 10.222.0.61 "GET /compute/v2.1/servers/25202ac2-6830-4d26-83fc-803adeb71796" status: 200 len: 1318 microversion: 2.1 time: 0.238873 May 14 15:57:53.139513 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: [pid: 128728|app: 0|req: 609/1200] 10.222.0.61 () {58 vars in 1235 bytes} [Sat May 14 15:57:52 2022] GET /compute/v2.1/servers/25202ac2-6830-4d26-83fc-803adeb71796 => generated 1318 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 15:57:53.177033 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.policy [None req-caa883a4-4fc9-4909-885c-956804f87fdc tempest-TestShelveInstance-1853374188 tempest-TestShelveInstance-1853374188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e05ae1c6a054a299e841d008f9d7a09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83d6b6f0aa4f4314811ee80480861958', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128729) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:57:53.185661 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: INFO nova.api.openstack.requestlog [None req-caa883a4-4fc9-4909-885c-956804f87fdc tempest-TestShelveInstance-1853374188 tempest-TestShelveInstance-1853374188-project] 10.222.0.61 "GET /compute/v2.1/servers/08195c98-5b1d-426c-a398-c7e914c14661" status: 200 len: 1225 microversion: 2.1 time: 0.157248 May 14 15:57:53.186228 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: [pid: 128729|app: 0|req: 592/1201] 10.222.0.61 () {58 vars in 1235 bytes} [Sat May 14 15:57:53 2022] GET /compute/v2.1/servers/08195c98-5b1d-426c-a398-c7e914c14661 => generated 1225 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 15:57:54.123824 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi [req-220ac81b-dc5c-438b-a579-c78b7ebce697 req-a8c4a24b-2109-478f-adb3-9adfe1acc5e1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "25202ac2-6830-4d26-83fc-803adeb71796", "tag": "684de684-f0ea-449d-a77c-a068f4d20b82"}]} {{(pid=128728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 15:57:54.145522 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [req-220ac81b-dc5c-438b-a579-c78b7ebce697 req-a8c4a24b-2109-478f-adb3-9adfe1acc5e1 service nova] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:57:54.146679 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [req-220ac81b-dc5c-438b-a579-c78b7ebce697 req-a8c4a24b-2109-478f-adb3-9adfe1acc5e1 service nova] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:57:54.148220 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi [None req-c5ef5c70-c68f-44d3-b182-6406f39d4d13 tempest-VolumesSnapshotTestJSON-671752898 tempest-VolumesSnapshotTestJSON-671752898-project] Calling method '>' {{(pid=128729) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 15:57:54.148832 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.compute.api [None req-c5ef5c70-c68f-44d3-b182-6406f39d4d13 tempest-VolumesSnapshotTestJSON-671752898 tempest-VolumesSnapshotTestJSON-671752898-project] [instance: 25202ac2-6830-4d26-83fc-803adeb71796] Fetching instance by UUID {{(pid=128729) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 15:57:54.158333 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-c5ef5c70-c68f-44d3-b182-6406f39d4d13 tempest-VolumesSnapshotTestJSON-671752898 tempest-VolumesSnapshotTestJSON-671752898-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:57:54.158786 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-c5ef5c70-c68f-44d3-b182-6406f39d4d13 tempest-VolumesSnapshotTestJSON-671752898 tempest-VolumesSnapshotTestJSON-671752898-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:57:54.159575 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-c5ef5c70-c68f-44d3-b182-6406f39d4d13 tempest-VolumesSnapshotTestJSON-671752898 tempest-VolumesSnapshotTestJSON-671752898-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:57:54.160005 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-c5ef5c70-c68f-44d3-b182-6406f39d4d13 tempest-VolumesSnapshotTestJSON-671752898 tempest-VolumesSnapshotTestJSON-671752898-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:57:54.163721 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: INFO nova.api.openstack.compute.server_external_events [req-220ac81b-dc5c-438b-a579-c78b7ebce697 req-a8c4a24b-2109-478f-adb3-9adfe1acc5e1 service nova] Creating event network-changed:684de684-f0ea-449d-a77c-a068f4d20b82 for instance 25202ac2-6830-4d26-83fc-803adeb71796 on hv-cinder-83979 May 14 15:57:54.171106 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: INFO nova.api.openstack.requestlog [req-220ac81b-dc5c-438b-a579-c78b7ebce697 req-a8c4a24b-2109-478f-adb3-9adfe1acc5e1 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.055012 May 14 15:57:54.172336 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: [pid: 128728|app: 0|req: 610/1202] 10.222.0.61 () {64 vars in 1317 bytes} [Sat May 14 15:57:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 14 15:57:54.206132 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi [None req-e7519c8d-6fdb-4eb1-a745-fe16ab1be480 tempest-TestShelveInstance-1853374188 tempest-TestShelveInstance-1853374188-project] Calling method '>' {{(pid=128728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 15:57:54.207695 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.compute.api [None req-e7519c8d-6fdb-4eb1-a745-fe16ab1be480 tempest-TestShelveInstance-1853374188 tempest-TestShelveInstance-1853374188-project] [instance: 08195c98-5b1d-426c-a398-c7e914c14661] Fetching instance by UUID {{(pid=128728) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 15:57:54.218866 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-e7519c8d-6fdb-4eb1-a745-fe16ab1be480 tempest-TestShelveInstance-1853374188 tempest-TestShelveInstance-1853374188-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:57:54.220616 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-e7519c8d-6fdb-4eb1-a745-fe16ab1be480 tempest-TestShelveInstance-1853374188 tempest-TestShelveInstance-1853374188-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:57:54.221819 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-e7519c8d-6fdb-4eb1-a745-fe16ab1be480 tempest-TestShelveInstance-1853374188 tempest-TestShelveInstance-1853374188-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:57:54.224386 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-e7519c8d-6fdb-4eb1-a745-fe16ab1be480 tempest-TestShelveInstance-1853374188 tempest-TestShelveInstance-1853374188-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:57:54.243923 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: INFO nova.api.openstack.wsgi [None req-e7519c8d-6fdb-4eb1-a745-fe16ab1be480 tempest-TestShelveInstance-1853374188 tempest-TestShelveInstance-1853374188-project] HTTP exception thrown: Instance 08195c98-5b1d-426c-a398-c7e914c14661 could not be found. May 14 15:57:54.245734 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi [None req-e7519c8d-6fdb-4eb1-a745-fe16ab1be480 tempest-TestShelveInstance-1853374188 tempest-TestShelveInstance-1853374188-project] Request method failure captured: May 14 15:57:54.245734 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: request: GET /compute/v2.1/servers/08195c98-5b1d-426c-a398-c7e914c14661 HTTP/1.1 May 14 15:57:54.245734 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: Accept: application/json May 14 15:57:54.245734 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: Accept-Encoding: identity May 14 15:57:54.245734 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: Connection: close May 14 15:57:54.245734 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: Content-Length: 0 May 14 15:57:54.245734 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: Content-Type: application/json May 14 15:57:54.245734 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: Host: 10.222.0.61 May 14 15:57:54.245734 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: Openstack-System-Scope: None May 14 15:57:54.245734 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: User-Agent: python-urllib3/1.26.9 May 14 15:57:54.245734 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: X-Auth-Token: gAAAAABif9AParYbvJBg1bcCrFbzNM-9_OKtEIoTYUaulglySvp7rJ0ptLJSW4ljZLKcNet_e-9XBOP9Zz_VAiszLp3mL1zzyboP2RMCKTZ4vegRAVs3al313wp-6zJJufZqAuajD_AvUE8BcUDrVoW0DtMJA1OI5Mh84-fjBu21_R1kaluRoHw May 14 15:57:54.245734 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: X-Domain-Id: None May 14 15:57:54.245734 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: X-Domain-Name: None May 14 15:57:54.245734 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: X-Identity-Status: Confirmed May 14 15:57:54.245734 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: X-Is-Admin-Project: True May 14 15:57:54.245734 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: X-Project-Domain-Id: default May 14 15:57:54.245734 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: X-Project-Domain-Name: Default May 14 15:57:54.245734 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: X-Project-Id: 83d6b6f0aa4f4314811ee80480861958 May 14 15:57:54.245734 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: X-Project-Name: tempest-TestShelveInstance-1853374188 May 14 15:57:54.245734 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: X-Role: reader,member May 14 15:57:54.245734 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: X-Roles: reader,member May 14 15:57:54.247721 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/83d6b6f0aa4f4314811ee80480861958"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/83d6b6f0aa4f4314811ee80480861958"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/83d6b6f0aa4f4314811ee80480861958"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_83d6b6f0aa4f4314811ee80480861958"}]}] May 14 15:57:54.247721 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: X-Tenant: tempest-TestShelveInstance-1853374188 May 14 15:57:54.247721 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: X-Tenant-Id: 83d6b6f0aa4f4314811ee80480861958 May 14 15:57:54.247721 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: X-Tenant-Name: tempest-TestShelveInstance-1853374188 May 14 15:57:54.247721 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: X-User: tempest-TestShelveInstance-1853374188-project May 14 15:57:54.247721 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: X-User-Domain-Id: default May 14 15:57:54.247721 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: X-User-Domain-Name: Default May 14 15:57:54.247721 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: X-User-Id: 4e05ae1c6a054a299e841d008f9d7a09 May 14 15:57:54.247721 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: X-User-Name: tempest-TestShelveInstance-1853374188-project May 14 15:57:54.247721 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: method: > May 14 15:57:54.247721 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: exception: Instance 08195c98-5b1d-426c-a398-c7e914c14661 could not be found. May 14 15:57:54.247721 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: action_args: {'id': '08195c98-5b1d-426c-a398-c7e914c14661'} May 14 15:57:54.248730 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: {{(pid=128728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 14 15:57:54.248730 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 15:57:54.248730 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 14 15:57:54.248730 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 14 15:57:54.248730 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 14 15:57:54.248730 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 14 15:57:54.248730 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 14 15:57:54.248730 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 14 15:57:54.248730 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 14 15:57:54.248730 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 14 15:57:54.248730 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 08195c98-5b1d-426c-a398-c7e914c14661 could not be found. May 14 15:57:54.248730 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: ERROR nova.api.openstack.wsgi May 14 15:57:54.248730 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 14 15:57:54.248730 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: ERROR nova.api.openstack.wsgi May 14 15:57:54.248730 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 15:57:54.248730 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 14 15:57:54.248730 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 14 15:57:54.248730 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 14 15:57:54.248730 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 14 15:57:54.248730 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 14 15:57:54.250200 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 14 15:57:54.250200 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 14 15:57:54.250200 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 14 15:57:54.250200 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 14 15:57:54.250200 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 14 15:57:54.250200 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 14 15:57:54.250200 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 14 15:57:54.250200 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 08195c98-5b1d-426c-a398-c7e914c14661 could not be found. May 14 15:57:54.250200 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: ERROR nova.api.openstack.wsgi May 14 15:57:54.250200 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 14 15:57:54.250200 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: ERROR nova.api.openstack.wsgi May 14 15:57:54.250200 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 15:57:54.250200 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 14 15:57:54.250200 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 14 15:57:54.250200 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 14 15:57:54.250200 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 14 15:57:54.250200 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 08195c98-5b1d-426c-a398-c7e914c14661 could not be found. May 14 15:57:54.250200 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: ERROR nova.api.openstack.wsgi May 14 15:57:54.251584 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi [None req-e7519c8d-6fdb-4eb1-a745-fe16ab1be480 tempest-TestShelveInstance-1853374188 tempest-TestShelveInstance-1853374188-project] Returning 404 to user: Instance 08195c98-5b1d-426c-a398-c7e914c14661 could not be found. {{(pid=128728) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 14 15:57:54.252547 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: INFO nova.api.openstack.requestlog [None req-e7519c8d-6fdb-4eb1-a745-fe16ab1be480 tempest-TestShelveInstance-1853374188 tempest-TestShelveInstance-1853374188-project] 10.222.0.61 "GET /compute/v2.1/servers/08195c98-5b1d-426c-a398-c7e914c14661" status: 404 len: 111 microversion: 2.1 time: 0.051322 May 14 15:57:54.256984 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: [pid: 128728|app: 0|req: 611/1203] 10.222.0.61 () {58 vars in 1235 bytes} [Sat May 14 15:57:54 2022] GET /compute/v2.1/servers/08195c98-5b1d-426c-a398-c7e914c14661 => generated 111 bytes in 56 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 14 15:57:54.395797 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi [req-5886543c-5359-42fe-a6b8-674b1c7bb816 req-6f6fe462-a81b-4f6e-b060-40f5565aa5fc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6dd9e299-5776-4848-b4ab-6d07424a3f8e", "tag": "d761eef1-490d-4627-a1cc-64f2436e7c0c"}]} {{(pid=128728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 15:57:54.413213 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [req-5886543c-5359-42fe-a6b8-674b1c7bb816 req-6f6fe462-a81b-4f6e-b060-40f5565aa5fc service nova] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:57:54.413919 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [req-5886543c-5359-42fe-a6b8-674b1c7bb816 req-6f6fe462-a81b-4f6e-b060-40f5565aa5fc service nova] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:57:54.428649 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: INFO nova.api.openstack.compute.server_external_events [req-5886543c-5359-42fe-a6b8-674b1c7bb816 req-6f6fe462-a81b-4f6e-b060-40f5565aa5fc service nova] Creating event network-changed:d761eef1-490d-4627-a1cc-64f2436e7c0c for instance 6dd9e299-5776-4848-b4ab-6d07424a3f8e on hv-cinder-83979 May 14 15:57:54.434489 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: INFO nova.api.openstack.requestlog [req-5886543c-5359-42fe-a6b8-674b1c7bb816 req-6f6fe462-a81b-4f6e-b060-40f5565aa5fc service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042233 May 14 15:57:54.436065 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: [pid: 128728|app: 0|req: 612/1204] 10.222.0.61 () {64 vars in 1317 bytes} [Sat May 14 15:57:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 14 15:57:54.459286 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.policy [None req-c5ef5c70-c68f-44d3-b182-6406f39d4d13 tempest-VolumesSnapshotTestJSON-671752898 tempest-VolumesSnapshotTestJSON-671752898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3e4193c9d9043c99ee5bee59f79f7a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ad8088ecb8a4f72a98ad70fa8be02b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128729) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:57:54.470854 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: INFO nova.api.openstack.requestlog [None req-c5ef5c70-c68f-44d3-b182-6406f39d4d13 tempest-VolumesSnapshotTestJSON-671752898 tempest-VolumesSnapshotTestJSON-671752898-project] 10.222.0.61 "GET /compute/v2.1/servers/25202ac2-6830-4d26-83fc-803adeb71796" status: 200 len: 1318 microversion: 2.1 time: 0.326753 May 14 15:57:54.472603 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: [pid: 128729|app: 0|req: 593/1205] 10.222.0.61 () {58 vars in 1235 bytes} [Sat May 14 15:57:54 2022] GET /compute/v2.1/servers/25202ac2-6830-4d26-83fc-803adeb71796 => generated 1318 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 15:57:54.641674 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi [None req-f83d16ef-75c1-4554-b32b-95d3bcd0b38e tempest-TestShelveInstance-1853374188 tempest-TestShelveInstance-1853374188-project] Calling method '.version_select at 0x7f77cb550310>' {{(pid=128728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 15:57:54.662507 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: INFO nova.api.openstack.requestlog [None req-f83d16ef-75c1-4554-b32b-95d3bcd0b38e tempest-TestShelveInstance-1853374188 tempest-TestShelveInstance-1853374188-project] 10.222.0.61 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1734050536" status: 202 len: 0 microversion: 2.1 time: 0.025300 May 14 15:57:54.666281 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: [pid: 128728|app: 0|req: 613/1206] 10.222.0.61 () {58 vars in 1253 bytes} [Sat May 14 15:57:54 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1734050536 => generated 0 bytes in 27 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 14 15:57:55.488976 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi [None req-a2a60793-db16-4612-b644-b5d7a37467f3 tempest-VolumesSnapshotTestJSON-671752898 tempest-VolumesSnapshotTestJSON-671752898-project] Calling method '>' {{(pid=128729) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 15:57:55.490327 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.compute.api [None req-a2a60793-db16-4612-b644-b5d7a37467f3 tempest-VolumesSnapshotTestJSON-671752898 tempest-VolumesSnapshotTestJSON-671752898-project] [instance: 25202ac2-6830-4d26-83fc-803adeb71796] Fetching instance by UUID {{(pid=128729) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 15:57:55.497342 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-a2a60793-db16-4612-b644-b5d7a37467f3 tempest-VolumesSnapshotTestJSON-671752898 tempest-VolumesSnapshotTestJSON-671752898-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:57:55.498000 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-a2a60793-db16-4612-b644-b5d7a37467f3 tempest-VolumesSnapshotTestJSON-671752898 tempest-VolumesSnapshotTestJSON-671752898-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:57:55.499074 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-a2a60793-db16-4612-b644-b5d7a37467f3 tempest-VolumesSnapshotTestJSON-671752898 tempest-VolumesSnapshotTestJSON-671752898-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:57:55.499647 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-a2a60793-db16-4612-b644-b5d7a37467f3 tempest-VolumesSnapshotTestJSON-671752898 tempest-VolumesSnapshotTestJSON-671752898-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:57:55.638697 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.policy [None req-a2a60793-db16-4612-b644-b5d7a37467f3 tempest-VolumesSnapshotTestJSON-671752898 tempest-VolumesSnapshotTestJSON-671752898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3e4193c9d9043c99ee5bee59f79f7a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ad8088ecb8a4f72a98ad70fa8be02b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128729) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:57:55.645972 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: INFO nova.api.openstack.requestlog [None req-a2a60793-db16-4612-b644-b5d7a37467f3 tempest-VolumesSnapshotTestJSON-671752898 tempest-VolumesSnapshotTestJSON-671752898-project] 10.222.0.61 "GET /compute/v2.1/servers/25202ac2-6830-4d26-83fc-803adeb71796" status: 200 len: 1318 microversion: 2.1 time: 0.160907 May 14 15:57:55.646708 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: [pid: 128729|app: 0|req: 594/1207] 10.222.0.61 () {58 vars in 1235 bytes} [Sat May 14 15:57:55 2022] GET /compute/v2.1/servers/25202ac2-6830-4d26-83fc-803adeb71796 => generated 1318 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 15:57:56.257760 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi [None req-9484b1ae-6d28-4e88-8892-b5b001cd907d tempest-VolumesNegativeTest-2072346752 tempest-VolumesNegativeTest-2072346752-project] Action: 'create', calling method: .version_select at 0x7f77cb61ca60>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-817783253", "metadata": {"Type": "work"}}} {{(pid=128728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 15:57:56.279227 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi [None req-9484b1ae-6d28-4e88-8892-b5b001cd907d tempest-VolumesNegativeTest-2072346752 tempest-VolumesNegativeTest-2072346752-project] Request method failure captured: May 14 15:57:56.279227 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: request: POST /compute/v2.1/os-volumes HTTP/1.1 May 14 15:57:56.279227 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: Accept: application/json May 14 15:57:56.279227 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: Accept-Encoding: identity May 14 15:57:56.279227 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: Connection: close May 14 15:57:56.279227 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: Content-Length: 121 May 14 15:57:56.279227 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: Content-Type: application/json May 14 15:57:56.279227 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: Host: 10.222.0.61 May 14 15:57:56.279227 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: Openstack-System-Scope: None May 14 15:57:56.279227 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: User-Agent: python-urllib3/1.26.9 May 14 15:57:56.279227 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: X-Auth-Token: gAAAAABif9GE9p1L1I_rlZYHvVH7UA7Syik4Kuv4PNSBK4YHvElggSPXWSQPr3APJ88sr03oTO8Cw2P2n3vqHncIAzh7Ts0k8dZ9sAsdRv3ZKkjAGgxmgryUA-7tYviJubt5n5rwWvc5X7tdGK875WvqorqYp9QJX2NxT8h7MGTdBi7ntQDwUUY May 14 15:57:56.279227 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: X-Domain-Id: None May 14 15:57:56.279227 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: X-Domain-Name: None May 14 15:57:56.279227 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: X-Identity-Status: Confirmed May 14 15:57:56.279227 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: X-Is-Admin-Project: True May 14 15:57:56.279227 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: X-Project-Domain-Id: default May 14 15:57:56.279227 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: X-Project-Domain-Name: Default May 14 15:57:56.279227 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: X-Project-Id: 3f21d13bd26b4543b87fe5ac946e4baa May 14 15:57:56.279227 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: X-Project-Name: tempest-VolumesNegativeTest-2072346752 May 14 15:57:56.279227 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: X-Role: reader,member May 14 15:57:56.279227 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: X-Roles: reader,member May 14 15:57:56.280975 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/3f21d13bd26b4543b87fe5ac946e4baa"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/3f21d13bd26b4543b87fe5ac946e4baa"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/3f21d13bd26b4543b87fe5ac946e4baa"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_3f21d13bd26b4543b87fe5ac946e4baa"}]}] May 14 15:57:56.280975 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: X-Tenant: tempest-VolumesNegativeTest-2072346752 May 14 15:57:56.280975 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: X-Tenant-Id: 3f21d13bd26b4543b87fe5ac946e4baa May 14 15:57:56.280975 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: X-Tenant-Name: tempest-VolumesNegativeTest-2072346752 May 14 15:57:56.280975 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: X-User: tempest-VolumesNegativeTest-2072346752-project May 14 15:57:56.280975 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: X-User-Domain-Id: default May 14 15:57:56.280975 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: X-User-Domain-Name: Default May 14 15:57:56.280975 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: X-User-Id: e4924b1b5f5a4d96afec1ee1d89a7818 May 14 15:57:56.280975 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: X-User-Name: tempest-VolumesNegativeTest-2072346752-project May 14 15:57:56.280975 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: May 14 15:57:56.280975 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-817783253", "metadata": {"Type": "work"}}} May 14 15:57:56.280975 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: method: May 14 15:57:56.280975 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: exception: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' May 14 15:57:56.282014 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: action_args: {'body': {'volume': {'size': '#$%', 'display_name': 'tempest-VolumesNegativeTest-Volume-817783253', 'metadata': {'Type': 'work'}}}} May 14 15:57:56.282014 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: {{(pid=128728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 14 15:57:56.282014 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 15:57:56.282014 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate May 14 15:57:56.282014 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) May 14 15:57:56.282014 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate May 14 15:57:56.282014 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: ERROR nova.api.openstack.wsgi raise error May 14 15:57:56.282014 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '#$%' does not match '^[0-9]+$' May 14 15:57:56.282014 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: ERROR nova.api.openstack.wsgi May 14 15:57:56.282014 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: May 14 15:57:56.282014 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} May 14 15:57:56.282014 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: ERROR nova.api.openstack.wsgi May 14 15:57:56.282014 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: ERROR nova.api.openstack.wsgi On instance['volume']: May 14 15:57:56.282014 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: ERROR nova.api.openstack.wsgi '#$%' May 14 15:57:56.282014 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: ERROR nova.api.openstack.wsgi May 14 15:57:56.282014 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 14 15:57:56.282014 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: ERROR nova.api.openstack.wsgi May 14 15:57:56.282014 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 15:57:56.282014 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 14 15:57:56.282014 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 14 15:57:56.282014 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 14 15:57:56.282014 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 14 15:57:56.283811 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 14 15:57:56.283811 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 14 15:57:56.283811 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 14 15:57:56.283811 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 14 15:57:56.283811 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper May 14 15:57:56.283811 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], May 14 15:57:56.283811 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper May 14 15:57:56.283811 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) May 14 15:57:56.283811 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate May 14 15:57:56.283811 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) May 14 15:57:56.283811 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' May 14 15:57:56.283811 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: ERROR nova.api.openstack.wsgi May 14 15:57:56.283811 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 14 15:57:56.283811 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: ERROR nova.api.openstack.wsgi May 14 15:57:56.283811 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 15:57:56.283811 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 14 15:57:56.283811 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 14 15:57:56.283811 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ May 14 15:57:56.283811 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( May 14 15:57:56.285124 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' May 14 15:57:56.285124 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: ERROR nova.api.openstack.wsgi May 14 15:57:56.285124 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi [None req-9484b1ae-6d28-4e88-8892-b5b001cd907d tempest-VolumesNegativeTest-2072346752 tempest-VolumesNegativeTest-2072346752-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=128728) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 14 15:57:56.285124 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: INFO nova.api.openstack.requestlog [None req-9484b1ae-6d28-4e88-8892-b5b001cd907d tempest-VolumesNegativeTest-2072346752 tempest-VolumesNegativeTest-2072346752-project] 10.222.0.61 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 0.142736 May 14 15:57:56.290253 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: [pid: 128728|app: 0|req: 614/1208] 10.222.0.61 () {60 vars in 1155 bytes} [Sat May 14 15:57:56 2022] POST /compute/v2.1/os-volumes => generated 127 bytes in 151 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) May 14 15:57:56.294859 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi [None req-ec1a6140-bd82-46bb-892d-1e0650f3dabd tempest-VolumesNegativeTest-2072346752 tempest-VolumesNegativeTest-2072346752-project] Action: 'create', calling method: .version_select at 0x7f77dd00cd30>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-1519626235", "metadata": {"Type": "work"}}} {{(pid=128729) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 15:57:56.298418 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi [None req-ec1a6140-bd82-46bb-892d-1e0650f3dabd tempest-VolumesNegativeTest-2072346752 tempest-VolumesNegativeTest-2072346752-project] Request method failure captured: May 14 15:57:56.298418 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: request: POST /compute/v2.1/os-volumes HTTP/1.1 May 14 15:57:56.298418 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: Accept: application/json May 14 15:57:56.298418 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: Accept-Encoding: identity May 14 15:57:56.298418 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: Connection: close May 14 15:57:56.298418 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: Content-Length: 120 May 14 15:57:56.298418 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: Content-Type: application/json May 14 15:57:56.298418 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: Host: 10.222.0.61 May 14 15:57:56.298418 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: Openstack-System-Scope: None May 14 15:57:56.298418 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: User-Agent: python-urllib3/1.26.9 May 14 15:57:56.298418 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: X-Auth-Token: gAAAAABif9GE9p1L1I_rlZYHvVH7UA7Syik4Kuv4PNSBK4YHvElggSPXWSQPr3APJ88sr03oTO8Cw2P2n3vqHncIAzh7Ts0k8dZ9sAsdRv3ZKkjAGgxmgryUA-7tYviJubt5n5rwWvc5X7tdGK875WvqorqYp9QJX2NxT8h7MGTdBi7ntQDwUUY May 14 15:57:56.298418 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: X-Domain-Id: None May 14 15:57:56.298418 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: X-Domain-Name: None May 14 15:57:56.298418 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: X-Identity-Status: Confirmed May 14 15:57:56.298418 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: X-Is-Admin-Project: True May 14 15:57:56.298418 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: X-Project-Domain-Id: default May 14 15:57:56.298418 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: X-Project-Domain-Name: Default May 14 15:57:56.298418 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: X-Project-Id: 3f21d13bd26b4543b87fe5ac946e4baa May 14 15:57:56.298418 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: X-Project-Name: tempest-VolumesNegativeTest-2072346752 May 14 15:57:56.298418 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: X-Role: reader,member May 14 15:57:56.298418 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: X-Roles: reader,member May 14 15:57:56.304440 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/3f21d13bd26b4543b87fe5ac946e4baa"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/3f21d13bd26b4543b87fe5ac946e4baa"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/3f21d13bd26b4543b87fe5ac946e4baa"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_3f21d13bd26b4543b87fe5ac946e4baa"}]}] May 14 15:57:56.304440 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: X-Tenant: tempest-VolumesNegativeTest-2072346752 May 14 15:57:56.304440 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: X-Tenant-Id: 3f21d13bd26b4543b87fe5ac946e4baa May 14 15:57:56.304440 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: X-Tenant-Name: tempest-VolumesNegativeTest-2072346752 May 14 15:57:56.304440 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: X-User: tempest-VolumesNegativeTest-2072346752-project May 14 15:57:56.304440 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: X-User-Domain-Id: default May 14 15:57:56.304440 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: X-User-Domain-Name: Default May 14 15:57:56.304440 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: X-User-Id: e4924b1b5f5a4d96afec1ee1d89a7818 May 14 15:57:56.304440 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: X-User-Name: tempest-VolumesNegativeTest-2072346752-project May 14 15:57:56.304440 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: May 14 15:57:56.304440 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-1519626235", "metadata": {"Type": "work"}}} May 14 15:57:56.304440 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: method: May 14 15:57:56.304440 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: exception: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 May 14 15:57:56.309158 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: action_args: {'body': {'volume': {'size': '0', 'display_name': 'tempest-VolumesNegativeTest-Volume-1519626235', 'metadata': {'Type': 'work'}}}} May 14 15:57:56.309158 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: {{(pid=128729) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 14 15:57:56.309158 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 15:57:56.309158 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate May 14 15:57:56.309158 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) May 14 15:57:56.309158 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate May 14 15:57:56.309158 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: ERROR nova.api.openstack.wsgi raise error May 14 15:57:56.309158 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 May 14 15:57:56.309158 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: ERROR nova.api.openstack.wsgi May 14 15:57:56.309158 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['volume']['properties']['size']: May 14 15:57:56.309158 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} May 14 15:57:56.309158 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: ERROR nova.api.openstack.wsgi May 14 15:57:56.309158 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: ERROR nova.api.openstack.wsgi On instance['volume']: May 14 15:57:56.309158 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: ERROR nova.api.openstack.wsgi '0' May 14 15:57:56.309158 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: ERROR nova.api.openstack.wsgi May 14 15:57:56.309158 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 14 15:57:56.309158 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: ERROR nova.api.openstack.wsgi May 14 15:57:56.309158 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 15:57:56.309158 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 14 15:57:56.309158 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 14 15:57:56.309158 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 14 15:57:56.309158 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 14 15:57:56.312275 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 14 15:57:56.312275 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 14 15:57:56.312275 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 14 15:57:56.312275 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 14 15:57:56.312275 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper May 14 15:57:56.312275 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], May 14 15:57:56.312275 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper May 14 15:57:56.312275 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) May 14 15:57:56.312275 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate May 14 15:57:56.312275 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) May 14 15:57:56.312275 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 May 14 15:57:56.312275 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: ERROR nova.api.openstack.wsgi May 14 15:57:56.312275 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 14 15:57:56.312275 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: ERROR nova.api.openstack.wsgi May 14 15:57:56.312275 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 15:57:56.312275 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 14 15:57:56.312275 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 14 15:57:56.312275 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ May 14 15:57:56.312275 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( May 14 15:57:56.315940 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 May 14 15:57:56.315940 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: ERROR nova.api.openstack.wsgi May 14 15:57:56.315940 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi [None req-ec1a6140-bd82-46bb-892d-1e0650f3dabd tempest-VolumesNegativeTest-2072346752 tempest-VolumesNegativeTest-2072346752-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=128729) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 14 15:57:56.315940 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: INFO nova.api.openstack.requestlog [None req-ec1a6140-bd82-46bb-892d-1e0650f3dabd tempest-VolumesNegativeTest-2072346752 tempest-VolumesNegativeTest-2072346752-project] 10.222.0.61 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.009547 May 14 15:57:56.315940 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: [pid: 128729|app: 0|req: 595/1209] 10.222.0.61 () {60 vars in 1155 bytes} [Sat May 14 15:57:56 2022] POST /compute/v2.1/os-volumes => generated 125 bytes in 11 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) May 14 15:57:56.317798 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi [None req-8380f4af-42b7-479e-ab78-aabe46925f68 tempest-VolumesNegativeTest-2072346752 tempest-VolumesNegativeTest-2072346752-project] Action: 'create', calling method: .version_select at 0x7f77cb61ca60>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-1427758435", "metadata": {"Type": "work"}}} {{(pid=128728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 15:57:56.317798 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi [None req-8380f4af-42b7-479e-ab78-aabe46925f68 tempest-VolumesNegativeTest-2072346752 tempest-VolumesNegativeTest-2072346752-project] Request method failure captured: May 14 15:57:56.317798 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: request: POST /compute/v2.1/os-volumes HTTP/1.1 May 14 15:57:56.317798 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: Accept: application/json May 14 15:57:56.317798 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: Accept-Encoding: identity May 14 15:57:56.317798 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: Connection: close May 14 15:57:56.317798 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: Content-Length: 119 May 14 15:57:56.317798 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: Content-Type: application/json May 14 15:57:56.317798 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: Host: 10.222.0.61 May 14 15:57:56.317798 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: Openstack-System-Scope: None May 14 15:57:56.317798 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: User-Agent: python-urllib3/1.26.9 May 14 15:57:56.317798 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: X-Auth-Token: gAAAAABif9GE9p1L1I_rlZYHvVH7UA7Syik4Kuv4PNSBK4YHvElggSPXWSQPr3APJ88sr03oTO8Cw2P2n3vqHncIAzh7Ts0k8dZ9sAsdRv3ZKkjAGgxmgryUA-7tYviJubt5n5rwWvc5X7tdGK875WvqorqYp9QJX2NxT8h7MGTdBi7ntQDwUUY May 14 15:57:56.317798 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: X-Domain-Id: None May 14 15:57:56.317798 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: X-Domain-Name: None May 14 15:57:56.317798 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: X-Identity-Status: Confirmed May 14 15:57:56.317798 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: X-Is-Admin-Project: True May 14 15:57:56.317798 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: X-Project-Domain-Id: default May 14 15:57:56.317798 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: X-Project-Domain-Name: Default May 14 15:57:56.317798 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: X-Project-Id: 3f21d13bd26b4543b87fe5ac946e4baa May 14 15:57:56.317798 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: X-Project-Name: tempest-VolumesNegativeTest-2072346752 May 14 15:57:56.317798 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: X-Role: reader,member May 14 15:57:56.317798 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: X-Roles: reader,member May 14 15:57:56.322639 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/3f21d13bd26b4543b87fe5ac946e4baa"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/3f21d13bd26b4543b87fe5ac946e4baa"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/3f21d13bd26b4543b87fe5ac946e4baa"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_3f21d13bd26b4543b87fe5ac946e4baa"}]}] May 14 15:57:56.322639 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: X-Tenant: tempest-VolumesNegativeTest-2072346752 May 14 15:57:56.322639 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: X-Tenant-Id: 3f21d13bd26b4543b87fe5ac946e4baa May 14 15:57:56.322639 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: X-Tenant-Name: tempest-VolumesNegativeTest-2072346752 May 14 15:57:56.322639 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: X-User: tempest-VolumesNegativeTest-2072346752-project May 14 15:57:56.322639 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: X-User-Domain-Id: default May 14 15:57:56.322639 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: X-User-Domain-Name: Default May 14 15:57:56.322639 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: X-User-Id: e4924b1b5f5a4d96afec1ee1d89a7818 May 14 15:57:56.322639 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: X-User-Name: tempest-VolumesNegativeTest-2072346752-project May 14 15:57:56.322639 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: May 14 15:57:56.322639 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-1427758435", "metadata": {"Type": "work"}}} May 14 15:57:56.322639 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: method: May 14 15:57:56.322639 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: exception: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' May 14 15:57:56.324975 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: action_args: {'body': {'volume': {'size': '', 'display_name': 'tempest-VolumesNegativeTest-Volume-1427758435', 'metadata': {'Type': 'work'}}}} May 14 15:57:56.324975 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: {{(pid=128728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 14 15:57:56.324975 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 15:57:56.324975 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate May 14 15:57:56.324975 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) May 14 15:57:56.324975 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate May 14 15:57:56.324975 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: ERROR nova.api.openstack.wsgi raise error May 14 15:57:56.324975 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match '^[0-9]+$' May 14 15:57:56.324975 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: ERROR nova.api.openstack.wsgi May 14 15:57:56.324975 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: May 14 15:57:56.324975 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} May 14 15:57:56.324975 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: ERROR nova.api.openstack.wsgi May 14 15:57:56.324975 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: ERROR nova.api.openstack.wsgi On instance['volume']: May 14 15:57:56.324975 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: ERROR nova.api.openstack.wsgi '' May 14 15:57:56.324975 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: ERROR nova.api.openstack.wsgi May 14 15:57:56.324975 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 14 15:57:56.324975 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: ERROR nova.api.openstack.wsgi May 14 15:57:56.324975 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 15:57:56.324975 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 14 15:57:56.324975 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 14 15:57:56.324975 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 14 15:57:56.324975 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 14 15:57:56.328824 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 14 15:57:56.328824 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 14 15:57:56.328824 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 14 15:57:56.328824 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 14 15:57:56.328824 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper May 14 15:57:56.328824 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], May 14 15:57:56.328824 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper May 14 15:57:56.328824 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) May 14 15:57:56.328824 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate May 14 15:57:56.328824 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) May 14 15:57:56.328824 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' May 14 15:57:56.328824 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: ERROR nova.api.openstack.wsgi May 14 15:57:56.328824 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 14 15:57:56.328824 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: ERROR nova.api.openstack.wsgi May 14 15:57:56.328824 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 15:57:56.328824 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 14 15:57:56.328824 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 14 15:57:56.328824 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ May 14 15:57:56.328824 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( May 14 15:57:56.331849 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' May 14 15:57:56.331849 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: ERROR nova.api.openstack.wsgi May 14 15:57:56.331849 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi [None req-8380f4af-42b7-479e-ab78-aabe46925f68 tempest-VolumesNegativeTest-2072346752 tempest-VolumesNegativeTest-2072346752-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=128728) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 14 15:57:56.331849 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: INFO nova.api.openstack.requestlog [None req-8380f4af-42b7-479e-ab78-aabe46925f68 tempest-VolumesNegativeTest-2072346752 tempest-VolumesNegativeTest-2072346752-project] 10.222.0.61 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.011022 May 14 15:57:56.331849 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: [pid: 128728|app: 0|req: 615/1210] 10.222.0.61 () {60 vars in 1155 bytes} [Sat May 14 15:57:56 2022] POST /compute/v2.1/os-volumes => generated 121 bytes in 12 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) May 14 15:57:56.332540 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi [None req-38ce5c19-86a5-42a7-a7e6-9a13145e2c4d tempest-VolumesNegativeTest-2072346752 tempest-VolumesNegativeTest-2072346752-project] Calling method '.version_select at 0x7f77cbfd4430>' {{(pid=128729) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 15:57:56.359177 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: INFO nova.api.openstack.wsgi [None req-38ce5c19-86a5-42a7-a7e6-9a13145e2c4d tempest-VolumesNegativeTest-2072346752 tempest-VolumesNegativeTest-2072346752-project] HTTP exception thrown: Volume tempest-invalid-724836670 could not be found. May 14 15:57:56.361918 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi [None req-38ce5c19-86a5-42a7-a7e6-9a13145e2c4d tempest-VolumesNegativeTest-2072346752 tempest-VolumesNegativeTest-2072346752-project] Request method failure captured: May 14 15:57:56.361918 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: request: DELETE /compute/v2.1/os-volumes/tempest-invalid-724836670 HTTP/1.1 May 14 15:57:56.361918 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: Accept: application/json May 14 15:57:56.361918 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: Accept-Encoding: identity May 14 15:57:56.361918 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: Connection: close May 14 15:57:56.361918 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: Content-Length: 0 May 14 15:57:56.361918 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: Content-Type: application/json May 14 15:57:56.361918 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: Host: 10.222.0.61 May 14 15:57:56.361918 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: Openstack-System-Scope: None May 14 15:57:56.361918 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: User-Agent: python-urllib3/1.26.9 May 14 15:57:56.361918 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: X-Auth-Token: gAAAAABif9GE9p1L1I_rlZYHvVH7UA7Syik4Kuv4PNSBK4YHvElggSPXWSQPr3APJ88sr03oTO8Cw2P2n3vqHncIAzh7Ts0k8dZ9sAsdRv3ZKkjAGgxmgryUA-7tYviJubt5n5rwWvc5X7tdGK875WvqorqYp9QJX2NxT8h7MGTdBi7ntQDwUUY May 14 15:57:56.361918 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: X-Domain-Id: None May 14 15:57:56.361918 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: X-Domain-Name: None May 14 15:57:56.361918 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: X-Identity-Status: Confirmed May 14 15:57:56.361918 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: X-Is-Admin-Project: True May 14 15:57:56.361918 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: X-Project-Domain-Id: default May 14 15:57:56.361918 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: X-Project-Domain-Name: Default May 14 15:57:56.361918 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: X-Project-Id: 3f21d13bd26b4543b87fe5ac946e4baa May 14 15:57:56.361918 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: X-Project-Name: tempest-VolumesNegativeTest-2072346752 May 14 15:57:56.361918 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: X-Role: reader,member May 14 15:57:56.361918 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: X-Roles: reader,member May 14 15:57:56.363277 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/3f21d13bd26b4543b87fe5ac946e4baa"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/3f21d13bd26b4543b87fe5ac946e4baa"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/3f21d13bd26b4543b87fe5ac946e4baa"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_3f21d13bd26b4543b87fe5ac946e4baa"}]}] May 14 15:57:56.363277 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: X-Tenant: tempest-VolumesNegativeTest-2072346752 May 14 15:57:56.363277 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: X-Tenant-Id: 3f21d13bd26b4543b87fe5ac946e4baa May 14 15:57:56.363277 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: X-Tenant-Name: tempest-VolumesNegativeTest-2072346752 May 14 15:57:56.363277 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: X-User: tempest-VolumesNegativeTest-2072346752-project May 14 15:57:56.363277 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: X-User-Domain-Id: default May 14 15:57:56.363277 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: X-User-Domain-Name: Default May 14 15:57:56.363277 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: X-User-Id: e4924b1b5f5a4d96afec1ee1d89a7818 May 14 15:57:56.363277 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: X-User-Name: tempest-VolumesNegativeTest-2072346752-project May 14 15:57:56.363277 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: method: May 14 15:57:56.363277 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: exception: Volume tempest-invalid-724836670 could not be found. May 14 15:57:56.363277 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: action_args: {'id': 'tempest-invalid-724836670'} May 14 15:57:56.363277 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: {{(pid=128729) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 14 15:57:56.364085 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 15:57:56.364085 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 14 15:57:56.364085 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 14 15:57:56.364085 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete May 14 15:57:56.364085 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) May 14 15:57:56.364085 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete May 14 15:57:56.364085 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: ERROR nova.api.openstack.wsgi return self._delete(loc) May 14 15:57:56.364085 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete May 14 15:57:56.364085 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) May 14 15:57:56.364085 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete May 14 15:57:56.364085 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) May 14 15:57:56.364085 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 14 15:57:56.364085 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 14 15:57:56.364085 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 14 15:57:56.364085 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 14 15:57:56.364085 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume tempest-invalid-724836670 could not be found. (HTTP 404) (Request-ID: req-f2b6d7e4-8ca7-4df8-974a-a91262645796) May 14 15:57:56.364085 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: ERROR nova.api.openstack.wsgi May 14 15:57:56.364085 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 14 15:57:56.364085 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: ERROR nova.api.openstack.wsgi May 14 15:57:56.365252 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 15:57:56.365252 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete May 14 15:57:56.365252 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) May 14 15:57:56.365252 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 14 15:57:56.365252 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 14 15:57:56.365252 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper May 14 15:57:56.365252 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) May 14 15:57:56.365252 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise May 14 15:57:56.365252 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) May 14 15:57:56.365252 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 14 15:57:56.365252 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 14 15:57:56.365252 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete May 14 15:57:56.365252 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) May 14 15:57:56.365252 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete May 14 15:57:56.365252 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: ERROR nova.api.openstack.wsgi return self._delete(loc) May 14 15:57:56.365252 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete May 14 15:57:56.365252 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) May 14 15:57:56.365252 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete May 14 15:57:56.365252 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) May 14 15:57:56.366910 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 14 15:57:56.366910 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 14 15:57:56.366910 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 14 15:57:56.366910 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 14 15:57:56.366910 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume tempest-invalid-724836670 could not be found. May 14 15:57:56.366910 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: ERROR nova.api.openstack.wsgi May 14 15:57:56.366910 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 14 15:57:56.366910 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: ERROR nova.api.openstack.wsgi May 14 15:57:56.366910 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 15:57:56.366910 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 14 15:57:56.366910 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 14 15:57:56.366910 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 14 15:57:56.366910 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 14 15:57:56.366910 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 14 15:57:56.366910 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 14 15:57:56.366910 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 14 15:57:56.366910 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 14 15:57:56.366910 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete May 14 15:57:56.366910 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 14 15:57:56.366910 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume tempest-invalid-724836670 could not be found. May 14 15:57:56.370614 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: ERROR nova.api.openstack.wsgi May 14 15:57:56.370614 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 14 15:57:56.370614 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: ERROR nova.api.openstack.wsgi May 14 15:57:56.370614 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 15:57:56.370614 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 14 15:57:56.370614 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 14 15:57:56.370614 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 14 15:57:56.370614 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 14 15:57:56.370614 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume tempest-invalid-724836670 could not be found. May 14 15:57:56.370614 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: ERROR nova.api.openstack.wsgi May 14 15:57:56.370614 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi [None req-38ce5c19-86a5-42a7-a7e6-9a13145e2c4d tempest-VolumesNegativeTest-2072346752 tempest-VolumesNegativeTest-2072346752-project] Returning 404 to user: Volume tempest-invalid-724836670 could not be found. {{(pid=128729) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 14 15:57:56.370614 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: INFO nova.api.openstack.requestlog [None req-38ce5c19-86a5-42a7-a7e6-9a13145e2c4d tempest-VolumesNegativeTest-2072346752 tempest-VolumesNegativeTest-2072346752-project] 10.222.0.61 "DELETE /compute/v2.1/os-volumes/tempest-invalid-724836670" status: 404 len: 98 microversion: 2.1 time: 0.041537 May 14 15:57:56.370614 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: [pid: 128729|app: 0|req: 596/1211] 10.222.0.61 () {58 vars in 1214 bytes} [Sat May 14 15:57:56 2022] DELETE /compute/v2.1/os-volumes/tempest-invalid-724836670 => generated 98 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) May 14 15:57:56.374740 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: INFO nova.api.openstack.requestlog [None req-c8c949cf-3129-4700-92cf-ceb5e6e401ae tempest-VolumesNegativeTest-2072346752 tempest-VolumesNegativeTest-2072346752-project] 10.222.0.61 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.004623 May 14 15:57:56.375252 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: [pid: 128728|app: 0|req: 616/1212] 10.222.0.61 () {58 vars in 1139 bytes} [Sat May 14 15:57:56 2022] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 6 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) May 14 15:57:56.384146 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: INFO nova.api.openstack.requestlog [None req-26c2e54e-512a-421f-ad79-629a75994868 tempest-VolumesNegativeTest-2072346752 tempest-VolumesNegativeTest-2072346752-project] 10.222.0.61 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.003921 May 14 15:57:56.384728 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: [pid: 128729|app: 0|req: 597/1213] 10.222.0.61 () {58 vars in 1136 bytes} [Sat May 14 15:57:56 2022] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 5 msecs (HTTP/1.1 404) 5 headers in 228 bytes (2 switches on core 0) May 14 15:57:56.395353 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi [None req-8f7689a0-d0ea-4b1c-a4ab-66cc60493092 tempest-VolumesNegativeTest-2072346752 tempest-VolumesNegativeTest-2072346752-project] Calling method '.version_select at 0x7f77cb550790>' {{(pid=128728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 15:57:56.424585 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: INFO nova.api.openstack.wsgi [None req-8f7689a0-d0ea-4b1c-a4ab-66cc60493092 tempest-VolumesNegativeTest-2072346752 tempest-VolumesNegativeTest-2072346752-project] HTTP exception thrown: Volume b64d9d3d-7e7c-4494-b8bb-b2d37a599242 could not be found. May 14 15:57:56.426613 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi [None req-8f7689a0-d0ea-4b1c-a4ab-66cc60493092 tempest-VolumesNegativeTest-2072346752 tempest-VolumesNegativeTest-2072346752-project] Request method failure captured: May 14 15:57:56.426613 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: request: DELETE /compute/v2.1/os-volumes/b64d9d3d-7e7c-4494-b8bb-b2d37a599242 HTTP/1.1 May 14 15:57:56.426613 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: Accept: application/json May 14 15:57:56.426613 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: Accept-Encoding: identity May 14 15:57:56.426613 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: Connection: close May 14 15:57:56.426613 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: Content-Length: 0 May 14 15:57:56.426613 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: Content-Type: application/json May 14 15:57:56.426613 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: Host: 10.222.0.61 May 14 15:57:56.426613 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: Openstack-System-Scope: None May 14 15:57:56.426613 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: User-Agent: python-urllib3/1.26.9 May 14 15:57:56.426613 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: X-Auth-Token: gAAAAABif9GE9p1L1I_rlZYHvVH7UA7Syik4Kuv4PNSBK4YHvElggSPXWSQPr3APJ88sr03oTO8Cw2P2n3vqHncIAzh7Ts0k8dZ9sAsdRv3ZKkjAGgxmgryUA-7tYviJubt5n5rwWvc5X7tdGK875WvqorqYp9QJX2NxT8h7MGTdBi7ntQDwUUY May 14 15:57:56.426613 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: X-Domain-Id: None May 14 15:57:56.426613 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: X-Domain-Name: None May 14 15:57:56.426613 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: X-Identity-Status: Confirmed May 14 15:57:56.426613 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: X-Is-Admin-Project: True May 14 15:57:56.426613 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: X-Project-Domain-Id: default May 14 15:57:56.426613 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: X-Project-Domain-Name: Default May 14 15:57:56.426613 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: X-Project-Id: 3f21d13bd26b4543b87fe5ac946e4baa May 14 15:57:56.426613 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: X-Project-Name: tempest-VolumesNegativeTest-2072346752 May 14 15:57:56.426613 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: X-Role: reader,member May 14 15:57:56.426613 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: X-Roles: reader,member May 14 15:57:56.427987 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/3f21d13bd26b4543b87fe5ac946e4baa"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/3f21d13bd26b4543b87fe5ac946e4baa"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/3f21d13bd26b4543b87fe5ac946e4baa"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_3f21d13bd26b4543b87fe5ac946e4baa"}]}] May 14 15:57:56.427987 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: X-Tenant: tempest-VolumesNegativeTest-2072346752 May 14 15:57:56.427987 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: X-Tenant-Id: 3f21d13bd26b4543b87fe5ac946e4baa May 14 15:57:56.427987 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: X-Tenant-Name: tempest-VolumesNegativeTest-2072346752 May 14 15:57:56.427987 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: X-User: tempest-VolumesNegativeTest-2072346752-project May 14 15:57:56.427987 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: X-User-Domain-Id: default May 14 15:57:56.427987 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: X-User-Domain-Name: Default May 14 15:57:56.427987 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: X-User-Id: e4924b1b5f5a4d96afec1ee1d89a7818 May 14 15:57:56.427987 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: X-User-Name: tempest-VolumesNegativeTest-2072346752-project May 14 15:57:56.427987 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: method: May 14 15:57:56.427987 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: exception: Volume b64d9d3d-7e7c-4494-b8bb-b2d37a599242 could not be found. May 14 15:57:56.427987 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: action_args: {'id': 'b64d9d3d-7e7c-4494-b8bb-b2d37a599242'} May 14 15:57:56.427987 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: {{(pid=128728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 14 15:57:56.428816 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 15:57:56.428816 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 14 15:57:56.428816 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 14 15:57:56.428816 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete May 14 15:57:56.428816 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) May 14 15:57:56.428816 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete May 14 15:57:56.428816 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: ERROR nova.api.openstack.wsgi return self._delete(loc) May 14 15:57:56.428816 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete May 14 15:57:56.428816 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) May 14 15:57:56.428816 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete May 14 15:57:56.428816 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) May 14 15:57:56.428816 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 14 15:57:56.428816 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 14 15:57:56.428816 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 14 15:57:56.428816 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 14 15:57:56.428816 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume b64d9d3d-7e7c-4494-b8bb-b2d37a599242 could not be found. (HTTP 404) (Request-ID: req-741ac73d-20be-4dda-96af-e07806d64b7b) May 14 15:57:56.428816 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: ERROR nova.api.openstack.wsgi May 14 15:57:56.428816 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 14 15:57:56.428816 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: ERROR nova.api.openstack.wsgi May 14 15:57:56.429972 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 15:57:56.429972 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete May 14 15:57:56.429972 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) May 14 15:57:56.429972 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 14 15:57:56.429972 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 14 15:57:56.429972 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper May 14 15:57:56.429972 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) May 14 15:57:56.429972 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise May 14 15:57:56.429972 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) May 14 15:57:56.429972 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 14 15:57:56.429972 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 14 15:57:56.429972 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete May 14 15:57:56.429972 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) May 14 15:57:56.429972 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete May 14 15:57:56.429972 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: ERROR nova.api.openstack.wsgi return self._delete(loc) May 14 15:57:56.429972 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete May 14 15:57:56.429972 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) May 14 15:57:56.429972 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete May 14 15:57:56.429972 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) May 14 15:57:56.433157 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 14 15:57:56.433157 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 14 15:57:56.433157 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 14 15:57:56.433157 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 14 15:57:56.433157 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume b64d9d3d-7e7c-4494-b8bb-b2d37a599242 could not be found. May 14 15:57:56.433157 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: ERROR nova.api.openstack.wsgi May 14 15:57:56.433157 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 14 15:57:56.433157 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: ERROR nova.api.openstack.wsgi May 14 15:57:56.433157 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 15:57:56.433157 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 14 15:57:56.433157 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 14 15:57:56.433157 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 14 15:57:56.433157 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 14 15:57:56.433157 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 14 15:57:56.433157 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 14 15:57:56.433157 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 14 15:57:56.433157 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 14 15:57:56.433157 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete May 14 15:57:56.433157 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 14 15:57:56.436467 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume b64d9d3d-7e7c-4494-b8bb-b2d37a599242 could not be found. May 14 15:57:56.436467 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: ERROR nova.api.openstack.wsgi May 14 15:57:56.436467 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 14 15:57:56.436467 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: ERROR nova.api.openstack.wsgi May 14 15:57:56.436467 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 15:57:56.436467 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 14 15:57:56.436467 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 14 15:57:56.436467 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 14 15:57:56.436467 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 14 15:57:56.436467 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume b64d9d3d-7e7c-4494-b8bb-b2d37a599242 could not be found. May 14 15:57:56.436467 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: ERROR nova.api.openstack.wsgi May 14 15:57:56.436467 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi [None req-8f7689a0-d0ea-4b1c-a4ab-66cc60493092 tempest-VolumesNegativeTest-2072346752 tempest-VolumesNegativeTest-2072346752-project] Returning 404 to user: Volume b64d9d3d-7e7c-4494-b8bb-b2d37a599242 could not be found. {{(pid=128728) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 14 15:57:56.436467 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: INFO nova.api.openstack.requestlog [None req-8f7689a0-d0ea-4b1c-a4ab-66cc60493092 tempest-VolumesNegativeTest-2072346752 tempest-VolumesNegativeTest-2072346752-project] 10.222.0.61 "DELETE /compute/v2.1/os-volumes/b64d9d3d-7e7c-4494-b8bb-b2d37a599242" status: 404 len: 109 microversion: 2.1 time: 0.036467 May 14 15:57:56.436467 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: [pid: 128728|app: 0|req: 617/1214] 10.222.0.61 () {58 vars in 1247 bytes} [Sat May 14 15:57:56 2022] DELETE /compute/v2.1/os-volumes/b64d9d3d-7e7c-4494-b8bb-b2d37a599242 => generated 109 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 14 15:57:56.438818 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi [None req-ef1b9231-a4d7-4b14-9163-1128c788e226 tempest-VolumesNegativeTest-2072346752 tempest-VolumesNegativeTest-2072346752-project] Calling method '.version_select at 0x7f77dcf71f70>' {{(pid=128729) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 15:57:56.468189 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: INFO nova.api.openstack.wsgi [None req-ef1b9231-a4d7-4b14-9163-1128c788e226 tempest-VolumesNegativeTest-2072346752 tempest-VolumesNegativeTest-2072346752-project] HTTP exception thrown: Volume 01258887-de37-48a7-98ec-ca2b9b548485 could not be found. May 14 15:57:56.470589 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi [None req-ef1b9231-a4d7-4b14-9163-1128c788e226 tempest-VolumesNegativeTest-2072346752 tempest-VolumesNegativeTest-2072346752-project] Request method failure captured: May 14 15:57:56.470589 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: request: GET /compute/v2.1/os-volumes/01258887-de37-48a7-98ec-ca2b9b548485 HTTP/1.1 May 14 15:57:56.470589 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: Accept: application/json May 14 15:57:56.470589 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: Accept-Encoding: identity May 14 15:57:56.470589 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: Connection: close May 14 15:57:56.470589 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: Content-Length: 0 May 14 15:57:56.470589 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: Content-Type: application/json May 14 15:57:56.470589 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: Host: 10.222.0.61 May 14 15:57:56.470589 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: Openstack-System-Scope: None May 14 15:57:56.470589 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: User-Agent: python-urllib3/1.26.9 May 14 15:57:56.470589 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: X-Auth-Token: gAAAAABif9GE9p1L1I_rlZYHvVH7UA7Syik4Kuv4PNSBK4YHvElggSPXWSQPr3APJ88sr03oTO8Cw2P2n3vqHncIAzh7Ts0k8dZ9sAsdRv3ZKkjAGgxmgryUA-7tYviJubt5n5rwWvc5X7tdGK875WvqorqYp9QJX2NxT8h7MGTdBi7ntQDwUUY May 14 15:57:56.470589 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: X-Domain-Id: None May 14 15:57:56.470589 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: X-Domain-Name: None May 14 15:57:56.470589 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: X-Identity-Status: Confirmed May 14 15:57:56.470589 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: X-Is-Admin-Project: True May 14 15:57:56.470589 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: X-Project-Domain-Id: default May 14 15:57:56.470589 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: X-Project-Domain-Name: Default May 14 15:57:56.470589 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: X-Project-Id: 3f21d13bd26b4543b87fe5ac946e4baa May 14 15:57:56.470589 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: X-Project-Name: tempest-VolumesNegativeTest-2072346752 May 14 15:57:56.470589 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: X-Role: reader,member May 14 15:57:56.470589 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: X-Roles: reader,member May 14 15:57:56.472041 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/3f21d13bd26b4543b87fe5ac946e4baa"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/3f21d13bd26b4543b87fe5ac946e4baa"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/3f21d13bd26b4543b87fe5ac946e4baa"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_3f21d13bd26b4543b87fe5ac946e4baa"}]}] May 14 15:57:56.472041 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: X-Tenant: tempest-VolumesNegativeTest-2072346752 May 14 15:57:56.472041 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: X-Tenant-Id: 3f21d13bd26b4543b87fe5ac946e4baa May 14 15:57:56.472041 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: X-Tenant-Name: tempest-VolumesNegativeTest-2072346752 May 14 15:57:56.472041 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: X-User: tempest-VolumesNegativeTest-2072346752-project May 14 15:57:56.472041 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: X-User-Domain-Id: default May 14 15:57:56.472041 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: X-User-Domain-Name: Default May 14 15:57:56.472041 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: X-User-Id: e4924b1b5f5a4d96afec1ee1d89a7818 May 14 15:57:56.472041 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: X-User-Name: tempest-VolumesNegativeTest-2072346752-project May 14 15:57:56.472041 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: method: May 14 15:57:56.472041 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: exception: Volume 01258887-de37-48a7-98ec-ca2b9b548485 could not be found. May 14 15:57:56.472041 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: action_args: {'id': '01258887-de37-48a7-98ec-ca2b9b548485'} May 14 15:57:56.472041 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: {{(pid=128729) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 14 15:57:56.472941 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 15:57:56.472941 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 14 15:57:56.472941 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 14 15:57:56.472941 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get May 14 15:57:56.472941 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: ERROR nova.api.openstack.wsgi item = cinderclient( May 14 15:57:56.472941 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get May 14 15:57:56.472941 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") May 14 15:57:56.472941 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 14 15:57:56.472941 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 14 15:57:56.472941 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 14 15:57:56.472941 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 14 15:57:56.472941 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 14 15:57:56.472941 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 14 15:57:56.472941 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 14 15:57:56.472941 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 14 15:57:56.472941 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 01258887-de37-48a7-98ec-ca2b9b548485 could not be found. (HTTP 404) (Request-ID: req-506c3091-563c-40f5-9561-3a809cacf177) May 14 15:57:56.472941 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: ERROR nova.api.openstack.wsgi May 14 15:57:56.472941 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 14 15:57:56.472941 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: ERROR nova.api.openstack.wsgi May 14 15:57:56.474358 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 15:57:56.474358 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show May 14 15:57:56.474358 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) May 14 15:57:56.474358 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 14 15:57:56.474358 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 14 15:57:56.474358 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper May 14 15:57:56.474358 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) May 14 15:57:56.474358 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise May 14 15:57:56.474358 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) May 14 15:57:56.474358 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 14 15:57:56.474358 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 14 15:57:56.474358 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get May 14 15:57:56.474358 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: ERROR nova.api.openstack.wsgi item = cinderclient( May 14 15:57:56.474358 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get May 14 15:57:56.474358 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") May 14 15:57:56.474358 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 14 15:57:56.474358 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 14 15:57:56.474358 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 14 15:57:56.474358 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 14 15:57:56.476694 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 14 15:57:56.476694 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 14 15:57:56.476694 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 14 15:57:56.476694 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 14 15:57:56.476694 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 01258887-de37-48a7-98ec-ca2b9b548485 could not be found. May 14 15:57:56.476694 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: ERROR nova.api.openstack.wsgi May 14 15:57:56.476694 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 14 15:57:56.476694 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: ERROR nova.api.openstack.wsgi May 14 15:57:56.476694 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 15:57:56.476694 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 14 15:57:56.476694 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 14 15:57:56.476694 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 14 15:57:56.476694 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 14 15:57:56.476694 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 14 15:57:56.476694 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 14 15:57:56.476694 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 14 15:57:56.476694 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 14 15:57:56.476694 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show May 14 15:57:56.476694 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 14 15:57:56.479554 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 01258887-de37-48a7-98ec-ca2b9b548485 could not be found. May 14 15:57:56.479554 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: ERROR nova.api.openstack.wsgi May 14 15:57:56.479554 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 14 15:57:56.479554 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: ERROR nova.api.openstack.wsgi May 14 15:57:56.479554 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 15:57:56.479554 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 14 15:57:56.479554 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 14 15:57:56.479554 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 14 15:57:56.479554 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 14 15:57:56.479554 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 01258887-de37-48a7-98ec-ca2b9b548485 could not be found. May 14 15:57:56.479554 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: ERROR nova.api.openstack.wsgi May 14 15:57:56.479554 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi [None req-ef1b9231-a4d7-4b14-9163-1128c788e226 tempest-VolumesNegativeTest-2072346752 tempest-VolumesNegativeTest-2072346752-project] Returning 404 to user: Volume 01258887-de37-48a7-98ec-ca2b9b548485 could not be found. {{(pid=128729) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 14 15:57:56.479554 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: INFO nova.api.openstack.requestlog [None req-ef1b9231-a4d7-4b14-9163-1128c788e226 tempest-VolumesNegativeTest-2072346752 tempest-VolumesNegativeTest-2072346752-project] 10.222.0.61 "GET /compute/v2.1/os-volumes/01258887-de37-48a7-98ec-ca2b9b548485" status: 404 len: 109 microversion: 2.1 time: 0.038433 May 14 15:57:56.479554 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: [pid: 128729|app: 0|req: 598/1215] 10.222.0.61 () {58 vars in 1244 bytes} [Sat May 14 15:57:56 2022] GET /compute/v2.1/os-volumes/01258887-de37-48a7-98ec-ca2b9b548485 => generated 109 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 14 15:57:56.663781 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi [None req-e2d654b4-6ace-46c2-b14a-029e6440796b tempest-VolumesSnapshotTestJSON-671752898 tempest-VolumesSnapshotTestJSON-671752898-project] Calling method '>' {{(pid=128728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 15:57:56.664554 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.compute.api [None req-e2d654b4-6ace-46c2-b14a-029e6440796b tempest-VolumesSnapshotTestJSON-671752898 tempest-VolumesSnapshotTestJSON-671752898-project] [instance: 25202ac2-6830-4d26-83fc-803adeb71796] Fetching instance by UUID {{(pid=128728) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 15:57:56.671563 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-e2d654b4-6ace-46c2-b14a-029e6440796b tempest-VolumesSnapshotTestJSON-671752898 tempest-VolumesSnapshotTestJSON-671752898-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:57:56.672438 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-e2d654b4-6ace-46c2-b14a-029e6440796b tempest-VolumesSnapshotTestJSON-671752898 tempest-VolumesSnapshotTestJSON-671752898-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:57:56.673578 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-e2d654b4-6ace-46c2-b14a-029e6440796b tempest-VolumesSnapshotTestJSON-671752898 tempest-VolumesSnapshotTestJSON-671752898-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:57:56.674022 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-e2d654b4-6ace-46c2-b14a-029e6440796b tempest-VolumesSnapshotTestJSON-671752898 tempest-VolumesSnapshotTestJSON-671752898-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:57:56.835514 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.policy [None req-e2d654b4-6ace-46c2-b14a-029e6440796b tempest-VolumesSnapshotTestJSON-671752898 tempest-VolumesSnapshotTestJSON-671752898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3e4193c9d9043c99ee5bee59f79f7a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ad8088ecb8a4f72a98ad70fa8be02b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128728) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:57:56.847332 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: INFO nova.api.openstack.requestlog [None req-e2d654b4-6ace-46c2-b14a-029e6440796b tempest-VolumesSnapshotTestJSON-671752898 tempest-VolumesSnapshotTestJSON-671752898-project] 10.222.0.61 "GET /compute/v2.1/servers/25202ac2-6830-4d26-83fc-803adeb71796" status: 200 len: 1318 microversion: 2.1 time: 0.188001 May 14 15:57:56.860506 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: [pid: 128728|app: 0|req: 618/1216] 10.222.0.61 () {58 vars in 1235 bytes} [Sat May 14 15:57:56 2022] GET /compute/v2.1/servers/25202ac2-6830-4d26-83fc-803adeb71796 => generated 1318 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 15:57:57.867451 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi [None req-193ef006-f8a5-4876-938f-b93fbd04b84e tempest-VolumesSnapshotTestJSON-671752898 tempest-VolumesSnapshotTestJSON-671752898-project] Calling method '>' {{(pid=128729) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 15:57:57.869462 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.compute.api [None req-193ef006-f8a5-4876-938f-b93fbd04b84e tempest-VolumesSnapshotTestJSON-671752898 tempest-VolumesSnapshotTestJSON-671752898-project] [instance: 25202ac2-6830-4d26-83fc-803adeb71796] Fetching instance by UUID {{(pid=128729) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 15:57:57.877528 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-193ef006-f8a5-4876-938f-b93fbd04b84e tempest-VolumesSnapshotTestJSON-671752898 tempest-VolumesSnapshotTestJSON-671752898-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:57:57.878244 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-193ef006-f8a5-4876-938f-b93fbd04b84e tempest-VolumesSnapshotTestJSON-671752898 tempest-VolumesSnapshotTestJSON-671752898-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:57:57.879231 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-193ef006-f8a5-4876-938f-b93fbd04b84e tempest-VolumesSnapshotTestJSON-671752898 tempest-VolumesSnapshotTestJSON-671752898-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:57:57.879779 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-193ef006-f8a5-4876-938f-b93fbd04b84e tempest-VolumesSnapshotTestJSON-671752898 tempest-VolumesSnapshotTestJSON-671752898-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:57:58.030600 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.policy [None req-193ef006-f8a5-4876-938f-b93fbd04b84e tempest-VolumesSnapshotTestJSON-671752898 tempest-VolumesSnapshotTestJSON-671752898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3e4193c9d9043c99ee5bee59f79f7a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ad8088ecb8a4f72a98ad70fa8be02b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128729) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:57:58.038871 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: INFO nova.api.openstack.requestlog [None req-193ef006-f8a5-4876-938f-b93fbd04b84e tempest-VolumesSnapshotTestJSON-671752898 tempest-VolumesSnapshotTestJSON-671752898-project] 10.222.0.61 "GET /compute/v2.1/servers/25202ac2-6830-4d26-83fc-803adeb71796" status: 200 len: 1318 microversion: 2.1 time: 0.177505 May 14 15:57:58.039804 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: [pid: 128729|app: 0|req: 599/1217] 10.222.0.61 () {58 vars in 1235 bytes} [Sat May 14 15:57:57 2022] GET /compute/v2.1/servers/25202ac2-6830-4d26-83fc-803adeb71796 => generated 1318 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 15:57:59.056618 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi [None req-bc5a3466-946e-4dfb-9b2d-39b1bf25a25d tempest-VolumesSnapshotTestJSON-671752898 tempest-VolumesSnapshotTestJSON-671752898-project] Calling method '>' {{(pid=128728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 15:57:59.057481 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.compute.api [None req-bc5a3466-946e-4dfb-9b2d-39b1bf25a25d tempest-VolumesSnapshotTestJSON-671752898 tempest-VolumesSnapshotTestJSON-671752898-project] [instance: 25202ac2-6830-4d26-83fc-803adeb71796] Fetching instance by UUID {{(pid=128728) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 15:57:59.065346 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-bc5a3466-946e-4dfb-9b2d-39b1bf25a25d tempest-VolumesSnapshotTestJSON-671752898 tempest-VolumesSnapshotTestJSON-671752898-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:57:59.069803 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-bc5a3466-946e-4dfb-9b2d-39b1bf25a25d tempest-VolumesSnapshotTestJSON-671752898 tempest-VolumesSnapshotTestJSON-671752898-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:57:59.071584 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-bc5a3466-946e-4dfb-9b2d-39b1bf25a25d tempest-VolumesSnapshotTestJSON-671752898 tempest-VolumesSnapshotTestJSON-671752898-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:57:59.072143 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-bc5a3466-946e-4dfb-9b2d-39b1bf25a25d tempest-VolumesSnapshotTestJSON-671752898 tempest-VolumesSnapshotTestJSON-671752898-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:57:59.233957 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.policy [None req-bc5a3466-946e-4dfb-9b2d-39b1bf25a25d tempest-VolumesSnapshotTestJSON-671752898 tempest-VolumesSnapshotTestJSON-671752898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3e4193c9d9043c99ee5bee59f79f7a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ad8088ecb8a4f72a98ad70fa8be02b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128728) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:57:59.243283 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: INFO nova.api.openstack.requestlog [None req-bc5a3466-946e-4dfb-9b2d-39b1bf25a25d tempest-VolumesSnapshotTestJSON-671752898 tempest-VolumesSnapshotTestJSON-671752898-project] 10.222.0.61 "GET /compute/v2.1/servers/25202ac2-6830-4d26-83fc-803adeb71796" status: 200 len: 1318 microversion: 2.1 time: 0.190605 May 14 15:57:59.243858 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: [pid: 128728|app: 0|req: 619/1218] 10.222.0.61 () {58 vars in 1235 bytes} [Sat May 14 15:57:59 2022] GET /compute/v2.1/servers/25202ac2-6830-4d26-83fc-803adeb71796 => generated 1318 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 15:57:59.929878 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi [req-11ce4927-9531-498f-be65-4f8109a9bae4 req-0c1d3914-92ef-47db-8126-fc99e4b764b1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "25202ac2-6830-4d26-83fc-803adeb71796", "name": "network-vif-plugged", "status": "completed", "tag": "684de684-f0ea-449d-a77c-a068f4d20b82"}]} {{(pid=128729) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 15:57:59.949883 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [req-11ce4927-9531-498f-be65-4f8109a9bae4 req-0c1d3914-92ef-47db-8126-fc99e4b764b1 service nova] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:57:59.949883 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [req-11ce4927-9531-498f-be65-4f8109a9bae4 req-0c1d3914-92ef-47db-8126-fc99e4b764b1 service nova] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:57:59.970558 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: INFO nova.api.openstack.compute.server_external_events [req-11ce4927-9531-498f-be65-4f8109a9bae4 req-0c1d3914-92ef-47db-8126-fc99e4b764b1 service nova] Creating event network-vif-plugged:684de684-f0ea-449d-a77c-a068f4d20b82 for instance 25202ac2-6830-4d26-83fc-803adeb71796 on hv-cinder-83979 May 14 15:57:59.991605 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: INFO nova.api.openstack.requestlog [req-11ce4927-9531-498f-be65-4f8109a9bae4 req-0c1d3914-92ef-47db-8126-fc99e4b764b1 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.062863 May 14 15:57:59.992226 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: [pid: 128729|app: 0|req: 600/1219] 10.222.0.61 () {64 vars in 1317 bytes} [Sat May 14 15:57:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 14 15:58:00.260196 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi [None req-b1a13ba8-6185-4085-be23-c82f109b904f tempest-VolumesSnapshotTestJSON-671752898 tempest-VolumesSnapshotTestJSON-671752898-project] Calling method '>' {{(pid=128728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 15:58:00.260839 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.compute.api [None req-b1a13ba8-6185-4085-be23-c82f109b904f tempest-VolumesSnapshotTestJSON-671752898 tempest-VolumesSnapshotTestJSON-671752898-project] [instance: 25202ac2-6830-4d26-83fc-803adeb71796] Fetching instance by UUID {{(pid=128728) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 15:58:00.267657 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-b1a13ba8-6185-4085-be23-c82f109b904f tempest-VolumesSnapshotTestJSON-671752898 tempest-VolumesSnapshotTestJSON-671752898-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:58:00.268109 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-b1a13ba8-6185-4085-be23-c82f109b904f tempest-VolumesSnapshotTestJSON-671752898 tempest-VolumesSnapshotTestJSON-671752898-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:58:00.268885 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-b1a13ba8-6185-4085-be23-c82f109b904f tempest-VolumesSnapshotTestJSON-671752898 tempest-VolumesSnapshotTestJSON-671752898-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:58:00.269325 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-b1a13ba8-6185-4085-be23-c82f109b904f tempest-VolumesSnapshotTestJSON-671752898 tempest-VolumesSnapshotTestJSON-671752898-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:58:00.410910 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.policy [None req-b1a13ba8-6185-4085-be23-c82f109b904f tempest-VolumesSnapshotTestJSON-671752898 tempest-VolumesSnapshotTestJSON-671752898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3e4193c9d9043c99ee5bee59f79f7a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ad8088ecb8a4f72a98ad70fa8be02b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128728) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:58:00.419450 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: INFO nova.api.openstack.requestlog [None req-b1a13ba8-6185-4085-be23-c82f109b904f tempest-VolumesSnapshotTestJSON-671752898 tempest-VolumesSnapshotTestJSON-671752898-project] 10.222.0.61 "GET /compute/v2.1/servers/25202ac2-6830-4d26-83fc-803adeb71796" status: 200 len: 1318 microversion: 2.1 time: 0.163126 May 14 15:58:00.420250 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: [pid: 128728|app: 0|req: 620/1220] 10.222.0.61 () {58 vars in 1235 bytes} [Sat May 14 15:58:00 2022] GET /compute/v2.1/servers/25202ac2-6830-4d26-83fc-803adeb71796 => generated 1318 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 15:58:01.440297 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi [None req-dce49faf-5fbc-425e-9dcf-3efed6196df9 tempest-VolumesSnapshotTestJSON-671752898 tempest-VolumesSnapshotTestJSON-671752898-project] Calling method '>' {{(pid=128729) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 15:58:01.440297 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.compute.api [None req-dce49faf-5fbc-425e-9dcf-3efed6196df9 tempest-VolumesSnapshotTestJSON-671752898 tempest-VolumesSnapshotTestJSON-671752898-project] [instance: 25202ac2-6830-4d26-83fc-803adeb71796] Fetching instance by UUID {{(pid=128729) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 15:58:01.447597 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-dce49faf-5fbc-425e-9dcf-3efed6196df9 tempest-VolumesSnapshotTestJSON-671752898 tempest-VolumesSnapshotTestJSON-671752898-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:58:01.448217 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-dce49faf-5fbc-425e-9dcf-3efed6196df9 tempest-VolumesSnapshotTestJSON-671752898 tempest-VolumesSnapshotTestJSON-671752898-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:58:01.449557 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-dce49faf-5fbc-425e-9dcf-3efed6196df9 tempest-VolumesSnapshotTestJSON-671752898 tempest-VolumesSnapshotTestJSON-671752898-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:58:01.450040 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-dce49faf-5fbc-425e-9dcf-3efed6196df9 tempest-VolumesSnapshotTestJSON-671752898 tempest-VolumesSnapshotTestJSON-671752898-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:58:01.673795 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.policy [None req-dce49faf-5fbc-425e-9dcf-3efed6196df9 tempest-VolumesSnapshotTestJSON-671752898 tempest-VolumesSnapshotTestJSON-671752898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3e4193c9d9043c99ee5bee59f79f7a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ad8088ecb8a4f72a98ad70fa8be02b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128729) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:58:01.684807 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: INFO nova.api.openstack.requestlog [None req-dce49faf-5fbc-425e-9dcf-3efed6196df9 tempest-VolumesSnapshotTestJSON-671752898 tempest-VolumesSnapshotTestJSON-671752898-project] 10.222.0.61 "GET /compute/v2.1/servers/25202ac2-6830-4d26-83fc-803adeb71796" status: 200 len: 1318 microversion: 2.1 time: 0.252101 May 14 15:58:01.687283 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: [pid: 128729|app: 0|req: 601/1221] 10.222.0.61 () {58 vars in 1235 bytes} [Sat May 14 15:58:01 2022] GET /compute/v2.1/servers/25202ac2-6830-4d26-83fc-803adeb71796 => generated 1318 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 15:58:02.702388 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi [None req-77f57797-283b-4f9c-ae44-ba0957f6adc0 tempest-VolumesSnapshotTestJSON-671752898 tempest-VolumesSnapshotTestJSON-671752898-project] Calling method '>' {{(pid=128728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 15:58:02.703598 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.compute.api [None req-77f57797-283b-4f9c-ae44-ba0957f6adc0 tempest-VolumesSnapshotTestJSON-671752898 tempest-VolumesSnapshotTestJSON-671752898-project] [instance: 25202ac2-6830-4d26-83fc-803adeb71796] Fetching instance by UUID {{(pid=128728) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 15:58:02.710733 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-77f57797-283b-4f9c-ae44-ba0957f6adc0 tempest-VolumesSnapshotTestJSON-671752898 tempest-VolumesSnapshotTestJSON-671752898-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:58:02.711189 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-77f57797-283b-4f9c-ae44-ba0957f6adc0 tempest-VolumesSnapshotTestJSON-671752898 tempest-VolumesSnapshotTestJSON-671752898-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:58:02.712155 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-77f57797-283b-4f9c-ae44-ba0957f6adc0 tempest-VolumesSnapshotTestJSON-671752898 tempest-VolumesSnapshotTestJSON-671752898-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:58:02.712601 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-77f57797-283b-4f9c-ae44-ba0957f6adc0 tempest-VolumesSnapshotTestJSON-671752898 tempest-VolumesSnapshotTestJSON-671752898-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:58:02.863284 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.policy [None req-77f57797-283b-4f9c-ae44-ba0957f6adc0 tempest-VolumesSnapshotTestJSON-671752898 tempest-VolumesSnapshotTestJSON-671752898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3e4193c9d9043c99ee5bee59f79f7a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ad8088ecb8a4f72a98ad70fa8be02b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128728) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:58:02.874559 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: INFO nova.api.openstack.requestlog [None req-77f57797-283b-4f9c-ae44-ba0957f6adc0 tempest-VolumesSnapshotTestJSON-671752898 tempest-VolumesSnapshotTestJSON-671752898-project] 10.222.0.61 "GET /compute/v2.1/servers/25202ac2-6830-4d26-83fc-803adeb71796" status: 200 len: 1507 microversion: 2.1 time: 0.177306 May 14 15:58:02.875536 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: [pid: 128728|app: 0|req: 621/1222] 10.222.0.61 () {58 vars in 1235 bytes} [Sat May 14 15:58:02 2022] GET /compute/v2.1/servers/25202ac2-6830-4d26-83fc-803adeb71796 => generated 1507 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 15:58:02.892399 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi [None req-1cc98740-ccbf-4487-af1e-119338520806 tempest-VolumesSnapshotTestJSON-671752898 tempest-VolumesSnapshotTestJSON-671752898-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "08bc81b8-a817-4183-b583-7d294ca3d73b", "device": "/dev/sdb"}} {{(pid=128729) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 15:58:02.893508 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.compute.api [None req-1cc98740-ccbf-4487-af1e-119338520806 tempest-VolumesSnapshotTestJSON-671752898 tempest-VolumesSnapshotTestJSON-671752898-project] [instance: 25202ac2-6830-4d26-83fc-803adeb71796] Fetching instance by UUID {{(pid=128729) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 15:58:02.899759 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-1cc98740-ccbf-4487-af1e-119338520806 tempest-VolumesSnapshotTestJSON-671752898 tempest-VolumesSnapshotTestJSON-671752898-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:58:02.900215 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-1cc98740-ccbf-4487-af1e-119338520806 tempest-VolumesSnapshotTestJSON-671752898 tempest-VolumesSnapshotTestJSON-671752898-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:58:02.900996 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-1cc98740-ccbf-4487-af1e-119338520806 tempest-VolumesSnapshotTestJSON-671752898 tempest-VolumesSnapshotTestJSON-671752898-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:58:02.901435 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-1cc98740-ccbf-4487-af1e-119338520806 tempest-VolumesSnapshotTestJSON-671752898 tempest-VolumesSnapshotTestJSON-671752898-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:58:03.219313 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: INFO nova.api.openstack.requestlog [None req-1cc98740-ccbf-4487-af1e-119338520806 tempest-VolumesSnapshotTestJSON-671752898 tempest-VolumesSnapshotTestJSON-671752898-project] 10.222.0.61 "POST /compute/v2.1/servers/25202ac2-6830-4d26-83fc-803adeb71796/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.330536 May 14 15:58:03.225605 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: [pid: 128729|app: 0|req: 602/1223] 10.222.0.61 () {60 vars in 1322 bytes} [Sat May 14 15:58:02 2022] POST /compute/v2.1/servers/25202ac2-6830-4d26-83fc-803adeb71796/os-volume_attachments => generated 194 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 14 15:58:06.950398 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 14 15:58:06.951001 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: Sat May 14 15:58:06 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 14 15:58:11.206497 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi [None req-67ee6a31-c5ca-4243-b3a7-3aaeeef3f0f3 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Calling method '>' {{(pid=128728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 15:58:11.207484 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.compute.api [None req-67ee6a31-c5ca-4243-b3a7-3aaeeef3f0f3 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] [instance: cca08141-979e-4519-88b3-c77e8a71ae3e] Fetching instance by UUID {{(pid=128728) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 15:58:11.213533 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-67ee6a31-c5ca-4243-b3a7-3aaeeef3f0f3 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:58:11.213995 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-67ee6a31-c5ca-4243-b3a7-3aaeeef3f0f3 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:58:11.215544 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-67ee6a31-c5ca-4243-b3a7-3aaeeef3f0f3 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:58:11.216010 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-67ee6a31-c5ca-4243-b3a7-3aaeeef3f0f3 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:58:11.245054 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: INFO nova.api.openstack.requestlog [None req-67ee6a31-c5ca-4243-b3a7-3aaeeef3f0f3 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] 10.222.0.61 "GET /compute/v2.1/servers/cca08141-979e-4519-88b3-c77e8a71ae3e/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.042795 May 14 15:58:11.249104 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: [pid: 128728|app: 0|req: 622/1224] 10.222.0.61 () {60 vars in 1342 bytes} [Sat May 14 15:58:11 2022] GET /compute/v2.1/servers/cca08141-979e-4519-88b3-c77e8a71ae3e/os-volume_attachments => generated 25 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 15:58:11.303699 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi [None req-bd076416-6fd1-400c-b88c-54a4f44eb773 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Calling method '>' {{(pid=128729) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 15:58:11.304320 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.compute.api [None req-bd076416-6fd1-400c-b88c-54a4f44eb773 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] [instance: cca08141-979e-4519-88b3-c77e8a71ae3e] Fetching instance by UUID {{(pid=128729) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 15:58:11.311299 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-bd076416-6fd1-400c-b88c-54a4f44eb773 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:58:11.311824 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-bd076416-6fd1-400c-b88c-54a4f44eb773 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:58:11.312695 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-bd076416-6fd1-400c-b88c-54a4f44eb773 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:58:11.313192 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-bd076416-6fd1-400c-b88c-54a4f44eb773 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:58:11.338090 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.compute.api [None req-bd076416-6fd1-400c-b88c-54a4f44eb773 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] [instance: cca08141-979e-4519-88b3-c77e8a71ae3e] Going to try to terminate instance {{(pid=128729) delete /opt/stack/nova/nova/compute/api.py:2664}} May 14 15:58:11.415808 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: INFO nova.api.openstack.requestlog [None req-bd076416-6fd1-400c-b88c-54a4f44eb773 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] 10.222.0.61 "DELETE /compute/v2.1/servers/cca08141-979e-4519-88b3-c77e8a71ae3e" status: 204 len: 0 microversion: 2.20 time: 0.116338 May 14 15:58:11.416761 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: [pid: 128729|app: 0|req: 603/1225] 10.222.0.61 () {60 vars in 1279 bytes} [Sat May 14 15:58:11 2022] DELETE /compute/v2.1/servers/cca08141-979e-4519-88b3-c77e8a71ae3e => generated 0 bytes in 118 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) May 14 15:58:11.430018 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi [None req-4dbabced-5575-46d4-92c0-a83ac528efc5 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Calling method '>' {{(pid=128728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 15:58:11.430658 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.compute.api [None req-4dbabced-5575-46d4-92c0-a83ac528efc5 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] [instance: cca08141-979e-4519-88b3-c77e8a71ae3e] Fetching instance by UUID {{(pid=128728) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 15:58:11.436726 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-4dbabced-5575-46d4-92c0-a83ac528efc5 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:58:11.437179 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-4dbabced-5575-46d4-92c0-a83ac528efc5 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:58:11.437966 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-4dbabced-5575-46d4-92c0-a83ac528efc5 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:58:11.438451 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-4dbabced-5575-46d4-92c0-a83ac528efc5 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:58:11.569871 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.policy [None req-4dbabced-5575-46d4-92c0-a83ac528efc5 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58bfb7417bc94583963401ae0fe9d39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0672be3fa3f7414da1c1a5b7300abbe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128728) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:58:11.578851 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.policy [None req-4dbabced-5575-46d4-92c0-a83ac528efc5 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58bfb7417bc94583963401ae0fe9d39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0672be3fa3f7414da1c1a5b7300abbe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128728) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:58:11.580354 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.policy [None req-4dbabced-5575-46d4-92c0-a83ac528efc5 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58bfb7417bc94583963401ae0fe9d39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0672be3fa3f7414da1c1a5b7300abbe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128728) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:58:11.581513 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: INFO nova.api.openstack.requestlog [None req-4dbabced-5575-46d4-92c0-a83ac528efc5 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] 10.222.0.61 "GET /compute/v2.1/servers/cca08141-979e-4519-88b3-c77e8a71ae3e" status: 200 len: 1724 microversion: 2.20 time: 0.155385 May 14 15:58:11.582064 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: [pid: 128728|app: 0|req: 623/1226] 10.222.0.61 () {60 vars in 1276 bytes} [Sat May 14 15:58:11 2022] GET /compute/v2.1/servers/cca08141-979e-4519-88b3-c77e8a71ae3e => generated 1724 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 14 15:58:12.601045 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi [None req-d30a9290-df6e-4ee5-a7d4-fd5bb5682487 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Calling method '>' {{(pid=128729) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 15:58:12.601745 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.compute.api [None req-d30a9290-df6e-4ee5-a7d4-fd5bb5682487 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] [instance: cca08141-979e-4519-88b3-c77e8a71ae3e] Fetching instance by UUID {{(pid=128729) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 15:58:12.608069 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-d30a9290-df6e-4ee5-a7d4-fd5bb5682487 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:58:12.608518 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-d30a9290-df6e-4ee5-a7d4-fd5bb5682487 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:58:12.609287 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-d30a9290-df6e-4ee5-a7d4-fd5bb5682487 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:58:12.609723 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-d30a9290-df6e-4ee5-a7d4-fd5bb5682487 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:58:12.733672 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.policy [None req-d30a9290-df6e-4ee5-a7d4-fd5bb5682487 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58bfb7417bc94583963401ae0fe9d39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0672be3fa3f7414da1c1a5b7300abbe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128729) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:58:12.741383 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.policy [None req-d30a9290-df6e-4ee5-a7d4-fd5bb5682487 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58bfb7417bc94583963401ae0fe9d39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0672be3fa3f7414da1c1a5b7300abbe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128729) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:58:12.742933 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.policy [None req-d30a9290-df6e-4ee5-a7d4-fd5bb5682487 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58bfb7417bc94583963401ae0fe9d39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0672be3fa3f7414da1c1a5b7300abbe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128729) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:58:12.744357 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: INFO nova.api.openstack.requestlog [None req-d30a9290-df6e-4ee5-a7d4-fd5bb5682487 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] 10.222.0.61 "GET /compute/v2.1/servers/cca08141-979e-4519-88b3-c77e8a71ae3e" status: 200 len: 1724 microversion: 2.20 time: 0.147670 May 14 15:58:12.744913 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: [pid: 128729|app: 0|req: 604/1227] 10.222.0.61 () {60 vars in 1276 bytes} [Sat May 14 15:58:12 2022] GET /compute/v2.1/servers/cca08141-979e-4519-88b3-c77e8a71ae3e => generated 1724 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 14 15:58:13.764665 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi [None req-0f04ac21-b4af-4182-901c-9ad25c78883f tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Calling method '>' {{(pid=128728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 15:58:13.765358 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.compute.api [None req-0f04ac21-b4af-4182-901c-9ad25c78883f tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] [instance: cca08141-979e-4519-88b3-c77e8a71ae3e] Fetching instance by UUID {{(pid=128728) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 15:58:13.771536 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-0f04ac21-b4af-4182-901c-9ad25c78883f tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:58:13.771984 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-0f04ac21-b4af-4182-901c-9ad25c78883f tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:58:13.772752 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-0f04ac21-b4af-4182-901c-9ad25c78883f tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:58:13.773187 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-0f04ac21-b4af-4182-901c-9ad25c78883f tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:58:13.908452 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.policy [None req-0f04ac21-b4af-4182-901c-9ad25c78883f tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58bfb7417bc94583963401ae0fe9d39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0672be3fa3f7414da1c1a5b7300abbe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128728) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:58:13.916879 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.policy [None req-0f04ac21-b4af-4182-901c-9ad25c78883f tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58bfb7417bc94583963401ae0fe9d39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0672be3fa3f7414da1c1a5b7300abbe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128728) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:58:13.918643 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.policy [None req-0f04ac21-b4af-4182-901c-9ad25c78883f tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58bfb7417bc94583963401ae0fe9d39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0672be3fa3f7414da1c1a5b7300abbe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128728) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:58:13.919869 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: INFO nova.api.openstack.requestlog [None req-0f04ac21-b4af-4182-901c-9ad25c78883f tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] 10.222.0.61 "GET /compute/v2.1/servers/cca08141-979e-4519-88b3-c77e8a71ae3e" status: 200 len: 1724 microversion: 2.20 time: 0.159662 May 14 15:58:13.920435 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: [pid: 128728|app: 0|req: 624/1228] 10.222.0.61 () {60 vars in 1276 bytes} [Sat May 14 15:58:13 2022] GET /compute/v2.1/servers/cca08141-979e-4519-88b3-c77e8a71ae3e => generated 1724 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 14 15:58:14.938114 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi [None req-b7bcc3e7-c51e-4a36-873f-320001bb5838 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Calling method '>' {{(pid=128729) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 15:58:14.938751 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.compute.api [None req-b7bcc3e7-c51e-4a36-873f-320001bb5838 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] [instance: cca08141-979e-4519-88b3-c77e8a71ae3e] Fetching instance by UUID {{(pid=128729) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 15:58:14.945254 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-b7bcc3e7-c51e-4a36-873f-320001bb5838 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:58:14.945707 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-b7bcc3e7-c51e-4a36-873f-320001bb5838 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:58:14.946530 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-b7bcc3e7-c51e-4a36-873f-320001bb5838 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:58:14.946977 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-b7bcc3e7-c51e-4a36-873f-320001bb5838 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:58:15.072095 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.policy [None req-b7bcc3e7-c51e-4a36-873f-320001bb5838 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58bfb7417bc94583963401ae0fe9d39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0672be3fa3f7414da1c1a5b7300abbe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128729) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:58:15.080553 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.policy [None req-b7bcc3e7-c51e-4a36-873f-320001bb5838 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58bfb7417bc94583963401ae0fe9d39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0672be3fa3f7414da1c1a5b7300abbe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128729) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:58:15.082061 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.policy [None req-b7bcc3e7-c51e-4a36-873f-320001bb5838 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58bfb7417bc94583963401ae0fe9d39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0672be3fa3f7414da1c1a5b7300abbe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128729) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:58:15.083244 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: INFO nova.api.openstack.requestlog [None req-b7bcc3e7-c51e-4a36-873f-320001bb5838 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] 10.222.0.61 "GET /compute/v2.1/servers/cca08141-979e-4519-88b3-c77e8a71ae3e" status: 200 len: 1724 microversion: 2.20 time: 0.148978 May 14 15:58:15.083797 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: [pid: 128729|app: 0|req: 605/1229] 10.222.0.61 () {60 vars in 1276 bytes} [Sat May 14 15:58:14 2022] GET /compute/v2.1/servers/cca08141-979e-4519-88b3-c77e8a71ae3e => generated 1724 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 14 15:58:16.101640 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi [None req-53b9b0c6-7f09-4542-b973-9753cf640998 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Calling method '>' {{(pid=128728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 15:58:16.102265 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.compute.api [None req-53b9b0c6-7f09-4542-b973-9753cf640998 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] [instance: cca08141-979e-4519-88b3-c77e8a71ae3e] Fetching instance by UUID {{(pid=128728) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 15:58:16.108977 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-53b9b0c6-7f09-4542-b973-9753cf640998 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:58:16.109435 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-53b9b0c6-7f09-4542-b973-9753cf640998 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:58:16.110212 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-53b9b0c6-7f09-4542-b973-9753cf640998 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:58:16.110682 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-53b9b0c6-7f09-4542-b973-9753cf640998 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:58:16.241196 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.policy [None req-53b9b0c6-7f09-4542-b973-9753cf640998 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58bfb7417bc94583963401ae0fe9d39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0672be3fa3f7414da1c1a5b7300abbe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128728) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:58:16.249631 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.policy [None req-53b9b0c6-7f09-4542-b973-9753cf640998 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58bfb7417bc94583963401ae0fe9d39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0672be3fa3f7414da1c1a5b7300abbe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128728) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:58:16.251171 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.policy [None req-53b9b0c6-7f09-4542-b973-9753cf640998 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58bfb7417bc94583963401ae0fe9d39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0672be3fa3f7414da1c1a5b7300abbe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128728) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:58:16.252339 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: INFO nova.api.openstack.requestlog [None req-53b9b0c6-7f09-4542-b973-9753cf640998 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] 10.222.0.61 "GET /compute/v2.1/servers/cca08141-979e-4519-88b3-c77e8a71ae3e" status: 200 len: 1724 microversion: 2.20 time: 0.154588 May 14 15:58:16.252900 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: [pid: 128728|app: 0|req: 625/1230] 10.222.0.61 () {60 vars in 1276 bytes} [Sat May 14 15:58:16 2022] GET /compute/v2.1/servers/cca08141-979e-4519-88b3-c77e8a71ae3e => generated 1724 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 14 15:58:17.272031 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi [None req-fbcca174-97bb-4c89-b6dc-ccf1cfeb5211 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Calling method '>' {{(pid=128729) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 15:58:17.272639 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.compute.api [None req-fbcca174-97bb-4c89-b6dc-ccf1cfeb5211 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] [instance: cca08141-979e-4519-88b3-c77e8a71ae3e] Fetching instance by UUID {{(pid=128729) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 15:58:17.279925 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-fbcca174-97bb-4c89-b6dc-ccf1cfeb5211 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:58:17.280326 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-fbcca174-97bb-4c89-b6dc-ccf1cfeb5211 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:58:17.280961 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-fbcca174-97bb-4c89-b6dc-ccf1cfeb5211 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:58:17.281396 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-fbcca174-97bb-4c89-b6dc-ccf1cfeb5211 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:58:17.426638 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.policy [None req-fbcca174-97bb-4c89-b6dc-ccf1cfeb5211 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58bfb7417bc94583963401ae0fe9d39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0672be3fa3f7414da1c1a5b7300abbe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128729) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:58:17.435397 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.policy [None req-fbcca174-97bb-4c89-b6dc-ccf1cfeb5211 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58bfb7417bc94583963401ae0fe9d39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0672be3fa3f7414da1c1a5b7300abbe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128729) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:58:17.438182 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.policy [None req-fbcca174-97bb-4c89-b6dc-ccf1cfeb5211 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58bfb7417bc94583963401ae0fe9d39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0672be3fa3f7414da1c1a5b7300abbe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128729) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:58:17.438909 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: INFO nova.api.openstack.requestlog [None req-fbcca174-97bb-4c89-b6dc-ccf1cfeb5211 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] 10.222.0.61 "GET /compute/v2.1/servers/cca08141-979e-4519-88b3-c77e8a71ae3e" status: 200 len: 1724 microversion: 2.20 time: 0.170903 May 14 15:58:17.445287 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: [pid: 128729|app: 0|req: 606/1231] 10.222.0.61 () {60 vars in 1276 bytes} [Sat May 14 15:58:17 2022] GET /compute/v2.1/servers/cca08141-979e-4519-88b3-c77e8a71ae3e => generated 1724 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 14 15:58:17.912304 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi [req-8223c48d-da93-427b-9533-033b37d14f64 req-8955ab11-6559-4a66-9215-edf360872f57 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cca08141-979e-4519-88b3-c77e8a71ae3e", "name": "network-vif-deleted", "tag": "e23afae5-7b01-4137-a087-ba1a741fd1f4"}]} {{(pid=128728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 15:58:17.922546 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [req-8223c48d-da93-427b-9533-033b37d14f64 req-8955ab11-6559-4a66-9215-edf360872f57 service nova] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:58:17.923370 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [req-8223c48d-da93-427b-9533-033b37d14f64 req-8955ab11-6559-4a66-9215-edf360872f57 service nova] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:58:17.936412 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: INFO nova.api.openstack.compute.server_external_events [req-8223c48d-da93-427b-9533-033b37d14f64 req-8955ab11-6559-4a66-9215-edf360872f57 service nova] Creating event network-vif-deleted:e23afae5-7b01-4137-a087-ba1a741fd1f4 for instance cca08141-979e-4519-88b3-c77e8a71ae3e on hv-cinder-83979 May 14 15:58:17.945353 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: INFO nova.api.openstack.requestlog [req-8223c48d-da93-427b-9533-033b37d14f64 req-8955ab11-6559-4a66-9215-edf360872f57 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036957 May 14 15:58:17.946994 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: [pid: 128728|app: 0|req: 626/1232] 10.222.0.61 () {64 vars in 1317 bytes} [Sat May 14 15:58:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 14 15:58:18.457856 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi [None req-ec2c9096-3670-4b90-b8a6-477879ecf620 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Calling method '>' {{(pid=128729) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 15:58:18.458696 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.compute.api [None req-ec2c9096-3670-4b90-b8a6-477879ecf620 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] [instance: cca08141-979e-4519-88b3-c77e8a71ae3e] Fetching instance by UUID {{(pid=128729) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 15:58:18.466123 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-ec2c9096-3670-4b90-b8a6-477879ecf620 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:58:18.467305 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-ec2c9096-3670-4b90-b8a6-477879ecf620 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:58:18.468427 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-ec2c9096-3670-4b90-b8a6-477879ecf620 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:58:18.468427 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-ec2c9096-3670-4b90-b8a6-477879ecf620 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:58:18.536310 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.policy [None req-ec2c9096-3670-4b90-b8a6-477879ecf620 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58bfb7417bc94583963401ae0fe9d39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0672be3fa3f7414da1c1a5b7300abbe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128729) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:58:18.545453 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.policy [None req-ec2c9096-3670-4b90-b8a6-477879ecf620 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58bfb7417bc94583963401ae0fe9d39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0672be3fa3f7414da1c1a5b7300abbe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128729) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:58:18.547153 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.policy [None req-ec2c9096-3670-4b90-b8a6-477879ecf620 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58bfb7417bc94583963401ae0fe9d39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0672be3fa3f7414da1c1a5b7300abbe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128729) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:58:18.548436 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: INFO nova.api.openstack.requestlog [None req-ec2c9096-3670-4b90-b8a6-477879ecf620 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] 10.222.0.61 "GET /compute/v2.1/servers/cca08141-979e-4519-88b3-c77e8a71ae3e" status: 200 len: 1656 microversion: 2.20 time: 0.095204 May 14 15:58:18.556597 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: [pid: 128729|app: 0|req: 607/1233] 10.222.0.61 () {60 vars in 1276 bytes} [Sat May 14 15:58:18 2022] GET /compute/v2.1/servers/cca08141-979e-4519-88b3-c77e8a71ae3e => generated 1656 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 14 15:58:19.568434 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi [None req-84ab9827-8b78-48fc-a3f9-be3ad6096bd9 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Calling method '>' {{(pid=128728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 15:58:19.569132 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.compute.api [None req-84ab9827-8b78-48fc-a3f9-be3ad6096bd9 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] [instance: cca08141-979e-4519-88b3-c77e8a71ae3e] Fetching instance by UUID {{(pid=128728) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 15:58:19.575146 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-84ab9827-8b78-48fc-a3f9-be3ad6096bd9 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:58:19.575587 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-84ab9827-8b78-48fc-a3f9-be3ad6096bd9 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:58:19.576398 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-84ab9827-8b78-48fc-a3f9-be3ad6096bd9 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:58:19.576830 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-84ab9827-8b78-48fc-a3f9-be3ad6096bd9 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:58:19.639882 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.policy [None req-84ab9827-8b78-48fc-a3f9-be3ad6096bd9 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58bfb7417bc94583963401ae0fe9d39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0672be3fa3f7414da1c1a5b7300abbe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128728) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:58:19.648054 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.policy [None req-84ab9827-8b78-48fc-a3f9-be3ad6096bd9 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58bfb7417bc94583963401ae0fe9d39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0672be3fa3f7414da1c1a5b7300abbe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128728) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:58:19.649564 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.policy [None req-84ab9827-8b78-48fc-a3f9-be3ad6096bd9 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58bfb7417bc94583963401ae0fe9d39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0672be3fa3f7414da1c1a5b7300abbe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128728) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:58:19.650723 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: INFO nova.api.openstack.requestlog [None req-84ab9827-8b78-48fc-a3f9-be3ad6096bd9 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] 10.222.0.61 "GET /compute/v2.1/servers/cca08141-979e-4519-88b3-c77e8a71ae3e" status: 200 len: 1367 microversion: 2.20 time: 0.086869 May 14 15:58:19.651277 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: [pid: 128728|app: 0|req: 627/1234] 10.222.0.61 () {60 vars in 1276 bytes} [Sat May 14 15:58:19 2022] GET /compute/v2.1/servers/cca08141-979e-4519-88b3-c77e8a71ae3e => generated 1367 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 14 15:58:20.669569 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi [None req-6c39e828-28ca-405d-ac51-02834d61caf0 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Calling method '>' {{(pid=128729) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 15:58:20.670207 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.compute.api [None req-6c39e828-28ca-405d-ac51-02834d61caf0 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] [instance: cca08141-979e-4519-88b3-c77e8a71ae3e] Fetching instance by UUID {{(pid=128729) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 15:58:20.676467 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-6c39e828-28ca-405d-ac51-02834d61caf0 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:58:20.676918 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-6c39e828-28ca-405d-ac51-02834d61caf0 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:58:20.677714 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-6c39e828-28ca-405d-ac51-02834d61caf0 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:58:20.678151 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-6c39e828-28ca-405d-ac51-02834d61caf0 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:58:20.740668 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.policy [None req-6c39e828-28ca-405d-ac51-02834d61caf0 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58bfb7417bc94583963401ae0fe9d39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0672be3fa3f7414da1c1a5b7300abbe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128729) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:58:20.748830 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.policy [None req-6c39e828-28ca-405d-ac51-02834d61caf0 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58bfb7417bc94583963401ae0fe9d39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0672be3fa3f7414da1c1a5b7300abbe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128729) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:58:20.750352 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.policy [None req-6c39e828-28ca-405d-ac51-02834d61caf0 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58bfb7417bc94583963401ae0fe9d39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0672be3fa3f7414da1c1a5b7300abbe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128729) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:58:20.751559 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: INFO nova.api.openstack.requestlog [None req-6c39e828-28ca-405d-ac51-02834d61caf0 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] 10.222.0.61 "GET /compute/v2.1/servers/cca08141-979e-4519-88b3-c77e8a71ae3e" status: 200 len: 1367 microversion: 2.20 time: 0.086175 May 14 15:58:20.752190 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: [pid: 128729|app: 0|req: 608/1235] 10.222.0.61 () {60 vars in 1276 bytes} [Sat May 14 15:58:20 2022] GET /compute/v2.1/servers/cca08141-979e-4519-88b3-c77e8a71ae3e => generated 1367 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 14 15:58:21.770584 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi [None req-389a494f-cf49-42f6-856f-ef2f0c9011d7 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Calling method '>' {{(pid=128728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 15:58:21.771273 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.compute.api [None req-389a494f-cf49-42f6-856f-ef2f0c9011d7 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] [instance: cca08141-979e-4519-88b3-c77e8a71ae3e] Fetching instance by UUID {{(pid=128728) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 15:58:21.778215 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-389a494f-cf49-42f6-856f-ef2f0c9011d7 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:58:21.778686 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-389a494f-cf49-42f6-856f-ef2f0c9011d7 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:58:21.779455 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-389a494f-cf49-42f6-856f-ef2f0c9011d7 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:58:21.779894 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-389a494f-cf49-42f6-856f-ef2f0c9011d7 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:58:21.811623 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-389a494f-cf49-42f6-856f-ef2f0c9011d7 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:58:21.812070 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-389a494f-cf49-42f6-856f-ef2f0c9011d7 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:58:21.812517 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.objects.instance [None req-389a494f-cf49-42f6-856f-ef2f0c9011d7 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Lazy-loading 'fault' on Instance uuid cca08141-979e-4519-88b3-c77e8a71ae3e {{(pid=128728) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 14 15:58:21.853019 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.policy [None req-389a494f-cf49-42f6-856f-ef2f0c9011d7 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58bfb7417bc94583963401ae0fe9d39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0672be3fa3f7414da1c1a5b7300abbe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128728) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:58:21.861818 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.policy [None req-389a494f-cf49-42f6-856f-ef2f0c9011d7 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58bfb7417bc94583963401ae0fe9d39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0672be3fa3f7414da1c1a5b7300abbe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128728) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:58:21.863395 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.policy [None req-389a494f-cf49-42f6-856f-ef2f0c9011d7 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58bfb7417bc94583963401ae0fe9d39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0672be3fa3f7414da1c1a5b7300abbe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128728) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:58:21.864690 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: INFO nova.api.openstack.requestlog [None req-389a494f-cf49-42f6-856f-ef2f0c9011d7 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] 10.222.0.61 "GET /compute/v2.1/servers/cca08141-979e-4519-88b3-c77e8a71ae3e" status: 200 len: 1372 microversion: 2.20 time: 0.098036 May 14 15:58:21.865254 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: [pid: 128728|app: 0|req: 628/1236] 10.222.0.61 () {60 vars in 1276 bytes} [Sat May 14 15:58:21 2022] GET /compute/v2.1/servers/cca08141-979e-4519-88b3-c77e8a71ae3e => generated 1372 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 14 15:58:22.883729 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi [None req-145dfe20-958b-403f-9da9-f07c0d7fd954 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Calling method '>' {{(pid=128729) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 15:58:22.884331 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.compute.api [None req-145dfe20-958b-403f-9da9-f07c0d7fd954 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] [instance: cca08141-979e-4519-88b3-c77e8a71ae3e] Fetching instance by UUID {{(pid=128729) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 15:58:22.890792 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-145dfe20-958b-403f-9da9-f07c0d7fd954 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:58:22.891187 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-145dfe20-958b-403f-9da9-f07c0d7fd954 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:58:22.891948 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-145dfe20-958b-403f-9da9-f07c0d7fd954 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:58:22.892395 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-145dfe20-958b-403f-9da9-f07c0d7fd954 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:58:22.905389 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: INFO nova.api.openstack.wsgi [None req-145dfe20-958b-403f-9da9-f07c0d7fd954 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] HTTP exception thrown: Instance cca08141-979e-4519-88b3-c77e8a71ae3e could not be found. May 14 15:58:22.907056 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi [None req-145dfe20-958b-403f-9da9-f07c0d7fd954 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Request method failure captured: May 14 15:58:22.907056 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: request: GET /compute/v2.1/servers/cca08141-979e-4519-88b3-c77e8a71ae3e HTTP/1.1 May 14 15:58:22.907056 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: Accept: application/json May 14 15:58:22.907056 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: Accept-Encoding: identity May 14 15:58:22.907056 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: Connection: close May 14 15:58:22.907056 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: Content-Length: 0 May 14 15:58:22.907056 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: Content-Type: application/json May 14 15:58:22.907056 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: Host: 10.222.0.61 May 14 15:58:22.907056 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: Openstack-System-Scope: None May 14 15:58:22.907056 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: User-Agent: python-urllib3/1.26.9 May 14 15:58:22.907056 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: X-Auth-Token: gAAAAABif87cXLSpyUu3a9K-vtFHqSpp1aQZW1jW-zQ2Idzmz1rv6VZ5naJZjx_0Ztni3S2PMUUkq4rTnJcFNAekAJmOB4fA7zofP6VQEp1yk3kHJThjsksUCeoFnGR1cQkBPZsCy1zToVK3Lc8wCHUoVwX7ZZ0iyqkTplJDA-CIW3iXuuBg1p8 May 14 15:58:22.907056 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: X-Domain-Id: None May 14 15:58:22.907056 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: X-Domain-Name: None May 14 15:58:22.907056 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: X-Identity-Status: Confirmed May 14 15:58:22.907056 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: X-Is-Admin-Project: True May 14 15:58:22.907056 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: X-Openstack-Nova-Api-Version: 2.20 May 14 15:58:22.907056 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: X-Project-Domain-Id: default May 14 15:58:22.907056 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: X-Project-Domain-Name: Default May 14 15:58:22.907056 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: X-Project-Id: 0672be3fa3f7414da1c1a5b7300abbe7 May 14 15:58:22.907056 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1739561036 May 14 15:58:22.907056 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: X-Role: reader,member May 14 15:58:22.907056 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: X-Roles: reader,member May 14 15:58:22.908843 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/0672be3fa3f7414da1c1a5b7300abbe7"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/0672be3fa3f7414da1c1a5b7300abbe7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/0672be3fa3f7414da1c1a5b7300abbe7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_0672be3fa3f7414da1c1a5b7300abbe7"}]}] May 14 15:58:22.908843 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1739561036 May 14 15:58:22.908843 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: X-Tenant-Id: 0672be3fa3f7414da1c1a5b7300abbe7 May 14 15:58:22.908843 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1739561036 May 14 15:58:22.908843 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: X-User: tempest-AttachVolumeShelveTestJSON-1739561036-project May 14 15:58:22.908843 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: X-User-Domain-Id: default May 14 15:58:22.908843 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: X-User-Domain-Name: Default May 14 15:58:22.908843 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: X-User-Id: 58bfb7417bc94583963401ae0fe9d39a May 14 15:58:22.908843 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1739561036-project May 14 15:58:22.908843 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: method: > May 14 15:58:22.908843 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: exception: Instance cca08141-979e-4519-88b3-c77e8a71ae3e could not be found. May 14 15:58:22.908843 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: action_args: {'id': 'cca08141-979e-4519-88b3-c77e8a71ae3e'} May 14 15:58:22.909791 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: {{(pid=128729) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 14 15:58:22.909791 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 15:58:22.909791 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 14 15:58:22.909791 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 14 15:58:22.909791 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 14 15:58:22.909791 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 14 15:58:22.909791 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 14 15:58:22.909791 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 14 15:58:22.909791 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 14 15:58:22.909791 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 14 15:58:22.909791 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cca08141-979e-4519-88b3-c77e8a71ae3e could not be found. May 14 15:58:22.909791 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: ERROR nova.api.openstack.wsgi May 14 15:58:22.909791 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 14 15:58:22.909791 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: ERROR nova.api.openstack.wsgi May 14 15:58:22.909791 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 15:58:22.909791 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 14 15:58:22.909791 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 14 15:58:22.909791 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 14 15:58:22.909791 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 14 15:58:22.909791 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 14 15:58:22.911404 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 14 15:58:22.911404 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 14 15:58:22.911404 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 14 15:58:22.911404 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 14 15:58:22.911404 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 14 15:58:22.911404 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 14 15:58:22.911404 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 14 15:58:22.911404 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cca08141-979e-4519-88b3-c77e8a71ae3e could not be found. May 14 15:58:22.911404 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: ERROR nova.api.openstack.wsgi May 14 15:58:22.911404 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 14 15:58:22.911404 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: ERROR nova.api.openstack.wsgi May 14 15:58:22.911404 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 15:58:22.911404 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 14 15:58:22.911404 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 14 15:58:22.911404 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 14 15:58:22.911404 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 14 15:58:22.911404 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cca08141-979e-4519-88b3-c77e8a71ae3e could not be found. May 14 15:58:22.911404 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: ERROR nova.api.openstack.wsgi May 14 15:58:22.912866 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi [None req-145dfe20-958b-403f-9da9-f07c0d7fd954 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Returning 404 to user: Instance cca08141-979e-4519-88b3-c77e8a71ae3e could not be found. {{(pid=128729) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 14 15:58:22.912866 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: INFO nova.api.openstack.requestlog [None req-145dfe20-958b-403f-9da9-f07c0d7fd954 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] 10.222.0.61 "GET /compute/v2.1/servers/cca08141-979e-4519-88b3-c77e8a71ae3e" status: 404 len: 111 microversion: 2.20 time: 0.028836 May 14 15:58:22.912866 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: [pid: 128729|app: 0|req: 609/1237] 10.222.0.61 () {60 vars in 1276 bytes} [Sat May 14 15:58:22 2022] GET /compute/v2.1/servers/cca08141-979e-4519-88b3-c77e8a71ae3e => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) May 14 15:58:22.918032 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi [None req-618d1fd0-c32a-42da-a716-e664549f2b8c tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Calling method '.version_select at 0x7f77cb61caf0>' {{(pid=128728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 15:58:22.935683 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: INFO nova.api.openstack.requestlog [None req-618d1fd0-c32a-42da-a716-e664549f2b8c tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] 10.222.0.61 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1111285347" status: 204 len: 0 microversion: 2.20 time: 0.022029 May 14 15:58:22.936244 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: [pid: 128728|app: 0|req: 629/1238] 10.222.0.61 () {60 vars in 1261 bytes} [Sat May 14 15:58:22 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1111285347 => generated 0 bytes in 23 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) May 14 15:58:24.717214 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi [None req-9edfab28-f074-446d-9a92-b19c7b2c9907 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Calling method '>' {{(pid=128729) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 15:58:24.717719 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.compute.api [None req-9edfab28-f074-446d-9a92-b19c7b2c9907 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] [instance: cca08141-979e-4519-88b3-c77e8a71ae3e] Fetching instance by UUID {{(pid=128729) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 15:58:24.724256 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-9edfab28-f074-446d-9a92-b19c7b2c9907 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:58:24.724703 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-9edfab28-f074-446d-9a92-b19c7b2c9907 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:58:24.725466 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-9edfab28-f074-446d-9a92-b19c7b2c9907 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:58:24.725903 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-9edfab28-f074-446d-9a92-b19c7b2c9907 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:58:24.739784 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: INFO nova.api.openstack.wsgi [None req-9edfab28-f074-446d-9a92-b19c7b2c9907 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] HTTP exception thrown: Instance cca08141-979e-4519-88b3-c77e8a71ae3e could not be found. May 14 15:58:24.741267 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi [None req-9edfab28-f074-446d-9a92-b19c7b2c9907 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Request method failure captured: May 14 15:58:24.741267 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: request: DELETE /compute/v2.1/servers/cca08141-979e-4519-88b3-c77e8a71ae3e HTTP/1.1 May 14 15:58:24.741267 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: Accept: application/json May 14 15:58:24.741267 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: Accept-Encoding: identity May 14 15:58:24.741267 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: Connection: close May 14 15:58:24.741267 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: Content-Length: 0 May 14 15:58:24.741267 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: Content-Type: application/json May 14 15:58:24.741267 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: Host: 10.222.0.61 May 14 15:58:24.741267 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: Openstack-System-Scope: None May 14 15:58:24.741267 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: User-Agent: python-urllib3/1.26.9 May 14 15:58:24.741267 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: X-Auth-Token: gAAAAABif87cXLSpyUu3a9K-vtFHqSpp1aQZW1jW-zQ2Idzmz1rv6VZ5naJZjx_0Ztni3S2PMUUkq4rTnJcFNAekAJmOB4fA7zofP6VQEp1yk3kHJThjsksUCeoFnGR1cQkBPZsCy1zToVK3Lc8wCHUoVwX7ZZ0iyqkTplJDA-CIW3iXuuBg1p8 May 14 15:58:24.741267 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: X-Domain-Id: None May 14 15:58:24.741267 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: X-Domain-Name: None May 14 15:58:24.741267 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: X-Identity-Status: Confirmed May 14 15:58:24.741267 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: X-Is-Admin-Project: True May 14 15:58:24.741267 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: X-Openstack-Nova-Api-Version: 2.20 May 14 15:58:24.741267 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: X-Project-Domain-Id: default May 14 15:58:24.741267 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: X-Project-Domain-Name: Default May 14 15:58:24.741267 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: X-Project-Id: 0672be3fa3f7414da1c1a5b7300abbe7 May 14 15:58:24.741267 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1739561036 May 14 15:58:24.741267 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: X-Role: reader,member May 14 15:58:24.741267 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: X-Roles: reader,member May 14 15:58:24.743055 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/0672be3fa3f7414da1c1a5b7300abbe7"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/0672be3fa3f7414da1c1a5b7300abbe7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/0672be3fa3f7414da1c1a5b7300abbe7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_0672be3fa3f7414da1c1a5b7300abbe7"}]}] May 14 15:58:24.743055 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1739561036 May 14 15:58:24.743055 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: X-Tenant-Id: 0672be3fa3f7414da1c1a5b7300abbe7 May 14 15:58:24.743055 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1739561036 May 14 15:58:24.743055 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: X-User: tempest-AttachVolumeShelveTestJSON-1739561036-project May 14 15:58:24.743055 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: X-User-Domain-Id: default May 14 15:58:24.743055 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: X-User-Domain-Name: Default May 14 15:58:24.743055 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: X-User-Id: 58bfb7417bc94583963401ae0fe9d39a May 14 15:58:24.743055 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1739561036-project May 14 15:58:24.743055 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: method: > May 14 15:58:24.743055 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: exception: Instance cca08141-979e-4519-88b3-c77e8a71ae3e could not be found. May 14 15:58:24.743055 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: action_args: {'id': 'cca08141-979e-4519-88b3-c77e8a71ae3e'} May 14 15:58:24.744290 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: {{(pid=128729) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 14 15:58:24.744290 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 15:58:24.744290 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 14 15:58:24.744290 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 14 15:58:24.744290 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 14 15:58:24.744290 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 14 15:58:24.744290 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 14 15:58:24.744290 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 14 15:58:24.744290 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 14 15:58:24.744290 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 14 15:58:24.744290 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cca08141-979e-4519-88b3-c77e8a71ae3e could not be found. May 14 15:58:24.744290 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: ERROR nova.api.openstack.wsgi May 14 15:58:24.744290 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 14 15:58:24.744290 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: ERROR nova.api.openstack.wsgi May 14 15:58:24.744290 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 15:58:24.744290 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 14 15:58:24.744290 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 14 15:58:24.744290 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 14 15:58:24.744290 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 14 15:58:24.744290 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 14 15:58:24.746053 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 14 15:58:24.746053 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 14 15:58:24.746053 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 14 15:58:24.746053 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 14 15:58:24.746053 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 14 15:58:24.746053 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 14 15:58:24.746053 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 14 15:58:24.746053 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 14 15:58:24.746053 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 14 15:58:24.746053 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cca08141-979e-4519-88b3-c77e8a71ae3e could not be found. May 14 15:58:24.746053 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: ERROR nova.api.openstack.wsgi May 14 15:58:24.746053 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 14 15:58:24.746053 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: ERROR nova.api.openstack.wsgi May 14 15:58:24.746053 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 15:58:24.746053 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 14 15:58:24.746053 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 14 15:58:24.746053 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 14 15:58:24.746053 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 14 15:58:24.746053 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cca08141-979e-4519-88b3-c77e8a71ae3e could not be found. May 14 15:58:24.746053 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: ERROR nova.api.openstack.wsgi May 14 15:58:24.747459 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi [None req-9edfab28-f074-446d-9a92-b19c7b2c9907 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Returning 404 to user: Instance cca08141-979e-4519-88b3-c77e8a71ae3e could not be found. {{(pid=128729) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 14 15:58:24.747459 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: INFO nova.api.openstack.requestlog [None req-9edfab28-f074-446d-9a92-b19c7b2c9907 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] 10.222.0.61 "DELETE /compute/v2.1/servers/cca08141-979e-4519-88b3-c77e8a71ae3e" status: 404 len: 111 microversion: 2.20 time: 0.029459 May 14 15:58:24.747459 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: [pid: 128729|app: 0|req: 610/1239] 10.222.0.61 () {60 vars in 1279 bytes} [Sat May 14 15:58:24 2022] DELETE /compute/v2.1/servers/cca08141-979e-4519-88b3-c77e8a71ae3e => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) May 14 15:58:24.754157 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi [None req-10230612-2a0a-42b9-93ed-9e29302e8558 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Calling method '>' {{(pid=128728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 15:58:24.754854 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.compute.api [None req-10230612-2a0a-42b9-93ed-9e29302e8558 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] [instance: cca08141-979e-4519-88b3-c77e8a71ae3e] Fetching instance by UUID {{(pid=128728) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 15:58:24.763381 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-10230612-2a0a-42b9-93ed-9e29302e8558 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:58:24.763828 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-10230612-2a0a-42b9-93ed-9e29302e8558 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:58:24.764686 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-10230612-2a0a-42b9-93ed-9e29302e8558 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:58:24.765177 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-10230612-2a0a-42b9-93ed-9e29302e8558 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:58:24.784887 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: INFO nova.api.openstack.wsgi [None req-10230612-2a0a-42b9-93ed-9e29302e8558 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] HTTP exception thrown: Instance cca08141-979e-4519-88b3-c77e8a71ae3e could not be found. May 14 15:58:24.786746 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi [None req-10230612-2a0a-42b9-93ed-9e29302e8558 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Request method failure captured: May 14 15:58:24.786746 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: request: GET /compute/v2.1/servers/cca08141-979e-4519-88b3-c77e8a71ae3e HTTP/1.1 May 14 15:58:24.786746 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: Accept: application/json May 14 15:58:24.786746 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: Accept-Encoding: identity May 14 15:58:24.786746 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: Connection: close May 14 15:58:24.786746 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: Content-Length: 0 May 14 15:58:24.786746 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: Content-Type: application/json May 14 15:58:24.786746 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: Host: 10.222.0.61 May 14 15:58:24.786746 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: Openstack-System-Scope: None May 14 15:58:24.786746 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: User-Agent: python-urllib3/1.26.9 May 14 15:58:24.786746 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: X-Auth-Token: gAAAAABif87cXLSpyUu3a9K-vtFHqSpp1aQZW1jW-zQ2Idzmz1rv6VZ5naJZjx_0Ztni3S2PMUUkq4rTnJcFNAekAJmOB4fA7zofP6VQEp1yk3kHJThjsksUCeoFnGR1cQkBPZsCy1zToVK3Lc8wCHUoVwX7ZZ0iyqkTplJDA-CIW3iXuuBg1p8 May 14 15:58:24.786746 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: X-Domain-Id: None May 14 15:58:24.786746 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: X-Domain-Name: None May 14 15:58:24.786746 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: X-Identity-Status: Confirmed May 14 15:58:24.786746 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: X-Is-Admin-Project: True May 14 15:58:24.786746 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: X-Openstack-Nova-Api-Version: 2.20 May 14 15:58:24.786746 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: X-Project-Domain-Id: default May 14 15:58:24.786746 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: X-Project-Domain-Name: Default May 14 15:58:24.786746 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: X-Project-Id: 0672be3fa3f7414da1c1a5b7300abbe7 May 14 15:58:24.786746 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1739561036 May 14 15:58:24.786746 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: X-Role: reader,member May 14 15:58:24.786746 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: X-Roles: reader,member May 14 15:58:24.788456 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/0672be3fa3f7414da1c1a5b7300abbe7"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/0672be3fa3f7414da1c1a5b7300abbe7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/0672be3fa3f7414da1c1a5b7300abbe7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_0672be3fa3f7414da1c1a5b7300abbe7"}]}] May 14 15:58:24.788456 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1739561036 May 14 15:58:24.788456 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: X-Tenant-Id: 0672be3fa3f7414da1c1a5b7300abbe7 May 14 15:58:24.788456 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1739561036 May 14 15:58:24.788456 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: X-User: tempest-AttachVolumeShelveTestJSON-1739561036-project May 14 15:58:24.788456 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: X-User-Domain-Id: default May 14 15:58:24.788456 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: X-User-Domain-Name: Default May 14 15:58:24.788456 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: X-User-Id: 58bfb7417bc94583963401ae0fe9d39a May 14 15:58:24.788456 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1739561036-project May 14 15:58:24.788456 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: method: > May 14 15:58:24.788456 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: exception: Instance cca08141-979e-4519-88b3-c77e8a71ae3e could not be found. May 14 15:58:24.788456 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: action_args: {'id': 'cca08141-979e-4519-88b3-c77e8a71ae3e'} May 14 15:58:24.790230 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: {{(pid=128728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 14 15:58:24.790230 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 15:58:24.790230 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 14 15:58:24.790230 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 14 15:58:24.790230 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 14 15:58:24.790230 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 14 15:58:24.790230 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 14 15:58:24.790230 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 14 15:58:24.790230 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 14 15:58:24.790230 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 14 15:58:24.790230 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cca08141-979e-4519-88b3-c77e8a71ae3e could not be found. May 14 15:58:24.790230 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: ERROR nova.api.openstack.wsgi May 14 15:58:24.790230 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 14 15:58:24.790230 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: ERROR nova.api.openstack.wsgi May 14 15:58:24.790230 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 15:58:24.790230 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 14 15:58:24.790230 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 14 15:58:24.790230 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 14 15:58:24.790230 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 14 15:58:24.790230 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 14 15:58:24.791879 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 14 15:58:24.791879 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 14 15:58:24.791879 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 14 15:58:24.791879 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 14 15:58:24.791879 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 14 15:58:24.791879 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 14 15:58:24.791879 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 14 15:58:24.791879 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cca08141-979e-4519-88b3-c77e8a71ae3e could not be found. May 14 15:58:24.791879 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: ERROR nova.api.openstack.wsgi May 14 15:58:24.791879 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 14 15:58:24.791879 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: ERROR nova.api.openstack.wsgi May 14 15:58:24.791879 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 15:58:24.791879 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 14 15:58:24.791879 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 14 15:58:24.791879 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 14 15:58:24.791879 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 14 15:58:24.791879 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cca08141-979e-4519-88b3-c77e8a71ae3e could not be found. May 14 15:58:24.791879 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: ERROR nova.api.openstack.wsgi May 14 15:58:24.793266 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi [None req-10230612-2a0a-42b9-93ed-9e29302e8558 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Returning 404 to user: Instance cca08141-979e-4519-88b3-c77e8a71ae3e could not be found. {{(pid=128728) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 14 15:58:24.793266 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: INFO nova.api.openstack.requestlog [None req-10230612-2a0a-42b9-93ed-9e29302e8558 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] 10.222.0.61 "GET /compute/v2.1/servers/cca08141-979e-4519-88b3-c77e8a71ae3e" status: 404 len: 111 microversion: 2.20 time: 0.039586 May 14 15:58:24.793266 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: [pid: 128728|app: 0|req: 630/1240] 10.222.0.61 () {60 vars in 1276 bytes} [Sat May 14 15:58:24 2022] GET /compute/v2.1/servers/cca08141-979e-4519-88b3-c77e8a71ae3e => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) May 14 15:58:25.604074 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi [None req-c97e5982-6216-4261-b084-94130d57ea33 tempest-VolumesSnapshotTestJSON-671752898 tempest-VolumesSnapshotTestJSON-671752898-project] Calling method '>' {{(pid=128729) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 15:58:25.604685 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.compute.api [None req-c97e5982-6216-4261-b084-94130d57ea33 tempest-VolumesSnapshotTestJSON-671752898 tempest-VolumesSnapshotTestJSON-671752898-project] [instance: 25202ac2-6830-4d26-83fc-803adeb71796] Fetching instance by UUID {{(pid=128729) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 15:58:25.610499 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-c97e5982-6216-4261-b084-94130d57ea33 tempest-VolumesSnapshotTestJSON-671752898 tempest-VolumesSnapshotTestJSON-671752898-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:58:25.611021 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-c97e5982-6216-4261-b084-94130d57ea33 tempest-VolumesSnapshotTestJSON-671752898 tempest-VolumesSnapshotTestJSON-671752898-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:58:25.611783 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-c97e5982-6216-4261-b084-94130d57ea33 tempest-VolumesSnapshotTestJSON-671752898 tempest-VolumesSnapshotTestJSON-671752898-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:58:25.612218 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-c97e5982-6216-4261-b084-94130d57ea33 tempest-VolumesSnapshotTestJSON-671752898 tempest-VolumesSnapshotTestJSON-671752898-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:58:25.689434 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.objects.instance [None req-c97e5982-6216-4261-b084-94130d57ea33 tempest-VolumesSnapshotTestJSON-671752898 tempest-VolumesSnapshotTestJSON-671752898-project] Lazy-loading 'services' on Instance uuid 25202ac2-6830-4d26-83fc-803adeb71796 {{(pid=128729) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 14 15:58:25.757588 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: INFO nova.api.openstack.requestlog [None req-c97e5982-6216-4261-b084-94130d57ea33 tempest-VolumesSnapshotTestJSON-671752898 tempest-VolumesSnapshotTestJSON-671752898-project] 10.222.0.61 "DELETE /compute/v2.1/servers/25202ac2-6830-4d26-83fc-803adeb71796/os-volume_attachments/08bc81b8-a817-4183-b583-7d294ca3d73b" status: 202 len: 0 microversion: 2.1 time: 0.157249 May 14 15:58:25.758368 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: [pid: 128729|app: 0|req: 611/1241] 10.222.0.61 () {58 vars in 1415 bytes} [Sat May 14 15:58:25 2022] DELETE /compute/v2.1/servers/25202ac2-6830-4d26-83fc-803adeb71796/os-volume_attachments/08bc81b8-a817-4183-b583-7d294ca3d73b => generated 0 bytes in 159 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 14 15:58:25.929787 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi [None req-442f7d2e-a3d7-4cfc-bbe5-bea5cc3d8295 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Calling method '>' {{(pid=128728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 15:58:25.930277 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.compute.api [None req-442f7d2e-a3d7-4cfc-bbe5-bea5cc3d8295 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] [instance: e33e9970-bfb7-46f3-8d40-782dbfa3d21c] Fetching instance by UUID {{(pid=128728) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 15:58:25.937295 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-442f7d2e-a3d7-4cfc-bbe5-bea5cc3d8295 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:58:25.937764 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-442f7d2e-a3d7-4cfc-bbe5-bea5cc3d8295 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:58:25.938567 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-442f7d2e-a3d7-4cfc-bbe5-bea5cc3d8295 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:58:25.939015 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-442f7d2e-a3d7-4cfc-bbe5-bea5cc3d8295 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:58:25.951862 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: INFO nova.api.openstack.wsgi [None req-442f7d2e-a3d7-4cfc-bbe5-bea5cc3d8295 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] HTTP exception thrown: Instance e33e9970-bfb7-46f3-8d40-782dbfa3d21c could not be found. May 14 15:58:25.953412 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi [None req-442f7d2e-a3d7-4cfc-bbe5-bea5cc3d8295 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Request method failure captured: May 14 15:58:25.953412 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: request: DELETE /compute/v2.1/servers/e33e9970-bfb7-46f3-8d40-782dbfa3d21c HTTP/1.1 May 14 15:58:25.953412 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: Accept: application/json May 14 15:58:25.953412 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: Accept-Encoding: identity May 14 15:58:25.953412 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: Connection: close May 14 15:58:25.953412 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: Content-Length: 0 May 14 15:58:25.953412 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: Content-Type: application/json May 14 15:58:25.953412 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: Host: 10.222.0.61 May 14 15:58:25.953412 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: Openstack-System-Scope: None May 14 15:58:25.953412 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: User-Agent: python-urllib3/1.26.9 May 14 15:58:25.953412 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: X-Auth-Token: gAAAAABif87cXLSpyUu3a9K-vtFHqSpp1aQZW1jW-zQ2Idzmz1rv6VZ5naJZjx_0Ztni3S2PMUUkq4rTnJcFNAekAJmOB4fA7zofP6VQEp1yk3kHJThjsksUCeoFnGR1cQkBPZsCy1zToVK3Lc8wCHUoVwX7ZZ0iyqkTplJDA-CIW3iXuuBg1p8 May 14 15:58:25.953412 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: X-Domain-Id: None May 14 15:58:25.953412 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: X-Domain-Name: None May 14 15:58:25.953412 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: X-Identity-Status: Confirmed May 14 15:58:25.953412 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: X-Is-Admin-Project: True May 14 15:58:25.953412 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: X-Openstack-Nova-Api-Version: 2.20 May 14 15:58:25.953412 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: X-Project-Domain-Id: default May 14 15:58:25.953412 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: X-Project-Domain-Name: Default May 14 15:58:25.953412 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: X-Project-Id: 0672be3fa3f7414da1c1a5b7300abbe7 May 14 15:58:25.953412 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1739561036 May 14 15:58:25.953412 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: X-Role: reader,member May 14 15:58:25.953412 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: X-Roles: reader,member May 14 15:58:25.955216 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/0672be3fa3f7414da1c1a5b7300abbe7"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/0672be3fa3f7414da1c1a5b7300abbe7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/0672be3fa3f7414da1c1a5b7300abbe7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_0672be3fa3f7414da1c1a5b7300abbe7"}]}] May 14 15:58:25.955216 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1739561036 May 14 15:58:25.955216 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: X-Tenant-Id: 0672be3fa3f7414da1c1a5b7300abbe7 May 14 15:58:25.955216 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1739561036 May 14 15:58:25.955216 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: X-User: tempest-AttachVolumeShelveTestJSON-1739561036-project May 14 15:58:25.955216 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: X-User-Domain-Id: default May 14 15:58:25.955216 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: X-User-Domain-Name: Default May 14 15:58:25.955216 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: X-User-Id: 58bfb7417bc94583963401ae0fe9d39a May 14 15:58:25.955216 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1739561036-project May 14 15:58:25.955216 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: method: > May 14 15:58:25.955216 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: exception: Instance e33e9970-bfb7-46f3-8d40-782dbfa3d21c could not be found. May 14 15:58:25.955216 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: action_args: {'id': 'e33e9970-bfb7-46f3-8d40-782dbfa3d21c'} May 14 15:58:25.956278 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: {{(pid=128728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 14 15:58:25.956278 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 15:58:25.956278 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 14 15:58:25.956278 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 14 15:58:25.956278 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 14 15:58:25.956278 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 14 15:58:25.956278 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 14 15:58:25.956278 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 14 15:58:25.956278 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 14 15:58:25.956278 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 14 15:58:25.956278 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e33e9970-bfb7-46f3-8d40-782dbfa3d21c could not be found. May 14 15:58:25.956278 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: ERROR nova.api.openstack.wsgi May 14 15:58:25.956278 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 14 15:58:25.956278 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: ERROR nova.api.openstack.wsgi May 14 15:58:25.956278 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 15:58:25.956278 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 14 15:58:25.956278 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 14 15:58:25.956278 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 14 15:58:25.956278 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 14 15:58:25.956278 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 14 15:58:25.957795 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 14 15:58:25.957795 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 14 15:58:25.957795 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 14 15:58:25.957795 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 14 15:58:25.957795 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 14 15:58:25.957795 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 14 15:58:25.957795 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 14 15:58:25.957795 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 14 15:58:25.957795 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 14 15:58:25.957795 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e33e9970-bfb7-46f3-8d40-782dbfa3d21c could not be found. May 14 15:58:25.957795 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: ERROR nova.api.openstack.wsgi May 14 15:58:25.957795 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 14 15:58:25.957795 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: ERROR nova.api.openstack.wsgi May 14 15:58:25.957795 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 15:58:25.957795 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 14 15:58:25.957795 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 14 15:58:25.957795 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 14 15:58:25.957795 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 14 15:58:25.957795 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e33e9970-bfb7-46f3-8d40-782dbfa3d21c could not be found. May 14 15:58:25.957795 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: ERROR nova.api.openstack.wsgi May 14 15:58:25.959825 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi [None req-442f7d2e-a3d7-4cfc-bbe5-bea5cc3d8295 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Returning 404 to user: Instance e33e9970-bfb7-46f3-8d40-782dbfa3d21c could not be found. {{(pid=128728) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 14 15:58:25.959825 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: INFO nova.api.openstack.requestlog [None req-442f7d2e-a3d7-4cfc-bbe5-bea5cc3d8295 tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] 10.222.0.61 "DELETE /compute/v2.1/servers/e33e9970-bfb7-46f3-8d40-782dbfa3d21c" status: 404 len: 111 microversion: 2.20 time: 0.028975 May 14 15:58:25.959825 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: [pid: 128728|app: 0|req: 631/1242] 10.222.0.61 () {60 vars in 1279 bytes} [Sat May 14 15:58:25 2022] DELETE /compute/v2.1/servers/e33e9970-bfb7-46f3-8d40-782dbfa3d21c => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) May 14 15:58:25.964720 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi [None req-a5a2cc20-e569-400a-af8a-add7d352b55e tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Calling method '>' {{(pid=128729) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 15:58:25.965353 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.compute.api [None req-a5a2cc20-e569-400a-af8a-add7d352b55e tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] [instance: e33e9970-bfb7-46f3-8d40-782dbfa3d21c] Fetching instance by UUID {{(pid=128729) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 15:58:25.971392 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-a5a2cc20-e569-400a-af8a-add7d352b55e tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:58:25.971841 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-a5a2cc20-e569-400a-af8a-add7d352b55e tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:58:25.972602 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-a5a2cc20-e569-400a-af8a-add7d352b55e tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:58:25.973038 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-a5a2cc20-e569-400a-af8a-add7d352b55e tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:58:25.986385 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: INFO nova.api.openstack.wsgi [None req-a5a2cc20-e569-400a-af8a-add7d352b55e tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] HTTP exception thrown: Instance e33e9970-bfb7-46f3-8d40-782dbfa3d21c could not be found. May 14 15:58:25.987990 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi [None req-a5a2cc20-e569-400a-af8a-add7d352b55e tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Request method failure captured: May 14 15:58:25.987990 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: request: GET /compute/v2.1/servers/e33e9970-bfb7-46f3-8d40-782dbfa3d21c HTTP/1.1 May 14 15:58:25.987990 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: Accept: application/json May 14 15:58:25.987990 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: Accept-Encoding: identity May 14 15:58:25.987990 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: Connection: close May 14 15:58:25.987990 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: Content-Length: 0 May 14 15:58:25.987990 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: Content-Type: application/json May 14 15:58:25.987990 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: Host: 10.222.0.61 May 14 15:58:25.987990 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: Openstack-System-Scope: None May 14 15:58:25.987990 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: User-Agent: python-urllib3/1.26.9 May 14 15:58:25.987990 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: X-Auth-Token: gAAAAABif87cXLSpyUu3a9K-vtFHqSpp1aQZW1jW-zQ2Idzmz1rv6VZ5naJZjx_0Ztni3S2PMUUkq4rTnJcFNAekAJmOB4fA7zofP6VQEp1yk3kHJThjsksUCeoFnGR1cQkBPZsCy1zToVK3Lc8wCHUoVwX7ZZ0iyqkTplJDA-CIW3iXuuBg1p8 May 14 15:58:25.987990 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: X-Domain-Id: None May 14 15:58:25.987990 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: X-Domain-Name: None May 14 15:58:25.987990 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: X-Identity-Status: Confirmed May 14 15:58:25.987990 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: X-Is-Admin-Project: True May 14 15:58:25.987990 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: X-Openstack-Nova-Api-Version: 2.20 May 14 15:58:25.987990 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: X-Project-Domain-Id: default May 14 15:58:25.987990 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: X-Project-Domain-Name: Default May 14 15:58:25.987990 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: X-Project-Id: 0672be3fa3f7414da1c1a5b7300abbe7 May 14 15:58:25.987990 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1739561036 May 14 15:58:25.987990 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: X-Role: reader,member May 14 15:58:25.987990 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: X-Roles: reader,member May 14 15:58:25.989673 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/0672be3fa3f7414da1c1a5b7300abbe7"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/0672be3fa3f7414da1c1a5b7300abbe7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/0672be3fa3f7414da1c1a5b7300abbe7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_0672be3fa3f7414da1c1a5b7300abbe7"}]}] May 14 15:58:25.989673 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1739561036 May 14 15:58:25.989673 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: X-Tenant-Id: 0672be3fa3f7414da1c1a5b7300abbe7 May 14 15:58:25.989673 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1739561036 May 14 15:58:25.989673 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: X-User: tempest-AttachVolumeShelveTestJSON-1739561036-project May 14 15:58:25.989673 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: X-User-Domain-Id: default May 14 15:58:25.989673 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: X-User-Domain-Name: Default May 14 15:58:25.989673 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: X-User-Id: 58bfb7417bc94583963401ae0fe9d39a May 14 15:58:25.989673 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1739561036-project May 14 15:58:25.989673 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: method: > May 14 15:58:25.989673 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: exception: Instance e33e9970-bfb7-46f3-8d40-782dbfa3d21c could not be found. May 14 15:58:25.989673 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: action_args: {'id': 'e33e9970-bfb7-46f3-8d40-782dbfa3d21c'} May 14 15:58:25.990673 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: {{(pid=128729) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 14 15:58:25.990673 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 15:58:25.990673 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 14 15:58:25.990673 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 14 15:58:25.990673 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 14 15:58:25.990673 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 14 15:58:25.990673 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 14 15:58:25.990673 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 14 15:58:25.990673 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 14 15:58:25.990673 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 14 15:58:25.990673 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e33e9970-bfb7-46f3-8d40-782dbfa3d21c could not be found. May 14 15:58:25.990673 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: ERROR nova.api.openstack.wsgi May 14 15:58:25.990673 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 14 15:58:25.990673 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: ERROR nova.api.openstack.wsgi May 14 15:58:25.990673 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 15:58:25.990673 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 14 15:58:25.990673 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 14 15:58:25.990673 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 14 15:58:25.990673 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 14 15:58:25.990673 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 14 15:58:25.991912 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 14 15:58:25.991912 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 14 15:58:25.991912 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 14 15:58:25.991912 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 14 15:58:25.991912 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 14 15:58:25.991912 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 14 15:58:25.991912 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 14 15:58:25.991912 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e33e9970-bfb7-46f3-8d40-782dbfa3d21c could not be found. May 14 15:58:25.991912 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: ERROR nova.api.openstack.wsgi May 14 15:58:25.991912 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 14 15:58:25.991912 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: ERROR nova.api.openstack.wsgi May 14 15:58:25.991912 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 15:58:25.991912 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 14 15:58:25.991912 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 14 15:58:25.991912 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 14 15:58:25.991912 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 14 15:58:25.991912 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e33e9970-bfb7-46f3-8d40-782dbfa3d21c could not be found. May 14 15:58:25.991912 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: ERROR nova.api.openstack.wsgi May 14 15:58:25.993534 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi [None req-a5a2cc20-e569-400a-af8a-add7d352b55e tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] Returning 404 to user: Instance e33e9970-bfb7-46f3-8d40-782dbfa3d21c could not be found. {{(pid=128729) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 14 15:58:25.993534 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: INFO nova.api.openstack.requestlog [None req-a5a2cc20-e569-400a-af8a-add7d352b55e tempest-AttachVolumeShelveTestJSON-1739561036 tempest-AttachVolumeShelveTestJSON-1739561036-project] 10.222.0.61 "GET /compute/v2.1/servers/e33e9970-bfb7-46f3-8d40-782dbfa3d21c" status: 404 len: 111 microversion: 2.20 time: 0.029110 May 14 15:58:25.993534 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: [pid: 128729|app: 0|req: 612/1243] 10.222.0.61 () {60 vars in 1276 bytes} [Sat May 14 15:58:25 2022] GET /compute/v2.1/servers/e33e9970-bfb7-46f3-8d40-782dbfa3d21c => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) May 14 15:58:26.868435 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi [None req-e4b8a192-9d84-43b7-8fc8-0b21528f06c3 tempest-VolumesSnapshotTestJSON-671752898 tempest-VolumesSnapshotTestJSON-671752898-project] Calling method '>' {{(pid=128728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 15:58:26.868941 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.compute.api [None req-e4b8a192-9d84-43b7-8fc8-0b21528f06c3 tempest-VolumesSnapshotTestJSON-671752898 tempest-VolumesSnapshotTestJSON-671752898-project] [instance: 25202ac2-6830-4d26-83fc-803adeb71796] Fetching instance by UUID {{(pid=128728) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 15:58:26.875429 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-e4b8a192-9d84-43b7-8fc8-0b21528f06c3 tempest-VolumesSnapshotTestJSON-671752898 tempest-VolumesSnapshotTestJSON-671752898-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:58:26.875881 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-e4b8a192-9d84-43b7-8fc8-0b21528f06c3 tempest-VolumesSnapshotTestJSON-671752898 tempest-VolumesSnapshotTestJSON-671752898-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:58:26.876655 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-e4b8a192-9d84-43b7-8fc8-0b21528f06c3 tempest-VolumesSnapshotTestJSON-671752898 tempest-VolumesSnapshotTestJSON-671752898-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:58:26.877098 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-e4b8a192-9d84-43b7-8fc8-0b21528f06c3 tempest-VolumesSnapshotTestJSON-671752898 tempest-VolumesSnapshotTestJSON-671752898-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:58:26.904176 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.compute.api [None req-e4b8a192-9d84-43b7-8fc8-0b21528f06c3 tempest-VolumesSnapshotTestJSON-671752898 tempest-VolumesSnapshotTestJSON-671752898-project] [instance: 25202ac2-6830-4d26-83fc-803adeb71796] Going to try to terminate instance {{(pid=128728) delete /opt/stack/nova/nova/compute/api.py:2664}} May 14 15:58:26.976486 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: INFO nova.api.openstack.requestlog [None req-e4b8a192-9d84-43b7-8fc8-0b21528f06c3 tempest-VolumesSnapshotTestJSON-671752898 tempest-VolumesSnapshotTestJSON-671752898-project] 10.222.0.61 "DELETE /compute/v2.1/servers/25202ac2-6830-4d26-83fc-803adeb71796" status: 204 len: 0 microversion: 2.1 time: 0.111839 May 14 15:58:26.977178 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: [pid: 128728|app: 0|req: 632/1244] 10.222.0.61 () {58 vars in 1238 bytes} [Sat May 14 15:58:26 2022] DELETE /compute/v2.1/servers/25202ac2-6830-4d26-83fc-803adeb71796 => generated 0 bytes in 113 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 14 15:58:26.986162 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi [None req-8455b1e6-f786-411c-8e78-2e0c59fe456f tempest-VolumesSnapshotTestJSON-671752898 tempest-VolumesSnapshotTestJSON-671752898-project] Calling method '>' {{(pid=128729) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 15:58:26.986803 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.compute.api [None req-8455b1e6-f786-411c-8e78-2e0c59fe456f tempest-VolumesSnapshotTestJSON-671752898 tempest-VolumesSnapshotTestJSON-671752898-project] [instance: 25202ac2-6830-4d26-83fc-803adeb71796] Fetching instance by UUID {{(pid=128729) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 15:58:26.992752 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-8455b1e6-f786-411c-8e78-2e0c59fe456f tempest-VolumesSnapshotTestJSON-671752898 tempest-VolumesSnapshotTestJSON-671752898-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:58:26.993461 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-8455b1e6-f786-411c-8e78-2e0c59fe456f tempest-VolumesSnapshotTestJSON-671752898 tempest-VolumesSnapshotTestJSON-671752898-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:58:26.994290 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-8455b1e6-f786-411c-8e78-2e0c59fe456f tempest-VolumesSnapshotTestJSON-671752898 tempest-VolumesSnapshotTestJSON-671752898-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:58:26.994750 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-8455b1e6-f786-411c-8e78-2e0c59fe456f tempest-VolumesSnapshotTestJSON-671752898 tempest-VolumesSnapshotTestJSON-671752898-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:58:27.148023 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.policy [None req-8455b1e6-f786-411c-8e78-2e0c59fe456f tempest-VolumesSnapshotTestJSON-671752898 tempest-VolumesSnapshotTestJSON-671752898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3e4193c9d9043c99ee5bee59f79f7a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ad8088ecb8a4f72a98ad70fa8be02b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128729) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:58:27.156072 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: INFO nova.api.openstack.requestlog [None req-8455b1e6-f786-411c-8e78-2e0c59fe456f tempest-VolumesSnapshotTestJSON-671752898 tempest-VolumesSnapshotTestJSON-671752898-project] 10.222.0.61 "GET /compute/v2.1/servers/25202ac2-6830-4d26-83fc-803adeb71796" status: 200 len: 1513 microversion: 2.1 time: 0.173802 May 14 15:58:27.156657 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: [pid: 128729|app: 0|req: 613/1245] 10.222.0.61 () {58 vars in 1235 bytes} [Sat May 14 15:58:26 2022] GET /compute/v2.1/servers/25202ac2-6830-4d26-83fc-803adeb71796 => generated 1513 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 15:58:28.174727 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi [None req-82550c5d-c890-4c59-96ab-0cdea2d649ea tempest-VolumesSnapshotTestJSON-671752898 tempest-VolumesSnapshotTestJSON-671752898-project] Calling method '>' {{(pid=128728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 15:58:28.176165 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.compute.api [None req-82550c5d-c890-4c59-96ab-0cdea2d649ea tempest-VolumesSnapshotTestJSON-671752898 tempest-VolumesSnapshotTestJSON-671752898-project] [instance: 25202ac2-6830-4d26-83fc-803adeb71796] Fetching instance by UUID {{(pid=128728) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 15:58:28.186755 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-82550c5d-c890-4c59-96ab-0cdea2d649ea tempest-VolumesSnapshotTestJSON-671752898 tempest-VolumesSnapshotTestJSON-671752898-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:58:28.187170 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-82550c5d-c890-4c59-96ab-0cdea2d649ea tempest-VolumesSnapshotTestJSON-671752898 tempest-VolumesSnapshotTestJSON-671752898-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:58:28.187948 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-82550c5d-c890-4c59-96ab-0cdea2d649ea tempest-VolumesSnapshotTestJSON-671752898 tempest-VolumesSnapshotTestJSON-671752898-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:58:28.188421 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-82550c5d-c890-4c59-96ab-0cdea2d649ea tempest-VolumesSnapshotTestJSON-671752898 tempest-VolumesSnapshotTestJSON-671752898-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:58:28.328298 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.policy [None req-82550c5d-c890-4c59-96ab-0cdea2d649ea tempest-VolumesSnapshotTestJSON-671752898 tempest-VolumesSnapshotTestJSON-671752898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3e4193c9d9043c99ee5bee59f79f7a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ad8088ecb8a4f72a98ad70fa8be02b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128728) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:58:28.335979 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: INFO nova.api.openstack.requestlog [None req-82550c5d-c890-4c59-96ab-0cdea2d649ea tempest-VolumesSnapshotTestJSON-671752898 tempest-VolumesSnapshotTestJSON-671752898-project] 10.222.0.61 "GET /compute/v2.1/servers/25202ac2-6830-4d26-83fc-803adeb71796" status: 200 len: 1513 microversion: 2.1 time: 0.165926 May 14 15:58:28.336544 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: [pid: 128728|app: 0|req: 633/1246] 10.222.0.61 () {58 vars in 1235 bytes} [Sat May 14 15:58:28 2022] GET /compute/v2.1/servers/25202ac2-6830-4d26-83fc-803adeb71796 => generated 1513 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 15:58:29.354202 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi [None req-fb4ed290-983b-4d01-a407-a175cb283ebb tempest-VolumesSnapshotTestJSON-671752898 tempest-VolumesSnapshotTestJSON-671752898-project] Calling method '>' {{(pid=128729) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 15:58:29.355699 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.compute.api [None req-fb4ed290-983b-4d01-a407-a175cb283ebb tempest-VolumesSnapshotTestJSON-671752898 tempest-VolumesSnapshotTestJSON-671752898-project] [instance: 25202ac2-6830-4d26-83fc-803adeb71796] Fetching instance by UUID {{(pid=128729) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 15:58:29.362804 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-fb4ed290-983b-4d01-a407-a175cb283ebb tempest-VolumesSnapshotTestJSON-671752898 tempest-VolumesSnapshotTestJSON-671752898-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:58:29.363475 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-fb4ed290-983b-4d01-a407-a175cb283ebb tempest-VolumesSnapshotTestJSON-671752898 tempest-VolumesSnapshotTestJSON-671752898-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:58:29.364429 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-fb4ed290-983b-4d01-a407-a175cb283ebb tempest-VolumesSnapshotTestJSON-671752898 tempest-VolumesSnapshotTestJSON-671752898-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:58:29.365038 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-fb4ed290-983b-4d01-a407-a175cb283ebb tempest-VolumesSnapshotTestJSON-671752898 tempest-VolumesSnapshotTestJSON-671752898-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:58:29.505134 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.policy [None req-fb4ed290-983b-4d01-a407-a175cb283ebb tempest-VolumesSnapshotTestJSON-671752898 tempest-VolumesSnapshotTestJSON-671752898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3e4193c9d9043c99ee5bee59f79f7a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ad8088ecb8a4f72a98ad70fa8be02b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128729) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:58:29.513312 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: INFO nova.api.openstack.requestlog [None req-fb4ed290-983b-4d01-a407-a175cb283ebb tempest-VolumesSnapshotTestJSON-671752898 tempest-VolumesSnapshotTestJSON-671752898-project] 10.222.0.61 "GET /compute/v2.1/servers/25202ac2-6830-4d26-83fc-803adeb71796" status: 200 len: 1513 microversion: 2.1 time: 0.162885 May 14 15:58:29.513895 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: [pid: 128729|app: 0|req: 614/1247] 10.222.0.61 () {58 vars in 1235 bytes} [Sat May 14 15:58:29 2022] GET /compute/v2.1/servers/25202ac2-6830-4d26-83fc-803adeb71796 => generated 1513 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 15:58:29.918139 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi [req-352afb7d-0983-4d17-a4be-520db7dcaa6a req-26f83b6a-060b-4e46-a29d-e5e529b88376 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "25202ac2-6830-4d26-83fc-803adeb71796", "name": "network-vif-deleted", "tag": "684de684-f0ea-449d-a77c-a068f4d20b82"}]} {{(pid=128728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 15:58:29.927843 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [req-352afb7d-0983-4d17-a4be-520db7dcaa6a req-26f83b6a-060b-4e46-a29d-e5e529b88376 service nova] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:58:29.928351 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [req-352afb7d-0983-4d17-a4be-520db7dcaa6a req-26f83b6a-060b-4e46-a29d-e5e529b88376 service nova] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:58:29.940165 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: INFO nova.api.openstack.compute.server_external_events [req-352afb7d-0983-4d17-a4be-520db7dcaa6a req-26f83b6a-060b-4e46-a29d-e5e529b88376 service nova] Creating event network-vif-deleted:684de684-f0ea-449d-a77c-a068f4d20b82 for instance 25202ac2-6830-4d26-83fc-803adeb71796 on hv-cinder-83979 May 14 15:58:29.945130 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: INFO nova.api.openstack.requestlog [req-352afb7d-0983-4d17-a4be-520db7dcaa6a req-26f83b6a-060b-4e46-a29d-e5e529b88376 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031193 May 14 15:58:29.945729 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: [pid: 128728|app: 0|req: 634/1248] 10.222.0.61 () {64 vars in 1317 bytes} [Sat May 14 15:58:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 14 15:58:30.531135 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi [None req-de61307b-72ed-4b04-9c52-8075583c246a tempest-VolumesSnapshotTestJSON-671752898 tempest-VolumesSnapshotTestJSON-671752898-project] Calling method '>' {{(pid=128729) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 15:58:30.531757 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.compute.api [None req-de61307b-72ed-4b04-9c52-8075583c246a tempest-VolumesSnapshotTestJSON-671752898 tempest-VolumesSnapshotTestJSON-671752898-project] [instance: 25202ac2-6830-4d26-83fc-803adeb71796] Fetching instance by UUID {{(pid=128729) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 15:58:30.537984 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-de61307b-72ed-4b04-9c52-8075583c246a tempest-VolumesSnapshotTestJSON-671752898 tempest-VolumesSnapshotTestJSON-671752898-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:58:30.538471 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-de61307b-72ed-4b04-9c52-8075583c246a tempest-VolumesSnapshotTestJSON-671752898 tempest-VolumesSnapshotTestJSON-671752898-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:58:30.539251 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-de61307b-72ed-4b04-9c52-8075583c246a tempest-VolumesSnapshotTestJSON-671752898 tempest-VolumesSnapshotTestJSON-671752898-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:58:30.539688 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-de61307b-72ed-4b04-9c52-8075583c246a tempest-VolumesSnapshotTestJSON-671752898 tempest-VolumesSnapshotTestJSON-671752898-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:58:30.558574 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: INFO nova.api.openstack.wsgi [None req-de61307b-72ed-4b04-9c52-8075583c246a tempest-VolumesSnapshotTestJSON-671752898 tempest-VolumesSnapshotTestJSON-671752898-project] HTTP exception thrown: Instance 25202ac2-6830-4d26-83fc-803adeb71796 could not be found. May 14 15:58:30.560197 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi [None req-de61307b-72ed-4b04-9c52-8075583c246a tempest-VolumesSnapshotTestJSON-671752898 tempest-VolumesSnapshotTestJSON-671752898-project] Request method failure captured: May 14 15:58:30.560197 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: request: GET /compute/v2.1/servers/25202ac2-6830-4d26-83fc-803adeb71796 HTTP/1.1 May 14 15:58:30.560197 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: Accept: application/json May 14 15:58:30.560197 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: Accept-Encoding: identity May 14 15:58:30.560197 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: Connection: close May 14 15:58:30.560197 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: Content-Length: 0 May 14 15:58:30.560197 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: Content-Type: application/json May 14 15:58:30.560197 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: Host: 10.222.0.61 May 14 15:58:30.560197 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: Openstack-System-Scope: None May 14 15:58:30.560197 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: User-Agent: python-urllib3/1.26.9 May 14 15:58:30.560197 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: X-Auth-Token: gAAAAABif9EFKhM32DIaQixVsy11oQMnUf6WwnkqQpKJITorRu3Znz-e1VjV_wXnlR5uemGumwkJ-G-fCJWke46_ZFtwHH43E-XIlo8N3VxY-NE0K0L2aNDBNuAbkhA8Hn1B5ks_8T_K0iFN_CX4J2vpIwIRVI_Uttlm9kfqp7_RzI5IaOFcVEg May 14 15:58:30.560197 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: X-Domain-Id: None May 14 15:58:30.560197 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: X-Domain-Name: None May 14 15:58:30.560197 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: X-Identity-Status: Confirmed May 14 15:58:30.560197 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: X-Is-Admin-Project: True May 14 15:58:30.560197 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: X-Project-Domain-Id: default May 14 15:58:30.560197 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: X-Project-Domain-Name: Default May 14 15:58:30.560197 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: X-Project-Id: 4ad8088ecb8a4f72a98ad70fa8be02b3 May 14 15:58:30.560197 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: X-Project-Name: tempest-VolumesSnapshotTestJSON-671752898 May 14 15:58:30.560197 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: X-Role: reader,member May 14 15:58:30.560197 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: X-Roles: reader,member May 14 15:58:30.561662 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/4ad8088ecb8a4f72a98ad70fa8be02b3"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/4ad8088ecb8a4f72a98ad70fa8be02b3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/4ad8088ecb8a4f72a98ad70fa8be02b3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_4ad8088ecb8a4f72a98ad70fa8be02b3"}]}] May 14 15:58:30.561662 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: X-Tenant: tempest-VolumesSnapshotTestJSON-671752898 May 14 15:58:30.561662 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: X-Tenant-Id: 4ad8088ecb8a4f72a98ad70fa8be02b3 May 14 15:58:30.561662 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-671752898 May 14 15:58:30.561662 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: X-User: tempest-VolumesSnapshotTestJSON-671752898-project May 14 15:58:30.561662 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: X-User-Domain-Id: default May 14 15:58:30.561662 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: X-User-Domain-Name: Default May 14 15:58:30.561662 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: X-User-Id: d3e4193c9d9043c99ee5bee59f79f7a8 May 14 15:58:30.561662 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: X-User-Name: tempest-VolumesSnapshotTestJSON-671752898-project May 14 15:58:30.561662 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: method: > May 14 15:58:30.561662 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: exception: Instance 25202ac2-6830-4d26-83fc-803adeb71796 could not be found. May 14 15:58:30.561662 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: action_args: {'id': '25202ac2-6830-4d26-83fc-803adeb71796'} May 14 15:58:30.562569 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: {{(pid=128729) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 14 15:58:30.562569 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 15:58:30.562569 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 14 15:58:30.562569 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 14 15:58:30.562569 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 14 15:58:30.562569 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 14 15:58:30.562569 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 14 15:58:30.562569 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 14 15:58:30.562569 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 14 15:58:30.562569 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 14 15:58:30.562569 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 25202ac2-6830-4d26-83fc-803adeb71796 could not be found. May 14 15:58:30.562569 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: ERROR nova.api.openstack.wsgi May 14 15:58:30.562569 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 14 15:58:30.562569 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: ERROR nova.api.openstack.wsgi May 14 15:58:30.562569 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 15:58:30.562569 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 14 15:58:30.562569 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 14 15:58:30.562569 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 14 15:58:30.562569 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 14 15:58:30.562569 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 14 15:58:30.563970 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 14 15:58:30.563970 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 14 15:58:30.563970 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 14 15:58:30.563970 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 14 15:58:30.563970 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 14 15:58:30.563970 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 14 15:58:30.563970 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 14 15:58:30.563970 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 25202ac2-6830-4d26-83fc-803adeb71796 could not be found. May 14 15:58:30.563970 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: ERROR nova.api.openstack.wsgi May 14 15:58:30.563970 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 14 15:58:30.563970 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: ERROR nova.api.openstack.wsgi May 14 15:58:30.563970 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 15:58:30.563970 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 14 15:58:30.563970 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 14 15:58:30.563970 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 14 15:58:30.563970 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 14 15:58:30.563970 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 25202ac2-6830-4d26-83fc-803adeb71796 could not be found. May 14 15:58:30.563970 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: ERROR nova.api.openstack.wsgi May 14 15:58:30.565126 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi [None req-de61307b-72ed-4b04-9c52-8075583c246a tempest-VolumesSnapshotTestJSON-671752898 tempest-VolumesSnapshotTestJSON-671752898-project] Returning 404 to user: Instance 25202ac2-6830-4d26-83fc-803adeb71796 could not be found. {{(pid=128729) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 14 15:58:30.565126 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: INFO nova.api.openstack.requestlog [None req-de61307b-72ed-4b04-9c52-8075583c246a tempest-VolumesSnapshotTestJSON-671752898 tempest-VolumesSnapshotTestJSON-671752898-project] 10.222.0.61 "GET /compute/v2.1/servers/25202ac2-6830-4d26-83fc-803adeb71796" status: 404 len: 111 microversion: 2.1 time: 0.035285 May 14 15:58:30.565126 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: [pid: 128729|app: 0|req: 615/1249] 10.222.0.61 () {58 vars in 1235 bytes} [Sat May 14 15:58:30 2022] GET /compute/v2.1/servers/25202ac2-6830-4d26-83fc-803adeb71796 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 14 15:58:35.707422 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi [None req-982ab70c-0c85-4a18-bcc7-6ff7d5e3aebc tempest-AttachVolumeTestJSON-1609025183 tempest-AttachVolumeTestJSON-1609025183-project] Action: 'create', calling method: .version_select at 0x7f77cb6b9700>, body: {"keypair": {"name": "tempest-keypair-185804968", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEe78LANcVVQe+pa4dsKyFjgRS1grWRL4peMURxcRb5s8oI4NHeIYiByKDiYvEvLAgv57PvrqX51qYlWXpNbNLUgH/8/6lDjzh7ZW32eLM3uMP5Vzb34rZyefR1pRo78Jg=="}} {{(pid=128728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 15:58:35.721669 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.quota [None req-982ab70c-0c85-4a18-bcc7-6ff7d5e3aebc tempest-AttachVolumeTestJSON-1609025183 tempest-AttachVolumeTestJSON-1609025183-project] Getting quotas for project 882808bd43644908a21ff8a58997c57f. Resources: {'key_pairs'} {{(pid=128728) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 14 15:58:35.725597 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.quota [None req-982ab70c-0c85-4a18-bcc7-6ff7d5e3aebc tempest-AttachVolumeTestJSON-1609025183 tempest-AttachVolumeTestJSON-1609025183-project] Getting quotas for user 742938d3a02a4c8babf518b7b6cf53a7 and project 882808bd43644908a21ff8a58997c57f. Resources: {'key_pairs'} {{(pid=128728) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 14 15:58:35.749327 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: INFO nova.api.openstack.requestlog [None req-982ab70c-0c85-4a18-bcc7-6ff7d5e3aebc tempest-AttachVolumeTestJSON-1609025183 tempest-AttachVolumeTestJSON-1609025183-project] 10.222.0.61 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.156954 May 14 15:58:35.749928 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: [pid: 128728|app: 0|req: 635/1250] 10.222.0.61 () {60 vars in 1158 bytes} [Sat May 14 15:58:35 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 14 15:58:37.413550 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi [None req-d64c449e-1e71-4dc1-b5e0-5c42457aacbb tempest-AttachVolumeTestJSON-1609025183 tempest-AttachVolumeTestJSON-1609025183-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1349464829", "imageRef": "1381e3d5-fc27-4fa7-ab03-5d86278a0546", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "43d22ca1-3a83-4fdf-9675-b59a4f503c47"}], "security_groups": [{"name": "tempest-securitygroup--1979930343"}], "key_name": "tempest-keypair-185804968", "user_data": "}} {{(pid=128729) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 15:58:37.528713 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.network.neutron [None req-d64c449e-1e71-4dc1-b5e0-5c42457aacbb tempest-AttachVolumeTestJSON-1609025183 tempest-AttachVolumeTestJSON-1609025183-project] validate_networks() for [('43d22ca1-3a83-4fdf-9675-b59a4f503c47', None, None, None, None, None)] {{(pid=128729) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 14 15:58:38.106690 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.virt.hardware [None req-d64c449e-1e71-4dc1-b5e0-5c42457aacbb tempest-AttachVolumeTestJSON-1609025183 tempest-AttachVolumeTestJSON-1609025183-project] Flavor limits 0:0:0 {{(pid=128729) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 14 15:58:38.107566 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.virt.hardware [None req-d64c449e-1e71-4dc1-b5e0-5c42457aacbb tempest-AttachVolumeTestJSON-1609025183 tempest-AttachVolumeTestJSON-1609025183-project] Image limits 0:0:0 {{(pid=128729) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 14 15:58:38.108148 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.virt.hardware [None req-d64c449e-1e71-4dc1-b5e0-5c42457aacbb tempest-AttachVolumeTestJSON-1609025183 tempest-AttachVolumeTestJSON-1609025183-project] Flavor pref 0:0:0 {{(pid=128729) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 14 15:58:38.108718 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.virt.hardware [None req-d64c449e-1e71-4dc1-b5e0-5c42457aacbb tempest-AttachVolumeTestJSON-1609025183 tempest-AttachVolumeTestJSON-1609025183-project] Image pref 0:0:0 {{(pid=128729) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 14 15:58:38.109226 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.virt.hardware [None req-d64c449e-1e71-4dc1-b5e0-5c42457aacbb tempest-AttachVolumeTestJSON-1609025183 tempest-AttachVolumeTestJSON-1609025183-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128729) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 14 15:58:38.121328 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-d64c449e-1e71-4dc1-b5e0-5c42457aacbb tempest-AttachVolumeTestJSON-1609025183 tempest-AttachVolumeTestJSON-1609025183-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:58:38.121938 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-d64c449e-1e71-4dc1-b5e0-5c42457aacbb tempest-AttachVolumeTestJSON-1609025183 tempest-AttachVolumeTestJSON-1609025183-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:58:38.123004 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-d64c449e-1e71-4dc1-b5e0-5c42457aacbb tempest-AttachVolumeTestJSON-1609025183 tempest-AttachVolumeTestJSON-1609025183-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:58:38.123826 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-d64c449e-1e71-4dc1-b5e0-5c42457aacbb tempest-AttachVolumeTestJSON-1609025183 tempest-AttachVolumeTestJSON-1609025183-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:58:38.145291 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.quota [None req-d64c449e-1e71-4dc1-b5e0-5c42457aacbb tempest-AttachVolumeTestJSON-1609025183 tempest-AttachVolumeTestJSON-1609025183-project] Getting quotas for project 882808bd43644908a21ff8a58997c57f. Resources: {'instances', 'cores', 'ram'} {{(pid=128729) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 14 15:58:38.149144 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.quota [None req-d64c449e-1e71-4dc1-b5e0-5c42457aacbb tempest-AttachVolumeTestJSON-1609025183 tempest-AttachVolumeTestJSON-1609025183-project] Getting quotas for user 742938d3a02a4c8babf518b7b6cf53a7 and project 882808bd43644908a21ff8a58997c57f. Resources: {'instances', 'cores', 'ram'} {{(pid=128729) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 14 15:58:38.161159 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.compute.api [None req-d64c449e-1e71-4dc1-b5e0-5c42457aacbb tempest-AttachVolumeTestJSON-1609025183 tempest-AttachVolumeTestJSON-1609025183-project] Going to run 1 instances... {{(pid=128729) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 14 15:58:38.163562 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.compute.api [None req-d64c449e-1e71-4dc1-b5e0-5c42457aacbb tempest-AttachVolumeTestJSON-1609025183 tempest-AttachVolumeTestJSON-1609025183-project] [instance: 34a25afd-ca05-47fe-8bba-30442b7b5348] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='1381e3d5-fc27-4fa7-ab03-5d86278a0546',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128729) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 14 15:58:38.214265 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: INFO nova.api.openstack.requestlog [None req-d64c449e-1e71-4dc1-b5e0-5c42457aacbb tempest-AttachVolumeTestJSON-1609025183 tempest-AttachVolumeTestJSON-1609025183-project] 10.222.0.61 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.804911 May 14 15:58:38.219915 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: [pid: 128729|app: 0|req: 616/1251] 10.222.0.61 () {60 vars in 1146 bytes} [Sat May 14 15:58:37 2022] POST /compute/v2.1/servers => generated 402 bytes in 806 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 14 15:58:38.225610 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi [None req-18955de3-5e48-4c4f-9dda-d101f1b28a58 tempest-AttachVolumeTestJSON-1609025183 tempest-AttachVolumeTestJSON-1609025183-project] Calling method '>' {{(pid=128728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 15:58:38.226452 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.compute.api [None req-18955de3-5e48-4c4f-9dda-d101f1b28a58 tempest-AttachVolumeTestJSON-1609025183 tempest-AttachVolumeTestJSON-1609025183-project] [instance: 34a25afd-ca05-47fe-8bba-30442b7b5348] Fetching instance by UUID {{(pid=128728) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 15:58:38.300623 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.policy [None req-18955de3-5e48-4c4f-9dda-d101f1b28a58 tempest-AttachVolumeTestJSON-1609025183 tempest-AttachVolumeTestJSON-1609025183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '742938d3a02a4c8babf518b7b6cf53a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '882808bd43644908a21ff8a58997c57f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128728) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:58:38.311099 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: INFO nova.api.openstack.requestlog [None req-18955de3-5e48-4c4f-9dda-d101f1b28a58 tempest-AttachVolumeTestJSON-1609025183 tempest-AttachVolumeTestJSON-1609025183-project] 10.222.0.61 "GET /compute/v2.1/servers/34a25afd-ca05-47fe-8bba-30442b7b5348" status: 200 len: 1237 microversion: 2.1 time: 0.089893 May 14 15:58:38.311694 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: [pid: 128728|app: 0|req: 636/1252] 10.222.0.61 () {58 vars in 1235 bytes} [Sat May 14 15:58:38 2022] GET /compute/v2.1/servers/34a25afd-ca05-47fe-8bba-30442b7b5348 => generated 1237 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 15:58:39.332133 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi [None req-b2c2c069-1f14-4329-b151-c795fb6b3754 tempest-AttachVolumeTestJSON-1609025183 tempest-AttachVolumeTestJSON-1609025183-project] Calling method '>' {{(pid=128729) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 15:58:39.332808 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.compute.api [None req-b2c2c069-1f14-4329-b151-c795fb6b3754 tempest-AttachVolumeTestJSON-1609025183 tempest-AttachVolumeTestJSON-1609025183-project] [instance: 34a25afd-ca05-47fe-8bba-30442b7b5348] Fetching instance by UUID {{(pid=128729) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 15:58:39.341624 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-b2c2c069-1f14-4329-b151-c795fb6b3754 tempest-AttachVolumeTestJSON-1609025183 tempest-AttachVolumeTestJSON-1609025183-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:58:39.342378 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-b2c2c069-1f14-4329-b151-c795fb6b3754 tempest-AttachVolumeTestJSON-1609025183 tempest-AttachVolumeTestJSON-1609025183-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:58:39.343396 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-b2c2c069-1f14-4329-b151-c795fb6b3754 tempest-AttachVolumeTestJSON-1609025183 tempest-AttachVolumeTestJSON-1609025183-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:58:39.343990 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-b2c2c069-1f14-4329-b151-c795fb6b3754 tempest-AttachVolumeTestJSON-1609025183 tempest-AttachVolumeTestJSON-1609025183-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:58:39.429201 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.policy [None req-b2c2c069-1f14-4329-b151-c795fb6b3754 tempest-AttachVolumeTestJSON-1609025183 tempest-AttachVolumeTestJSON-1609025183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '742938d3a02a4c8babf518b7b6cf53a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '882808bd43644908a21ff8a58997c57f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128729) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:58:39.443395 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: INFO nova.api.openstack.requestlog [None req-b2c2c069-1f14-4329-b151-c795fb6b3754 tempest-AttachVolumeTestJSON-1609025183 tempest-AttachVolumeTestJSON-1609025183-project] 10.222.0.61 "GET /compute/v2.1/servers/34a25afd-ca05-47fe-8bba-30442b7b5348" status: 200 len: 1297 microversion: 2.1 time: 0.117742 May 14 15:58:39.444705 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: [pid: 128729|app: 0|req: 617/1253] 10.222.0.61 () {58 vars in 1235 bytes} [Sat May 14 15:58:39 2022] GET /compute/v2.1/servers/34a25afd-ca05-47fe-8bba-30442b7b5348 => generated 1297 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 15:58:40.461133 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi [None req-fca1d450-e1dc-4de2-81cc-a1a80f0afc0c tempest-AttachVolumeTestJSON-1609025183 tempest-AttachVolumeTestJSON-1609025183-project] Calling method '>' {{(pid=128728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 15:58:40.461731 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.compute.api [None req-fca1d450-e1dc-4de2-81cc-a1a80f0afc0c tempest-AttachVolumeTestJSON-1609025183 tempest-AttachVolumeTestJSON-1609025183-project] [instance: 34a25afd-ca05-47fe-8bba-30442b7b5348] Fetching instance by UUID {{(pid=128728) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 15:58:40.468279 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-fca1d450-e1dc-4de2-81cc-a1a80f0afc0c tempest-AttachVolumeTestJSON-1609025183 tempest-AttachVolumeTestJSON-1609025183-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:58:40.468724 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-fca1d450-e1dc-4de2-81cc-a1a80f0afc0c tempest-AttachVolumeTestJSON-1609025183 tempest-AttachVolumeTestJSON-1609025183-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:58:40.469503 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-fca1d450-e1dc-4de2-81cc-a1a80f0afc0c tempest-AttachVolumeTestJSON-1609025183 tempest-AttachVolumeTestJSON-1609025183-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:58:40.470023 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-fca1d450-e1dc-4de2-81cc-a1a80f0afc0c tempest-AttachVolumeTestJSON-1609025183 tempest-AttachVolumeTestJSON-1609025183-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:58:40.616346 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.policy [None req-fca1d450-e1dc-4de2-81cc-a1a80f0afc0c tempest-AttachVolumeTestJSON-1609025183 tempest-AttachVolumeTestJSON-1609025183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '742938d3a02a4c8babf518b7b6cf53a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '882808bd43644908a21ff8a58997c57f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128728) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:58:40.625107 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: INFO nova.api.openstack.requestlog [None req-fca1d450-e1dc-4de2-81cc-a1a80f0afc0c tempest-AttachVolumeTestJSON-1609025183 tempest-AttachVolumeTestJSON-1609025183-project] 10.222.0.61 "GET /compute/v2.1/servers/34a25afd-ca05-47fe-8bba-30442b7b5348" status: 200 len: 1363 microversion: 2.1 time: 0.167976 May 14 15:58:40.625798 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: [pid: 128728|app: 0|req: 637/1254] 10.222.0.61 () {58 vars in 1235 bytes} [Sat May 14 15:58:40 2022] GET /compute/v2.1/servers/34a25afd-ca05-47fe-8bba-30442b7b5348 => generated 1363 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 15:58:40.812920 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi [req-6af8038f-74b5-45a0-96f3-faa88a6f65ce req-b330e0b3-4908-4ba2-93f6-ed02905805c4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "34a25afd-ca05-47fe-8bba-30442b7b5348", "tag": "1df3d18b-4cc0-425e-9b62-d5b2705661f4"}]} {{(pid=128729) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 15:58:40.822224 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [req-6af8038f-74b5-45a0-96f3-faa88a6f65ce req-b330e0b3-4908-4ba2-93f6-ed02905805c4 service nova] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:58:40.822475 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [req-6af8038f-74b5-45a0-96f3-faa88a6f65ce req-b330e0b3-4908-4ba2-93f6-ed02905805c4 service nova] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:58:40.847751 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: INFO nova.api.openstack.compute.server_external_events [req-6af8038f-74b5-45a0-96f3-faa88a6f65ce req-b330e0b3-4908-4ba2-93f6-ed02905805c4 service nova] Creating event network-changed:1df3d18b-4cc0-425e-9b62-d5b2705661f4 for instance 34a25afd-ca05-47fe-8bba-30442b7b5348 on hv-cinder-83979 May 14 15:58:40.856969 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: INFO nova.api.openstack.requestlog [req-6af8038f-74b5-45a0-96f3-faa88a6f65ce req-b330e0b3-4908-4ba2-93f6-ed02905805c4 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049498 May 14 15:58:40.858301 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: [pid: 128729|app: 0|req: 618/1255] 10.222.0.61 () {64 vars in 1317 bytes} [Sat May 14 15:58:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 14 15:58:41.642901 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi [None req-59db26c2-7e95-4d49-882f-b095c6ebb75b tempest-AttachVolumeTestJSON-1609025183 tempest-AttachVolumeTestJSON-1609025183-project] Calling method '>' {{(pid=128728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 15:58:41.643518 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.compute.api [None req-59db26c2-7e95-4d49-882f-b095c6ebb75b tempest-AttachVolumeTestJSON-1609025183 tempest-AttachVolumeTestJSON-1609025183-project] [instance: 34a25afd-ca05-47fe-8bba-30442b7b5348] Fetching instance by UUID {{(pid=128728) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 15:58:41.649330 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-59db26c2-7e95-4d49-882f-b095c6ebb75b tempest-AttachVolumeTestJSON-1609025183 tempest-AttachVolumeTestJSON-1609025183-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:58:41.649785 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-59db26c2-7e95-4d49-882f-b095c6ebb75b tempest-AttachVolumeTestJSON-1609025183 tempest-AttachVolumeTestJSON-1609025183-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:58:41.650595 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-59db26c2-7e95-4d49-882f-b095c6ebb75b tempest-AttachVolumeTestJSON-1609025183 tempest-AttachVolumeTestJSON-1609025183-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:58:41.652333 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-59db26c2-7e95-4d49-882f-b095c6ebb75b tempest-AttachVolumeTestJSON-1609025183 tempest-AttachVolumeTestJSON-1609025183-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:58:41.775426 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.policy [None req-59db26c2-7e95-4d49-882f-b095c6ebb75b tempest-AttachVolumeTestJSON-1609025183 tempest-AttachVolumeTestJSON-1609025183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '742938d3a02a4c8babf518b7b6cf53a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '882808bd43644908a21ff8a58997c57f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128728) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:58:41.783289 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: INFO nova.api.openstack.requestlog [None req-59db26c2-7e95-4d49-882f-b095c6ebb75b tempest-AttachVolumeTestJSON-1609025183 tempest-AttachVolumeTestJSON-1609025183-project] 10.222.0.61 "GET /compute/v2.1/servers/34a25afd-ca05-47fe-8bba-30442b7b5348" status: 200 len: 1363 microversion: 2.1 time: 0.144474 May 14 15:58:41.783854 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: [pid: 128728|app: 0|req: 638/1256] 10.222.0.61 () {58 vars in 1235 bytes} [Sat May 14 15:58:41 2022] GET /compute/v2.1/servers/34a25afd-ca05-47fe-8bba-30442b7b5348 => generated 1363 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 15:58:42.801139 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi [None req-cb63504b-0037-4389-a5bc-8aabb2617448 tempest-AttachVolumeTestJSON-1609025183 tempest-AttachVolumeTestJSON-1609025183-project] Calling method '>' {{(pid=128729) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 15:58:42.801750 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.compute.api [None req-cb63504b-0037-4389-a5bc-8aabb2617448 tempest-AttachVolumeTestJSON-1609025183 tempest-AttachVolumeTestJSON-1609025183-project] [instance: 34a25afd-ca05-47fe-8bba-30442b7b5348] Fetching instance by UUID {{(pid=128729) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 15:58:42.808380 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-cb63504b-0037-4389-a5bc-8aabb2617448 tempest-AttachVolumeTestJSON-1609025183 tempest-AttachVolumeTestJSON-1609025183-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:58:42.809199 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-cb63504b-0037-4389-a5bc-8aabb2617448 tempest-AttachVolumeTestJSON-1609025183 tempest-AttachVolumeTestJSON-1609025183-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:58:42.810513 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-cb63504b-0037-4389-a5bc-8aabb2617448 tempest-AttachVolumeTestJSON-1609025183 tempest-AttachVolumeTestJSON-1609025183-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:58:42.810963 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-cb63504b-0037-4389-a5bc-8aabb2617448 tempest-AttachVolumeTestJSON-1609025183 tempest-AttachVolumeTestJSON-1609025183-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:58:42.940541 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.policy [None req-cb63504b-0037-4389-a5bc-8aabb2617448 tempest-AttachVolumeTestJSON-1609025183 tempest-AttachVolumeTestJSON-1609025183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '742938d3a02a4c8babf518b7b6cf53a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '882808bd43644908a21ff8a58997c57f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128729) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:58:42.947926 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: INFO nova.api.openstack.requestlog [None req-cb63504b-0037-4389-a5bc-8aabb2617448 tempest-AttachVolumeTestJSON-1609025183 tempest-AttachVolumeTestJSON-1609025183-project] 10.222.0.61 "GET /compute/v2.1/servers/34a25afd-ca05-47fe-8bba-30442b7b5348" status: 200 len: 1363 microversion: 2.1 time: 0.151435 May 14 15:58:42.948712 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: [pid: 128729|app: 0|req: 619/1257] 10.222.0.61 () {58 vars in 1235 bytes} [Sat May 14 15:58:42 2022] GET /compute/v2.1/servers/34a25afd-ca05-47fe-8bba-30442b7b5348 => generated 1363 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 15:58:43.964914 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi [None req-215996dc-a4e0-41d4-9a8e-7a32985e42bb tempest-AttachVolumeTestJSON-1609025183 tempest-AttachVolumeTestJSON-1609025183-project] Calling method '>' {{(pid=128728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 15:58:43.965550 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.compute.api [None req-215996dc-a4e0-41d4-9a8e-7a32985e42bb tempest-AttachVolumeTestJSON-1609025183 tempest-AttachVolumeTestJSON-1609025183-project] [instance: 34a25afd-ca05-47fe-8bba-30442b7b5348] Fetching instance by UUID {{(pid=128728) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 15:58:43.971902 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-215996dc-a4e0-41d4-9a8e-7a32985e42bb tempest-AttachVolumeTestJSON-1609025183 tempest-AttachVolumeTestJSON-1609025183-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:58:43.972348 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-215996dc-a4e0-41d4-9a8e-7a32985e42bb tempest-AttachVolumeTestJSON-1609025183 tempest-AttachVolumeTestJSON-1609025183-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:58:43.973115 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-215996dc-a4e0-41d4-9a8e-7a32985e42bb tempest-AttachVolumeTestJSON-1609025183 tempest-AttachVolumeTestJSON-1609025183-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:58:43.973552 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-215996dc-a4e0-41d4-9a8e-7a32985e42bb tempest-AttachVolumeTestJSON-1609025183 tempest-AttachVolumeTestJSON-1609025183-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:58:44.107665 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.policy [None req-215996dc-a4e0-41d4-9a8e-7a32985e42bb tempest-AttachVolumeTestJSON-1609025183 tempest-AttachVolumeTestJSON-1609025183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '742938d3a02a4c8babf518b7b6cf53a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '882808bd43644908a21ff8a58997c57f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128728) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:58:44.115276 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: INFO nova.api.openstack.requestlog [None req-215996dc-a4e0-41d4-9a8e-7a32985e42bb tempest-AttachVolumeTestJSON-1609025183 tempest-AttachVolumeTestJSON-1609025183-project] 10.222.0.61 "GET /compute/v2.1/servers/34a25afd-ca05-47fe-8bba-30442b7b5348" status: 200 len: 1363 microversion: 2.1 time: 0.155037 May 14 15:58:44.115852 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: [pid: 128728|app: 0|req: 639/1258] 10.222.0.61 () {58 vars in 1235 bytes} [Sat May 14 15:58:43 2022] GET /compute/v2.1/servers/34a25afd-ca05-47fe-8bba-30442b7b5348 => generated 1363 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 15:58:45.133433 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi [None req-cd086040-b2e9-48af-9116-221670b4e312 tempest-AttachVolumeTestJSON-1609025183 tempest-AttachVolumeTestJSON-1609025183-project] Calling method '>' {{(pid=128729) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 15:58:45.134098 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.compute.api [None req-cd086040-b2e9-48af-9116-221670b4e312 tempest-AttachVolumeTestJSON-1609025183 tempest-AttachVolumeTestJSON-1609025183-project] [instance: 34a25afd-ca05-47fe-8bba-30442b7b5348] Fetching instance by UUID {{(pid=128729) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 15:58:45.141308 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-cd086040-b2e9-48af-9116-221670b4e312 tempest-AttachVolumeTestJSON-1609025183 tempest-AttachVolumeTestJSON-1609025183-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:58:45.141703 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-cd086040-b2e9-48af-9116-221670b4e312 tempest-AttachVolumeTestJSON-1609025183 tempest-AttachVolumeTestJSON-1609025183-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:58:45.142515 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-cd086040-b2e9-48af-9116-221670b4e312 tempest-AttachVolumeTestJSON-1609025183 tempest-AttachVolumeTestJSON-1609025183-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:58:45.142955 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-cd086040-b2e9-48af-9116-221670b4e312 tempest-AttachVolumeTestJSON-1609025183 tempest-AttachVolumeTestJSON-1609025183-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:58:45.288524 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.policy [None req-cd086040-b2e9-48af-9116-221670b4e312 tempest-AttachVolumeTestJSON-1609025183 tempest-AttachVolumeTestJSON-1609025183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '742938d3a02a4c8babf518b7b6cf53a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '882808bd43644908a21ff8a58997c57f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128729) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:58:45.296698 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: INFO nova.api.openstack.requestlog [None req-cd086040-b2e9-48af-9116-221670b4e312 tempest-AttachVolumeTestJSON-1609025183 tempest-AttachVolumeTestJSON-1609025183-project] 10.222.0.61 "GET /compute/v2.1/servers/34a25afd-ca05-47fe-8bba-30442b7b5348" status: 200 len: 1363 microversion: 2.1 time: 0.167445 May 14 15:58:45.297696 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: [pid: 128729|app: 0|req: 620/1259] 10.222.0.61 () {58 vars in 1235 bytes} [Sat May 14 15:58:45 2022] GET /compute/v2.1/servers/34a25afd-ca05-47fe-8bba-30442b7b5348 => generated 1363 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 15:58:46.314343 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi [None req-7bff0c0c-ed40-422a-aa6f-55043f8f5bce tempest-AttachVolumeTestJSON-1609025183 tempest-AttachVolumeTestJSON-1609025183-project] Calling method '>' {{(pid=128728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 15:58:46.314962 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.compute.api [None req-7bff0c0c-ed40-422a-aa6f-55043f8f5bce tempest-AttachVolumeTestJSON-1609025183 tempest-AttachVolumeTestJSON-1609025183-project] [instance: 34a25afd-ca05-47fe-8bba-30442b7b5348] Fetching instance by UUID {{(pid=128728) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 15:58:46.321242 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-7bff0c0c-ed40-422a-aa6f-55043f8f5bce tempest-AttachVolumeTestJSON-1609025183 tempest-AttachVolumeTestJSON-1609025183-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:58:46.321695 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-7bff0c0c-ed40-422a-aa6f-55043f8f5bce tempest-AttachVolumeTestJSON-1609025183 tempest-AttachVolumeTestJSON-1609025183-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:58:46.322490 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-7bff0c0c-ed40-422a-aa6f-55043f8f5bce tempest-AttachVolumeTestJSON-1609025183 tempest-AttachVolumeTestJSON-1609025183-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:58:46.323473 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-7bff0c0c-ed40-422a-aa6f-55043f8f5bce tempest-AttachVolumeTestJSON-1609025183 tempest-AttachVolumeTestJSON-1609025183-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:58:46.454789 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.policy [None req-7bff0c0c-ed40-422a-aa6f-55043f8f5bce tempest-AttachVolumeTestJSON-1609025183 tempest-AttachVolumeTestJSON-1609025183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '742938d3a02a4c8babf518b7b6cf53a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '882808bd43644908a21ff8a58997c57f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128728) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:58:46.462036 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: INFO nova.api.openstack.requestlog [None req-7bff0c0c-ed40-422a-aa6f-55043f8f5bce tempest-AttachVolumeTestJSON-1609025183 tempest-AttachVolumeTestJSON-1609025183-project] 10.222.0.61 "GET /compute/v2.1/servers/34a25afd-ca05-47fe-8bba-30442b7b5348" status: 200 len: 1363 microversion: 2.1 time: 0.151555 May 14 15:58:46.462626 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: [pid: 128728|app: 0|req: 640/1260] 10.222.0.61 () {58 vars in 1235 bytes} [Sat May 14 15:58:46 2022] GET /compute/v2.1/servers/34a25afd-ca05-47fe-8bba-30442b7b5348 => generated 1363 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 15:58:47.477955 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi [None req-fe146217-d39a-40a9-9d32-327611ecda83 tempest-AttachVolumeTestJSON-1609025183 tempest-AttachVolumeTestJSON-1609025183-project] Calling method '>' {{(pid=128729) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 15:58:47.478593 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.compute.api [None req-fe146217-d39a-40a9-9d32-327611ecda83 tempest-AttachVolumeTestJSON-1609025183 tempest-AttachVolumeTestJSON-1609025183-project] [instance: 34a25afd-ca05-47fe-8bba-30442b7b5348] Fetching instance by UUID {{(pid=128729) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 15:58:47.485416 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-fe146217-d39a-40a9-9d32-327611ecda83 tempest-AttachVolumeTestJSON-1609025183 tempest-AttachVolumeTestJSON-1609025183-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:58:47.485867 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-fe146217-d39a-40a9-9d32-327611ecda83 tempest-AttachVolumeTestJSON-1609025183 tempest-AttachVolumeTestJSON-1609025183-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:58:47.486740 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-fe146217-d39a-40a9-9d32-327611ecda83 tempest-AttachVolumeTestJSON-1609025183 tempest-AttachVolumeTestJSON-1609025183-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:58:47.487181 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-fe146217-d39a-40a9-9d32-327611ecda83 tempest-AttachVolumeTestJSON-1609025183 tempest-AttachVolumeTestJSON-1609025183-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:58:47.616657 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.policy [None req-fe146217-d39a-40a9-9d32-327611ecda83 tempest-AttachVolumeTestJSON-1609025183 tempest-AttachVolumeTestJSON-1609025183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '742938d3a02a4c8babf518b7b6cf53a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '882808bd43644908a21ff8a58997c57f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128729) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:58:47.624942 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: INFO nova.api.openstack.requestlog [None req-fe146217-d39a-40a9-9d32-327611ecda83 tempest-AttachVolumeTestJSON-1609025183 tempest-AttachVolumeTestJSON-1609025183-project] 10.222.0.61 "GET /compute/v2.1/servers/34a25afd-ca05-47fe-8bba-30442b7b5348" status: 200 len: 1363 microversion: 2.1 time: 0.150841 May 14 15:58:47.625708 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: [pid: 128729|app: 0|req: 621/1261] 10.222.0.61 () {58 vars in 1235 bytes} [Sat May 14 15:58:47 2022] GET /compute/v2.1/servers/34a25afd-ca05-47fe-8bba-30442b7b5348 => generated 1363 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 15:58:48.643566 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi [None req-9be057ee-1932-46e1-8a61-6d74733725e9 tempest-AttachVolumeTestJSON-1609025183 tempest-AttachVolumeTestJSON-1609025183-project] Calling method '>' {{(pid=128728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 15:58:48.644172 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.compute.api [None req-9be057ee-1932-46e1-8a61-6d74733725e9 tempest-AttachVolumeTestJSON-1609025183 tempest-AttachVolumeTestJSON-1609025183-project] [instance: 34a25afd-ca05-47fe-8bba-30442b7b5348] Fetching instance by UUID {{(pid=128728) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 15:58:48.650610 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-9be057ee-1932-46e1-8a61-6d74733725e9 tempest-AttachVolumeTestJSON-1609025183 tempest-AttachVolumeTestJSON-1609025183-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:58:48.651099 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-9be057ee-1932-46e1-8a61-6d74733725e9 tempest-AttachVolumeTestJSON-1609025183 tempest-AttachVolumeTestJSON-1609025183-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:58:48.651905 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-9be057ee-1932-46e1-8a61-6d74733725e9 tempest-AttachVolumeTestJSON-1609025183 tempest-AttachVolumeTestJSON-1609025183-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:58:48.652340 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-9be057ee-1932-46e1-8a61-6d74733725e9 tempest-AttachVolumeTestJSON-1609025183 tempest-AttachVolumeTestJSON-1609025183-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:58:48.782269 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.policy [None req-9be057ee-1932-46e1-8a61-6d74733725e9 tempest-AttachVolumeTestJSON-1609025183 tempest-AttachVolumeTestJSON-1609025183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '742938d3a02a4c8babf518b7b6cf53a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '882808bd43644908a21ff8a58997c57f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128728) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:58:48.789459 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: INFO nova.api.openstack.requestlog [None req-9be057ee-1932-46e1-8a61-6d74733725e9 tempest-AttachVolumeTestJSON-1609025183 tempest-AttachVolumeTestJSON-1609025183-project] 10.222.0.61 "GET /compute/v2.1/servers/34a25afd-ca05-47fe-8bba-30442b7b5348" status: 200 len: 1363 microversion: 2.1 time: 0.150856 May 14 15:58:48.790018 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: [pid: 128728|app: 0|req: 641/1262] 10.222.0.61 () {58 vars in 1235 bytes} [Sat May 14 15:58:48 2022] GET /compute/v2.1/servers/34a25afd-ca05-47fe-8bba-30442b7b5348 => generated 1363 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 15:58:49.806769 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi [None req-7576d9d8-52b7-4847-ba52-877dacd1877b tempest-AttachVolumeTestJSON-1609025183 tempest-AttachVolumeTestJSON-1609025183-project] Calling method '>' {{(pid=128729) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 15:58:49.807997 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.compute.api [None req-7576d9d8-52b7-4847-ba52-877dacd1877b tempest-AttachVolumeTestJSON-1609025183 tempest-AttachVolumeTestJSON-1609025183-project] [instance: 34a25afd-ca05-47fe-8bba-30442b7b5348] Fetching instance by UUID {{(pid=128729) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 15:58:49.814182 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-7576d9d8-52b7-4847-ba52-877dacd1877b tempest-AttachVolumeTestJSON-1609025183 tempest-AttachVolumeTestJSON-1609025183-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:58:49.814661 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-7576d9d8-52b7-4847-ba52-877dacd1877b tempest-AttachVolumeTestJSON-1609025183 tempest-AttachVolumeTestJSON-1609025183-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:58:49.815420 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-7576d9d8-52b7-4847-ba52-877dacd1877b tempest-AttachVolumeTestJSON-1609025183 tempest-AttachVolumeTestJSON-1609025183-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:58:49.815857 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-7576d9d8-52b7-4847-ba52-877dacd1877b tempest-AttachVolumeTestJSON-1609025183 tempest-AttachVolumeTestJSON-1609025183-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:58:49.945729 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.policy [None req-7576d9d8-52b7-4847-ba52-877dacd1877b tempest-AttachVolumeTestJSON-1609025183 tempest-AttachVolumeTestJSON-1609025183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '742938d3a02a4c8babf518b7b6cf53a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '882808bd43644908a21ff8a58997c57f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128729) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:58:49.953078 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: INFO nova.api.openstack.requestlog [None req-7576d9d8-52b7-4847-ba52-877dacd1877b tempest-AttachVolumeTestJSON-1609025183 tempest-AttachVolumeTestJSON-1609025183-project] 10.222.0.61 "GET /compute/v2.1/servers/34a25afd-ca05-47fe-8bba-30442b7b5348" status: 200 len: 1363 microversion: 2.1 time: 0.150112 May 14 15:58:49.953639 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: [pid: 128729|app: 0|req: 622/1263] 10.222.0.61 () {58 vars in 1235 bytes} [Sat May 14 15:58:49 2022] GET /compute/v2.1/servers/34a25afd-ca05-47fe-8bba-30442b7b5348 => generated 1363 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 15:58:50.419330 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi [req-12de803a-92bb-457a-8cae-d6dabc1a90cd req-6c2871f2-b0c5-4343-80f2-6e561eb17e3e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "34a25afd-ca05-47fe-8bba-30442b7b5348", "name": "network-vif-plugged", "status": "completed", "tag": "1df3d18b-4cc0-425e-9b62-d5b2705661f4"}]} {{(pid=128728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 15:58:50.427851 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [req-12de803a-92bb-457a-8cae-d6dabc1a90cd req-6c2871f2-b0c5-4343-80f2-6e561eb17e3e service nova] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:58:50.428296 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [req-12de803a-92bb-457a-8cae-d6dabc1a90cd req-6c2871f2-b0c5-4343-80f2-6e561eb17e3e service nova] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:58:50.440497 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: INFO nova.api.openstack.compute.server_external_events [req-12de803a-92bb-457a-8cae-d6dabc1a90cd req-6c2871f2-b0c5-4343-80f2-6e561eb17e3e service nova] Creating event network-vif-plugged:1df3d18b-4cc0-425e-9b62-d5b2705661f4 for instance 34a25afd-ca05-47fe-8bba-30442b7b5348 on hv-cinder-83979 May 14 15:58:50.446001 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: INFO nova.api.openstack.requestlog [req-12de803a-92bb-457a-8cae-d6dabc1a90cd req-6c2871f2-b0c5-4343-80f2-6e561eb17e3e service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032049 May 14 15:58:50.446873 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: [pid: 128728|app: 0|req: 642/1264] 10.222.0.61 () {64 vars in 1317 bytes} [Sat May 14 15:58:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 14 15:58:50.970358 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi [None req-bed6b949-878c-4e23-b3c7-a51e96948727 tempest-AttachVolumeTestJSON-1609025183 tempest-AttachVolumeTestJSON-1609025183-project] Calling method '>' {{(pid=128729) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 15:58:50.970910 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.compute.api [None req-bed6b949-878c-4e23-b3c7-a51e96948727 tempest-AttachVolumeTestJSON-1609025183 tempest-AttachVolumeTestJSON-1609025183-project] [instance: 34a25afd-ca05-47fe-8bba-30442b7b5348] Fetching instance by UUID {{(pid=128729) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 15:58:50.977250 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-bed6b949-878c-4e23-b3c7-a51e96948727 tempest-AttachVolumeTestJSON-1609025183 tempest-AttachVolumeTestJSON-1609025183-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:58:50.977703 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-bed6b949-878c-4e23-b3c7-a51e96948727 tempest-AttachVolumeTestJSON-1609025183 tempest-AttachVolumeTestJSON-1609025183-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:58:50.978506 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-bed6b949-878c-4e23-b3c7-a51e96948727 tempest-AttachVolumeTestJSON-1609025183 tempest-AttachVolumeTestJSON-1609025183-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:58:50.979675 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-bed6b949-878c-4e23-b3c7-a51e96948727 tempest-AttachVolumeTestJSON-1609025183 tempest-AttachVolumeTestJSON-1609025183-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:58:51.103716 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.policy [None req-bed6b949-878c-4e23-b3c7-a51e96948727 tempest-AttachVolumeTestJSON-1609025183 tempest-AttachVolumeTestJSON-1609025183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '742938d3a02a4c8babf518b7b6cf53a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '882808bd43644908a21ff8a58997c57f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128729) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:58:51.111707 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: INFO nova.api.openstack.requestlog [None req-bed6b949-878c-4e23-b3c7-a51e96948727 tempest-AttachVolumeTestJSON-1609025183 tempest-AttachVolumeTestJSON-1609025183-project] 10.222.0.61 "GET /compute/v2.1/servers/34a25afd-ca05-47fe-8bba-30442b7b5348" status: 200 len: 1363 microversion: 2.1 time: 0.145307 May 14 15:58:51.112250 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: [pid: 128729|app: 0|req: 623/1265] 10.222.0.61 () {58 vars in 1235 bytes} [Sat May 14 15:58:50 2022] GET /compute/v2.1/servers/34a25afd-ca05-47fe-8bba-30442b7b5348 => generated 1363 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 15:58:52.128906 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi [None req-cc96184a-365d-4e89-ad2b-9edf187e7b66 tempest-AttachVolumeTestJSON-1609025183 tempest-AttachVolumeTestJSON-1609025183-project] Calling method '>' {{(pid=128728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 15:58:52.129601 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.compute.api [None req-cc96184a-365d-4e89-ad2b-9edf187e7b66 tempest-AttachVolumeTestJSON-1609025183 tempest-AttachVolumeTestJSON-1609025183-project] [instance: 34a25afd-ca05-47fe-8bba-30442b7b5348] Fetching instance by UUID {{(pid=128728) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 15:58:52.136043 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-cc96184a-365d-4e89-ad2b-9edf187e7b66 tempest-AttachVolumeTestJSON-1609025183 tempest-AttachVolumeTestJSON-1609025183-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:58:52.136488 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-cc96184a-365d-4e89-ad2b-9edf187e7b66 tempest-AttachVolumeTestJSON-1609025183 tempest-AttachVolumeTestJSON-1609025183-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:58:52.137250 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-cc96184a-365d-4e89-ad2b-9edf187e7b66 tempest-AttachVolumeTestJSON-1609025183 tempest-AttachVolumeTestJSON-1609025183-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:58:52.137683 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-cc96184a-365d-4e89-ad2b-9edf187e7b66 tempest-AttachVolumeTestJSON-1609025183 tempest-AttachVolumeTestJSON-1609025183-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:58:52.265897 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.policy [None req-cc96184a-365d-4e89-ad2b-9edf187e7b66 tempest-AttachVolumeTestJSON-1609025183 tempest-AttachVolumeTestJSON-1609025183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '742938d3a02a4c8babf518b7b6cf53a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '882808bd43644908a21ff8a58997c57f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128728) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:58:52.273037 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: INFO nova.api.openstack.requestlog [None req-cc96184a-365d-4e89-ad2b-9edf187e7b66 tempest-AttachVolumeTestJSON-1609025183 tempest-AttachVolumeTestJSON-1609025183-project] 10.222.0.61 "GET /compute/v2.1/servers/34a25afd-ca05-47fe-8bba-30442b7b5348" status: 200 len: 1363 microversion: 2.1 time: 0.148731 May 14 15:58:52.273588 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: [pid: 128728|app: 0|req: 643/1266] 10.222.0.61 () {58 vars in 1235 bytes} [Sat May 14 15:58:52 2022] GET /compute/v2.1/servers/34a25afd-ca05-47fe-8bba-30442b7b5348 => generated 1363 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 15:58:53.289987 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi [None req-1deadf8a-4341-4713-a3b1-11a01c95e401 tempest-AttachVolumeTestJSON-1609025183 tempest-AttachVolumeTestJSON-1609025183-project] Calling method '>' {{(pid=128729) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 15:58:53.290568 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.compute.api [None req-1deadf8a-4341-4713-a3b1-11a01c95e401 tempest-AttachVolumeTestJSON-1609025183 tempest-AttachVolumeTestJSON-1609025183-project] [instance: 34a25afd-ca05-47fe-8bba-30442b7b5348] Fetching instance by UUID {{(pid=128729) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 15:58:53.297384 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-1deadf8a-4341-4713-a3b1-11a01c95e401 tempest-AttachVolumeTestJSON-1609025183 tempest-AttachVolumeTestJSON-1609025183-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:58:53.297855 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-1deadf8a-4341-4713-a3b1-11a01c95e401 tempest-AttachVolumeTestJSON-1609025183 tempest-AttachVolumeTestJSON-1609025183-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:58:53.298784 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-1deadf8a-4341-4713-a3b1-11a01c95e401 tempest-AttachVolumeTestJSON-1609025183 tempest-AttachVolumeTestJSON-1609025183-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:58:53.299309 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-1deadf8a-4341-4713-a3b1-11a01c95e401 tempest-AttachVolumeTestJSON-1609025183 tempest-AttachVolumeTestJSON-1609025183-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:58:53.425006 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.policy [None req-1deadf8a-4341-4713-a3b1-11a01c95e401 tempest-AttachVolumeTestJSON-1609025183 tempest-AttachVolumeTestJSON-1609025183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '742938d3a02a4c8babf518b7b6cf53a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '882808bd43644908a21ff8a58997c57f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128729) authorize /opt/stack/nova/nova/policy.py:199}} May 14 15:58:53.433056 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: INFO nova.api.openstack.requestlog [None req-1deadf8a-4341-4713-a3b1-11a01c95e401 tempest-AttachVolumeTestJSON-1609025183 tempest-AttachVolumeTestJSON-1609025183-project] 10.222.0.61 "GET /compute/v2.1/servers/34a25afd-ca05-47fe-8bba-30442b7b5348" status: 200 len: 1549 microversion: 2.1 time: 0.146950 May 14 15:58:53.433630 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: [pid: 128729|app: 0|req: 624/1267] 10.222.0.61 () {58 vars in 1235 bytes} [Sat May 14 15:58:53 2022] GET /compute/v2.1/servers/34a25afd-ca05-47fe-8bba-30442b7b5348 => generated 1549 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 15:58:53.450194 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi [None req-9995273a-bf12-4281-b20b-015b24f61495 tempest-AttachVolumeTestJSON-1609025183 tempest-AttachVolumeTestJSON-1609025183-project] Calling method '>' {{(pid=128728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 15:58:53.450720 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.compute.api [None req-9995273a-bf12-4281-b20b-015b24f61495 tempest-AttachVolumeTestJSON-1609025183 tempest-AttachVolumeTestJSON-1609025183-project] [instance: 34a25afd-ca05-47fe-8bba-30442b7b5348] Fetching instance by UUID {{(pid=128728) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 15:58:53.456948 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-9995273a-bf12-4281-b20b-015b24f61495 tempest-AttachVolumeTestJSON-1609025183 tempest-AttachVolumeTestJSON-1609025183-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:58:53.457398 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-9995273a-bf12-4281-b20b-015b24f61495 tempest-AttachVolumeTestJSON-1609025183 tempest-AttachVolumeTestJSON-1609025183-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:58:53.458157 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-9995273a-bf12-4281-b20b-015b24f61495 tempest-AttachVolumeTestJSON-1609025183 tempest-AttachVolumeTestJSON-1609025183-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:58:53.458655 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-9995273a-bf12-4281-b20b-015b24f61495 tempest-AttachVolumeTestJSON-1609025183 tempest-AttachVolumeTestJSON-1609025183-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:58:53.540711 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: INFO nova.api.openstack.requestlog [None req-9995273a-bf12-4281-b20b-015b24f61495 tempest-AttachVolumeTestJSON-1609025183 tempest-AttachVolumeTestJSON-1609025183-project] 10.222.0.61 "GET /compute/v2.1/servers/34a25afd-ca05-47fe-8bba-30442b7b5348/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.094920 May 14 15:58:53.541743 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: [pid: 128728|app: 0|req: 644/1268] 10.222.0.61 () {58 vars in 1274 bytes} [Sat May 14 15:58:53 2022] GET /compute/v2.1/servers/34a25afd-ca05-47fe-8bba-30442b7b5348/os-interface => generated 285 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 14 15:58:54.498068 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi [req-f0ecc5e2-ad9a-4836-9ef9-ba94da97d70c req-574fe3b4-635e-4809-9513-65619fbe03eb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "34a25afd-ca05-47fe-8bba-30442b7b5348", "tag": "1df3d18b-4cc0-425e-9b62-d5b2705661f4"}]} {{(pid=128729) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 15:58:54.506301 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [req-f0ecc5e2-ad9a-4836-9ef9-ba94da97d70c req-574fe3b4-635e-4809-9513-65619fbe03eb service nova] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 15:58:54.506783 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [req-f0ecc5e2-ad9a-4836-9ef9-ba94da97d70c req-574fe3b4-635e-4809-9513-65619fbe03eb service nova] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 15:58:54.518102 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: INFO nova.api.openstack.compute.server_external_events [req-f0ecc5e2-ad9a-4836-9ef9-ba94da97d70c req-574fe3b4-635e-4809-9513-65619fbe03eb service nova] Creating event network-changed:1df3d18b-4cc0-425e-9b62-d5b2705661f4 for instance 34a25afd-ca05-47fe-8bba-30442b7b5348 on hv-cinder-83979 May 14 15:58:54.523037 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: INFO nova.api.openstack.requestlog [req-f0ecc5e2-ad9a-4836-9ef9-ba94da97d70c req-574fe3b4-635e-4809-9513-65619fbe03eb service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.028699 May 14 15:58:54.523812 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: [pid: 128729|app: 0|req: 625/1269] 10.222.0.61 () {64 vars in 1317 bytes} [Sat May 14 15:58:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 14 16:00:08.241184 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi [None req-2fbc48b0-d89c-4d4a-bf8c-a1955c03ec3f tempest-TestVolumeBootPattern-2062489882 tempest-TestVolumeBootPattern-2062489882-project] Calling method '>' {{(pid=128728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 16:00:08.241734 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.compute.api [None req-2fbc48b0-d89c-4d4a-bf8c-a1955c03ec3f tempest-TestVolumeBootPattern-2062489882 tempest-TestVolumeBootPattern-2062489882-project] [instance: 6dd9e299-5776-4848-b4ab-6d07424a3f8e] Fetching instance by UUID {{(pid=128728) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 16:00:08.243780 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi [req-2f01f955-7710-4719-9764-cfc3377f598e req-29cff800-90fd-4756-a9d1-429c5dde2e5a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6dd9e299-5776-4848-b4ab-6d07424a3f8e", "tag": "d761eef1-490d-4627-a1cc-64f2436e7c0c"}]} {{(pid=128729) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 16:00:08.248922 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-2fbc48b0-d89c-4d4a-bf8c-a1955c03ec3f tempest-TestVolumeBootPattern-2062489882 tempest-TestVolumeBootPattern-2062489882-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 16:00:08.249579 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-2fbc48b0-d89c-4d4a-bf8c-a1955c03ec3f tempest-TestVolumeBootPattern-2062489882 tempest-TestVolumeBootPattern-2062489882-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 16:00:08.250390 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-2fbc48b0-d89c-4d4a-bf8c-a1955c03ec3f tempest-TestVolumeBootPattern-2062489882 tempest-TestVolumeBootPattern-2062489882-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 16:00:08.250835 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-2fbc48b0-d89c-4d4a-bf8c-a1955c03ec3f tempest-TestVolumeBootPattern-2062489882 tempest-TestVolumeBootPattern-2062489882-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 16:00:08.253150 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [req-2f01f955-7710-4719-9764-cfc3377f598e req-29cff800-90fd-4756-a9d1-429c5dde2e5a service nova] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 16:00:08.253834 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [req-2f01f955-7710-4719-9764-cfc3377f598e req-29cff800-90fd-4756-a9d1-429c5dde2e5a service nova] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 16:00:08.264997 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: INFO nova.api.openstack.compute.server_external_events [req-2f01f955-7710-4719-9764-cfc3377f598e req-29cff800-90fd-4756-a9d1-429c5dde2e5a service nova] Creating event network-changed:d761eef1-490d-4627-a1cc-64f2436e7c0c for instance 6dd9e299-5776-4848-b4ab-6d07424a3f8e on hv-cinder-83979 May 14 16:00:08.270753 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: INFO nova.api.openstack.requestlog [req-2f01f955-7710-4719-9764-cfc3377f598e req-29cff800-90fd-4756-a9d1-429c5dde2e5a service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032346 May 14 16:00:08.271717 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: [pid: 128729|app: 0|req: 626/1270] 10.222.0.61 () {64 vars in 1317 bytes} [Sat May 14 16:00:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 14 16:00:08.277078 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.compute.api [None req-2fbc48b0-d89c-4d4a-bf8c-a1955c03ec3f tempest-TestVolumeBootPattern-2062489882 tempest-TestVolumeBootPattern-2062489882-project] [instance: 6dd9e299-5776-4848-b4ab-6d07424a3f8e] Going to try to terminate instance {{(pid=128728) delete /opt/stack/nova/nova/compute/api.py:2664}} May 14 16:00:08.359507 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: INFO nova.api.openstack.requestlog [None req-2fbc48b0-d89c-4d4a-bf8c-a1955c03ec3f tempest-TestVolumeBootPattern-2062489882 tempest-TestVolumeBootPattern-2062489882-project] 10.222.0.61 "DELETE /compute/v2.1/servers/6dd9e299-5776-4848-b4ab-6d07424a3f8e" status: 204 len: 0 microversion: 2.1 time: 0.123302 May 14 16:00:08.359970 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: [pid: 128728|app: 0|req: 645/1271] 10.222.0.61 () {58 vars in 1238 bytes} [Sat May 14 16:00:08 2022] DELETE /compute/v2.1/servers/6dd9e299-5776-4848-b4ab-6d07424a3f8e => generated 0 bytes in 125 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 14 16:00:08.369261 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi [None req-d2d2a534-8f78-4c5d-b22e-dd6d5f4f49f9 tempest-TestVolumeBootPattern-2062489882 tempest-TestVolumeBootPattern-2062489882-project] Calling method '>' {{(pid=128729) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 16:00:08.370289 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.compute.api [None req-d2d2a534-8f78-4c5d-b22e-dd6d5f4f49f9 tempest-TestVolumeBootPattern-2062489882 tempest-TestVolumeBootPattern-2062489882-project] [instance: 6dd9e299-5776-4848-b4ab-6d07424a3f8e] Fetching instance by UUID {{(pid=128729) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 16:00:08.377148 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-d2d2a534-8f78-4c5d-b22e-dd6d5f4f49f9 tempest-TestVolumeBootPattern-2062489882 tempest-TestVolumeBootPattern-2062489882-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 16:00:08.377622 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-d2d2a534-8f78-4c5d-b22e-dd6d5f4f49f9 tempest-TestVolumeBootPattern-2062489882 tempest-TestVolumeBootPattern-2062489882-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 16:00:08.378436 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-d2d2a534-8f78-4c5d-b22e-dd6d5f4f49f9 tempest-TestVolumeBootPattern-2062489882 tempest-TestVolumeBootPattern-2062489882-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 16:00:08.378879 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-d2d2a534-8f78-4c5d-b22e-dd6d5f4f49f9 tempest-TestVolumeBootPattern-2062489882 tempest-TestVolumeBootPattern-2062489882-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 16:00:08.514580 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.policy [None req-d2d2a534-8f78-4c5d-b22e-dd6d5f4f49f9 tempest-TestVolumeBootPattern-2062489882 tempest-TestVolumeBootPattern-2062489882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '568f6783dd4d43398a70a9ffa58ff660', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a3a2b5dee7a404a8445c8aa434b5a43', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128729) authorize /opt/stack/nova/nova/policy.py:199}} May 14 16:00:08.521922 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: INFO nova.api.openstack.requestlog [None req-d2d2a534-8f78-4c5d-b22e-dd6d5f4f49f9 tempest-TestVolumeBootPattern-2062489882 tempest-TestVolumeBootPattern-2062489882-project] 10.222.0.61 "GET /compute/v2.1/servers/6dd9e299-5776-4848-b4ab-6d07424a3f8e" status: 200 len: 1578 microversion: 2.1 time: 0.157430 May 14 16:00:08.522515 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: [pid: 128729|app: 0|req: 627/1272] 10.222.0.61 () {58 vars in 1235 bytes} [Sat May 14 16:00:08 2022] GET /compute/v2.1/servers/6dd9e299-5776-4848-b4ab-6d07424a3f8e => generated 1578 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 16:00:09.540512 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi [None req-205cdc3a-3268-4121-a27a-a767ab6cc49a tempest-TestVolumeBootPattern-2062489882 tempest-TestVolumeBootPattern-2062489882-project] Calling method '>' {{(pid=128728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 16:00:09.541134 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.compute.api [None req-205cdc3a-3268-4121-a27a-a767ab6cc49a tempest-TestVolumeBootPattern-2062489882 tempest-TestVolumeBootPattern-2062489882-project] [instance: 6dd9e299-5776-4848-b4ab-6d07424a3f8e] Fetching instance by UUID {{(pid=128728) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 16:00:09.547456 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-205cdc3a-3268-4121-a27a-a767ab6cc49a tempest-TestVolumeBootPattern-2062489882 tempest-TestVolumeBootPattern-2062489882-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 16:00:09.547908 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-205cdc3a-3268-4121-a27a-a767ab6cc49a tempest-TestVolumeBootPattern-2062489882 tempest-TestVolumeBootPattern-2062489882-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 16:00:09.548683 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-205cdc3a-3268-4121-a27a-a767ab6cc49a tempest-TestVolumeBootPattern-2062489882 tempest-TestVolumeBootPattern-2062489882-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 16:00:09.549120 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-205cdc3a-3268-4121-a27a-a767ab6cc49a tempest-TestVolumeBootPattern-2062489882 tempest-TestVolumeBootPattern-2062489882-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 16:00:09.682291 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.policy [None req-205cdc3a-3268-4121-a27a-a767ab6cc49a tempest-TestVolumeBootPattern-2062489882 tempest-TestVolumeBootPattern-2062489882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '568f6783dd4d43398a70a9ffa58ff660', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a3a2b5dee7a404a8445c8aa434b5a43', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128728) authorize /opt/stack/nova/nova/policy.py:199}} May 14 16:00:09.690365 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: INFO nova.api.openstack.requestlog [None req-205cdc3a-3268-4121-a27a-a767ab6cc49a tempest-TestVolumeBootPattern-2062489882 tempest-TestVolumeBootPattern-2062489882-project] 10.222.0.61 "GET /compute/v2.1/servers/6dd9e299-5776-4848-b4ab-6d07424a3f8e" status: 200 len: 1578 microversion: 2.1 time: 0.154231 May 14 16:00:09.690940 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: [pid: 128728|app: 0|req: 646/1273] 10.222.0.61 () {58 vars in 1235 bytes} [Sat May 14 16:00:09 2022] GET /compute/v2.1/servers/6dd9e299-5776-4848-b4ab-6d07424a3f8e => generated 1578 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 16:00:10.708303 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi [None req-8a0794f7-d2e3-48cc-9ac9-5cb2e2d643d2 tempest-TestVolumeBootPattern-2062489882 tempest-TestVolumeBootPattern-2062489882-project] Calling method '>' {{(pid=128729) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 16:00:10.709153 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.compute.api [None req-8a0794f7-d2e3-48cc-9ac9-5cb2e2d643d2 tempest-TestVolumeBootPattern-2062489882 tempest-TestVolumeBootPattern-2062489882-project] [instance: 6dd9e299-5776-4848-b4ab-6d07424a3f8e] Fetching instance by UUID {{(pid=128729) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 16:00:10.716294 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-8a0794f7-d2e3-48cc-9ac9-5cb2e2d643d2 tempest-TestVolumeBootPattern-2062489882 tempest-TestVolumeBootPattern-2062489882-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 16:00:10.716778 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-8a0794f7-d2e3-48cc-9ac9-5cb2e2d643d2 tempest-TestVolumeBootPattern-2062489882 tempest-TestVolumeBootPattern-2062489882-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 16:00:10.717563 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-8a0794f7-d2e3-48cc-9ac9-5cb2e2d643d2 tempest-TestVolumeBootPattern-2062489882 tempest-TestVolumeBootPattern-2062489882-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 16:00:10.717998 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-8a0794f7-d2e3-48cc-9ac9-5cb2e2d643d2 tempest-TestVolumeBootPattern-2062489882 tempest-TestVolumeBootPattern-2062489882-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 16:00:10.741363 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi [req-e624e149-830a-4078-b796-f3838422a62c req-3b83f9bc-c39f-4d20-92c9-923f42742d59 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6dd9e299-5776-4848-b4ab-6d07424a3f8e", "name": "network-vif-deleted", "tag": "d761eef1-490d-4627-a1cc-64f2436e7c0c"}]} {{(pid=128728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 16:00:10.751836 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [req-e624e149-830a-4078-b796-f3838422a62c req-3b83f9bc-c39f-4d20-92c9-923f42742d59 service nova] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 16:00:10.752281 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [req-e624e149-830a-4078-b796-f3838422a62c req-3b83f9bc-c39f-4d20-92c9-923f42742d59 service nova] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 16:00:10.765170 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: INFO nova.api.openstack.compute.server_external_events [req-e624e149-830a-4078-b796-f3838422a62c req-3b83f9bc-c39f-4d20-92c9-923f42742d59 service nova] Creating event network-vif-deleted:d761eef1-490d-4627-a1cc-64f2436e7c0c for instance 6dd9e299-5776-4848-b4ab-6d07424a3f8e on hv-cinder-83979 May 14 16:00:10.770890 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: INFO nova.api.openstack.requestlog [req-e624e149-830a-4078-b796-f3838422a62c req-3b83f9bc-c39f-4d20-92c9-923f42742d59 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033280 May 14 16:00:10.771489 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: [pid: 128728|app: 0|req: 647/1274] 10.222.0.61 () {64 vars in 1317 bytes} [Sat May 14 16:00:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 14 16:00:10.785324 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.policy [None req-8a0794f7-d2e3-48cc-9ac9-5cb2e2d643d2 tempest-TestVolumeBootPattern-2062489882 tempest-TestVolumeBootPattern-2062489882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '568f6783dd4d43398a70a9ffa58ff660', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a3a2b5dee7a404a8445c8aa434b5a43', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128729) authorize /opt/stack/nova/nova/policy.py:199}} May 14 16:00:10.792676 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: INFO nova.api.openstack.requestlog [None req-8a0794f7-d2e3-48cc-9ac9-5cb2e2d643d2 tempest-TestVolumeBootPattern-2062489882 tempest-TestVolumeBootPattern-2062489882-project] 10.222.0.61 "GET /compute/v2.1/servers/6dd9e299-5776-4848-b4ab-6d07424a3f8e" status: 200 len: 1392 microversion: 2.1 time: 0.088276 May 14 16:00:10.793254 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: [pid: 128729|app: 0|req: 628/1275] 10.222.0.61 () {58 vars in 1235 bytes} [Sat May 14 16:00:10 2022] GET /compute/v2.1/servers/6dd9e299-5776-4848-b4ab-6d07424a3f8e => generated 1392 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 16:00:11.811991 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi [None req-45210ab5-44be-404e-8ae5-e41cf04d756c tempest-TestVolumeBootPattern-2062489882 tempest-TestVolumeBootPattern-2062489882-project] Calling method '>' {{(pid=128728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 16:00:11.812617 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.compute.api [None req-45210ab5-44be-404e-8ae5-e41cf04d756c tempest-TestVolumeBootPattern-2062489882 tempest-TestVolumeBootPattern-2062489882-project] [instance: 6dd9e299-5776-4848-b4ab-6d07424a3f8e] Fetching instance by UUID {{(pid=128728) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 16:00:11.819033 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-45210ab5-44be-404e-8ae5-e41cf04d756c tempest-TestVolumeBootPattern-2062489882 tempest-TestVolumeBootPattern-2062489882-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 16:00:11.819490 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-45210ab5-44be-404e-8ae5-e41cf04d756c tempest-TestVolumeBootPattern-2062489882 tempest-TestVolumeBootPattern-2062489882-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 16:00:11.820273 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-45210ab5-44be-404e-8ae5-e41cf04d756c tempest-TestVolumeBootPattern-2062489882 tempest-TestVolumeBootPattern-2062489882-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 16:00:11.820736 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-45210ab5-44be-404e-8ae5-e41cf04d756c tempest-TestVolumeBootPattern-2062489882 tempest-TestVolumeBootPattern-2062489882-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 16:00:11.836694 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: INFO nova.api.openstack.wsgi [None req-45210ab5-44be-404e-8ae5-e41cf04d756c tempest-TestVolumeBootPattern-2062489882 tempest-TestVolumeBootPattern-2062489882-project] HTTP exception thrown: Instance 6dd9e299-5776-4848-b4ab-6d07424a3f8e could not be found. May 14 16:00:11.838361 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi [None req-45210ab5-44be-404e-8ae5-e41cf04d756c tempest-TestVolumeBootPattern-2062489882 tempest-TestVolumeBootPattern-2062489882-project] Request method failure captured: May 14 16:00:11.838361 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: request: GET /compute/v2.1/servers/6dd9e299-5776-4848-b4ab-6d07424a3f8e HTTP/1.1 May 14 16:00:11.838361 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: Accept: application/json May 14 16:00:11.838361 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: Accept-Encoding: identity May 14 16:00:11.838361 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: Connection: close May 14 16:00:11.838361 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: Content-Length: 0 May 14 16:00:11.838361 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: Content-Type: application/json May 14 16:00:11.838361 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: Host: 10.222.0.61 May 14 16:00:11.838361 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: Openstack-System-Scope: None May 14 16:00:11.838361 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: User-Agent: python-urllib3/1.26.9 May 14 16:00:11.838361 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: X-Auth-Token: gAAAAABif8-lCLq-GQek68v-_sRqyHHqHhinLFceOm1nxU0oEpG1HfTWZbvoXlaDlvIU3j62ihUgO3gpKQoVZ_Mbcr-Tz4MT6eGJscH5YeNw12lcZBRyAEEuzJzzBdMJWhMHN_wlrrar4GMjLQJoWNJfsFXqC8FnnClvp4CX1Z0sCsKsqQmufeM May 14 16:00:11.838361 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: X-Domain-Id: None May 14 16:00:11.838361 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: X-Domain-Name: None May 14 16:00:11.838361 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: X-Identity-Status: Confirmed May 14 16:00:11.838361 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: X-Is-Admin-Project: True May 14 16:00:11.838361 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: X-Project-Domain-Id: default May 14 16:00:11.838361 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: X-Project-Domain-Name: Default May 14 16:00:11.838361 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: X-Project-Id: 7a3a2b5dee7a404a8445c8aa434b5a43 May 14 16:00:11.838361 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: X-Project-Name: tempest-TestVolumeBootPattern-2062489882 May 14 16:00:11.838361 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: X-Role: reader,member May 14 16:00:11.838361 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: X-Roles: reader,member May 14 16:00:11.840060 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/7a3a2b5dee7a404a8445c8aa434b5a43"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/7a3a2b5dee7a404a8445c8aa434b5a43"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/7a3a2b5dee7a404a8445c8aa434b5a43"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_7a3a2b5dee7a404a8445c8aa434b5a43"}]}] May 14 16:00:11.840060 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: X-Tenant: tempest-TestVolumeBootPattern-2062489882 May 14 16:00:11.840060 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: X-Tenant-Id: 7a3a2b5dee7a404a8445c8aa434b5a43 May 14 16:00:11.840060 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: X-Tenant-Name: tempest-TestVolumeBootPattern-2062489882 May 14 16:00:11.840060 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: X-User: tempest-TestVolumeBootPattern-2062489882-project May 14 16:00:11.840060 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: X-User-Domain-Id: default May 14 16:00:11.840060 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: X-User-Domain-Name: Default May 14 16:00:11.840060 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: X-User-Id: 568f6783dd4d43398a70a9ffa58ff660 May 14 16:00:11.840060 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: X-User-Name: tempest-TestVolumeBootPattern-2062489882-project May 14 16:00:11.840060 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: method: > May 14 16:00:11.840060 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: exception: Instance 6dd9e299-5776-4848-b4ab-6d07424a3f8e could not be found. May 14 16:00:11.840060 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: action_args: {'id': '6dd9e299-5776-4848-b4ab-6d07424a3f8e'} May 14 16:00:11.841068 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: {{(pid=128728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 14 16:00:11.841068 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 16:00:11.841068 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 14 16:00:11.841068 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 14 16:00:11.841068 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 14 16:00:11.841068 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 14 16:00:11.841068 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 14 16:00:11.841068 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 14 16:00:11.841068 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 14 16:00:11.841068 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 14 16:00:11.841068 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6dd9e299-5776-4848-b4ab-6d07424a3f8e could not be found. May 14 16:00:11.841068 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: ERROR nova.api.openstack.wsgi May 14 16:00:11.841068 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 14 16:00:11.841068 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: ERROR nova.api.openstack.wsgi May 14 16:00:11.841068 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 16:00:11.841068 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 14 16:00:11.841068 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 14 16:00:11.841068 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 14 16:00:11.841068 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 14 16:00:11.841068 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 14 16:00:11.842722 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 14 16:00:11.842722 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 14 16:00:11.842722 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 14 16:00:11.842722 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 14 16:00:11.842722 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 14 16:00:11.842722 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 14 16:00:11.842722 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 14 16:00:11.842722 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6dd9e299-5776-4848-b4ab-6d07424a3f8e could not be found. May 14 16:00:11.842722 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: ERROR nova.api.openstack.wsgi May 14 16:00:11.842722 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 14 16:00:11.842722 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: ERROR nova.api.openstack.wsgi May 14 16:00:11.842722 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 16:00:11.842722 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 14 16:00:11.842722 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 14 16:00:11.842722 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 14 16:00:11.842722 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 14 16:00:11.842722 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6dd9e299-5776-4848-b4ab-6d07424a3f8e could not be found. May 14 16:00:11.842722 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: ERROR nova.api.openstack.wsgi May 14 16:00:11.844120 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi [None req-45210ab5-44be-404e-8ae5-e41cf04d756c tempest-TestVolumeBootPattern-2062489882 tempest-TestVolumeBootPattern-2062489882-project] Returning 404 to user: Instance 6dd9e299-5776-4848-b4ab-6d07424a3f8e could not be found. {{(pid=128728) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 14 16:00:11.844120 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: INFO nova.api.openstack.requestlog [None req-45210ab5-44be-404e-8ae5-e41cf04d756c tempest-TestVolumeBootPattern-2062489882 tempest-TestVolumeBootPattern-2062489882-project] 10.222.0.61 "GET /compute/v2.1/servers/6dd9e299-5776-4848-b4ab-6d07424a3f8e" status: 404 len: 111 microversion: 2.1 time: 0.033086 May 14 16:00:11.844120 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: [pid: 128728|app: 0|req: 648/1276] 10.222.0.61 () {58 vars in 1235 bytes} [Sat May 14 16:00:11 2022] GET /compute/v2.1/servers/6dd9e299-5776-4848-b4ab-6d07424a3f8e => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 14 16:00:12.607177 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi [None req-dc54307d-55d1-46d6-8ca0-237762c3649f tempest-AttachVolumeTestJSON-1609025183 tempest-AttachVolumeTestJSON-1609025183-project] Calling method '>' {{(pid=128729) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 16:00:12.607763 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.compute.api [None req-dc54307d-55d1-46d6-8ca0-237762c3649f tempest-AttachVolumeTestJSON-1609025183 tempest-AttachVolumeTestJSON-1609025183-project] [instance: 34a25afd-ca05-47fe-8bba-30442b7b5348] Fetching instance by UUID {{(pid=128729) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 16:00:12.614007 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-dc54307d-55d1-46d6-8ca0-237762c3649f tempest-AttachVolumeTestJSON-1609025183 tempest-AttachVolumeTestJSON-1609025183-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 16:00:12.614491 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-dc54307d-55d1-46d6-8ca0-237762c3649f tempest-AttachVolumeTestJSON-1609025183 tempest-AttachVolumeTestJSON-1609025183-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 16:00:12.615268 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-dc54307d-55d1-46d6-8ca0-237762c3649f tempest-AttachVolumeTestJSON-1609025183 tempest-AttachVolumeTestJSON-1609025183-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 16:00:12.615709 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-dc54307d-55d1-46d6-8ca0-237762c3649f tempest-AttachVolumeTestJSON-1609025183 tempest-AttachVolumeTestJSON-1609025183-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 16:00:12.638141 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: INFO nova.api.openstack.requestlog [None req-dc54307d-55d1-46d6-8ca0-237762c3649f tempest-AttachVolumeTestJSON-1609025183 tempest-AttachVolumeTestJSON-1609025183-project] 10.222.0.61 "GET /compute/v2.1/servers/34a25afd-ca05-47fe-8bba-30442b7b5348/ips" status: 200 len: 146 microversion: 2.1 time: 0.035449 May 14 16:00:12.638727 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: [pid: 128729|app: 0|req: 629/1277] 10.222.0.61 () {58 vars in 1247 bytes} [Sat May 14 16:00:12 2022] GET /compute/v2.1/servers/34a25afd-ca05-47fe-8bba-30442b7b5348/ips => generated 146 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 14 16:00:14.599248 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi [None req-6d9b15fc-85b4-4c0e-bac2-b1da1f2b00c6 tempest-AttachVolumeTestJSON-1609025183 tempest-AttachVolumeTestJSON-1609025183-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "5dcfcf8d-8edd-4029-8287-147effa9d344"}} {{(pid=128728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 16:00:14.601011 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.compute.api [None req-6d9b15fc-85b4-4c0e-bac2-b1da1f2b00c6 tempest-AttachVolumeTestJSON-1609025183 tempest-AttachVolumeTestJSON-1609025183-project] [instance: 34a25afd-ca05-47fe-8bba-30442b7b5348] Fetching instance by UUID {{(pid=128728) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 16:00:14.607980 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-6d9b15fc-85b4-4c0e-bac2-b1da1f2b00c6 tempest-AttachVolumeTestJSON-1609025183 tempest-AttachVolumeTestJSON-1609025183-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 16:00:14.608631 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-6d9b15fc-85b4-4c0e-bac2-b1da1f2b00c6 tempest-AttachVolumeTestJSON-1609025183 tempest-AttachVolumeTestJSON-1609025183-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 16:00:14.609564 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-6d9b15fc-85b4-4c0e-bac2-b1da1f2b00c6 tempest-AttachVolumeTestJSON-1609025183 tempest-AttachVolumeTestJSON-1609025183-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 16:00:14.610206 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-6d9b15fc-85b4-4c0e-bac2-b1da1f2b00c6 tempest-AttachVolumeTestJSON-1609025183 tempest-AttachVolumeTestJSON-1609025183-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 16:00:14.884660 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: INFO nova.api.openstack.requestlog [None req-6d9b15fc-85b4-4c0e-bac2-b1da1f2b00c6 tempest-AttachVolumeTestJSON-1609025183 tempest-AttachVolumeTestJSON-1609025183-project] 10.222.0.61 "POST /compute/v2.1/servers/34a25afd-ca05-47fe-8bba-30442b7b5348/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.289148 May 14 16:00:14.890074 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: [pid: 128728|app: 0|req: 649/1278] 10.222.0.61 () {60 vars in 1322 bytes} [Sat May 14 16:00:14 2022] POST /compute/v2.1/servers/34a25afd-ca05-47fe-8bba-30442b7b5348/os-volume_attachments => generated 194 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 14 16:00:14.951229 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi [None req-98799ed1-8657-4bf0-a997-a46304c086ce tempest-TestVolumeBootPattern-2062489882 tempest-TestVolumeBootPattern-2062489882-project] Calling method '>' {{(pid=128729) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 16:00:14.951665 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.compute.api [None req-98799ed1-8657-4bf0-a997-a46304c086ce tempest-TestVolumeBootPattern-2062489882 tempest-TestVolumeBootPattern-2062489882-project] [instance: a3ea9ec3-f9f5-4d5f-81e2-83d33e93a74b] Fetching instance by UUID {{(pid=128729) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 16:00:14.956655 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi [req-daef3534-41f1-45ac-bd40-38e9896ff4b9 req-15679c81-23b2-4138-a909-e6ec24797944 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a3ea9ec3-f9f5-4d5f-81e2-83d33e93a74b", "tag": "85faf801-1e40-4e72-a22b-f9e9a859f83a"}]} {{(pid=128728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 16:00:14.957478 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-98799ed1-8657-4bf0-a997-a46304c086ce tempest-TestVolumeBootPattern-2062489882 tempest-TestVolumeBootPattern-2062489882-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 16:00:14.957926 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-98799ed1-8657-4bf0-a997-a46304c086ce tempest-TestVolumeBootPattern-2062489882 tempest-TestVolumeBootPattern-2062489882-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 16:00:14.958733 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-98799ed1-8657-4bf0-a997-a46304c086ce tempest-TestVolumeBootPattern-2062489882 tempest-TestVolumeBootPattern-2062489882-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 16:00:14.959165 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-98799ed1-8657-4bf0-a997-a46304c086ce tempest-TestVolumeBootPattern-2062489882 tempest-TestVolumeBootPattern-2062489882-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 16:00:14.965845 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [req-daef3534-41f1-45ac-bd40-38e9896ff4b9 req-15679c81-23b2-4138-a909-e6ec24797944 service nova] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 16:00:14.966294 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [req-daef3534-41f1-45ac-bd40-38e9896ff4b9 req-15679c81-23b2-4138-a909-e6ec24797944 service nova] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 16:00:14.979061 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: INFO nova.api.openstack.compute.server_external_events [req-daef3534-41f1-45ac-bd40-38e9896ff4b9 req-15679c81-23b2-4138-a909-e6ec24797944 service nova] Creating event network-changed:85faf801-1e40-4e72-a22b-f9e9a859f83a for instance a3ea9ec3-f9f5-4d5f-81e2-83d33e93a74b on hv-cinder-83979 May 14 16:00:14.985370 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: INFO nova.api.openstack.requestlog [req-daef3534-41f1-45ac-bd40-38e9896ff4b9 req-15679c81-23b2-4138-a909-e6ec24797944 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032390 May 14 16:00:14.986169 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: [pid: 128728|app: 0|req: 650/1279] 10.222.0.61 () {64 vars in 1317 bytes} [Sat May 14 16:00:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 14 16:00:15.000576 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.compute.api [None req-98799ed1-8657-4bf0-a997-a46304c086ce tempest-TestVolumeBootPattern-2062489882 tempest-TestVolumeBootPattern-2062489882-project] [instance: a3ea9ec3-f9f5-4d5f-81e2-83d33e93a74b] Going to try to terminate instance {{(pid=128729) delete /opt/stack/nova/nova/compute/api.py:2664}} May 14 16:00:15.088162 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: INFO nova.api.openstack.requestlog [None req-98799ed1-8657-4bf0-a997-a46304c086ce tempest-TestVolumeBootPattern-2062489882 tempest-TestVolumeBootPattern-2062489882-project] 10.222.0.61 "DELETE /compute/v2.1/servers/a3ea9ec3-f9f5-4d5f-81e2-83d33e93a74b" status: 204 len: 0 microversion: 2.1 time: 0.140844 May 14 16:00:15.092637 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: [pid: 128729|app: 0|req: 630/1280] 10.222.0.61 () {58 vars in 1238 bytes} [Sat May 14 16:00:14 2022] DELETE /compute/v2.1/servers/a3ea9ec3-f9f5-4d5f-81e2-83d33e93a74b => generated 0 bytes in 143 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 14 16:00:15.099165 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi [None req-c58e5f43-9999-445a-ba4a-7057d3f4476d tempest-TestVolumeBootPattern-2062489882 tempest-TestVolumeBootPattern-2062489882-project] Calling method '>' {{(pid=128728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 16:00:15.101194 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.compute.api [None req-c58e5f43-9999-445a-ba4a-7057d3f4476d tempest-TestVolumeBootPattern-2062489882 tempest-TestVolumeBootPattern-2062489882-project] [instance: a3ea9ec3-f9f5-4d5f-81e2-83d33e93a74b] Fetching instance by UUID {{(pid=128728) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 16:00:15.112288 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-c58e5f43-9999-445a-ba4a-7057d3f4476d tempest-TestVolumeBootPattern-2062489882 tempest-TestVolumeBootPattern-2062489882-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 16:00:15.112733 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-c58e5f43-9999-445a-ba4a-7057d3f4476d tempest-TestVolumeBootPattern-2062489882 tempest-TestVolumeBootPattern-2062489882-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 16:00:15.113513 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-c58e5f43-9999-445a-ba4a-7057d3f4476d tempest-TestVolumeBootPattern-2062489882 tempest-TestVolumeBootPattern-2062489882-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 16:00:15.113943 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-c58e5f43-9999-445a-ba4a-7057d3f4476d tempest-TestVolumeBootPattern-2062489882 tempest-TestVolumeBootPattern-2062489882-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 16:00:15.268635 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.policy [None req-c58e5f43-9999-445a-ba4a-7057d3f4476d tempest-TestVolumeBootPattern-2062489882 tempest-TestVolumeBootPattern-2062489882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '568f6783dd4d43398a70a9ffa58ff660', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a3a2b5dee7a404a8445c8aa434b5a43', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128728) authorize /opt/stack/nova/nova/policy.py:199}} May 14 16:00:15.281766 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: INFO nova.api.openstack.requestlog [None req-c58e5f43-9999-445a-ba4a-7057d3f4476d tempest-TestVolumeBootPattern-2062489882 tempest-TestVolumeBootPattern-2062489882-project] 10.222.0.61 "GET /compute/v2.1/servers/a3ea9ec3-f9f5-4d5f-81e2-83d33e93a74b" status: 200 len: 1578 microversion: 2.1 time: 0.187983 May 14 16:00:15.282583 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: [pid: 128728|app: 0|req: 651/1281] 10.222.0.61 () {58 vars in 1235 bytes} [Sat May 14 16:00:15 2022] GET /compute/v2.1/servers/a3ea9ec3-f9f5-4d5f-81e2-83d33e93a74b => generated 1578 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 16:00:16.302804 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi [None req-fa44f615-db5d-41f4-b9cf-42b89cccd23d tempest-TestVolumeBootPattern-2062489882 tempest-TestVolumeBootPattern-2062489882-project] Calling method '>' {{(pid=128729) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 16:00:16.304138 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.compute.api [None req-fa44f615-db5d-41f4-b9cf-42b89cccd23d tempest-TestVolumeBootPattern-2062489882 tempest-TestVolumeBootPattern-2062489882-project] [instance: a3ea9ec3-f9f5-4d5f-81e2-83d33e93a74b] Fetching instance by UUID {{(pid=128729) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 16:00:16.315538 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-fa44f615-db5d-41f4-b9cf-42b89cccd23d tempest-TestVolumeBootPattern-2062489882 tempest-TestVolumeBootPattern-2062489882-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 16:00:16.316338 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-fa44f615-db5d-41f4-b9cf-42b89cccd23d tempest-TestVolumeBootPattern-2062489882 tempest-TestVolumeBootPattern-2062489882-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 16:00:16.317756 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-fa44f615-db5d-41f4-b9cf-42b89cccd23d tempest-TestVolumeBootPattern-2062489882 tempest-TestVolumeBootPattern-2062489882-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 16:00:16.318605 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-fa44f615-db5d-41f4-b9cf-42b89cccd23d tempest-TestVolumeBootPattern-2062489882 tempest-TestVolumeBootPattern-2062489882-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 16:00:16.406499 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.policy [None req-fa44f615-db5d-41f4-b9cf-42b89cccd23d tempest-TestVolumeBootPattern-2062489882 tempest-TestVolumeBootPattern-2062489882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '568f6783dd4d43398a70a9ffa58ff660', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a3a2b5dee7a404a8445c8aa434b5a43', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128729) authorize /opt/stack/nova/nova/policy.py:199}} May 14 16:00:16.416230 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: INFO nova.api.openstack.requestlog [None req-fa44f615-db5d-41f4-b9cf-42b89cccd23d tempest-TestVolumeBootPattern-2062489882 tempest-TestVolumeBootPattern-2062489882-project] 10.222.0.61 "GET /compute/v2.1/servers/a3ea9ec3-f9f5-4d5f-81e2-83d33e93a74b" status: 200 len: 1392 microversion: 2.1 time: 0.121088 May 14 16:00:16.417276 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: [pid: 128729|app: 0|req: 631/1282] 10.222.0.61 () {58 vars in 1235 bytes} [Sat May 14 16:00:16 2022] GET /compute/v2.1/servers/a3ea9ec3-f9f5-4d5f-81e2-83d33e93a74b => generated 1392 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 16:00:16.465369 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi [req-a34ded8f-b73c-40d5-8008-871c59ed2286 req-cc0c3833-3e05-429d-b61e-7c0022227397 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a3ea9ec3-f9f5-4d5f-81e2-83d33e93a74b", "name": "network-vif-deleted", "tag": "85faf801-1e40-4e72-a22b-f9e9a859f83a"}]} {{(pid=128728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 16:00:16.474362 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [req-a34ded8f-b73c-40d5-8008-871c59ed2286 req-cc0c3833-3e05-429d-b61e-7c0022227397 service nova] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 16:00:16.474812 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [req-a34ded8f-b73c-40d5-8008-871c59ed2286 req-cc0c3833-3e05-429d-b61e-7c0022227397 service nova] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 16:00:16.487107 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: INFO nova.api.openstack.compute.server_external_events [req-a34ded8f-b73c-40d5-8008-871c59ed2286 req-cc0c3833-3e05-429d-b61e-7c0022227397 service nova] Creating event network-vif-deleted:85faf801-1e40-4e72-a22b-f9e9a859f83a for instance a3ea9ec3-f9f5-4d5f-81e2-83d33e93a74b on hv-cinder-83979 May 14 16:00:16.492159 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: INFO nova.api.openstack.requestlog [req-a34ded8f-b73c-40d5-8008-871c59ed2286 req-cc0c3833-3e05-429d-b61e-7c0022227397 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030417 May 14 16:00:16.493046 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: [pid: 128728|app: 0|req: 652/1283] 10.222.0.61 () {64 vars in 1317 bytes} [Sat May 14 16:00:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 14 16:00:17.433434 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi [None req-c631ddf9-0bf5-4668-8bee-b74d507494e3 tempest-TestVolumeBootPattern-2062489882 tempest-TestVolumeBootPattern-2062489882-project] Calling method '>' {{(pid=128729) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 16:00:17.434706 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.compute.api [None req-c631ddf9-0bf5-4668-8bee-b74d507494e3 tempest-TestVolumeBootPattern-2062489882 tempest-TestVolumeBootPattern-2062489882-project] [instance: a3ea9ec3-f9f5-4d5f-81e2-83d33e93a74b] Fetching instance by UUID {{(pid=128729) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 16:00:17.440965 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-c631ddf9-0bf5-4668-8bee-b74d507494e3 tempest-TestVolumeBootPattern-2062489882 tempest-TestVolumeBootPattern-2062489882-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 16:00:17.441407 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-c631ddf9-0bf5-4668-8bee-b74d507494e3 tempest-TestVolumeBootPattern-2062489882 tempest-TestVolumeBootPattern-2062489882-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 16:00:17.442165 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-c631ddf9-0bf5-4668-8bee-b74d507494e3 tempest-TestVolumeBootPattern-2062489882 tempest-TestVolumeBootPattern-2062489882-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 16:00:17.442627 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-c631ddf9-0bf5-4668-8bee-b74d507494e3 tempest-TestVolumeBootPattern-2062489882 tempest-TestVolumeBootPattern-2062489882-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 16:00:17.455468 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: INFO nova.api.openstack.wsgi [None req-c631ddf9-0bf5-4668-8bee-b74d507494e3 tempest-TestVolumeBootPattern-2062489882 tempest-TestVolumeBootPattern-2062489882-project] HTTP exception thrown: Instance a3ea9ec3-f9f5-4d5f-81e2-83d33e93a74b could not be found. May 14 16:00:17.457097 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi [None req-c631ddf9-0bf5-4668-8bee-b74d507494e3 tempest-TestVolumeBootPattern-2062489882 tempest-TestVolumeBootPattern-2062489882-project] Request method failure captured: May 14 16:00:17.457097 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: request: GET /compute/v2.1/servers/a3ea9ec3-f9f5-4d5f-81e2-83d33e93a74b HTTP/1.1 May 14 16:00:17.457097 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: Accept: application/json May 14 16:00:17.457097 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: Accept-Encoding: identity May 14 16:00:17.457097 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: Connection: close May 14 16:00:17.457097 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: Content-Length: 0 May 14 16:00:17.457097 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: Content-Type: application/json May 14 16:00:17.457097 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: Host: 10.222.0.61 May 14 16:00:17.457097 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: Openstack-System-Scope: None May 14 16:00:17.457097 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: User-Agent: python-urllib3/1.26.9 May 14 16:00:17.457097 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: X-Auth-Token: gAAAAABif8-lCLq-GQek68v-_sRqyHHqHhinLFceOm1nxU0oEpG1HfTWZbvoXlaDlvIU3j62ihUgO3gpKQoVZ_Mbcr-Tz4MT6eGJscH5YeNw12lcZBRyAEEuzJzzBdMJWhMHN_wlrrar4GMjLQJoWNJfsFXqC8FnnClvp4CX1Z0sCsKsqQmufeM May 14 16:00:17.457097 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: X-Domain-Id: None May 14 16:00:17.457097 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: X-Domain-Name: None May 14 16:00:17.457097 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: X-Identity-Status: Confirmed May 14 16:00:17.457097 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: X-Is-Admin-Project: True May 14 16:00:17.457097 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: X-Project-Domain-Id: default May 14 16:00:17.457097 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: X-Project-Domain-Name: Default May 14 16:00:17.457097 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: X-Project-Id: 7a3a2b5dee7a404a8445c8aa434b5a43 May 14 16:00:17.457097 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: X-Project-Name: tempest-TestVolumeBootPattern-2062489882 May 14 16:00:17.457097 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: X-Role: reader,member May 14 16:00:17.457097 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: X-Roles: reader,member May 14 16:00:17.458821 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/7a3a2b5dee7a404a8445c8aa434b5a43"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/7a3a2b5dee7a404a8445c8aa434b5a43"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/7a3a2b5dee7a404a8445c8aa434b5a43"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_7a3a2b5dee7a404a8445c8aa434b5a43"}]}] May 14 16:00:17.458821 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: X-Tenant: tempest-TestVolumeBootPattern-2062489882 May 14 16:00:17.458821 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: X-Tenant-Id: 7a3a2b5dee7a404a8445c8aa434b5a43 May 14 16:00:17.458821 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: X-Tenant-Name: tempest-TestVolumeBootPattern-2062489882 May 14 16:00:17.458821 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: X-User: tempest-TestVolumeBootPattern-2062489882-project May 14 16:00:17.458821 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: X-User-Domain-Id: default May 14 16:00:17.458821 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: X-User-Domain-Name: Default May 14 16:00:17.458821 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: X-User-Id: 568f6783dd4d43398a70a9ffa58ff660 May 14 16:00:17.458821 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: X-User-Name: tempest-TestVolumeBootPattern-2062489882-project May 14 16:00:17.458821 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: method: > May 14 16:00:17.458821 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: exception: Instance a3ea9ec3-f9f5-4d5f-81e2-83d33e93a74b could not be found. May 14 16:00:17.458821 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: action_args: {'id': 'a3ea9ec3-f9f5-4d5f-81e2-83d33e93a74b'} May 14 16:00:17.459976 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: {{(pid=128729) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 14 16:00:17.459976 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 16:00:17.459976 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 14 16:00:17.459976 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 14 16:00:17.459976 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 14 16:00:17.459976 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 14 16:00:17.459976 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 14 16:00:17.459976 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 14 16:00:17.459976 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 14 16:00:17.459976 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 14 16:00:17.459976 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a3ea9ec3-f9f5-4d5f-81e2-83d33e93a74b could not be found. May 14 16:00:17.459976 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: ERROR nova.api.openstack.wsgi May 14 16:00:17.459976 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 14 16:00:17.459976 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: ERROR nova.api.openstack.wsgi May 14 16:00:17.459976 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 16:00:17.459976 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 14 16:00:17.459976 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 14 16:00:17.459976 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 14 16:00:17.459976 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 14 16:00:17.459976 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 14 16:00:17.461597 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 14 16:00:17.461597 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 14 16:00:17.461597 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 14 16:00:17.461597 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 14 16:00:17.461597 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 14 16:00:17.461597 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 14 16:00:17.461597 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 14 16:00:17.461597 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a3ea9ec3-f9f5-4d5f-81e2-83d33e93a74b could not be found. May 14 16:00:17.461597 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: ERROR nova.api.openstack.wsgi May 14 16:00:17.461597 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 14 16:00:17.461597 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: ERROR nova.api.openstack.wsgi May 14 16:00:17.461597 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 16:00:17.461597 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 14 16:00:17.461597 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 14 16:00:17.461597 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 14 16:00:17.461597 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 14 16:00:17.461597 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a3ea9ec3-f9f5-4d5f-81e2-83d33e93a74b could not be found. May 14 16:00:17.461597 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: ERROR nova.api.openstack.wsgi May 14 16:00:17.463223 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi [None req-c631ddf9-0bf5-4668-8bee-b74d507494e3 tempest-TestVolumeBootPattern-2062489882 tempest-TestVolumeBootPattern-2062489882-project] Returning 404 to user: Instance a3ea9ec3-f9f5-4d5f-81e2-83d33e93a74b could not be found. {{(pid=128729) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 14 16:00:17.463223 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: INFO nova.api.openstack.requestlog [None req-c631ddf9-0bf5-4668-8bee-b74d507494e3 tempest-TestVolumeBootPattern-2062489882 tempest-TestVolumeBootPattern-2062489882-project] 10.222.0.61 "GET /compute/v2.1/servers/a3ea9ec3-f9f5-4d5f-81e2-83d33e93a74b" status: 404 len: 111 microversion: 2.1 time: 0.028891 May 14 16:00:17.463223 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: [pid: 128729|app: 0|req: 632/1284] 10.222.0.61 () {58 vars in 1235 bytes} [Sat May 14 16:00:17 2022] GET /compute/v2.1/servers/a3ea9ec3-f9f5-4d5f-81e2-83d33e93a74b => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 14 16:00:17.899391 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi [None req-be1dbca1-2055-4e11-8a5a-92581b39196c tempest-TestVolumeBootPattern-2062489882 tempest-TestVolumeBootPattern-2062489882-project] Calling method '>' {{(pid=128728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 16:00:17.900092 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.compute.api [None req-be1dbca1-2055-4e11-8a5a-92581b39196c tempest-TestVolumeBootPattern-2062489882 tempest-TestVolumeBootPattern-2062489882-project] [instance: 7ee38041-8e54-4fdb-909d-585952a4f5bd] Fetching instance by UUID {{(pid=128728) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 16:00:17.907581 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-be1dbca1-2055-4e11-8a5a-92581b39196c tempest-TestVolumeBootPattern-2062489882 tempest-TestVolumeBootPattern-2062489882-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 16:00:17.908027 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-be1dbca1-2055-4e11-8a5a-92581b39196c tempest-TestVolumeBootPattern-2062489882 tempest-TestVolumeBootPattern-2062489882-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 16:00:17.908785 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-be1dbca1-2055-4e11-8a5a-92581b39196c tempest-TestVolumeBootPattern-2062489882 tempest-TestVolumeBootPattern-2062489882-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 16:00:17.909219 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-be1dbca1-2055-4e11-8a5a-92581b39196c tempest-TestVolumeBootPattern-2062489882 tempest-TestVolumeBootPattern-2062489882-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 16:00:17.921927 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: INFO nova.api.openstack.wsgi [None req-be1dbca1-2055-4e11-8a5a-92581b39196c tempest-TestVolumeBootPattern-2062489882 tempest-TestVolumeBootPattern-2062489882-project] HTTP exception thrown: Instance 7ee38041-8e54-4fdb-909d-585952a4f5bd could not be found. May 14 16:00:17.923592 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi [None req-be1dbca1-2055-4e11-8a5a-92581b39196c tempest-TestVolumeBootPattern-2062489882 tempest-TestVolumeBootPattern-2062489882-project] Request method failure captured: May 14 16:00:17.923592 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: request: DELETE /compute/v2.1/servers/7ee38041-8e54-4fdb-909d-585952a4f5bd HTTP/1.1 May 14 16:00:17.923592 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: Accept: application/json May 14 16:00:17.923592 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: Accept-Encoding: identity May 14 16:00:17.923592 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: Connection: close May 14 16:00:17.923592 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: Content-Length: 0 May 14 16:00:17.923592 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: Content-Type: application/json May 14 16:00:17.923592 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: Host: 10.222.0.61 May 14 16:00:17.923592 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: Openstack-System-Scope: None May 14 16:00:17.923592 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: User-Agent: python-urllib3/1.26.9 May 14 16:00:17.923592 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: X-Auth-Token: gAAAAABif8-lCLq-GQek68v-_sRqyHHqHhinLFceOm1nxU0oEpG1HfTWZbvoXlaDlvIU3j62ihUgO3gpKQoVZ_Mbcr-Tz4MT6eGJscH5YeNw12lcZBRyAEEuzJzzBdMJWhMHN_wlrrar4GMjLQJoWNJfsFXqC8FnnClvp4CX1Z0sCsKsqQmufeM May 14 16:00:17.923592 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: X-Domain-Id: None May 14 16:00:17.923592 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: X-Domain-Name: None May 14 16:00:17.923592 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: X-Identity-Status: Confirmed May 14 16:00:17.923592 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: X-Is-Admin-Project: True May 14 16:00:17.923592 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: X-Project-Domain-Id: default May 14 16:00:17.923592 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: X-Project-Domain-Name: Default May 14 16:00:17.923592 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: X-Project-Id: 7a3a2b5dee7a404a8445c8aa434b5a43 May 14 16:00:17.923592 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: X-Project-Name: tempest-TestVolumeBootPattern-2062489882 May 14 16:00:17.923592 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: X-Role: reader,member May 14 16:00:17.923592 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: X-Roles: reader,member May 14 16:00:17.925207 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/7a3a2b5dee7a404a8445c8aa434b5a43"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/7a3a2b5dee7a404a8445c8aa434b5a43"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/7a3a2b5dee7a404a8445c8aa434b5a43"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_7a3a2b5dee7a404a8445c8aa434b5a43"}]}] May 14 16:00:17.925207 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: X-Tenant: tempest-TestVolumeBootPattern-2062489882 May 14 16:00:17.925207 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: X-Tenant-Id: 7a3a2b5dee7a404a8445c8aa434b5a43 May 14 16:00:17.925207 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: X-Tenant-Name: tempest-TestVolumeBootPattern-2062489882 May 14 16:00:17.925207 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: X-User: tempest-TestVolumeBootPattern-2062489882-project May 14 16:00:17.925207 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: X-User-Domain-Id: default May 14 16:00:17.925207 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: X-User-Domain-Name: Default May 14 16:00:17.925207 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: X-User-Id: 568f6783dd4d43398a70a9ffa58ff660 May 14 16:00:17.925207 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: X-User-Name: tempest-TestVolumeBootPattern-2062489882-project May 14 16:00:17.925207 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: method: > May 14 16:00:17.925207 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: exception: Instance 7ee38041-8e54-4fdb-909d-585952a4f5bd could not be found. May 14 16:00:17.925207 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: action_args: {'id': '7ee38041-8e54-4fdb-909d-585952a4f5bd'} May 14 16:00:17.926266 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: {{(pid=128728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 14 16:00:17.926266 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 16:00:17.926266 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 14 16:00:17.926266 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 14 16:00:17.926266 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 14 16:00:17.926266 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 14 16:00:17.926266 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 14 16:00:17.926266 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 14 16:00:17.926266 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 14 16:00:17.926266 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 14 16:00:17.926266 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7ee38041-8e54-4fdb-909d-585952a4f5bd could not be found. May 14 16:00:17.926266 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: ERROR nova.api.openstack.wsgi May 14 16:00:17.926266 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 14 16:00:17.926266 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: ERROR nova.api.openstack.wsgi May 14 16:00:17.926266 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 16:00:17.926266 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 14 16:00:17.926266 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 14 16:00:17.926266 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 14 16:00:17.926266 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 14 16:00:17.926266 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 14 16:00:17.927810 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 14 16:00:17.927810 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 14 16:00:17.927810 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 14 16:00:17.927810 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 14 16:00:17.927810 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 14 16:00:17.927810 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 14 16:00:17.927810 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 14 16:00:17.927810 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 14 16:00:17.927810 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 14 16:00:17.927810 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7ee38041-8e54-4fdb-909d-585952a4f5bd could not be found. May 14 16:00:17.927810 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: ERROR nova.api.openstack.wsgi May 14 16:00:17.927810 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 14 16:00:17.927810 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: ERROR nova.api.openstack.wsgi May 14 16:00:17.927810 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 16:00:17.927810 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 14 16:00:17.927810 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 14 16:00:17.927810 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 14 16:00:17.927810 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 14 16:00:17.927810 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7ee38041-8e54-4fdb-909d-585952a4f5bd could not be found. May 14 16:00:17.927810 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: ERROR nova.api.openstack.wsgi May 14 16:00:17.929414 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi [None req-be1dbca1-2055-4e11-8a5a-92581b39196c tempest-TestVolumeBootPattern-2062489882 tempest-TestVolumeBootPattern-2062489882-project] Returning 404 to user: Instance 7ee38041-8e54-4fdb-909d-585952a4f5bd could not be found. {{(pid=128728) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 14 16:00:17.929414 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: INFO nova.api.openstack.requestlog [None req-be1dbca1-2055-4e11-8a5a-92581b39196c tempest-TestVolumeBootPattern-2062489882 tempest-TestVolumeBootPattern-2062489882-project] 10.222.0.61 "DELETE /compute/v2.1/servers/7ee38041-8e54-4fdb-909d-585952a4f5bd" status: 404 len: 111 microversion: 2.1 time: 0.030263 May 14 16:00:17.929414 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: [pid: 128728|app: 0|req: 653/1285] 10.222.0.61 () {58 vars in 1238 bytes} [Sat May 14 16:00:17 2022] DELETE /compute/v2.1/servers/7ee38041-8e54-4fdb-909d-585952a4f5bd => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 14 16:00:17.933439 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi [None req-a1dc3a82-cfa8-460f-ab83-a9e0cb91d4b1 tempest-TestVolumeBootPattern-2062489882 tempest-TestVolumeBootPattern-2062489882-project] Calling method '>' {{(pid=128729) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 16:00:17.934691 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.compute.api [None req-a1dc3a82-cfa8-460f-ab83-a9e0cb91d4b1 tempest-TestVolumeBootPattern-2062489882 tempest-TestVolumeBootPattern-2062489882-project] [instance: 7ee38041-8e54-4fdb-909d-585952a4f5bd] Fetching instance by UUID {{(pid=128729) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 16:00:17.940688 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-a1dc3a82-cfa8-460f-ab83-a9e0cb91d4b1 tempest-TestVolumeBootPattern-2062489882 tempest-TestVolumeBootPattern-2062489882-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 16:00:17.941141 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-a1dc3a82-cfa8-460f-ab83-a9e0cb91d4b1 tempest-TestVolumeBootPattern-2062489882 tempest-TestVolumeBootPattern-2062489882-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 16:00:17.941908 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-a1dc3a82-cfa8-460f-ab83-a9e0cb91d4b1 tempest-TestVolumeBootPattern-2062489882 tempest-TestVolumeBootPattern-2062489882-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 16:00:17.942372 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-a1dc3a82-cfa8-460f-ab83-a9e0cb91d4b1 tempest-TestVolumeBootPattern-2062489882 tempest-TestVolumeBootPattern-2062489882-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 16:00:17.956149 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: INFO nova.api.openstack.wsgi [None req-a1dc3a82-cfa8-460f-ab83-a9e0cb91d4b1 tempest-TestVolumeBootPattern-2062489882 tempest-TestVolumeBootPattern-2062489882-project] HTTP exception thrown: Instance 7ee38041-8e54-4fdb-909d-585952a4f5bd could not be found. May 14 16:00:17.957710 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi [None req-a1dc3a82-cfa8-460f-ab83-a9e0cb91d4b1 tempest-TestVolumeBootPattern-2062489882 tempest-TestVolumeBootPattern-2062489882-project] Request method failure captured: May 14 16:00:17.957710 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: request: GET /compute/v2.1/servers/7ee38041-8e54-4fdb-909d-585952a4f5bd HTTP/1.1 May 14 16:00:17.957710 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: Accept: application/json May 14 16:00:17.957710 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: Accept-Encoding: identity May 14 16:00:17.957710 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: Connection: close May 14 16:00:17.957710 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: Content-Length: 0 May 14 16:00:17.957710 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: Content-Type: application/json May 14 16:00:17.957710 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: Host: 10.222.0.61 May 14 16:00:17.957710 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: Openstack-System-Scope: None May 14 16:00:17.957710 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: User-Agent: python-urllib3/1.26.9 May 14 16:00:17.957710 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: X-Auth-Token: gAAAAABif8-lCLq-GQek68v-_sRqyHHqHhinLFceOm1nxU0oEpG1HfTWZbvoXlaDlvIU3j62ihUgO3gpKQoVZ_Mbcr-Tz4MT6eGJscH5YeNw12lcZBRyAEEuzJzzBdMJWhMHN_wlrrar4GMjLQJoWNJfsFXqC8FnnClvp4CX1Z0sCsKsqQmufeM May 14 16:00:17.957710 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: X-Domain-Id: None May 14 16:00:17.957710 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: X-Domain-Name: None May 14 16:00:17.957710 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: X-Identity-Status: Confirmed May 14 16:00:17.957710 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: X-Is-Admin-Project: True May 14 16:00:17.957710 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: X-Project-Domain-Id: default May 14 16:00:17.957710 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: X-Project-Domain-Name: Default May 14 16:00:17.957710 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: X-Project-Id: 7a3a2b5dee7a404a8445c8aa434b5a43 May 14 16:00:17.957710 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: X-Project-Name: tempest-TestVolumeBootPattern-2062489882 May 14 16:00:17.957710 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: X-Role: reader,member May 14 16:00:17.957710 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: X-Roles: reader,member May 14 16:00:17.959418 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/7a3a2b5dee7a404a8445c8aa434b5a43"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/7a3a2b5dee7a404a8445c8aa434b5a43"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/7a3a2b5dee7a404a8445c8aa434b5a43"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_7a3a2b5dee7a404a8445c8aa434b5a43"}]}] May 14 16:00:17.959418 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: X-Tenant: tempest-TestVolumeBootPattern-2062489882 May 14 16:00:17.959418 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: X-Tenant-Id: 7a3a2b5dee7a404a8445c8aa434b5a43 May 14 16:00:17.959418 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: X-Tenant-Name: tempest-TestVolumeBootPattern-2062489882 May 14 16:00:17.959418 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: X-User: tempest-TestVolumeBootPattern-2062489882-project May 14 16:00:17.959418 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: X-User-Domain-Id: default May 14 16:00:17.959418 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: X-User-Domain-Name: Default May 14 16:00:17.959418 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: X-User-Id: 568f6783dd4d43398a70a9ffa58ff660 May 14 16:00:17.959418 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: X-User-Name: tempest-TestVolumeBootPattern-2062489882-project May 14 16:00:17.959418 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: method: > May 14 16:00:17.959418 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: exception: Instance 7ee38041-8e54-4fdb-909d-585952a4f5bd could not be found. May 14 16:00:17.959418 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: action_args: {'id': '7ee38041-8e54-4fdb-909d-585952a4f5bd'} May 14 16:00:17.960361 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: {{(pid=128729) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 14 16:00:17.960361 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 16:00:17.960361 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 14 16:00:17.960361 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 14 16:00:17.960361 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 14 16:00:17.960361 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 14 16:00:17.960361 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 14 16:00:17.960361 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 14 16:00:17.960361 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 14 16:00:17.960361 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 14 16:00:17.960361 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7ee38041-8e54-4fdb-909d-585952a4f5bd could not be found. May 14 16:00:17.960361 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: ERROR nova.api.openstack.wsgi May 14 16:00:17.960361 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 14 16:00:17.960361 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: ERROR nova.api.openstack.wsgi May 14 16:00:17.960361 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 16:00:17.960361 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 14 16:00:17.960361 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 14 16:00:17.960361 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 14 16:00:17.960361 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 14 16:00:17.960361 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 14 16:00:17.961872 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 14 16:00:17.961872 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 14 16:00:17.961872 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 14 16:00:17.961872 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 14 16:00:17.961872 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 14 16:00:17.961872 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 14 16:00:17.961872 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 14 16:00:17.961872 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7ee38041-8e54-4fdb-909d-585952a4f5bd could not be found. May 14 16:00:17.961872 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: ERROR nova.api.openstack.wsgi May 14 16:00:17.961872 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 14 16:00:17.961872 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: ERROR nova.api.openstack.wsgi May 14 16:00:17.961872 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 16:00:17.961872 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 14 16:00:17.961872 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 14 16:00:17.961872 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 14 16:00:17.961872 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 14 16:00:17.961872 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7ee38041-8e54-4fdb-909d-585952a4f5bd could not be found. May 14 16:00:17.961872 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: ERROR nova.api.openstack.wsgi May 14 16:00:17.963221 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi [None req-a1dc3a82-cfa8-460f-ab83-a9e0cb91d4b1 tempest-TestVolumeBootPattern-2062489882 tempest-TestVolumeBootPattern-2062489882-project] Returning 404 to user: Instance 7ee38041-8e54-4fdb-909d-585952a4f5bd could not be found. {{(pid=128729) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 14 16:00:17.963221 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: INFO nova.api.openstack.requestlog [None req-a1dc3a82-cfa8-460f-ab83-a9e0cb91d4b1 tempest-TestVolumeBootPattern-2062489882 tempest-TestVolumeBootPattern-2062489882-project] 10.222.0.61 "GET /compute/v2.1/servers/7ee38041-8e54-4fdb-909d-585952a4f5bd" status: 404 len: 111 microversion: 2.1 time: 0.029526 May 14 16:00:17.963221 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: [pid: 128729|app: 0|req: 633/1286] 10.222.0.61 () {58 vars in 1235 bytes} [Sat May 14 16:00:17 2022] GET /compute/v2.1/servers/7ee38041-8e54-4fdb-909d-585952a4f5bd => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 14 16:00:19.242937 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi [None req-53698e66-6a60-4624-b344-6e5f894d3fd0 tempest-TestVolumeBootPattern-2062489882 tempest-TestVolumeBootPattern-2062489882-project] Calling method '.version_select at 0x7f77cb5839d0>' {{(pid=128728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 16:00:19.262690 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: INFO nova.api.openstack.requestlog [None req-53698e66-6a60-4624-b344-6e5f894d3fd0 tempest-TestVolumeBootPattern-2062489882 tempest-TestVolumeBootPattern-2062489882-project] 10.222.0.61 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1553604469" status: 202 len: 0 microversion: 2.1 time: 0.023010 May 14 16:00:19.263307 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: [pid: 128728|app: 0|req: 654/1287] 10.222.0.61 () {58 vars in 1262 bytes} [Sat May 14 16:00:19 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1553604469 => generated 0 bytes in 25 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) May 14 16:00:22.403253 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi [None req-6abe7040-dd52-40bf-b9f4-267e44833d53 tempest-AttachVolumeTestJSON-1609025183 tempest-AttachVolumeTestJSON-1609025183-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=128729) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 16:00:22.414021 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-6abe7040-dd52-40bf-b9f4-267e44833d53 tempest-AttachVolumeTestJSON-1609025183 tempest-AttachVolumeTestJSON-1609025183-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 16:00:22.414634 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-6abe7040-dd52-40bf-b9f4-267e44833d53 tempest-AttachVolumeTestJSON-1609025183 tempest-AttachVolumeTestJSON-1609025183-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 16:00:22.486191 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.compute.api [None req-6abe7040-dd52-40bf-b9f4-267e44833d53 tempest-AttachVolumeTestJSON-1609025183 tempest-AttachVolumeTestJSON-1609025183-project] [instance: 34a25afd-ca05-47fe-8bba-30442b7b5348] Going to try to stop instance {{(pid=128729) force_stop /opt/stack/nova/nova/compute/api.py:2707}} May 14 16:00:22.538236 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: INFO nova.api.openstack.requestlog [None req-6abe7040-dd52-40bf-b9f4-267e44833d53 tempest-AttachVolumeTestJSON-1609025183 tempest-AttachVolumeTestJSON-1609025183-project] 10.222.0.61 "POST /compute/v2.1/servers/34a25afd-ca05-47fe-8bba-30442b7b5348/action" status: 202 len: 0 microversion: 2.1 time: 0.139622 May 14 16:00:22.548591 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi [None req-aa5abbb0-c35c-443c-967c-4bf65a5f76b3 tempest-AttachVolumeTestJSON-1609025183 tempest-AttachVolumeTestJSON-1609025183-project] Calling method '>' {{(pid=128728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 16:00:22.549786 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.compute.api [None req-aa5abbb0-c35c-443c-967c-4bf65a5f76b3 tempest-AttachVolumeTestJSON-1609025183 tempest-AttachVolumeTestJSON-1609025183-project] [instance: 34a25afd-ca05-47fe-8bba-30442b7b5348] Fetching instance by UUID {{(pid=128728) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 16:00:22.554463 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: [pid: 128729|app: 0|req: 634/1288] 10.222.0.61 () {60 vars in 1277 bytes} [Sat May 14 16:00:22 2022] POST /compute/v2.1/servers/34a25afd-ca05-47fe-8bba-30442b7b5348/action => generated 0 bytes in 156 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 14 16:00:22.563469 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-aa5abbb0-c35c-443c-967c-4bf65a5f76b3 tempest-AttachVolumeTestJSON-1609025183 tempest-AttachVolumeTestJSON-1609025183-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 16:00:22.563663 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-aa5abbb0-c35c-443c-967c-4bf65a5f76b3 tempest-AttachVolumeTestJSON-1609025183 tempest-AttachVolumeTestJSON-1609025183-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 16:00:22.564588 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-aa5abbb0-c35c-443c-967c-4bf65a5f76b3 tempest-AttachVolumeTestJSON-1609025183 tempest-AttachVolumeTestJSON-1609025183-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 16:00:22.568987 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-aa5abbb0-c35c-443c-967c-4bf65a5f76b3 tempest-AttachVolumeTestJSON-1609025183 tempest-AttachVolumeTestJSON-1609025183-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 16:00:22.731066 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.policy [None req-aa5abbb0-c35c-443c-967c-4bf65a5f76b3 tempest-AttachVolumeTestJSON-1609025183 tempest-AttachVolumeTestJSON-1609025183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '742938d3a02a4c8babf518b7b6cf53a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '882808bd43644908a21ff8a58997c57f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128728) authorize /opt/stack/nova/nova/policy.py:199}} May 14 16:00:22.739560 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: INFO nova.api.openstack.requestlog [None req-aa5abbb0-c35c-443c-967c-4bf65a5f76b3 tempest-AttachVolumeTestJSON-1609025183 tempest-AttachVolumeTestJSON-1609025183-project] 10.222.0.61 "GET /compute/v2.1/servers/34a25afd-ca05-47fe-8bba-30442b7b5348" status: 200 len: 1724 microversion: 2.1 time: 0.196229 May 14 16:00:22.740120 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: [pid: 128728|app: 0|req: 655/1289] 10.222.0.61 () {58 vars in 1235 bytes} [Sat May 14 16:00:22 2022] GET /compute/v2.1/servers/34a25afd-ca05-47fe-8bba-30442b7b5348 => generated 1724 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 16:00:23.757926 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi [None req-78070f81-5a0f-4c69-b754-c095b5dc03a0 tempest-AttachVolumeTestJSON-1609025183 tempest-AttachVolumeTestJSON-1609025183-project] Calling method '>' {{(pid=128729) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 16:00:23.758874 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.compute.api [None req-78070f81-5a0f-4c69-b754-c095b5dc03a0 tempest-AttachVolumeTestJSON-1609025183 tempest-AttachVolumeTestJSON-1609025183-project] [instance: 34a25afd-ca05-47fe-8bba-30442b7b5348] Fetching instance by UUID {{(pid=128729) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 16:00:23.765039 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-78070f81-5a0f-4c69-b754-c095b5dc03a0 tempest-AttachVolumeTestJSON-1609025183 tempest-AttachVolumeTestJSON-1609025183-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 16:00:23.765495 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-78070f81-5a0f-4c69-b754-c095b5dc03a0 tempest-AttachVolumeTestJSON-1609025183 tempest-AttachVolumeTestJSON-1609025183-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 16:00:23.766278 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-78070f81-5a0f-4c69-b754-c095b5dc03a0 tempest-AttachVolumeTestJSON-1609025183 tempest-AttachVolumeTestJSON-1609025183-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 16:00:23.766751 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-78070f81-5a0f-4c69-b754-c095b5dc03a0 tempest-AttachVolumeTestJSON-1609025183 tempest-AttachVolumeTestJSON-1609025183-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 16:00:23.904978 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.policy [None req-78070f81-5a0f-4c69-b754-c095b5dc03a0 tempest-AttachVolumeTestJSON-1609025183 tempest-AttachVolumeTestJSON-1609025183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '742938d3a02a4c8babf518b7b6cf53a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '882808bd43644908a21ff8a58997c57f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128729) authorize /opt/stack/nova/nova/policy.py:199}} May 14 16:00:23.912891 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: INFO nova.api.openstack.requestlog [None req-78070f81-5a0f-4c69-b754-c095b5dc03a0 tempest-AttachVolumeTestJSON-1609025183 tempest-AttachVolumeTestJSON-1609025183-project] 10.222.0.61 "GET /compute/v2.1/servers/34a25afd-ca05-47fe-8bba-30442b7b5348" status: 200 len: 1724 microversion: 2.1 time: 0.159621 May 14 16:00:23.913721 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: [pid: 128729|app: 0|req: 635/1290] 10.222.0.61 () {58 vars in 1235 bytes} [Sat May 14 16:00:23 2022] GET /compute/v2.1/servers/34a25afd-ca05-47fe-8bba-30442b7b5348 => generated 1724 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 16:00:24.929932 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi [None req-e052797c-005e-45a5-b533-ed9a5da1c87c tempest-AttachVolumeTestJSON-1609025183 tempest-AttachVolumeTestJSON-1609025183-project] Calling method '>' {{(pid=128728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 16:00:24.930744 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.compute.api [None req-e052797c-005e-45a5-b533-ed9a5da1c87c tempest-AttachVolumeTestJSON-1609025183 tempest-AttachVolumeTestJSON-1609025183-project] [instance: 34a25afd-ca05-47fe-8bba-30442b7b5348] Fetching instance by UUID {{(pid=128728) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 16:00:24.938086 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-e052797c-005e-45a5-b533-ed9a5da1c87c tempest-AttachVolumeTestJSON-1609025183 tempest-AttachVolumeTestJSON-1609025183-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 16:00:24.938587 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-e052797c-005e-45a5-b533-ed9a5da1c87c tempest-AttachVolumeTestJSON-1609025183 tempest-AttachVolumeTestJSON-1609025183-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 16:00:24.939493 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-e052797c-005e-45a5-b533-ed9a5da1c87c tempest-AttachVolumeTestJSON-1609025183 tempest-AttachVolumeTestJSON-1609025183-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 16:00:24.939936 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-e052797c-005e-45a5-b533-ed9a5da1c87c tempest-AttachVolumeTestJSON-1609025183 tempest-AttachVolumeTestJSON-1609025183-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 16:00:25.074907 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.policy [None req-e052797c-005e-45a5-b533-ed9a5da1c87c tempest-AttachVolumeTestJSON-1609025183 tempest-AttachVolumeTestJSON-1609025183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '742938d3a02a4c8babf518b7b6cf53a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '882808bd43644908a21ff8a58997c57f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128728) authorize /opt/stack/nova/nova/policy.py:199}} May 14 16:00:25.083437 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: INFO nova.api.openstack.requestlog [None req-e052797c-005e-45a5-b533-ed9a5da1c87c tempest-AttachVolumeTestJSON-1609025183 tempest-AttachVolumeTestJSON-1609025183-project] 10.222.0.61 "GET /compute/v2.1/servers/34a25afd-ca05-47fe-8bba-30442b7b5348" status: 200 len: 1724 microversion: 2.1 time: 0.157302 May 14 16:00:25.083945 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: [pid: 128728|app: 0|req: 656/1291] 10.222.0.61 () {58 vars in 1235 bytes} [Sat May 14 16:00:24 2022] GET /compute/v2.1/servers/34a25afd-ca05-47fe-8bba-30442b7b5348 => generated 1724 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 16:00:26.100907 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi [None req-137983a5-afcf-4b64-b30c-8282fddcf5d3 tempest-AttachVolumeTestJSON-1609025183 tempest-AttachVolumeTestJSON-1609025183-project] Calling method '>' {{(pid=128729) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 16:00:26.101480 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.compute.api [None req-137983a5-afcf-4b64-b30c-8282fddcf5d3 tempest-AttachVolumeTestJSON-1609025183 tempest-AttachVolumeTestJSON-1609025183-project] [instance: 34a25afd-ca05-47fe-8bba-30442b7b5348] Fetching instance by UUID {{(pid=128729) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 16:00:26.107896 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-137983a5-afcf-4b64-b30c-8282fddcf5d3 tempest-AttachVolumeTestJSON-1609025183 tempest-AttachVolumeTestJSON-1609025183-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 16:00:26.108348 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-137983a5-afcf-4b64-b30c-8282fddcf5d3 tempest-AttachVolumeTestJSON-1609025183 tempest-AttachVolumeTestJSON-1609025183-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 16:00:26.109117 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-137983a5-afcf-4b64-b30c-8282fddcf5d3 tempest-AttachVolumeTestJSON-1609025183 tempest-AttachVolumeTestJSON-1609025183-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 16:00:26.109550 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-137983a5-afcf-4b64-b30c-8282fddcf5d3 tempest-AttachVolumeTestJSON-1609025183 tempest-AttachVolumeTestJSON-1609025183-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 16:00:26.259960 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.policy [None req-137983a5-afcf-4b64-b30c-8282fddcf5d3 tempest-AttachVolumeTestJSON-1609025183 tempest-AttachVolumeTestJSON-1609025183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '742938d3a02a4c8babf518b7b6cf53a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '882808bd43644908a21ff8a58997c57f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128729) authorize /opt/stack/nova/nova/policy.py:199}} May 14 16:00:26.268113 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: INFO nova.api.openstack.requestlog [None req-137983a5-afcf-4b64-b30c-8282fddcf5d3 tempest-AttachVolumeTestJSON-1609025183 tempest-AttachVolumeTestJSON-1609025183-project] 10.222.0.61 "GET /compute/v2.1/servers/34a25afd-ca05-47fe-8bba-30442b7b5348" status: 200 len: 1724 microversion: 2.1 time: 0.171117 May 14 16:00:26.280119 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: [pid: 128729|app: 0|req: 636/1292] 10.222.0.61 () {58 vars in 1235 bytes} [Sat May 14 16:00:26 2022] GET /compute/v2.1/servers/34a25afd-ca05-47fe-8bba-30442b7b5348 => generated 1724 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 16:00:27.286920 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi [None req-cf6bf697-1084-49da-b07c-74e0ab9921a9 tempest-AttachVolumeTestJSON-1609025183 tempest-AttachVolumeTestJSON-1609025183-project] Calling method '>' {{(pid=128728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 16:00:27.287537 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.compute.api [None req-cf6bf697-1084-49da-b07c-74e0ab9921a9 tempest-AttachVolumeTestJSON-1609025183 tempest-AttachVolumeTestJSON-1609025183-project] [instance: 34a25afd-ca05-47fe-8bba-30442b7b5348] Fetching instance by UUID {{(pid=128728) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 16:00:27.293882 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-cf6bf697-1084-49da-b07c-74e0ab9921a9 tempest-AttachVolumeTestJSON-1609025183 tempest-AttachVolumeTestJSON-1609025183-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 16:00:27.294356 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-cf6bf697-1084-49da-b07c-74e0ab9921a9 tempest-AttachVolumeTestJSON-1609025183 tempest-AttachVolumeTestJSON-1609025183-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 16:00:27.295135 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-cf6bf697-1084-49da-b07c-74e0ab9921a9 tempest-AttachVolumeTestJSON-1609025183 tempest-AttachVolumeTestJSON-1609025183-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 16:00:27.295576 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-cf6bf697-1084-49da-b07c-74e0ab9921a9 tempest-AttachVolumeTestJSON-1609025183 tempest-AttachVolumeTestJSON-1609025183-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 16:00:27.426196 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.policy [None req-cf6bf697-1084-49da-b07c-74e0ab9921a9 tempest-AttachVolumeTestJSON-1609025183 tempest-AttachVolumeTestJSON-1609025183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '742938d3a02a4c8babf518b7b6cf53a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '882808bd43644908a21ff8a58997c57f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128728) authorize /opt/stack/nova/nova/policy.py:199}} May 14 16:00:27.434258 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: INFO nova.api.openstack.requestlog [None req-cf6bf697-1084-49da-b07c-74e0ab9921a9 tempest-AttachVolumeTestJSON-1609025183 tempest-AttachVolumeTestJSON-1609025183-project] 10.222.0.61 "GET /compute/v2.1/servers/34a25afd-ca05-47fe-8bba-30442b7b5348" status: 200 len: 1724 microversion: 2.1 time: 0.151000 May 14 16:00:27.434848 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: [pid: 128728|app: 0|req: 657/1293] 10.222.0.61 () {58 vars in 1235 bytes} [Sat May 14 16:00:27 2022] GET /compute/v2.1/servers/34a25afd-ca05-47fe-8bba-30442b7b5348 => generated 1724 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 16:00:28.451443 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi [None req-8992f814-c09e-4317-b247-86c6cc684b65 tempest-AttachVolumeTestJSON-1609025183 tempest-AttachVolumeTestJSON-1609025183-project] Calling method '>' {{(pid=128729) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 16:00:28.452068 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.compute.api [None req-8992f814-c09e-4317-b247-86c6cc684b65 tempest-AttachVolumeTestJSON-1609025183 tempest-AttachVolumeTestJSON-1609025183-project] [instance: 34a25afd-ca05-47fe-8bba-30442b7b5348] Fetching instance by UUID {{(pid=128729) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 16:00:28.458297 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-8992f814-c09e-4317-b247-86c6cc684b65 tempest-AttachVolumeTestJSON-1609025183 tempest-AttachVolumeTestJSON-1609025183-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 16:00:28.458802 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-8992f814-c09e-4317-b247-86c6cc684b65 tempest-AttachVolumeTestJSON-1609025183 tempest-AttachVolumeTestJSON-1609025183-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 16:00:28.459583 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-8992f814-c09e-4317-b247-86c6cc684b65 tempest-AttachVolumeTestJSON-1609025183 tempest-AttachVolumeTestJSON-1609025183-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 16:00:28.460014 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-8992f814-c09e-4317-b247-86c6cc684b65 tempest-AttachVolumeTestJSON-1609025183 tempest-AttachVolumeTestJSON-1609025183-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 16:00:28.585960 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.policy [None req-8992f814-c09e-4317-b247-86c6cc684b65 tempest-AttachVolumeTestJSON-1609025183 tempest-AttachVolumeTestJSON-1609025183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '742938d3a02a4c8babf518b7b6cf53a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '882808bd43644908a21ff8a58997c57f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128729) authorize /opt/stack/nova/nova/policy.py:199}} May 14 16:00:28.594381 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: INFO nova.api.openstack.requestlog [None req-8992f814-c09e-4317-b247-86c6cc684b65 tempest-AttachVolumeTestJSON-1609025183 tempest-AttachVolumeTestJSON-1609025183-project] 10.222.0.61 "GET /compute/v2.1/servers/34a25afd-ca05-47fe-8bba-30442b7b5348" status: 200 len: 1724 microversion: 2.1 time: 0.146760 May 14 16:00:28.594953 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: [pid: 128729|app: 0|req: 637/1294] 10.222.0.61 () {58 vars in 1235 bytes} [Sat May 14 16:00:28 2022] GET /compute/v2.1/servers/34a25afd-ca05-47fe-8bba-30442b7b5348 => generated 1724 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 16:00:29.615064 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi [None req-b44bbb92-24a5-4ce1-b8ff-b55ce701d56a tempest-AttachVolumeTestJSON-1609025183 tempest-AttachVolumeTestJSON-1609025183-project] Calling method '>' {{(pid=128728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 16:00:29.615758 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.compute.api [None req-b44bbb92-24a5-4ce1-b8ff-b55ce701d56a tempest-AttachVolumeTestJSON-1609025183 tempest-AttachVolumeTestJSON-1609025183-project] [instance: 34a25afd-ca05-47fe-8bba-30442b7b5348] Fetching instance by UUID {{(pid=128728) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 16:00:29.623050 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-b44bbb92-24a5-4ce1-b8ff-b55ce701d56a tempest-AttachVolumeTestJSON-1609025183 tempest-AttachVolumeTestJSON-1609025183-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 16:00:29.623580 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-b44bbb92-24a5-4ce1-b8ff-b55ce701d56a tempest-AttachVolumeTestJSON-1609025183 tempest-AttachVolumeTestJSON-1609025183-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 16:00:29.624377 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-b44bbb92-24a5-4ce1-b8ff-b55ce701d56a tempest-AttachVolumeTestJSON-1609025183 tempest-AttachVolumeTestJSON-1609025183-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 16:00:29.624823 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-b44bbb92-24a5-4ce1-b8ff-b55ce701d56a tempest-AttachVolumeTestJSON-1609025183 tempest-AttachVolumeTestJSON-1609025183-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 16:00:29.753913 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.policy [None req-b44bbb92-24a5-4ce1-b8ff-b55ce701d56a tempest-AttachVolumeTestJSON-1609025183 tempest-AttachVolumeTestJSON-1609025183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '742938d3a02a4c8babf518b7b6cf53a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '882808bd43644908a21ff8a58997c57f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128728) authorize /opt/stack/nova/nova/policy.py:199}} May 14 16:00:29.761737 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: INFO nova.api.openstack.requestlog [None req-b44bbb92-24a5-4ce1-b8ff-b55ce701d56a tempest-AttachVolumeTestJSON-1609025183 tempest-AttachVolumeTestJSON-1609025183-project] 10.222.0.61 "GET /compute/v2.1/servers/34a25afd-ca05-47fe-8bba-30442b7b5348" status: 200 len: 1724 microversion: 2.1 time: 0.150576 May 14 16:00:29.762300 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: [pid: 128728|app: 0|req: 658/1295] 10.222.0.61 () {58 vars in 1235 bytes} [Sat May 14 16:00:29 2022] GET /compute/v2.1/servers/34a25afd-ca05-47fe-8bba-30442b7b5348 => generated 1724 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 16:00:30.778605 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi [None req-f094b4eb-ac89-4b06-8210-1e2313cb0725 tempest-AttachVolumeTestJSON-1609025183 tempest-AttachVolumeTestJSON-1609025183-project] Calling method '>' {{(pid=128729) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 16:00:30.779218 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.compute.api [None req-f094b4eb-ac89-4b06-8210-1e2313cb0725 tempest-AttachVolumeTestJSON-1609025183 tempest-AttachVolumeTestJSON-1609025183-project] [instance: 34a25afd-ca05-47fe-8bba-30442b7b5348] Fetching instance by UUID {{(pid=128729) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 16:00:30.785784 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-f094b4eb-ac89-4b06-8210-1e2313cb0725 tempest-AttachVolumeTestJSON-1609025183 tempest-AttachVolumeTestJSON-1609025183-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 16:00:30.786243 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-f094b4eb-ac89-4b06-8210-1e2313cb0725 tempest-AttachVolumeTestJSON-1609025183 tempest-AttachVolumeTestJSON-1609025183-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 16:00:30.787033 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-f094b4eb-ac89-4b06-8210-1e2313cb0725 tempest-AttachVolumeTestJSON-1609025183 tempest-AttachVolumeTestJSON-1609025183-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 16:00:30.787468 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-f094b4eb-ac89-4b06-8210-1e2313cb0725 tempest-AttachVolumeTestJSON-1609025183 tempest-AttachVolumeTestJSON-1609025183-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 16:00:30.915069 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.policy [None req-f094b4eb-ac89-4b06-8210-1e2313cb0725 tempest-AttachVolumeTestJSON-1609025183 tempest-AttachVolumeTestJSON-1609025183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '742938d3a02a4c8babf518b7b6cf53a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '882808bd43644908a21ff8a58997c57f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128729) authorize /opt/stack/nova/nova/policy.py:199}} May 14 16:00:30.923347 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: INFO nova.api.openstack.requestlog [None req-f094b4eb-ac89-4b06-8210-1e2313cb0725 tempest-AttachVolumeTestJSON-1609025183 tempest-AttachVolumeTestJSON-1609025183-project] 10.222.0.61 "GET /compute/v2.1/servers/34a25afd-ca05-47fe-8bba-30442b7b5348" status: 200 len: 1724 microversion: 2.1 time: 0.149374 May 14 16:00:30.923903 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: [pid: 128729|app: 0|req: 638/1296] 10.222.0.61 () {58 vars in 1235 bytes} [Sat May 14 16:00:30 2022] GET /compute/v2.1/servers/34a25afd-ca05-47fe-8bba-30442b7b5348 => generated 1724 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 16:00:31.940469 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi [None req-4a5661a9-1aa8-430d-87ac-92f70c748059 tempest-AttachVolumeTestJSON-1609025183 tempest-AttachVolumeTestJSON-1609025183-project] Calling method '>' {{(pid=128728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 16:00:31.941079 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.compute.api [None req-4a5661a9-1aa8-430d-87ac-92f70c748059 tempest-AttachVolumeTestJSON-1609025183 tempest-AttachVolumeTestJSON-1609025183-project] [instance: 34a25afd-ca05-47fe-8bba-30442b7b5348] Fetching instance by UUID {{(pid=128728) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 16:00:31.947587 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-4a5661a9-1aa8-430d-87ac-92f70c748059 tempest-AttachVolumeTestJSON-1609025183 tempest-AttachVolumeTestJSON-1609025183-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 16:00:31.948030 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-4a5661a9-1aa8-430d-87ac-92f70c748059 tempest-AttachVolumeTestJSON-1609025183 tempest-AttachVolumeTestJSON-1609025183-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 16:00:31.948792 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-4a5661a9-1aa8-430d-87ac-92f70c748059 tempest-AttachVolumeTestJSON-1609025183 tempest-AttachVolumeTestJSON-1609025183-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 16:00:31.949963 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-4a5661a9-1aa8-430d-87ac-92f70c748059 tempest-AttachVolumeTestJSON-1609025183 tempest-AttachVolumeTestJSON-1609025183-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 16:00:32.076941 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.policy [None req-4a5661a9-1aa8-430d-87ac-92f70c748059 tempest-AttachVolumeTestJSON-1609025183 tempest-AttachVolumeTestJSON-1609025183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '742938d3a02a4c8babf518b7b6cf53a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '882808bd43644908a21ff8a58997c57f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128728) authorize /opt/stack/nova/nova/policy.py:199}} May 14 16:00:32.084652 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: INFO nova.api.openstack.requestlog [None req-4a5661a9-1aa8-430d-87ac-92f70c748059 tempest-AttachVolumeTestJSON-1609025183 tempest-AttachVolumeTestJSON-1609025183-project] 10.222.0.61 "GET /compute/v2.1/servers/34a25afd-ca05-47fe-8bba-30442b7b5348" status: 200 len: 1724 microversion: 2.1 time: 0.148015 May 14 16:00:32.085217 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: [pid: 128728|app: 0|req: 659/1297] 10.222.0.61 () {58 vars in 1235 bytes} [Sat May 14 16:00:31 2022] GET /compute/v2.1/servers/34a25afd-ca05-47fe-8bba-30442b7b5348 => generated 1724 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 16:00:33.101785 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi [None req-91b3e8f3-c450-4e3a-95af-44982d033180 tempest-AttachVolumeTestJSON-1609025183 tempest-AttachVolumeTestJSON-1609025183-project] Calling method '>' {{(pid=128729) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 16:00:33.102476 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.compute.api [None req-91b3e8f3-c450-4e3a-95af-44982d033180 tempest-AttachVolumeTestJSON-1609025183 tempest-AttachVolumeTestJSON-1609025183-project] [instance: 34a25afd-ca05-47fe-8bba-30442b7b5348] Fetching instance by UUID {{(pid=128729) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 16:00:33.108770 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-91b3e8f3-c450-4e3a-95af-44982d033180 tempest-AttachVolumeTestJSON-1609025183 tempest-AttachVolumeTestJSON-1609025183-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 16:00:33.109223 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-91b3e8f3-c450-4e3a-95af-44982d033180 tempest-AttachVolumeTestJSON-1609025183 tempest-AttachVolumeTestJSON-1609025183-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 16:00:33.109996 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-91b3e8f3-c450-4e3a-95af-44982d033180 tempest-AttachVolumeTestJSON-1609025183 tempest-AttachVolumeTestJSON-1609025183-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 16:00:33.110477 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-91b3e8f3-c450-4e3a-95af-44982d033180 tempest-AttachVolumeTestJSON-1609025183 tempest-AttachVolumeTestJSON-1609025183-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 16:00:33.242470 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.policy [None req-91b3e8f3-c450-4e3a-95af-44982d033180 tempest-AttachVolumeTestJSON-1609025183 tempest-AttachVolumeTestJSON-1609025183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '742938d3a02a4c8babf518b7b6cf53a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '882808bd43644908a21ff8a58997c57f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128729) authorize /opt/stack/nova/nova/policy.py:199}} May 14 16:00:33.251236 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: INFO nova.api.openstack.requestlog [None req-91b3e8f3-c450-4e3a-95af-44982d033180 tempest-AttachVolumeTestJSON-1609025183 tempest-AttachVolumeTestJSON-1609025183-project] 10.222.0.61 "GET /compute/v2.1/servers/34a25afd-ca05-47fe-8bba-30442b7b5348" status: 200 len: 1724 microversion: 2.1 time: 0.153244 May 14 16:00:33.251922 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: [pid: 128729|app: 0|req: 639/1298] 10.222.0.61 () {58 vars in 1235 bytes} [Sat May 14 16:00:33 2022] GET /compute/v2.1/servers/34a25afd-ca05-47fe-8bba-30442b7b5348 => generated 1724 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 16:00:34.268522 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi [None req-f009d79a-d879-4297-95a5-42cda80cd2e7 tempest-AttachVolumeTestJSON-1609025183 tempest-AttachVolumeTestJSON-1609025183-project] Calling method '>' {{(pid=128728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 16:00:34.269139 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.compute.api [None req-f009d79a-d879-4297-95a5-42cda80cd2e7 tempest-AttachVolumeTestJSON-1609025183 tempest-AttachVolumeTestJSON-1609025183-project] [instance: 34a25afd-ca05-47fe-8bba-30442b7b5348] Fetching instance by UUID {{(pid=128728) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 16:00:34.275460 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-f009d79a-d879-4297-95a5-42cda80cd2e7 tempest-AttachVolumeTestJSON-1609025183 tempest-AttachVolumeTestJSON-1609025183-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 16:00:34.275926 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-f009d79a-d879-4297-95a5-42cda80cd2e7 tempest-AttachVolumeTestJSON-1609025183 tempest-AttachVolumeTestJSON-1609025183-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 16:00:34.276680 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-f009d79a-d879-4297-95a5-42cda80cd2e7 tempest-AttachVolumeTestJSON-1609025183 tempest-AttachVolumeTestJSON-1609025183-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 16:00:34.277632 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-f009d79a-d879-4297-95a5-42cda80cd2e7 tempest-AttachVolumeTestJSON-1609025183 tempest-AttachVolumeTestJSON-1609025183-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 16:00:34.405569 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.policy [None req-f009d79a-d879-4297-95a5-42cda80cd2e7 tempest-AttachVolumeTestJSON-1609025183 tempest-AttachVolumeTestJSON-1609025183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '742938d3a02a4c8babf518b7b6cf53a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '882808bd43644908a21ff8a58997c57f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128728) authorize /opt/stack/nova/nova/policy.py:199}} May 14 16:00:34.413226 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: INFO nova.api.openstack.requestlog [None req-f009d79a-d879-4297-95a5-42cda80cd2e7 tempest-AttachVolumeTestJSON-1609025183 tempest-AttachVolumeTestJSON-1609025183-project] 10.222.0.61 "GET /compute/v2.1/servers/34a25afd-ca05-47fe-8bba-30442b7b5348" status: 200 len: 1724 microversion: 2.1 time: 0.148690 May 14 16:00:34.413785 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: [pid: 128728|app: 0|req: 660/1299] 10.222.0.61 () {58 vars in 1235 bytes} [Sat May 14 16:00:34 2022] GET /compute/v2.1/servers/34a25afd-ca05-47fe-8bba-30442b7b5348 => generated 1724 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 16:00:35.431147 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi [None req-14212dd5-4cb6-43ab-8792-a3ec21f04a5f tempest-AttachVolumeTestJSON-1609025183 tempest-AttachVolumeTestJSON-1609025183-project] Calling method '>' {{(pid=128729) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 16:00:35.431677 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.compute.api [None req-14212dd5-4cb6-43ab-8792-a3ec21f04a5f tempest-AttachVolumeTestJSON-1609025183 tempest-AttachVolumeTestJSON-1609025183-project] [instance: 34a25afd-ca05-47fe-8bba-30442b7b5348] Fetching instance by UUID {{(pid=128729) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 16:00:35.437551 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-14212dd5-4cb6-43ab-8792-a3ec21f04a5f tempest-AttachVolumeTestJSON-1609025183 tempest-AttachVolumeTestJSON-1609025183-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 16:00:35.437999 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-14212dd5-4cb6-43ab-8792-a3ec21f04a5f tempest-AttachVolumeTestJSON-1609025183 tempest-AttachVolumeTestJSON-1609025183-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 16:00:35.438789 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-14212dd5-4cb6-43ab-8792-a3ec21f04a5f tempest-AttachVolumeTestJSON-1609025183 tempest-AttachVolumeTestJSON-1609025183-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 16:00:35.439230 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-14212dd5-4cb6-43ab-8792-a3ec21f04a5f tempest-AttachVolumeTestJSON-1609025183 tempest-AttachVolumeTestJSON-1609025183-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 16:00:35.575397 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.policy [None req-14212dd5-4cb6-43ab-8792-a3ec21f04a5f tempest-AttachVolumeTestJSON-1609025183 tempest-AttachVolumeTestJSON-1609025183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '742938d3a02a4c8babf518b7b6cf53a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '882808bd43644908a21ff8a58997c57f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128729) authorize /opt/stack/nova/nova/policy.py:199}} May 14 16:00:35.583005 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: INFO nova.api.openstack.requestlog [None req-14212dd5-4cb6-43ab-8792-a3ec21f04a5f tempest-AttachVolumeTestJSON-1609025183 tempest-AttachVolumeTestJSON-1609025183-project] 10.222.0.61 "GET /compute/v2.1/servers/34a25afd-ca05-47fe-8bba-30442b7b5348" status: 200 len: 1724 microversion: 2.1 time: 0.155935 May 14 16:00:35.583565 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: [pid: 128729|app: 0|req: 640/1300] 10.222.0.61 () {58 vars in 1235 bytes} [Sat May 14 16:00:35 2022] GET /compute/v2.1/servers/34a25afd-ca05-47fe-8bba-30442b7b5348 => generated 1724 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 16:00:36.600432 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi [None req-3f24e138-439d-4870-bbac-73df4849504c tempest-AttachVolumeTestJSON-1609025183 tempest-AttachVolumeTestJSON-1609025183-project] Calling method '>' {{(pid=128728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 16:00:36.601168 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.compute.api [None req-3f24e138-439d-4870-bbac-73df4849504c tempest-AttachVolumeTestJSON-1609025183 tempest-AttachVolumeTestJSON-1609025183-project] [instance: 34a25afd-ca05-47fe-8bba-30442b7b5348] Fetching instance by UUID {{(pid=128728) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 16:00:36.607440 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-3f24e138-439d-4870-bbac-73df4849504c tempest-AttachVolumeTestJSON-1609025183 tempest-AttachVolumeTestJSON-1609025183-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 16:00:36.607898 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-3f24e138-439d-4870-bbac-73df4849504c tempest-AttachVolumeTestJSON-1609025183 tempest-AttachVolumeTestJSON-1609025183-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 16:00:36.608678 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-3f24e138-439d-4870-bbac-73df4849504c tempest-AttachVolumeTestJSON-1609025183 tempest-AttachVolumeTestJSON-1609025183-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 16:00:36.609123 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-3f24e138-439d-4870-bbac-73df4849504c tempest-AttachVolumeTestJSON-1609025183 tempest-AttachVolumeTestJSON-1609025183-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 16:00:36.735995 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.policy [None req-3f24e138-439d-4870-bbac-73df4849504c tempest-AttachVolumeTestJSON-1609025183 tempest-AttachVolumeTestJSON-1609025183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '742938d3a02a4c8babf518b7b6cf53a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '882808bd43644908a21ff8a58997c57f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128728) authorize /opt/stack/nova/nova/policy.py:199}} May 14 16:00:36.743791 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: INFO nova.api.openstack.requestlog [None req-3f24e138-439d-4870-bbac-73df4849504c tempest-AttachVolumeTestJSON-1609025183 tempest-AttachVolumeTestJSON-1609025183-project] 10.222.0.61 "GET /compute/v2.1/servers/34a25afd-ca05-47fe-8bba-30442b7b5348" status: 200 len: 1724 microversion: 2.1 time: 0.147221 May 14 16:00:36.744365 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: [pid: 128728|app: 0|req: 661/1301] 10.222.0.61 () {58 vars in 1235 bytes} [Sat May 14 16:00:36 2022] GET /compute/v2.1/servers/34a25afd-ca05-47fe-8bba-30442b7b5348 => generated 1724 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 16:00:37.761155 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi [None req-c318dbdd-1fd3-4b41-b44b-f73c57cca9f9 tempest-AttachVolumeTestJSON-1609025183 tempest-AttachVolumeTestJSON-1609025183-project] Calling method '>' {{(pid=128729) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 16:00:37.761805 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.compute.api [None req-c318dbdd-1fd3-4b41-b44b-f73c57cca9f9 tempest-AttachVolumeTestJSON-1609025183 tempest-AttachVolumeTestJSON-1609025183-project] [instance: 34a25afd-ca05-47fe-8bba-30442b7b5348] Fetching instance by UUID {{(pid=128729) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 16:00:37.768175 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-c318dbdd-1fd3-4b41-b44b-f73c57cca9f9 tempest-AttachVolumeTestJSON-1609025183 tempest-AttachVolumeTestJSON-1609025183-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 16:00:37.768645 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-c318dbdd-1fd3-4b41-b44b-f73c57cca9f9 tempest-AttachVolumeTestJSON-1609025183 tempest-AttachVolumeTestJSON-1609025183-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 16:00:37.769414 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-c318dbdd-1fd3-4b41-b44b-f73c57cca9f9 tempest-AttachVolumeTestJSON-1609025183 tempest-AttachVolumeTestJSON-1609025183-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 16:00:37.769854 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-c318dbdd-1fd3-4b41-b44b-f73c57cca9f9 tempest-AttachVolumeTestJSON-1609025183 tempest-AttachVolumeTestJSON-1609025183-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 16:00:37.895877 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.policy [None req-c318dbdd-1fd3-4b41-b44b-f73c57cca9f9 tempest-AttachVolumeTestJSON-1609025183 tempest-AttachVolumeTestJSON-1609025183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '742938d3a02a4c8babf518b7b6cf53a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '882808bd43644908a21ff8a58997c57f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128729) authorize /opt/stack/nova/nova/policy.py:199}} May 14 16:00:37.903738 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: INFO nova.api.openstack.requestlog [None req-c318dbdd-1fd3-4b41-b44b-f73c57cca9f9 tempest-AttachVolumeTestJSON-1609025183 tempest-AttachVolumeTestJSON-1609025183-project] 10.222.0.61 "GET /compute/v2.1/servers/34a25afd-ca05-47fe-8bba-30442b7b5348" status: 200 len: 1724 microversion: 2.1 time: 0.146544 May 14 16:00:37.904306 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: [pid: 128729|app: 0|req: 641/1302] 10.222.0.61 () {58 vars in 1235 bytes} [Sat May 14 16:00:37 2022] GET /compute/v2.1/servers/34a25afd-ca05-47fe-8bba-30442b7b5348 => generated 1724 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 16:00:38.920962 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi [None req-5eb53281-c206-4231-b3da-3807c4b9391a tempest-AttachVolumeTestJSON-1609025183 tempest-AttachVolumeTestJSON-1609025183-project] Calling method '>' {{(pid=128728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 16:00:38.921573 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.compute.api [None req-5eb53281-c206-4231-b3da-3807c4b9391a tempest-AttachVolumeTestJSON-1609025183 tempest-AttachVolumeTestJSON-1609025183-project] [instance: 34a25afd-ca05-47fe-8bba-30442b7b5348] Fetching instance by UUID {{(pid=128728) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 16:00:38.927929 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-5eb53281-c206-4231-b3da-3807c4b9391a tempest-AttachVolumeTestJSON-1609025183 tempest-AttachVolumeTestJSON-1609025183-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 16:00:38.928382 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-5eb53281-c206-4231-b3da-3807c4b9391a tempest-AttachVolumeTestJSON-1609025183 tempest-AttachVolumeTestJSON-1609025183-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 16:00:38.929152 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-5eb53281-c206-4231-b3da-3807c4b9391a tempest-AttachVolumeTestJSON-1609025183 tempest-AttachVolumeTestJSON-1609025183-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 16:00:38.929594 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-5eb53281-c206-4231-b3da-3807c4b9391a tempest-AttachVolumeTestJSON-1609025183 tempest-AttachVolumeTestJSON-1609025183-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 16:00:39.060186 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.policy [None req-5eb53281-c206-4231-b3da-3807c4b9391a tempest-AttachVolumeTestJSON-1609025183 tempest-AttachVolumeTestJSON-1609025183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '742938d3a02a4c8babf518b7b6cf53a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '882808bd43644908a21ff8a58997c57f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128728) authorize /opt/stack/nova/nova/policy.py:199}} May 14 16:00:39.067937 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: INFO nova.api.openstack.requestlog [None req-5eb53281-c206-4231-b3da-3807c4b9391a tempest-AttachVolumeTestJSON-1609025183 tempest-AttachVolumeTestJSON-1609025183-project] 10.222.0.61 "GET /compute/v2.1/servers/34a25afd-ca05-47fe-8bba-30442b7b5348" status: 200 len: 1724 microversion: 2.1 time: 0.150971 May 14 16:00:39.068499 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: [pid: 128728|app: 0|req: 662/1303] 10.222.0.61 () {58 vars in 1235 bytes} [Sat May 14 16:00:38 2022] GET /compute/v2.1/servers/34a25afd-ca05-47fe-8bba-30442b7b5348 => generated 1724 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 16:00:40.086020 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi [None req-7508e124-415a-41d5-aa8a-44745e3ef924 tempest-AttachVolumeTestJSON-1609025183 tempest-AttachVolumeTestJSON-1609025183-project] Calling method '>' {{(pid=128729) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 16:00:40.086597 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.compute.api [None req-7508e124-415a-41d5-aa8a-44745e3ef924 tempest-AttachVolumeTestJSON-1609025183 tempest-AttachVolumeTestJSON-1609025183-project] [instance: 34a25afd-ca05-47fe-8bba-30442b7b5348] Fetching instance by UUID {{(pid=128729) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 16:00:40.092897 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-7508e124-415a-41d5-aa8a-44745e3ef924 tempest-AttachVolumeTestJSON-1609025183 tempest-AttachVolumeTestJSON-1609025183-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 16:00:40.093342 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-7508e124-415a-41d5-aa8a-44745e3ef924 tempest-AttachVolumeTestJSON-1609025183 tempest-AttachVolumeTestJSON-1609025183-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 16:00:40.094099 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-7508e124-415a-41d5-aa8a-44745e3ef924 tempest-AttachVolumeTestJSON-1609025183 tempest-AttachVolumeTestJSON-1609025183-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 16:00:40.094565 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-7508e124-415a-41d5-aa8a-44745e3ef924 tempest-AttachVolumeTestJSON-1609025183 tempest-AttachVolumeTestJSON-1609025183-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 16:00:40.223039 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.policy [None req-7508e124-415a-41d5-aa8a-44745e3ef924 tempest-AttachVolumeTestJSON-1609025183 tempest-AttachVolumeTestJSON-1609025183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '742938d3a02a4c8babf518b7b6cf53a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '882808bd43644908a21ff8a58997c57f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128729) authorize /opt/stack/nova/nova/policy.py:199}} May 14 16:00:40.231247 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: INFO nova.api.openstack.requestlog [None req-7508e124-415a-41d5-aa8a-44745e3ef924 tempest-AttachVolumeTestJSON-1609025183 tempest-AttachVolumeTestJSON-1609025183-project] 10.222.0.61 "GET /compute/v2.1/servers/34a25afd-ca05-47fe-8bba-30442b7b5348" status: 200 len: 1724 microversion: 2.1 time: 0.149168 May 14 16:00:40.231804 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: [pid: 128729|app: 0|req: 642/1304] 10.222.0.61 () {58 vars in 1235 bytes} [Sat May 14 16:00:40 2022] GET /compute/v2.1/servers/34a25afd-ca05-47fe-8bba-30442b7b5348 => generated 1724 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 16:00:41.248564 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi [None req-ac817b35-ce4f-41c2-9f32-90258384da0b tempest-AttachVolumeTestJSON-1609025183 tempest-AttachVolumeTestJSON-1609025183-project] Calling method '>' {{(pid=128728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 16:00:41.249167 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.compute.api [None req-ac817b35-ce4f-41c2-9f32-90258384da0b tempest-AttachVolumeTestJSON-1609025183 tempest-AttachVolumeTestJSON-1609025183-project] [instance: 34a25afd-ca05-47fe-8bba-30442b7b5348] Fetching instance by UUID {{(pid=128728) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 16:00:41.255471 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-ac817b35-ce4f-41c2-9f32-90258384da0b tempest-AttachVolumeTestJSON-1609025183 tempest-AttachVolumeTestJSON-1609025183-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 16:00:41.255916 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-ac817b35-ce4f-41c2-9f32-90258384da0b tempest-AttachVolumeTestJSON-1609025183 tempest-AttachVolumeTestJSON-1609025183-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 16:00:41.256671 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-ac817b35-ce4f-41c2-9f32-90258384da0b tempest-AttachVolumeTestJSON-1609025183 tempest-AttachVolumeTestJSON-1609025183-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 16:00:41.257102 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-ac817b35-ce4f-41c2-9f32-90258384da0b tempest-AttachVolumeTestJSON-1609025183 tempest-AttachVolumeTestJSON-1609025183-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 16:00:41.388583 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.policy [None req-ac817b35-ce4f-41c2-9f32-90258384da0b tempest-AttachVolumeTestJSON-1609025183 tempest-AttachVolumeTestJSON-1609025183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '742938d3a02a4c8babf518b7b6cf53a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '882808bd43644908a21ff8a58997c57f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128728) authorize /opt/stack/nova/nova/policy.py:199}} May 14 16:00:41.396186 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: INFO nova.api.openstack.requestlog [None req-ac817b35-ce4f-41c2-9f32-90258384da0b tempest-AttachVolumeTestJSON-1609025183 tempest-AttachVolumeTestJSON-1609025183-project] 10.222.0.61 "GET /compute/v2.1/servers/34a25afd-ca05-47fe-8bba-30442b7b5348" status: 200 len: 1724 microversion: 2.1 time: 0.151833 May 14 16:00:41.396745 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: [pid: 128728|app: 0|req: 663/1305] 10.222.0.61 () {58 vars in 1235 bytes} [Sat May 14 16:00:41 2022] GET /compute/v2.1/servers/34a25afd-ca05-47fe-8bba-30442b7b5348 => generated 1724 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 16:00:42.414364 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi [None req-40bc799e-b262-4c74-8edc-bcb9102807f9 tempest-AttachVolumeTestJSON-1609025183 tempest-AttachVolumeTestJSON-1609025183-project] Calling method '>' {{(pid=128729) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 16:00:42.414985 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.compute.api [None req-40bc799e-b262-4c74-8edc-bcb9102807f9 tempest-AttachVolumeTestJSON-1609025183 tempest-AttachVolumeTestJSON-1609025183-project] [instance: 34a25afd-ca05-47fe-8bba-30442b7b5348] Fetching instance by UUID {{(pid=128729) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 16:00:42.422688 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-40bc799e-b262-4c74-8edc-bcb9102807f9 tempest-AttachVolumeTestJSON-1609025183 tempest-AttachVolumeTestJSON-1609025183-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 16:00:42.423250 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-40bc799e-b262-4c74-8edc-bcb9102807f9 tempest-AttachVolumeTestJSON-1609025183 tempest-AttachVolumeTestJSON-1609025183-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 16:00:42.424014 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-40bc799e-b262-4c74-8edc-bcb9102807f9 tempest-AttachVolumeTestJSON-1609025183 tempest-AttachVolumeTestJSON-1609025183-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 16:00:42.424446 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-40bc799e-b262-4c74-8edc-bcb9102807f9 tempest-AttachVolumeTestJSON-1609025183 tempest-AttachVolumeTestJSON-1609025183-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 16:00:42.553770 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.policy [None req-40bc799e-b262-4c74-8edc-bcb9102807f9 tempest-AttachVolumeTestJSON-1609025183 tempest-AttachVolumeTestJSON-1609025183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '742938d3a02a4c8babf518b7b6cf53a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '882808bd43644908a21ff8a58997c57f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128729) authorize /opt/stack/nova/nova/policy.py:199}} May 14 16:00:42.562038 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: INFO nova.api.openstack.requestlog [None req-40bc799e-b262-4c74-8edc-bcb9102807f9 tempest-AttachVolumeTestJSON-1609025183 tempest-AttachVolumeTestJSON-1609025183-project] 10.222.0.61 "GET /compute/v2.1/servers/34a25afd-ca05-47fe-8bba-30442b7b5348" status: 200 len: 1724 microversion: 2.1 time: 0.151523 May 14 16:00:42.562635 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: [pid: 128729|app: 0|req: 643/1306] 10.222.0.61 () {58 vars in 1235 bytes} [Sat May 14 16:00:42 2022] GET /compute/v2.1/servers/34a25afd-ca05-47fe-8bba-30442b7b5348 => generated 1724 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 16:00:43.579937 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi [None req-ecb35530-5936-405f-b108-10c150df5d9f tempest-AttachVolumeTestJSON-1609025183 tempest-AttachVolumeTestJSON-1609025183-project] Calling method '>' {{(pid=128728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 16:00:43.580542 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.compute.api [None req-ecb35530-5936-405f-b108-10c150df5d9f tempest-AttachVolumeTestJSON-1609025183 tempest-AttachVolumeTestJSON-1609025183-project] [instance: 34a25afd-ca05-47fe-8bba-30442b7b5348] Fetching instance by UUID {{(pid=128728) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 16:00:43.587245 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-ecb35530-5936-405f-b108-10c150df5d9f tempest-AttachVolumeTestJSON-1609025183 tempest-AttachVolumeTestJSON-1609025183-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 16:00:43.587692 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-ecb35530-5936-405f-b108-10c150df5d9f tempest-AttachVolumeTestJSON-1609025183 tempest-AttachVolumeTestJSON-1609025183-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 16:00:43.588455 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-ecb35530-5936-405f-b108-10c150df5d9f tempest-AttachVolumeTestJSON-1609025183 tempest-AttachVolumeTestJSON-1609025183-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 16:00:43.588887 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-ecb35530-5936-405f-b108-10c150df5d9f tempest-AttachVolumeTestJSON-1609025183 tempest-AttachVolumeTestJSON-1609025183-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 16:00:43.720015 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.policy [None req-ecb35530-5936-405f-b108-10c150df5d9f tempest-AttachVolumeTestJSON-1609025183 tempest-AttachVolumeTestJSON-1609025183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '742938d3a02a4c8babf518b7b6cf53a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '882808bd43644908a21ff8a58997c57f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128728) authorize /opt/stack/nova/nova/policy.py:199}} May 14 16:00:43.727669 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: INFO nova.api.openstack.requestlog [None req-ecb35530-5936-405f-b108-10c150df5d9f tempest-AttachVolumeTestJSON-1609025183 tempest-AttachVolumeTestJSON-1609025183-project] 10.222.0.61 "GET /compute/v2.1/servers/34a25afd-ca05-47fe-8bba-30442b7b5348" status: 200 len: 1701 microversion: 2.1 time: 0.151862 May 14 16:00:43.728233 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: [pid: 128728|app: 0|req: 664/1307] 10.222.0.61 () {58 vars in 1235 bytes} [Sat May 14 16:00:43 2022] GET /compute/v2.1/servers/34a25afd-ca05-47fe-8bba-30442b7b5348 => generated 1701 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 16:00:43.744373 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi [None req-4316b645-fad8-4726-ab4d-b57d1f31c497 tempest-AttachVolumeTestJSON-1609025183 tempest-AttachVolumeTestJSON-1609025183-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=128729) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 16:00:43.751697 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-4316b645-fad8-4726-ab4d-b57d1f31c497 tempest-AttachVolumeTestJSON-1609025183 tempest-AttachVolumeTestJSON-1609025183-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 16:00:43.752146 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-4316b645-fad8-4726-ab4d-b57d1f31c497 tempest-AttachVolumeTestJSON-1609025183 tempest-AttachVolumeTestJSON-1609025183-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 16:00:43.773290 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.compute.api [None req-4316b645-fad8-4726-ab4d-b57d1f31c497 tempest-AttachVolumeTestJSON-1609025183 tempest-AttachVolumeTestJSON-1609025183-project] [instance: 34a25afd-ca05-47fe-8bba-30442b7b5348] Going to try to start instance {{(pid=128729) start /opt/stack/nova/nova/compute/api.py:2730}} May 14 16:00:43.813512 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: INFO nova.api.openstack.requestlog [None req-4316b645-fad8-4726-ab4d-b57d1f31c497 tempest-AttachVolumeTestJSON-1609025183 tempest-AttachVolumeTestJSON-1609025183-project] 10.222.0.61 "POST /compute/v2.1/servers/34a25afd-ca05-47fe-8bba-30442b7b5348/action" status: 202 len: 0 microversion: 2.1 time: 0.072805 May 14 16:00:43.814102 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: [pid: 128729|app: 0|req: 644/1308] 10.222.0.61 () {60 vars in 1277 bytes} [Sat May 14 16:00:43 2022] POST /compute/v2.1/servers/34a25afd-ca05-47fe-8bba-30442b7b5348/action => generated 0 bytes in 74 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 14 16:00:43.822120 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi [None req-5858c55a-ed4f-4a2a-bf9e-f3cbf5b6fe4d tempest-AttachVolumeTestJSON-1609025183 tempest-AttachVolumeTestJSON-1609025183-project] Calling method '>' {{(pid=128728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 16:00:43.822764 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.compute.api [None req-5858c55a-ed4f-4a2a-bf9e-f3cbf5b6fe4d tempest-AttachVolumeTestJSON-1609025183 tempest-AttachVolumeTestJSON-1609025183-project] [instance: 34a25afd-ca05-47fe-8bba-30442b7b5348] Fetching instance by UUID {{(pid=128728) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 16:00:43.829078 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-5858c55a-ed4f-4a2a-bf9e-f3cbf5b6fe4d tempest-AttachVolumeTestJSON-1609025183 tempest-AttachVolumeTestJSON-1609025183-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 16:00:43.829537 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-5858c55a-ed4f-4a2a-bf9e-f3cbf5b6fe4d tempest-AttachVolumeTestJSON-1609025183 tempest-AttachVolumeTestJSON-1609025183-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 16:00:43.830426 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-5858c55a-ed4f-4a2a-bf9e-f3cbf5b6fe4d tempest-AttachVolumeTestJSON-1609025183 tempest-AttachVolumeTestJSON-1609025183-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 16:00:43.830951 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-5858c55a-ed4f-4a2a-bf9e-f3cbf5b6fe4d tempest-AttachVolumeTestJSON-1609025183 tempest-AttachVolumeTestJSON-1609025183-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 16:00:43.965345 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.policy [None req-5858c55a-ed4f-4a2a-bf9e-f3cbf5b6fe4d tempest-AttachVolumeTestJSON-1609025183 tempest-AttachVolumeTestJSON-1609025183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '742938d3a02a4c8babf518b7b6cf53a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '882808bd43644908a21ff8a58997c57f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128728) authorize /opt/stack/nova/nova/policy.py:199}} May 14 16:00:43.973081 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: INFO nova.api.openstack.requestlog [None req-5858c55a-ed4f-4a2a-bf9e-f3cbf5b6fe4d tempest-AttachVolumeTestJSON-1609025183 tempest-AttachVolumeTestJSON-1609025183-project] 10.222.0.61 "GET /compute/v2.1/servers/34a25afd-ca05-47fe-8bba-30442b7b5348" status: 200 len: 1710 microversion: 2.1 time: 0.154799 May 14 16:00:43.973649 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: [pid: 128728|app: 0|req: 665/1309] 10.222.0.61 () {58 vars in 1235 bytes} [Sat May 14 16:00:43 2022] GET /compute/v2.1/servers/34a25afd-ca05-47fe-8bba-30442b7b5348 => generated 1710 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 16:00:44.992529 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi [None req-e25445ee-c64a-49ed-80a0-b57f6bcbdb66 tempest-AttachVolumeTestJSON-1609025183 tempest-AttachVolumeTestJSON-1609025183-project] Calling method '>' {{(pid=128729) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 16:00:44.993244 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.compute.api [None req-e25445ee-c64a-49ed-80a0-b57f6bcbdb66 tempest-AttachVolumeTestJSON-1609025183 tempest-AttachVolumeTestJSON-1609025183-project] [instance: 34a25afd-ca05-47fe-8bba-30442b7b5348] Fetching instance by UUID {{(pid=128729) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 16:00:45.000503 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-e25445ee-c64a-49ed-80a0-b57f6bcbdb66 tempest-AttachVolumeTestJSON-1609025183 tempest-AttachVolumeTestJSON-1609025183-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 16:00:45.001037 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-e25445ee-c64a-49ed-80a0-b57f6bcbdb66 tempest-AttachVolumeTestJSON-1609025183 tempest-AttachVolumeTestJSON-1609025183-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 16:00:45.001824 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-e25445ee-c64a-49ed-80a0-b57f6bcbdb66 tempest-AttachVolumeTestJSON-1609025183 tempest-AttachVolumeTestJSON-1609025183-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 16:00:45.002273 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-e25445ee-c64a-49ed-80a0-b57f6bcbdb66 tempest-AttachVolumeTestJSON-1609025183 tempest-AttachVolumeTestJSON-1609025183-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 16:00:45.132809 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.policy [None req-e25445ee-c64a-49ed-80a0-b57f6bcbdb66 tempest-AttachVolumeTestJSON-1609025183 tempest-AttachVolumeTestJSON-1609025183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '742938d3a02a4c8babf518b7b6cf53a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '882808bd43644908a21ff8a58997c57f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128729) authorize /opt/stack/nova/nova/policy.py:199}} May 14 16:00:45.141651 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: INFO nova.api.openstack.requestlog [None req-e25445ee-c64a-49ed-80a0-b57f6bcbdb66 tempest-AttachVolumeTestJSON-1609025183 tempest-AttachVolumeTestJSON-1609025183-project] 10.222.0.61 "GET /compute/v2.1/servers/34a25afd-ca05-47fe-8bba-30442b7b5348" status: 200 len: 1710 microversion: 2.1 time: 0.153763 May 14 16:00:45.142229 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: [pid: 128729|app: 0|req: 645/1310] 10.222.0.61 () {58 vars in 1235 bytes} [Sat May 14 16:00:44 2022] GET /compute/v2.1/servers/34a25afd-ca05-47fe-8bba-30442b7b5348 => generated 1710 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 16:00:46.158962 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi [None req-edd62cb9-a9b3-4e12-8231-5171d0a9943c tempest-AttachVolumeTestJSON-1609025183 tempest-AttachVolumeTestJSON-1609025183-project] Calling method '>' {{(pid=128728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 16:00:46.159523 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.compute.api [None req-edd62cb9-a9b3-4e12-8231-5171d0a9943c tempest-AttachVolumeTestJSON-1609025183 tempest-AttachVolumeTestJSON-1609025183-project] [instance: 34a25afd-ca05-47fe-8bba-30442b7b5348] Fetching instance by UUID {{(pid=128728) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 16:00:46.165710 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-edd62cb9-a9b3-4e12-8231-5171d0a9943c tempest-AttachVolumeTestJSON-1609025183 tempest-AttachVolumeTestJSON-1609025183-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 16:00:46.166165 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-edd62cb9-a9b3-4e12-8231-5171d0a9943c tempest-AttachVolumeTestJSON-1609025183 tempest-AttachVolumeTestJSON-1609025183-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 16:00:46.166968 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-edd62cb9-a9b3-4e12-8231-5171d0a9943c tempest-AttachVolumeTestJSON-1609025183 tempest-AttachVolumeTestJSON-1609025183-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 16:00:46.167541 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-edd62cb9-a9b3-4e12-8231-5171d0a9943c tempest-AttachVolumeTestJSON-1609025183 tempest-AttachVolumeTestJSON-1609025183-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 16:00:46.296913 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.policy [None req-edd62cb9-a9b3-4e12-8231-5171d0a9943c tempest-AttachVolumeTestJSON-1609025183 tempest-AttachVolumeTestJSON-1609025183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '742938d3a02a4c8babf518b7b6cf53a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '882808bd43644908a21ff8a58997c57f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128728) authorize /opt/stack/nova/nova/policy.py:199}} May 14 16:00:46.304502 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: INFO nova.api.openstack.requestlog [None req-edd62cb9-a9b3-4e12-8231-5171d0a9943c tempest-AttachVolumeTestJSON-1609025183 tempest-AttachVolumeTestJSON-1609025183-project] 10.222.0.61 "GET /compute/v2.1/servers/34a25afd-ca05-47fe-8bba-30442b7b5348" status: 200 len: 1714 microversion: 2.1 time: 0.149546 May 14 16:00:46.305054 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: [pid: 128728|app: 0|req: 666/1311] 10.222.0.61 () {58 vars in 1235 bytes} [Sat May 14 16:00:46 2022] GET /compute/v2.1/servers/34a25afd-ca05-47fe-8bba-30442b7b5348 => generated 1714 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 16:01:20.663791 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 14 16:01:20.664433 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: Sat May 14 16:01:20 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 14 16:01:26.960514 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 14 16:01:26.961152 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: Sat May 14 16:01:26 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 14 16:01:41.531972 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi [None req-95767138-fc35-4cc4-b4eb-2fbdead19f70 tempest-AttachVolumeTestJSON-1609025183 tempest-AttachVolumeTestJSON-1609025183-project] Calling method '>' {{(pid=128729) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 16:01:41.532609 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.compute.api [None req-95767138-fc35-4cc4-b4eb-2fbdead19f70 tempest-AttachVolumeTestJSON-1609025183 tempest-AttachVolumeTestJSON-1609025183-project] [instance: 34a25afd-ca05-47fe-8bba-30442b7b5348] Fetching instance by UUID {{(pid=128729) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 16:01:41.538792 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-95767138-fc35-4cc4-b4eb-2fbdead19f70 tempest-AttachVolumeTestJSON-1609025183 tempest-AttachVolumeTestJSON-1609025183-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 16:01:41.539249 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-95767138-fc35-4cc4-b4eb-2fbdead19f70 tempest-AttachVolumeTestJSON-1609025183 tempest-AttachVolumeTestJSON-1609025183-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 16:01:41.540027 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-95767138-fc35-4cc4-b4eb-2fbdead19f70 tempest-AttachVolumeTestJSON-1609025183 tempest-AttachVolumeTestJSON-1609025183-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 16:01:41.540469 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-95767138-fc35-4cc4-b4eb-2fbdead19f70 tempest-AttachVolumeTestJSON-1609025183 tempest-AttachVolumeTestJSON-1609025183-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 16:01:41.858656 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.objects.instance [None req-95767138-fc35-4cc4-b4eb-2fbdead19f70 tempest-AttachVolumeTestJSON-1609025183 tempest-AttachVolumeTestJSON-1609025183-project] Lazy-loading 'services' on Instance uuid 34a25afd-ca05-47fe-8bba-30442b7b5348 {{(pid=128729) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 14 16:01:41.927088 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: INFO nova.api.openstack.requestlog [None req-95767138-fc35-4cc4-b4eb-2fbdead19f70 tempest-AttachVolumeTestJSON-1609025183 tempest-AttachVolumeTestJSON-1609025183-project] 10.222.0.61 "DELETE /compute/v2.1/servers/34a25afd-ca05-47fe-8bba-30442b7b5348/os-volume_attachments/5dcfcf8d-8edd-4029-8287-147effa9d344" status: 202 len: 0 microversion: 2.1 time: 0.399802 May 14 16:01:41.927668 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: [pid: 128729|app: 0|req: 646/1312] 10.222.0.61 () {58 vars in 1415 bytes} [Sat May 14 16:01:41 2022] DELETE /compute/v2.1/servers/34a25afd-ca05-47fe-8bba-30442b7b5348/os-volume_attachments/5dcfcf8d-8edd-4029-8287-147effa9d344 => generated 0 bytes in 401 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 14 16:01:43.037343 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi [None req-7e47f206-064d-4ef3-9fc5-cd770a6ee3d4 tempest-AttachVolumeTestJSON-1609025183 tempest-AttachVolumeTestJSON-1609025183-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=128728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 16:01:43.043287 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-7e47f206-064d-4ef3-9fc5-cd770a6ee3d4 tempest-AttachVolumeTestJSON-1609025183 tempest-AttachVolumeTestJSON-1609025183-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 16:01:43.043740 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-7e47f206-064d-4ef3-9fc5-cd770a6ee3d4 tempest-AttachVolumeTestJSON-1609025183 tempest-AttachVolumeTestJSON-1609025183-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 16:01:43.102733 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.compute.api [None req-7e47f206-064d-4ef3-9fc5-cd770a6ee3d4 tempest-AttachVolumeTestJSON-1609025183 tempest-AttachVolumeTestJSON-1609025183-project] [instance: 34a25afd-ca05-47fe-8bba-30442b7b5348] Going to try to stop instance {{(pid=128728) force_stop /opt/stack/nova/nova/compute/api.py:2707}} May 14 16:01:43.143912 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: INFO nova.api.openstack.requestlog [None req-7e47f206-064d-4ef3-9fc5-cd770a6ee3d4 tempest-AttachVolumeTestJSON-1609025183 tempest-AttachVolumeTestJSON-1609025183-project] 10.222.0.61 "POST /compute/v2.1/servers/34a25afd-ca05-47fe-8bba-30442b7b5348/action" status: 202 len: 0 microversion: 2.1 time: 0.110449 May 14 16:01:43.144592 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: [pid: 128728|app: 0|req: 667/1313] 10.222.0.61 () {60 vars in 1277 bytes} [Sat May 14 16:01:43 2022] POST /compute/v2.1/servers/34a25afd-ca05-47fe-8bba-30442b7b5348/action => generated 0 bytes in 112 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 14 16:01:43.153743 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi [None req-0c1bb4d9-a8d0-437e-a120-9c4a8cc40e32 tempest-AttachVolumeTestJSON-1609025183 tempest-AttachVolumeTestJSON-1609025183-project] Calling method '>' {{(pid=128729) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 16:01:43.154481 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.compute.api [None req-0c1bb4d9-a8d0-437e-a120-9c4a8cc40e32 tempest-AttachVolumeTestJSON-1609025183 tempest-AttachVolumeTestJSON-1609025183-project] [instance: 34a25afd-ca05-47fe-8bba-30442b7b5348] Fetching instance by UUID {{(pid=128729) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 16:01:43.162823 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-0c1bb4d9-a8d0-437e-a120-9c4a8cc40e32 tempest-AttachVolumeTestJSON-1609025183 tempest-AttachVolumeTestJSON-1609025183-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 16:01:43.163449 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-0c1bb4d9-a8d0-437e-a120-9c4a8cc40e32 tempest-AttachVolumeTestJSON-1609025183 tempest-AttachVolumeTestJSON-1609025183-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 16:01:43.164240 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-0c1bb4d9-a8d0-437e-a120-9c4a8cc40e32 tempest-AttachVolumeTestJSON-1609025183 tempest-AttachVolumeTestJSON-1609025183-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 16:01:43.164860 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-0c1bb4d9-a8d0-437e-a120-9c4a8cc40e32 tempest-AttachVolumeTestJSON-1609025183 tempest-AttachVolumeTestJSON-1609025183-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 16:01:43.295214 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.policy [None req-0c1bb4d9-a8d0-437e-a120-9c4a8cc40e32 tempest-AttachVolumeTestJSON-1609025183 tempest-AttachVolumeTestJSON-1609025183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '742938d3a02a4c8babf518b7b6cf53a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '882808bd43644908a21ff8a58997c57f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128729) authorize /opt/stack/nova/nova/policy.py:199}} May 14 16:01:43.303171 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: INFO nova.api.openstack.requestlog [None req-0c1bb4d9-a8d0-437e-a120-9c4a8cc40e32 tempest-AttachVolumeTestJSON-1609025183 tempest-AttachVolumeTestJSON-1609025183-project] 10.222.0.61 "GET /compute/v2.1/servers/34a25afd-ca05-47fe-8bba-30442b7b5348" status: 200 len: 1678 microversion: 2.1 time: 0.153776 May 14 16:01:43.303733 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: [pid: 128729|app: 0|req: 647/1314] 10.222.0.61 () {58 vars in 1235 bytes} [Sat May 14 16:01:43 2022] GET /compute/v2.1/servers/34a25afd-ca05-47fe-8bba-30442b7b5348 => generated 1678 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 16:01:44.321678 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi [None req-a08ddb16-57ee-4534-a618-ebaa749b2e14 tempest-AttachVolumeTestJSON-1609025183 tempest-AttachVolumeTestJSON-1609025183-project] Calling method '>' {{(pid=128728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 16:01:44.322399 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.compute.api [None req-a08ddb16-57ee-4534-a618-ebaa749b2e14 tempest-AttachVolumeTestJSON-1609025183 tempest-AttachVolumeTestJSON-1609025183-project] [instance: 34a25afd-ca05-47fe-8bba-30442b7b5348] Fetching instance by UUID {{(pid=128728) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 16:01:44.328656 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-a08ddb16-57ee-4534-a618-ebaa749b2e14 tempest-AttachVolumeTestJSON-1609025183 tempest-AttachVolumeTestJSON-1609025183-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 16:01:44.329108 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-a08ddb16-57ee-4534-a618-ebaa749b2e14 tempest-AttachVolumeTestJSON-1609025183 tempest-AttachVolumeTestJSON-1609025183-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 16:01:44.329879 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-a08ddb16-57ee-4534-a618-ebaa749b2e14 tempest-AttachVolumeTestJSON-1609025183 tempest-AttachVolumeTestJSON-1609025183-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 16:01:44.330343 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-a08ddb16-57ee-4534-a618-ebaa749b2e14 tempest-AttachVolumeTestJSON-1609025183 tempest-AttachVolumeTestJSON-1609025183-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 16:01:44.554691 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.policy [None req-a08ddb16-57ee-4534-a618-ebaa749b2e14 tempest-AttachVolumeTestJSON-1609025183 tempest-AttachVolumeTestJSON-1609025183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '742938d3a02a4c8babf518b7b6cf53a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '882808bd43644908a21ff8a58997c57f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128728) authorize /opt/stack/nova/nova/policy.py:199}} May 14 16:01:44.562546 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: INFO nova.api.openstack.requestlog [None req-a08ddb16-57ee-4534-a618-ebaa749b2e14 tempest-AttachVolumeTestJSON-1609025183 tempest-AttachVolumeTestJSON-1609025183-project] 10.222.0.61 "GET /compute/v2.1/servers/34a25afd-ca05-47fe-8bba-30442b7b5348" status: 200 len: 1678 microversion: 2.1 time: 0.245679 May 14 16:01:44.563114 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: [pid: 128728|app: 0|req: 668/1315] 10.222.0.61 () {58 vars in 1235 bytes} [Sat May 14 16:01:44 2022] GET /compute/v2.1/servers/34a25afd-ca05-47fe-8bba-30442b7b5348 => generated 1678 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 16:01:45.581393 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi [None req-fc4cd5b5-b8af-4581-b088-d6f4d6c42e51 tempest-AttachVolumeTestJSON-1609025183 tempest-AttachVolumeTestJSON-1609025183-project] Calling method '>' {{(pid=128729) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 16:01:45.582000 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.compute.api [None req-fc4cd5b5-b8af-4581-b088-d6f4d6c42e51 tempest-AttachVolumeTestJSON-1609025183 tempest-AttachVolumeTestJSON-1609025183-project] [instance: 34a25afd-ca05-47fe-8bba-30442b7b5348] Fetching instance by UUID {{(pid=128729) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 16:01:45.588265 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-fc4cd5b5-b8af-4581-b088-d6f4d6c42e51 tempest-AttachVolumeTestJSON-1609025183 tempest-AttachVolumeTestJSON-1609025183-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 16:01:45.588711 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-fc4cd5b5-b8af-4581-b088-d6f4d6c42e51 tempest-AttachVolumeTestJSON-1609025183 tempest-AttachVolumeTestJSON-1609025183-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 16:01:45.589473 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-fc4cd5b5-b8af-4581-b088-d6f4d6c42e51 tempest-AttachVolumeTestJSON-1609025183 tempest-AttachVolumeTestJSON-1609025183-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 16:01:45.589906 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-fc4cd5b5-b8af-4581-b088-d6f4d6c42e51 tempest-AttachVolumeTestJSON-1609025183 tempest-AttachVolumeTestJSON-1609025183-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 16:01:45.716268 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.policy [None req-fc4cd5b5-b8af-4581-b088-d6f4d6c42e51 tempest-AttachVolumeTestJSON-1609025183 tempest-AttachVolumeTestJSON-1609025183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '742938d3a02a4c8babf518b7b6cf53a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '882808bd43644908a21ff8a58997c57f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128729) authorize /opt/stack/nova/nova/policy.py:199}} May 14 16:01:45.723590 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: INFO nova.api.openstack.requestlog [None req-fc4cd5b5-b8af-4581-b088-d6f4d6c42e51 tempest-AttachVolumeTestJSON-1609025183 tempest-AttachVolumeTestJSON-1609025183-project] 10.222.0.61 "GET /compute/v2.1/servers/34a25afd-ca05-47fe-8bba-30442b7b5348" status: 200 len: 1678 microversion: 2.1 time: 0.146671 May 14 16:01:45.724147 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: [pid: 128729|app: 0|req: 648/1316] 10.222.0.61 () {58 vars in 1235 bytes} [Sat May 14 16:01:45 2022] GET /compute/v2.1/servers/34a25afd-ca05-47fe-8bba-30442b7b5348 => generated 1678 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 16:01:46.740504 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi [None req-fdcf24c9-c217-4670-bc8c-2956038b32f4 tempest-AttachVolumeTestJSON-1609025183 tempest-AttachVolumeTestJSON-1609025183-project] Calling method '>' {{(pid=128728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 16:01:46.741115 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.compute.api [None req-fdcf24c9-c217-4670-bc8c-2956038b32f4 tempest-AttachVolumeTestJSON-1609025183 tempest-AttachVolumeTestJSON-1609025183-project] [instance: 34a25afd-ca05-47fe-8bba-30442b7b5348] Fetching instance by UUID {{(pid=128728) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 16:01:46.747623 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-fdcf24c9-c217-4670-bc8c-2956038b32f4 tempest-AttachVolumeTestJSON-1609025183 tempest-AttachVolumeTestJSON-1609025183-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 16:01:46.748075 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-fdcf24c9-c217-4670-bc8c-2956038b32f4 tempest-AttachVolumeTestJSON-1609025183 tempest-AttachVolumeTestJSON-1609025183-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 16:01:46.748905 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-fdcf24c9-c217-4670-bc8c-2956038b32f4 tempest-AttachVolumeTestJSON-1609025183 tempest-AttachVolumeTestJSON-1609025183-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 16:01:46.749568 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-fdcf24c9-c217-4670-bc8c-2956038b32f4 tempest-AttachVolumeTestJSON-1609025183 tempest-AttachVolumeTestJSON-1609025183-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 16:01:46.878226 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.policy [None req-fdcf24c9-c217-4670-bc8c-2956038b32f4 tempest-AttachVolumeTestJSON-1609025183 tempest-AttachVolumeTestJSON-1609025183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '742938d3a02a4c8babf518b7b6cf53a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '882808bd43644908a21ff8a58997c57f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128728) authorize /opt/stack/nova/nova/policy.py:199}} May 14 16:01:46.885473 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: INFO nova.api.openstack.requestlog [None req-fdcf24c9-c217-4670-bc8c-2956038b32f4 tempest-AttachVolumeTestJSON-1609025183 tempest-AttachVolumeTestJSON-1609025183-project] 10.222.0.61 "GET /compute/v2.1/servers/34a25afd-ca05-47fe-8bba-30442b7b5348" status: 200 len: 1678 microversion: 2.1 time: 0.148835 May 14 16:01:46.886046 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: [pid: 128728|app: 0|req: 669/1317] 10.222.0.61 () {58 vars in 1235 bytes} [Sat May 14 16:01:46 2022] GET /compute/v2.1/servers/34a25afd-ca05-47fe-8bba-30442b7b5348 => generated 1678 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 16:01:47.903069 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi [None req-d3715928-ab77-497f-9681-55cd96435b8d tempest-AttachVolumeTestJSON-1609025183 tempest-AttachVolumeTestJSON-1609025183-project] Calling method '>' {{(pid=128729) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 16:01:47.903682 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.compute.api [None req-d3715928-ab77-497f-9681-55cd96435b8d tempest-AttachVolumeTestJSON-1609025183 tempest-AttachVolumeTestJSON-1609025183-project] [instance: 34a25afd-ca05-47fe-8bba-30442b7b5348] Fetching instance by UUID {{(pid=128729) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 16:01:47.911063 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-d3715928-ab77-497f-9681-55cd96435b8d tempest-AttachVolumeTestJSON-1609025183 tempest-AttachVolumeTestJSON-1609025183-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 16:01:47.911513 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-d3715928-ab77-497f-9681-55cd96435b8d tempest-AttachVolumeTestJSON-1609025183 tempest-AttachVolumeTestJSON-1609025183-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 16:01:47.912281 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-d3715928-ab77-497f-9681-55cd96435b8d tempest-AttachVolumeTestJSON-1609025183 tempest-AttachVolumeTestJSON-1609025183-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 16:01:47.912722 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-d3715928-ab77-497f-9681-55cd96435b8d tempest-AttachVolumeTestJSON-1609025183 tempest-AttachVolumeTestJSON-1609025183-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 16:01:48.049699 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.policy [None req-d3715928-ab77-497f-9681-55cd96435b8d tempest-AttachVolumeTestJSON-1609025183 tempest-AttachVolumeTestJSON-1609025183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '742938d3a02a4c8babf518b7b6cf53a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '882808bd43644908a21ff8a58997c57f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128729) authorize /opt/stack/nova/nova/policy.py:199}} May 14 16:01:48.058005 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: INFO nova.api.openstack.requestlog [None req-d3715928-ab77-497f-9681-55cd96435b8d tempest-AttachVolumeTestJSON-1609025183 tempest-AttachVolumeTestJSON-1609025183-project] 10.222.0.61 "GET /compute/v2.1/servers/34a25afd-ca05-47fe-8bba-30442b7b5348" status: 200 len: 1678 microversion: 2.1 time: 0.158478 May 14 16:01:48.058671 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: [pid: 128729|app: 0|req: 649/1318] 10.222.0.61 () {58 vars in 1235 bytes} [Sat May 14 16:01:47 2022] GET /compute/v2.1/servers/34a25afd-ca05-47fe-8bba-30442b7b5348 => generated 1678 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 16:01:49.077553 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi [None req-1cc8fe51-2649-48ad-ae6c-ace44dede880 tempest-AttachVolumeTestJSON-1609025183 tempest-AttachVolumeTestJSON-1609025183-project] Calling method '>' {{(pid=128728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 16:01:49.078362 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.compute.api [None req-1cc8fe51-2649-48ad-ae6c-ace44dede880 tempest-AttachVolumeTestJSON-1609025183 tempest-AttachVolumeTestJSON-1609025183-project] [instance: 34a25afd-ca05-47fe-8bba-30442b7b5348] Fetching instance by UUID {{(pid=128728) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 16:01:49.084635 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-1cc8fe51-2649-48ad-ae6c-ace44dede880 tempest-AttachVolumeTestJSON-1609025183 tempest-AttachVolumeTestJSON-1609025183-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 16:01:49.085089 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-1cc8fe51-2649-48ad-ae6c-ace44dede880 tempest-AttachVolumeTestJSON-1609025183 tempest-AttachVolumeTestJSON-1609025183-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 16:01:49.085917 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-1cc8fe51-2649-48ad-ae6c-ace44dede880 tempest-AttachVolumeTestJSON-1609025183 tempest-AttachVolumeTestJSON-1609025183-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 16:01:49.086293 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-1cc8fe51-2649-48ad-ae6c-ace44dede880 tempest-AttachVolumeTestJSON-1609025183 tempest-AttachVolumeTestJSON-1609025183-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 16:01:49.212445 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.policy [None req-1cc8fe51-2649-48ad-ae6c-ace44dede880 tempest-AttachVolumeTestJSON-1609025183 tempest-AttachVolumeTestJSON-1609025183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '742938d3a02a4c8babf518b7b6cf53a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '882808bd43644908a21ff8a58997c57f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128728) authorize /opt/stack/nova/nova/policy.py:199}} May 14 16:01:49.219898 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: INFO nova.api.openstack.requestlog [None req-1cc8fe51-2649-48ad-ae6c-ace44dede880 tempest-AttachVolumeTestJSON-1609025183 tempest-AttachVolumeTestJSON-1609025183-project] 10.222.0.61 "GET /compute/v2.1/servers/34a25afd-ca05-47fe-8bba-30442b7b5348" status: 200 len: 1678 microversion: 2.1 time: 0.146708 May 14 16:01:49.220466 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: [pid: 128728|app: 0|req: 670/1319] 10.222.0.61 () {58 vars in 1235 bytes} [Sat May 14 16:01:49 2022] GET /compute/v2.1/servers/34a25afd-ca05-47fe-8bba-30442b7b5348 => generated 1678 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 16:01:50.237158 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi [None req-411052a0-ccdc-485b-84ca-b6304c49077f tempest-AttachVolumeTestJSON-1609025183 tempest-AttachVolumeTestJSON-1609025183-project] Calling method '>' {{(pid=128729) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 16:01:50.237719 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.compute.api [None req-411052a0-ccdc-485b-84ca-b6304c49077f tempest-AttachVolumeTestJSON-1609025183 tempest-AttachVolumeTestJSON-1609025183-project] [instance: 34a25afd-ca05-47fe-8bba-30442b7b5348] Fetching instance by UUID {{(pid=128729) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 16:01:50.243923 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-411052a0-ccdc-485b-84ca-b6304c49077f tempest-AttachVolumeTestJSON-1609025183 tempest-AttachVolumeTestJSON-1609025183-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 16:01:50.244367 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-411052a0-ccdc-485b-84ca-b6304c49077f tempest-AttachVolumeTestJSON-1609025183 tempest-AttachVolumeTestJSON-1609025183-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 16:01:50.245128 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-411052a0-ccdc-485b-84ca-b6304c49077f tempest-AttachVolumeTestJSON-1609025183 tempest-AttachVolumeTestJSON-1609025183-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 16:01:50.245831 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-411052a0-ccdc-485b-84ca-b6304c49077f tempest-AttachVolumeTestJSON-1609025183 tempest-AttachVolumeTestJSON-1609025183-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 16:01:50.376395 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.policy [None req-411052a0-ccdc-485b-84ca-b6304c49077f tempest-AttachVolumeTestJSON-1609025183 tempest-AttachVolumeTestJSON-1609025183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '742938d3a02a4c8babf518b7b6cf53a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '882808bd43644908a21ff8a58997c57f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128729) authorize /opt/stack/nova/nova/policy.py:199}} May 14 16:01:50.383705 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: INFO nova.api.openstack.requestlog [None req-411052a0-ccdc-485b-84ca-b6304c49077f tempest-AttachVolumeTestJSON-1609025183 tempest-AttachVolumeTestJSON-1609025183-project] 10.222.0.61 "GET /compute/v2.1/servers/34a25afd-ca05-47fe-8bba-30442b7b5348" status: 200 len: 1678 microversion: 2.1 time: 0.150769 May 14 16:01:50.384273 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: [pid: 128729|app: 0|req: 650/1320] 10.222.0.61 () {58 vars in 1235 bytes} [Sat May 14 16:01:50 2022] GET /compute/v2.1/servers/34a25afd-ca05-47fe-8bba-30442b7b5348 => generated 1678 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 16:01:51.401122 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi [None req-11a437f5-752d-4034-9cbd-d3bf5242a8f1 tempest-AttachVolumeTestJSON-1609025183 tempest-AttachVolumeTestJSON-1609025183-project] Calling method '>' {{(pid=128728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 16:01:51.401731 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.compute.api [None req-11a437f5-752d-4034-9cbd-d3bf5242a8f1 tempest-AttachVolumeTestJSON-1609025183 tempest-AttachVolumeTestJSON-1609025183-project] [instance: 34a25afd-ca05-47fe-8bba-30442b7b5348] Fetching instance by UUID {{(pid=128728) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 16:01:51.408918 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-11a437f5-752d-4034-9cbd-d3bf5242a8f1 tempest-AttachVolumeTestJSON-1609025183 tempest-AttachVolumeTestJSON-1609025183-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 16:01:51.409375 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-11a437f5-752d-4034-9cbd-d3bf5242a8f1 tempest-AttachVolumeTestJSON-1609025183 tempest-AttachVolumeTestJSON-1609025183-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 16:01:51.410149 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-11a437f5-752d-4034-9cbd-d3bf5242a8f1 tempest-AttachVolumeTestJSON-1609025183 tempest-AttachVolumeTestJSON-1609025183-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 16:01:51.410624 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-11a437f5-752d-4034-9cbd-d3bf5242a8f1 tempest-AttachVolumeTestJSON-1609025183 tempest-AttachVolumeTestJSON-1609025183-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 16:01:51.534990 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.policy [None req-11a437f5-752d-4034-9cbd-d3bf5242a8f1 tempest-AttachVolumeTestJSON-1609025183 tempest-AttachVolumeTestJSON-1609025183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '742938d3a02a4c8babf518b7b6cf53a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '882808bd43644908a21ff8a58997c57f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128728) authorize /opt/stack/nova/nova/policy.py:199}} May 14 16:01:51.542112 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: INFO nova.api.openstack.requestlog [None req-11a437f5-752d-4034-9cbd-d3bf5242a8f1 tempest-AttachVolumeTestJSON-1609025183 tempest-AttachVolumeTestJSON-1609025183-project] 10.222.0.61 "GET /compute/v2.1/servers/34a25afd-ca05-47fe-8bba-30442b7b5348" status: 200 len: 1678 microversion: 2.1 time: 0.144898 May 14 16:01:51.542715 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: [pid: 128728|app: 0|req: 671/1321] 10.222.0.61 () {58 vars in 1235 bytes} [Sat May 14 16:01:51 2022] GET /compute/v2.1/servers/34a25afd-ca05-47fe-8bba-30442b7b5348 => generated 1678 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 16:01:52.559731 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi [None req-9256b955-42d6-48a3-b73b-955913857686 tempest-AttachVolumeTestJSON-1609025183 tempest-AttachVolumeTestJSON-1609025183-project] Calling method '>' {{(pid=128729) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 16:01:52.560350 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.compute.api [None req-9256b955-42d6-48a3-b73b-955913857686 tempest-AttachVolumeTestJSON-1609025183 tempest-AttachVolumeTestJSON-1609025183-project] [instance: 34a25afd-ca05-47fe-8bba-30442b7b5348] Fetching instance by UUID {{(pid=128729) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 16:01:52.566632 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-9256b955-42d6-48a3-b73b-955913857686 tempest-AttachVolumeTestJSON-1609025183 tempest-AttachVolumeTestJSON-1609025183-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 16:01:52.567083 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-9256b955-42d6-48a3-b73b-955913857686 tempest-AttachVolumeTestJSON-1609025183 tempest-AttachVolumeTestJSON-1609025183-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 16:01:52.567852 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-9256b955-42d6-48a3-b73b-955913857686 tempest-AttachVolumeTestJSON-1609025183 tempest-AttachVolumeTestJSON-1609025183-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 16:01:52.568290 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-9256b955-42d6-48a3-b73b-955913857686 tempest-AttachVolumeTestJSON-1609025183 tempest-AttachVolumeTestJSON-1609025183-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 16:01:52.695825 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.policy [None req-9256b955-42d6-48a3-b73b-955913857686 tempest-AttachVolumeTestJSON-1609025183 tempest-AttachVolumeTestJSON-1609025183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '742938d3a02a4c8babf518b7b6cf53a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '882808bd43644908a21ff8a58997c57f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128729) authorize /opt/stack/nova/nova/policy.py:199}} May 14 16:01:52.703615 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: INFO nova.api.openstack.requestlog [None req-9256b955-42d6-48a3-b73b-955913857686 tempest-AttachVolumeTestJSON-1609025183 tempest-AttachVolumeTestJSON-1609025183-project] 10.222.0.61 "GET /compute/v2.1/servers/34a25afd-ca05-47fe-8bba-30442b7b5348" status: 200 len: 1678 microversion: 2.1 time: 0.147748 May 14 16:01:52.704176 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: [pid: 128729|app: 0|req: 651/1322] 10.222.0.61 () {58 vars in 1235 bytes} [Sat May 14 16:01:52 2022] GET /compute/v2.1/servers/34a25afd-ca05-47fe-8bba-30442b7b5348 => generated 1678 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 16:01:53.721152 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi [None req-e7db38c4-52d0-46e4-8d7f-2dce9238afec tempest-AttachVolumeTestJSON-1609025183 tempest-AttachVolumeTestJSON-1609025183-project] Calling method '>' {{(pid=128728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 16:01:53.721783 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.compute.api [None req-e7db38c4-52d0-46e4-8d7f-2dce9238afec tempest-AttachVolumeTestJSON-1609025183 tempest-AttachVolumeTestJSON-1609025183-project] [instance: 34a25afd-ca05-47fe-8bba-30442b7b5348] Fetching instance by UUID {{(pid=128728) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 16:01:53.728179 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-e7db38c4-52d0-46e4-8d7f-2dce9238afec tempest-AttachVolumeTestJSON-1609025183 tempest-AttachVolumeTestJSON-1609025183-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 16:01:53.728623 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-e7db38c4-52d0-46e4-8d7f-2dce9238afec tempest-AttachVolumeTestJSON-1609025183 tempest-AttachVolumeTestJSON-1609025183-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 16:01:53.729384 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-e7db38c4-52d0-46e4-8d7f-2dce9238afec tempest-AttachVolumeTestJSON-1609025183 tempest-AttachVolumeTestJSON-1609025183-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 16:01:53.729817 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-e7db38c4-52d0-46e4-8d7f-2dce9238afec tempest-AttachVolumeTestJSON-1609025183 tempest-AttachVolumeTestJSON-1609025183-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 16:01:53.856918 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.policy [None req-e7db38c4-52d0-46e4-8d7f-2dce9238afec tempest-AttachVolumeTestJSON-1609025183 tempest-AttachVolumeTestJSON-1609025183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '742938d3a02a4c8babf518b7b6cf53a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '882808bd43644908a21ff8a58997c57f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128728) authorize /opt/stack/nova/nova/policy.py:199}} May 14 16:01:53.864207 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: INFO nova.api.openstack.requestlog [None req-e7db38c4-52d0-46e4-8d7f-2dce9238afec tempest-AttachVolumeTestJSON-1609025183 tempest-AttachVolumeTestJSON-1609025183-project] 10.222.0.61 "GET /compute/v2.1/servers/34a25afd-ca05-47fe-8bba-30442b7b5348" status: 200 len: 1655 microversion: 2.1 time: 0.147508 May 14 16:01:53.864764 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: [pid: 128728|app: 0|req: 672/1323] 10.222.0.61 () {58 vars in 1235 bytes} [Sat May 14 16:01:53 2022] GET /compute/v2.1/servers/34a25afd-ca05-47fe-8bba-30442b7b5348 => generated 1655 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 16:01:53.881289 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi [None req-50c619b8-43f8-43cb-af33-818ee63f76dd tempest-AttachVolumeTestJSON-1609025183 tempest-AttachVolumeTestJSON-1609025183-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=128729) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 16:01:53.887590 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-50c619b8-43f8-43cb-af33-818ee63f76dd tempest-AttachVolumeTestJSON-1609025183 tempest-AttachVolumeTestJSON-1609025183-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 16:01:53.888034 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-50c619b8-43f8-43cb-af33-818ee63f76dd tempest-AttachVolumeTestJSON-1609025183 tempest-AttachVolumeTestJSON-1609025183-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 16:01:53.910012 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.compute.api [None req-50c619b8-43f8-43cb-af33-818ee63f76dd tempest-AttachVolumeTestJSON-1609025183 tempest-AttachVolumeTestJSON-1609025183-project] [instance: 34a25afd-ca05-47fe-8bba-30442b7b5348] Going to try to start instance {{(pid=128729) start /opt/stack/nova/nova/compute/api.py:2730}} May 14 16:01:53.950919 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: INFO nova.api.openstack.requestlog [None req-50c619b8-43f8-43cb-af33-818ee63f76dd tempest-AttachVolumeTestJSON-1609025183 tempest-AttachVolumeTestJSON-1609025183-project] 10.222.0.61 "POST /compute/v2.1/servers/34a25afd-ca05-47fe-8bba-30442b7b5348/action" status: 202 len: 0 microversion: 2.1 time: 0.073241 May 14 16:01:53.951511 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: [pid: 128729|app: 0|req: 652/1324] 10.222.0.61 () {60 vars in 1277 bytes} [Sat May 14 16:01:53 2022] POST /compute/v2.1/servers/34a25afd-ca05-47fe-8bba-30442b7b5348/action => generated 0 bytes in 75 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 14 16:01:53.960428 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi [None req-e3ba06da-9fb3-4252-b87c-82f6f264e078 tempest-AttachVolumeTestJSON-1609025183 tempest-AttachVolumeTestJSON-1609025183-project] Calling method '>' {{(pid=128728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 16:01:53.961046 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.compute.api [None req-e3ba06da-9fb3-4252-b87c-82f6f264e078 tempest-AttachVolumeTestJSON-1609025183 tempest-AttachVolumeTestJSON-1609025183-project] [instance: 34a25afd-ca05-47fe-8bba-30442b7b5348] Fetching instance by UUID {{(pid=128728) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 16:01:53.967494 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-e3ba06da-9fb3-4252-b87c-82f6f264e078 tempest-AttachVolumeTestJSON-1609025183 tempest-AttachVolumeTestJSON-1609025183-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 16:01:53.968289 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-e3ba06da-9fb3-4252-b87c-82f6f264e078 tempest-AttachVolumeTestJSON-1609025183 tempest-AttachVolumeTestJSON-1609025183-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 16:01:53.969224 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-e3ba06da-9fb3-4252-b87c-82f6f264e078 tempest-AttachVolumeTestJSON-1609025183 tempest-AttachVolumeTestJSON-1609025183-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 16:01:53.969664 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-e3ba06da-9fb3-4252-b87c-82f6f264e078 tempest-AttachVolumeTestJSON-1609025183 tempest-AttachVolumeTestJSON-1609025183-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 16:01:54.102336 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.policy [None req-e3ba06da-9fb3-4252-b87c-82f6f264e078 tempest-AttachVolumeTestJSON-1609025183 tempest-AttachVolumeTestJSON-1609025183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '742938d3a02a4c8babf518b7b6cf53a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '882808bd43644908a21ff8a58997c57f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128728) authorize /opt/stack/nova/nova/policy.py:199}} May 14 16:01:54.109914 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: INFO nova.api.openstack.requestlog [None req-e3ba06da-9fb3-4252-b87c-82f6f264e078 tempest-AttachVolumeTestJSON-1609025183 tempest-AttachVolumeTestJSON-1609025183-project] 10.222.0.61 "GET /compute/v2.1/servers/34a25afd-ca05-47fe-8bba-30442b7b5348" status: 200 len: 1664 microversion: 2.1 time: 0.153473 May 14 16:01:54.110516 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: [pid: 128728|app: 0|req: 673/1325] 10.222.0.61 () {58 vars in 1235 bytes} [Sat May 14 16:01:53 2022] GET /compute/v2.1/servers/34a25afd-ca05-47fe-8bba-30442b7b5348 => generated 1664 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 16:01:55.128562 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi [None req-4b0a96ae-2006-4bb5-bbac-1b3cb0a33123 tempest-AttachVolumeTestJSON-1609025183 tempest-AttachVolumeTestJSON-1609025183-project] Calling method '>' {{(pid=128729) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 16:01:55.129178 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.compute.api [None req-4b0a96ae-2006-4bb5-bbac-1b3cb0a33123 tempest-AttachVolumeTestJSON-1609025183 tempest-AttachVolumeTestJSON-1609025183-project] [instance: 34a25afd-ca05-47fe-8bba-30442b7b5348] Fetching instance by UUID {{(pid=128729) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 16:01:55.135219 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-4b0a96ae-2006-4bb5-bbac-1b3cb0a33123 tempest-AttachVolumeTestJSON-1609025183 tempest-AttachVolumeTestJSON-1609025183-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 16:01:55.135667 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-4b0a96ae-2006-4bb5-bbac-1b3cb0a33123 tempest-AttachVolumeTestJSON-1609025183 tempest-AttachVolumeTestJSON-1609025183-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 16:01:55.136427 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-4b0a96ae-2006-4bb5-bbac-1b3cb0a33123 tempest-AttachVolumeTestJSON-1609025183 tempest-AttachVolumeTestJSON-1609025183-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 16:01:55.136865 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-4b0a96ae-2006-4bb5-bbac-1b3cb0a33123 tempest-AttachVolumeTestJSON-1609025183 tempest-AttachVolumeTestJSON-1609025183-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 16:01:55.266765 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.policy [None req-4b0a96ae-2006-4bb5-bbac-1b3cb0a33123 tempest-AttachVolumeTestJSON-1609025183 tempest-AttachVolumeTestJSON-1609025183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '742938d3a02a4c8babf518b7b6cf53a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '882808bd43644908a21ff8a58997c57f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128729) authorize /opt/stack/nova/nova/policy.py:199}} May 14 16:01:55.274071 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: INFO nova.api.openstack.requestlog [None req-4b0a96ae-2006-4bb5-bbac-1b3cb0a33123 tempest-AttachVolumeTestJSON-1609025183 tempest-AttachVolumeTestJSON-1609025183-project] 10.222.0.61 "GET /compute/v2.1/servers/34a25afd-ca05-47fe-8bba-30442b7b5348" status: 200 len: 1668 microversion: 2.1 time: 0.150718 May 14 16:01:55.274678 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: [pid: 128729|app: 0|req: 653/1326] 10.222.0.61 () {58 vars in 1235 bytes} [Sat May 14 16:01:55 2022] GET /compute/v2.1/servers/34a25afd-ca05-47fe-8bba-30442b7b5348 => generated 1668 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 16:02:58.589022 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi [None req-474a9831-75fd-4090-b41a-7f2b3b205ce6 tempest-AttachVolumeTestJSON-1609025183 tempest-AttachVolumeTestJSON-1609025183-project] Calling method '>' {{(pid=128728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 16:02:58.590004 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.compute.api [None req-474a9831-75fd-4090-b41a-7f2b3b205ce6 tempest-AttachVolumeTestJSON-1609025183 tempest-AttachVolumeTestJSON-1609025183-project] [instance: 34a25afd-ca05-47fe-8bba-30442b7b5348] Fetching instance by UUID {{(pid=128728) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 16:02:58.596531 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-474a9831-75fd-4090-b41a-7f2b3b205ce6 tempest-AttachVolumeTestJSON-1609025183 tempest-AttachVolumeTestJSON-1609025183-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 16:02:58.596979 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-474a9831-75fd-4090-b41a-7f2b3b205ce6 tempest-AttachVolumeTestJSON-1609025183 tempest-AttachVolumeTestJSON-1609025183-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 16:02:58.597757 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-474a9831-75fd-4090-b41a-7f2b3b205ce6 tempest-AttachVolumeTestJSON-1609025183 tempest-AttachVolumeTestJSON-1609025183-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 16:02:58.598194 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-474a9831-75fd-4090-b41a-7f2b3b205ce6 tempest-AttachVolumeTestJSON-1609025183 tempest-AttachVolumeTestJSON-1609025183-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 16:02:58.625825 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: INFO nova.api.openstack.requestlog [None req-474a9831-75fd-4090-b41a-7f2b3b205ce6 tempest-AttachVolumeTestJSON-1609025183 tempest-AttachVolumeTestJSON-1609025183-project] 10.222.0.61 "GET /compute/v2.1/servers/34a25afd-ca05-47fe-8bba-30442b7b5348/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.041600 May 14 16:02:58.626392 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: [pid: 128728|app: 0|req: 674/1327] 10.222.0.61 () {58 vars in 1301 bytes} [Sat May 14 16:02:58 2022] GET /compute/v2.1/servers/34a25afd-ca05-47fe-8bba-30442b7b5348/os-volume_attachments => generated 25 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 14 16:02:58.683496 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi [None req-a3123647-c564-4038-92b9-e76461e48b4d tempest-AttachVolumeTestJSON-1609025183 tempest-AttachVolumeTestJSON-1609025183-project] Calling method '>' {{(pid=128729) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 16:02:58.684042 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.compute.api [None req-a3123647-c564-4038-92b9-e76461e48b4d tempest-AttachVolumeTestJSON-1609025183 tempest-AttachVolumeTestJSON-1609025183-project] [instance: 34a25afd-ca05-47fe-8bba-30442b7b5348] Fetching instance by UUID {{(pid=128729) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 16:02:58.689765 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-a3123647-c564-4038-92b9-e76461e48b4d tempest-AttachVolumeTestJSON-1609025183 tempest-AttachVolumeTestJSON-1609025183-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 16:02:58.690209 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-a3123647-c564-4038-92b9-e76461e48b4d tempest-AttachVolumeTestJSON-1609025183 tempest-AttachVolumeTestJSON-1609025183-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 16:02:58.691009 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-a3123647-c564-4038-92b9-e76461e48b4d tempest-AttachVolumeTestJSON-1609025183 tempest-AttachVolumeTestJSON-1609025183-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 16:02:58.691441 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-a3123647-c564-4038-92b9-e76461e48b4d tempest-AttachVolumeTestJSON-1609025183 tempest-AttachVolumeTestJSON-1609025183-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 16:02:58.715380 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.compute.api [None req-a3123647-c564-4038-92b9-e76461e48b4d tempest-AttachVolumeTestJSON-1609025183 tempest-AttachVolumeTestJSON-1609025183-project] [instance: 34a25afd-ca05-47fe-8bba-30442b7b5348] Going to try to terminate instance {{(pid=128729) delete /opt/stack/nova/nova/compute/api.py:2664}} May 14 16:02:58.787662 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: INFO nova.api.openstack.requestlog [None req-a3123647-c564-4038-92b9-e76461e48b4d tempest-AttachVolumeTestJSON-1609025183 tempest-AttachVolumeTestJSON-1609025183-project] 10.222.0.61 "DELETE /compute/v2.1/servers/34a25afd-ca05-47fe-8bba-30442b7b5348" status: 204 len: 0 microversion: 2.1 time: 0.108494 May 14 16:02:58.788615 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: [pid: 128729|app: 0|req: 654/1328] 10.222.0.61 () {58 vars in 1238 bytes} [Sat May 14 16:02:58 2022] DELETE /compute/v2.1/servers/34a25afd-ca05-47fe-8bba-30442b7b5348 => generated 0 bytes in 110 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 14 16:02:58.796591 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi [None req-aeae6f2a-d541-448a-aaa4-23e4793fd521 tempest-AttachVolumeTestJSON-1609025183 tempest-AttachVolumeTestJSON-1609025183-project] Calling method '>' {{(pid=128728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 16:02:58.797221 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.compute.api [None req-aeae6f2a-d541-448a-aaa4-23e4793fd521 tempest-AttachVolumeTestJSON-1609025183 tempest-AttachVolumeTestJSON-1609025183-project] [instance: 34a25afd-ca05-47fe-8bba-30442b7b5348] Fetching instance by UUID {{(pid=128728) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 16:02:58.803446 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-aeae6f2a-d541-448a-aaa4-23e4793fd521 tempest-AttachVolumeTestJSON-1609025183 tempest-AttachVolumeTestJSON-1609025183-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 16:02:58.803905 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-aeae6f2a-d541-448a-aaa4-23e4793fd521 tempest-AttachVolumeTestJSON-1609025183 tempest-AttachVolumeTestJSON-1609025183-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 16:02:58.804682 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-aeae6f2a-d541-448a-aaa4-23e4793fd521 tempest-AttachVolumeTestJSON-1609025183 tempest-AttachVolumeTestJSON-1609025183-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 16:02:58.805121 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-aeae6f2a-d541-448a-aaa4-23e4793fd521 tempest-AttachVolumeTestJSON-1609025183 tempest-AttachVolumeTestJSON-1609025183-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 16:02:58.933426 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.policy [None req-aeae6f2a-d541-448a-aaa4-23e4793fd521 tempest-AttachVolumeTestJSON-1609025183 tempest-AttachVolumeTestJSON-1609025183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '742938d3a02a4c8babf518b7b6cf53a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '882808bd43644908a21ff8a58997c57f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128728) authorize /opt/stack/nova/nova/policy.py:199}} May 14 16:02:58.941163 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: INFO nova.api.openstack.requestlog [None req-aeae6f2a-d541-448a-aaa4-23e4793fd521 tempest-AttachVolumeTestJSON-1609025183 tempest-AttachVolumeTestJSON-1609025183-project] 10.222.0.61 "GET /compute/v2.1/servers/34a25afd-ca05-47fe-8bba-30442b7b5348" status: 200 len: 1674 microversion: 2.1 time: 0.148643 May 14 16:02:58.941729 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: [pid: 128728|app: 0|req: 675/1329] 10.222.0.61 () {58 vars in 1235 bytes} [Sat May 14 16:02:58 2022] GET /compute/v2.1/servers/34a25afd-ca05-47fe-8bba-30442b7b5348 => generated 1674 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 16:02:59.959003 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi [None req-98f6c10e-6e9c-40a7-8461-c42748bc641c tempest-AttachVolumeTestJSON-1609025183 tempest-AttachVolumeTestJSON-1609025183-project] Calling method '>' {{(pid=128729) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 16:02:59.959711 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.compute.api [None req-98f6c10e-6e9c-40a7-8461-c42748bc641c tempest-AttachVolumeTestJSON-1609025183 tempest-AttachVolumeTestJSON-1609025183-project] [instance: 34a25afd-ca05-47fe-8bba-30442b7b5348] Fetching instance by UUID {{(pid=128729) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 16:02:59.966062 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-98f6c10e-6e9c-40a7-8461-c42748bc641c tempest-AttachVolumeTestJSON-1609025183 tempest-AttachVolumeTestJSON-1609025183-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 16:02:59.966558 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-98f6c10e-6e9c-40a7-8461-c42748bc641c tempest-AttachVolumeTestJSON-1609025183 tempest-AttachVolumeTestJSON-1609025183-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 16:02:59.967340 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-98f6c10e-6e9c-40a7-8461-c42748bc641c tempest-AttachVolumeTestJSON-1609025183 tempest-AttachVolumeTestJSON-1609025183-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 16:02:59.967794 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-98f6c10e-6e9c-40a7-8461-c42748bc641c tempest-AttachVolumeTestJSON-1609025183 tempest-AttachVolumeTestJSON-1609025183-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 16:03:00.102842 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.policy [None req-98f6c10e-6e9c-40a7-8461-c42748bc641c tempest-AttachVolumeTestJSON-1609025183 tempest-AttachVolumeTestJSON-1609025183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '742938d3a02a4c8babf518b7b6cf53a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '882808bd43644908a21ff8a58997c57f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128729) authorize /opt/stack/nova/nova/policy.py:199}} May 14 16:03:00.110696 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: INFO nova.api.openstack.requestlog [None req-98f6c10e-6e9c-40a7-8461-c42748bc641c tempest-AttachVolumeTestJSON-1609025183 tempest-AttachVolumeTestJSON-1609025183-project] 10.222.0.61 "GET /compute/v2.1/servers/34a25afd-ca05-47fe-8bba-30442b7b5348" status: 200 len: 1674 microversion: 2.1 time: 0.155362 May 14 16:03:00.111278 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: [pid: 128729|app: 0|req: 655/1330] 10.222.0.61 () {58 vars in 1235 bytes} [Sat May 14 16:02:59 2022] GET /compute/v2.1/servers/34a25afd-ca05-47fe-8bba-30442b7b5348 => generated 1674 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 16:03:01.128651 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi [None req-c4a25768-0aef-4a48-b0d5-799aaa683cfd tempest-AttachVolumeTestJSON-1609025183 tempest-AttachVolumeTestJSON-1609025183-project] Calling method '>' {{(pid=128728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 16:03:01.129300 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.compute.api [None req-c4a25768-0aef-4a48-b0d5-799aaa683cfd tempest-AttachVolumeTestJSON-1609025183 tempest-AttachVolumeTestJSON-1609025183-project] [instance: 34a25afd-ca05-47fe-8bba-30442b7b5348] Fetching instance by UUID {{(pid=128728) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 16:03:01.135769 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-c4a25768-0aef-4a48-b0d5-799aaa683cfd tempest-AttachVolumeTestJSON-1609025183 tempest-AttachVolumeTestJSON-1609025183-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 16:03:01.136218 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-c4a25768-0aef-4a48-b0d5-799aaa683cfd tempest-AttachVolumeTestJSON-1609025183 tempest-AttachVolumeTestJSON-1609025183-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 16:03:01.136996 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-c4a25768-0aef-4a48-b0d5-799aaa683cfd tempest-AttachVolumeTestJSON-1609025183 tempest-AttachVolumeTestJSON-1609025183-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 16:03:01.137435 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-c4a25768-0aef-4a48-b0d5-799aaa683cfd tempest-AttachVolumeTestJSON-1609025183 tempest-AttachVolumeTestJSON-1609025183-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 16:03:01.269769 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.policy [None req-c4a25768-0aef-4a48-b0d5-799aaa683cfd tempest-AttachVolumeTestJSON-1609025183 tempest-AttachVolumeTestJSON-1609025183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '742938d3a02a4c8babf518b7b6cf53a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '882808bd43644908a21ff8a58997c57f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128728) authorize /opt/stack/nova/nova/policy.py:199}} May 14 16:03:01.277144 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: INFO nova.api.openstack.requestlog [None req-c4a25768-0aef-4a48-b0d5-799aaa683cfd tempest-AttachVolumeTestJSON-1609025183 tempest-AttachVolumeTestJSON-1609025183-project] 10.222.0.61 "GET /compute/v2.1/servers/34a25afd-ca05-47fe-8bba-30442b7b5348" status: 200 len: 1674 microversion: 2.1 time: 0.152848 May 14 16:03:01.277716 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: [pid: 128728|app: 0|req: 676/1331] 10.222.0.61 () {58 vars in 1235 bytes} [Sat May 14 16:03:01 2022] GET /compute/v2.1/servers/34a25afd-ca05-47fe-8bba-30442b7b5348 => generated 1674 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 16:03:01.784682 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi [req-4c5c1a7a-376e-4ff4-9152-d414c0e1b225 req-a4eee56c-cb32-48fd-96ac-0dd83dbfbccf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "34a25afd-ca05-47fe-8bba-30442b7b5348", "name": "network-vif-deleted", "tag": "1df3d18b-4cc0-425e-9b62-d5b2705661f4"}]} {{(pid=128729) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 16:03:01.794740 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [req-4c5c1a7a-376e-4ff4-9152-d414c0e1b225 req-a4eee56c-cb32-48fd-96ac-0dd83dbfbccf service nova] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 16:03:01.795192 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [req-4c5c1a7a-376e-4ff4-9152-d414c0e1b225 req-a4eee56c-cb32-48fd-96ac-0dd83dbfbccf service nova] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 16:03:01.809177 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: INFO nova.api.openstack.compute.server_external_events [req-4c5c1a7a-376e-4ff4-9152-d414c0e1b225 req-a4eee56c-cb32-48fd-96ac-0dd83dbfbccf service nova] Creating event network-vif-deleted:1df3d18b-4cc0-425e-9b62-d5b2705661f4 for instance 34a25afd-ca05-47fe-8bba-30442b7b5348 on hv-cinder-83979 May 14 16:03:01.815828 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: INFO nova.api.openstack.requestlog [req-4c5c1a7a-376e-4ff4-9152-d414c0e1b225 req-a4eee56c-cb32-48fd-96ac-0dd83dbfbccf service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.110498 May 14 16:03:01.817026 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: [pid: 128729|app: 0|req: 656/1332] 10.222.0.61 () {64 vars in 1317 bytes} [Sat May 14 16:03:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 14 16:03:02.294341 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi [None req-36dbec02-6acf-460b-b97e-01ce462b33da tempest-AttachVolumeTestJSON-1609025183 tempest-AttachVolumeTestJSON-1609025183-project] Calling method '>' {{(pid=128728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 16:03:02.294907 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.compute.api [None req-36dbec02-6acf-460b-b97e-01ce462b33da tempest-AttachVolumeTestJSON-1609025183 tempest-AttachVolumeTestJSON-1609025183-project] [instance: 34a25afd-ca05-47fe-8bba-30442b7b5348] Fetching instance by UUID {{(pid=128728) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 16:03:02.301953 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-36dbec02-6acf-460b-b97e-01ce462b33da tempest-AttachVolumeTestJSON-1609025183 tempest-AttachVolumeTestJSON-1609025183-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 16:03:02.302535 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-36dbec02-6acf-460b-b97e-01ce462b33da tempest-AttachVolumeTestJSON-1609025183 tempest-AttachVolumeTestJSON-1609025183-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 16:03:02.303320 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-36dbec02-6acf-460b-b97e-01ce462b33da tempest-AttachVolumeTestJSON-1609025183 tempest-AttachVolumeTestJSON-1609025183-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 16:03:02.303762 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-36dbec02-6acf-460b-b97e-01ce462b33da tempest-AttachVolumeTestJSON-1609025183 tempest-AttachVolumeTestJSON-1609025183-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 16:03:02.319351 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: INFO nova.api.openstack.wsgi [None req-36dbec02-6acf-460b-b97e-01ce462b33da tempest-AttachVolumeTestJSON-1609025183 tempest-AttachVolumeTestJSON-1609025183-project] HTTP exception thrown: Instance 34a25afd-ca05-47fe-8bba-30442b7b5348 could not be found. May 14 16:03:02.321022 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi [None req-36dbec02-6acf-460b-b97e-01ce462b33da tempest-AttachVolumeTestJSON-1609025183 tempest-AttachVolumeTestJSON-1609025183-project] Request method failure captured: May 14 16:03:02.321022 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: request: GET /compute/v2.1/servers/34a25afd-ca05-47fe-8bba-30442b7b5348 HTTP/1.1 May 14 16:03:02.321022 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: Accept: application/json May 14 16:03:02.321022 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: Accept-Encoding: identity May 14 16:03:02.321022 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: Connection: close May 14 16:03:02.321022 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: Content-Length: 0 May 14 16:03:02.321022 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: Content-Type: application/json May 14 16:03:02.321022 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: Host: 10.222.0.61 May 14 16:03:02.321022 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: Openstack-System-Scope: None May 14 16:03:02.321022 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: User-Agent: python-urllib3/1.26.9 May 14 16:03:02.321022 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: X-Auth-Token: gAAAAABif9Gr79lItj3mwTw-NdY3QT97srgkpsWpCseJJi9csZRpQOMQDp2kaxkWy888C_FDHsFiHETHxjz1y8G2SkJ75Li0I1knXUbNBk40A-O__SigSWW6C655IkbIyYax2Uzqjv_g5hPRwMaE9qqPd4XTwCSygMi72uyZ2EHg1pUAE3jSQns May 14 16:03:02.321022 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: X-Domain-Id: None May 14 16:03:02.321022 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: X-Domain-Name: None May 14 16:03:02.321022 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: X-Identity-Status: Confirmed May 14 16:03:02.321022 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: X-Is-Admin-Project: True May 14 16:03:02.321022 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: X-Project-Domain-Id: default May 14 16:03:02.321022 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: X-Project-Domain-Name: Default May 14 16:03:02.321022 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: X-Project-Id: 882808bd43644908a21ff8a58997c57f May 14 16:03:02.321022 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: X-Project-Name: tempest-AttachVolumeTestJSON-1609025183 May 14 16:03:02.321022 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: X-Role: reader,member May 14 16:03:02.321022 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: X-Roles: reader,member May 14 16:03:02.322521 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/882808bd43644908a21ff8a58997c57f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/882808bd43644908a21ff8a58997c57f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/882808bd43644908a21ff8a58997c57f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_882808bd43644908a21ff8a58997c57f"}]}] May 14 16:03:02.322521 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: X-Tenant: tempest-AttachVolumeTestJSON-1609025183 May 14 16:03:02.322521 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: X-Tenant-Id: 882808bd43644908a21ff8a58997c57f May 14 16:03:02.322521 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1609025183 May 14 16:03:02.322521 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: X-User: tempest-AttachVolumeTestJSON-1609025183-project May 14 16:03:02.322521 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: X-User-Domain-Id: default May 14 16:03:02.322521 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: X-User-Domain-Name: Default May 14 16:03:02.322521 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: X-User-Id: 742938d3a02a4c8babf518b7b6cf53a7 May 14 16:03:02.322521 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: X-User-Name: tempest-AttachVolumeTestJSON-1609025183-project May 14 16:03:02.322521 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: method: > May 14 16:03:02.322521 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: exception: Instance 34a25afd-ca05-47fe-8bba-30442b7b5348 could not be found. May 14 16:03:02.322521 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: action_args: {'id': '34a25afd-ca05-47fe-8bba-30442b7b5348'} May 14 16:03:02.323795 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: {{(pid=128728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 14 16:03:02.323795 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 16:03:02.323795 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 14 16:03:02.323795 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 14 16:03:02.323795 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 14 16:03:02.323795 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 14 16:03:02.323795 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 14 16:03:02.323795 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 14 16:03:02.323795 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 14 16:03:02.323795 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 14 16:03:02.323795 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 34a25afd-ca05-47fe-8bba-30442b7b5348 could not be found. May 14 16:03:02.323795 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: ERROR nova.api.openstack.wsgi May 14 16:03:02.323795 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 14 16:03:02.323795 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: ERROR nova.api.openstack.wsgi May 14 16:03:02.323795 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 16:03:02.323795 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 14 16:03:02.323795 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 14 16:03:02.323795 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 14 16:03:02.323795 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 14 16:03:02.323795 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 14 16:03:02.325510 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 14 16:03:02.325510 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 14 16:03:02.325510 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 14 16:03:02.325510 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 14 16:03:02.325510 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 14 16:03:02.325510 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 14 16:03:02.325510 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 14 16:03:02.325510 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 34a25afd-ca05-47fe-8bba-30442b7b5348 could not be found. May 14 16:03:02.325510 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: ERROR nova.api.openstack.wsgi May 14 16:03:02.325510 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 14 16:03:02.325510 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: ERROR nova.api.openstack.wsgi May 14 16:03:02.325510 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 16:03:02.325510 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 14 16:03:02.325510 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 14 16:03:02.325510 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 14 16:03:02.325510 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 14 16:03:02.325510 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 34a25afd-ca05-47fe-8bba-30442b7b5348 could not be found. May 14 16:03:02.325510 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: ERROR nova.api.openstack.wsgi May 14 16:03:02.327278 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi [None req-36dbec02-6acf-460b-b97e-01ce462b33da tempest-AttachVolumeTestJSON-1609025183 tempest-AttachVolumeTestJSON-1609025183-project] Returning 404 to user: Instance 34a25afd-ca05-47fe-8bba-30442b7b5348 could not be found. {{(pid=128728) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 14 16:03:02.327278 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: INFO nova.api.openstack.requestlog [None req-36dbec02-6acf-460b-b97e-01ce462b33da tempest-AttachVolumeTestJSON-1609025183 tempest-AttachVolumeTestJSON-1609025183-project] 10.222.0.61 "GET /compute/v2.1/servers/34a25afd-ca05-47fe-8bba-30442b7b5348" status: 404 len: 111 microversion: 2.1 time: 0.032094 May 14 16:03:02.327278 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: [pid: 128728|app: 0|req: 677/1333] 10.222.0.61 () {58 vars in 1235 bytes} [Sat May 14 16:03:02 2022] GET /compute/v2.1/servers/34a25afd-ca05-47fe-8bba-30442b7b5348 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 14 16:03:02.332217 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi [None req-fe54deca-fcec-4133-bb8f-acb82eccb55c tempest-AttachVolumeTestJSON-1609025183 tempest-AttachVolumeTestJSON-1609025183-project] Calling method '.version_select at 0x7f77d80e7430>' {{(pid=128729) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 16:03:02.353221 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: INFO nova.api.openstack.requestlog [None req-fe54deca-fcec-4133-bb8f-acb82eccb55c tempest-AttachVolumeTestJSON-1609025183 tempest-AttachVolumeTestJSON-1609025183-project] 10.222.0.61 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-185804968" status: 202 len: 0 microversion: 2.1 time: 0.025453 May 14 16:03:02.353908 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: [pid: 128729|app: 0|req: 657/1334] 10.222.0.61 () {58 vars in 1217 bytes} [Sat May 14 16:03:02 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-185804968 => generated 0 bytes in 27 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 14 16:03:02.984527 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi [None req-f58add0d-068a-4a9e-9615-9c311ed3c0aa tempest-AttachVolumeTestJSON-1609025183 tempest-AttachVolumeTestJSON-1609025183-project] Action: 'create', calling method: .version_select at 0x7f77d80daa60>, body: {"keypair": {"name": "tempest-keypair-744978699", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPnqcmF17TM68tKpo2iuiQaCWBSooAik09BQHWyQQ60gh5skNUIl1rANRsksVy/Kabkg+fvzSGMbAu2Arzc8EiA+7OSZFSbK6o2v2f1cW+VVt9x2qZ5DnL2AQKCZtJauBA=="}} {{(pid=128728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 16:03:02.998660 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.quota [None req-f58add0d-068a-4a9e-9615-9c311ed3c0aa tempest-AttachVolumeTestJSON-1609025183 tempest-AttachVolumeTestJSON-1609025183-project] Getting quotas for project 882808bd43644908a21ff8a58997c57f. Resources: {'key_pairs'} {{(pid=128728) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 14 16:03:03.002576 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.quota [None req-f58add0d-068a-4a9e-9615-9c311ed3c0aa tempest-AttachVolumeTestJSON-1609025183 tempest-AttachVolumeTestJSON-1609025183-project] Getting quotas for user 742938d3a02a4c8babf518b7b6cf53a7 and project 882808bd43644908a21ff8a58997c57f. Resources: {'key_pairs'} {{(pid=128728) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 14 16:03:03.013886 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: ERROR oslo.messaging._drivers.impl_rabbit [None req-f58add0d-068a-4a9e-9615-9c311ed3c0aa tempest-AttachVolumeTestJSON-1609025183 tempest-AttachVolumeTestJSON-1609025183-project] [e74aacd9-80dd-405c-af8b-0617f22ed469] AMQP server on 10.222.0.61:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer May 14 16:03:04.022393 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: INFO oslo.messaging._drivers.impl_rabbit [None req-f58add0d-068a-4a9e-9615-9c311ed3c0aa tempest-AttachVolumeTestJSON-1609025183 tempest-AttachVolumeTestJSON-1609025183-project] [e74aacd9-80dd-405c-af8b-0617f22ed469] Reconnected to AMQP server on 10.222.0.61:5672 via [amqp] client with port 54928. May 14 16:03:04.039151 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: INFO nova.api.openstack.requestlog [None req-f58add0d-068a-4a9e-9615-9c311ed3c0aa tempest-AttachVolumeTestJSON-1609025183 tempest-AttachVolumeTestJSON-1609025183-project] 10.222.0.61 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 1.058405 May 14 16:03:04.039756 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: [pid: 128728|app: 0|req: 678/1335] 10.222.0.61 () {60 vars in 1158 bytes} [Sat May 14 16:03:02 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 1060 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 14 16:03:05.311114 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi [None req-aa49170f-ddd5-4763-b595-1472c697ac0d tempest-AttachVolumeTestJSON-1609025183 tempest-AttachVolumeTestJSON-1609025183-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-4817570", "imageRef": "1381e3d5-fc27-4fa7-ab03-5d86278a0546", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "43d22ca1-3a83-4fdf-9675-b59a4f503c47"}], "security_groups": [{"name": "tempest-securitygroup--1109259340"}], "key_name": "tempest-keypair-744978699", "user_data": "}} {{(pid=128729) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 16:03:05.412976 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.network.neutron [None req-aa49170f-ddd5-4763-b595-1472c697ac0d tempest-AttachVolumeTestJSON-1609025183 tempest-AttachVolumeTestJSON-1609025183-project] validate_networks() for [('43d22ca1-3a83-4fdf-9675-b59a4f503c47', None, None, None, None, None)] {{(pid=128729) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 14 16:03:06.027642 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.virt.hardware [None req-aa49170f-ddd5-4763-b595-1472c697ac0d tempest-AttachVolumeTestJSON-1609025183 tempest-AttachVolumeTestJSON-1609025183-project] Flavor limits 0:0:0 {{(pid=128729) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 14 16:03:06.028074 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.virt.hardware [None req-aa49170f-ddd5-4763-b595-1472c697ac0d tempest-AttachVolumeTestJSON-1609025183 tempest-AttachVolumeTestJSON-1609025183-project] Image limits 0:0:0 {{(pid=128729) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 14 16:03:06.028718 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.virt.hardware [None req-aa49170f-ddd5-4763-b595-1472c697ac0d tempest-AttachVolumeTestJSON-1609025183 tempest-AttachVolumeTestJSON-1609025183-project] Flavor pref 0:0:0 {{(pid=128729) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 14 16:03:06.028944 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.virt.hardware [None req-aa49170f-ddd5-4763-b595-1472c697ac0d tempest-AttachVolumeTestJSON-1609025183 tempest-AttachVolumeTestJSON-1609025183-project] Image pref 0:0:0 {{(pid=128729) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 14 16:03:06.029358 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.virt.hardware [None req-aa49170f-ddd5-4763-b595-1472c697ac0d tempest-AttachVolumeTestJSON-1609025183 tempest-AttachVolumeTestJSON-1609025183-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128729) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 14 16:03:06.038697 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-aa49170f-ddd5-4763-b595-1472c697ac0d tempest-AttachVolumeTestJSON-1609025183 tempest-AttachVolumeTestJSON-1609025183-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 16:03:06.039154 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-aa49170f-ddd5-4763-b595-1472c697ac0d tempest-AttachVolumeTestJSON-1609025183 tempest-AttachVolumeTestJSON-1609025183-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 16:03:06.039964 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-aa49170f-ddd5-4763-b595-1472c697ac0d tempest-AttachVolumeTestJSON-1609025183 tempest-AttachVolumeTestJSON-1609025183-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 16:03:06.040408 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-aa49170f-ddd5-4763-b595-1472c697ac0d tempest-AttachVolumeTestJSON-1609025183 tempest-AttachVolumeTestJSON-1609025183-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 16:03:06.056443 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.quota [None req-aa49170f-ddd5-4763-b595-1472c697ac0d tempest-AttachVolumeTestJSON-1609025183 tempest-AttachVolumeTestJSON-1609025183-project] Getting quotas for project 882808bd43644908a21ff8a58997c57f. Resources: {'instances', 'cores', 'ram'} {{(pid=128729) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 14 16:03:06.060351 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.quota [None req-aa49170f-ddd5-4763-b595-1472c697ac0d tempest-AttachVolumeTestJSON-1609025183 tempest-AttachVolumeTestJSON-1609025183-project] Getting quotas for user 742938d3a02a4c8babf518b7b6cf53a7 and project 882808bd43644908a21ff8a58997c57f. Resources: {'instances', 'cores', 'ram'} {{(pid=128729) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 14 16:03:06.070959 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.compute.api [None req-aa49170f-ddd5-4763-b595-1472c697ac0d tempest-AttachVolumeTestJSON-1609025183 tempest-AttachVolumeTestJSON-1609025183-project] Going to run 1 instances... {{(pid=128729) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 14 16:03:06.073293 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.compute.api [None req-aa49170f-ddd5-4763-b595-1472c697ac0d tempest-AttachVolumeTestJSON-1609025183 tempest-AttachVolumeTestJSON-1609025183-project] [instance: 748407bd-67ec-47e8-9a38-3c31cc18118c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='1381e3d5-fc27-4fa7-ab03-5d86278a0546',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128729) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 14 16:03:06.118517 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: INFO nova.api.openstack.requestlog [None req-aa49170f-ddd5-4763-b595-1472c697ac0d tempest-AttachVolumeTestJSON-1609025183 tempest-AttachVolumeTestJSON-1609025183-project] 10.222.0.61 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.812120 May 14 16:03:06.119164 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: [pid: 128729|app: 0|req: 658/1336] 10.222.0.61 () {60 vars in 1146 bytes} [Sat May 14 16:03:05 2022] POST /compute/v2.1/servers => generated 402 bytes in 813 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 14 16:03:06.129805 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi [None req-5ca3afc9-7a32-4f47-89b7-b67712a865ed tempest-AttachVolumeTestJSON-1609025183 tempest-AttachVolumeTestJSON-1609025183-project] Calling method '>' {{(pid=128728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 16:03:06.130437 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.compute.api [None req-5ca3afc9-7a32-4f47-89b7-b67712a865ed tempest-AttachVolumeTestJSON-1609025183 tempest-AttachVolumeTestJSON-1609025183-project] [instance: 748407bd-67ec-47e8-9a38-3c31cc18118c] Fetching instance by UUID {{(pid=128728) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 16:03:06.184049 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.policy [None req-5ca3afc9-7a32-4f47-89b7-b67712a865ed tempest-AttachVolumeTestJSON-1609025183 tempest-AttachVolumeTestJSON-1609025183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '742938d3a02a4c8babf518b7b6cf53a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '882808bd43644908a21ff8a58997c57f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128728) authorize /opt/stack/nova/nova/policy.py:199}} May 14 16:03:06.190863 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: INFO nova.api.openstack.requestlog [None req-5ca3afc9-7a32-4f47-89b7-b67712a865ed tempest-AttachVolumeTestJSON-1609025183 tempest-AttachVolumeTestJSON-1609025183-project] 10.222.0.61 "GET /compute/v2.1/servers/748407bd-67ec-47e8-9a38-3c31cc18118c" status: 200 len: 1234 microversion: 2.1 time: 0.065395 May 14 16:03:06.191345 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: [pid: 128728|app: 0|req: 679/1337] 10.222.0.61 () {58 vars in 1235 bytes} [Sat May 14 16:03:06 2022] GET /compute/v2.1/servers/748407bd-67ec-47e8-9a38-3c31cc18118c => generated 1234 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 16:03:07.209148 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi [None req-0e7c90c4-bc2d-44a1-86d8-939c52c41237 tempest-AttachVolumeTestJSON-1609025183 tempest-AttachVolumeTestJSON-1609025183-project] Calling method '>' {{(pid=128729) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 16:03:07.209599 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.compute.api [None req-0e7c90c4-bc2d-44a1-86d8-939c52c41237 tempest-AttachVolumeTestJSON-1609025183 tempest-AttachVolumeTestJSON-1609025183-project] [instance: 748407bd-67ec-47e8-9a38-3c31cc18118c] Fetching instance by UUID {{(pid=128729) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 16:03:07.217105 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-0e7c90c4-bc2d-44a1-86d8-939c52c41237 tempest-AttachVolumeTestJSON-1609025183 tempest-AttachVolumeTestJSON-1609025183-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 16:03:07.217738 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-0e7c90c4-bc2d-44a1-86d8-939c52c41237 tempest-AttachVolumeTestJSON-1609025183 tempest-AttachVolumeTestJSON-1609025183-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 16:03:07.218877 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-0e7c90c4-bc2d-44a1-86d8-939c52c41237 tempest-AttachVolumeTestJSON-1609025183 tempest-AttachVolumeTestJSON-1609025183-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 16:03:07.219511 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-0e7c90c4-bc2d-44a1-86d8-939c52c41237 tempest-AttachVolumeTestJSON-1609025183 tempest-AttachVolumeTestJSON-1609025183-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 16:03:07.286849 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.policy [None req-0e7c90c4-bc2d-44a1-86d8-939c52c41237 tempest-AttachVolumeTestJSON-1609025183 tempest-AttachVolumeTestJSON-1609025183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '742938d3a02a4c8babf518b7b6cf53a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '882808bd43644908a21ff8a58997c57f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128729) authorize /opt/stack/nova/nova/policy.py:199}} May 14 16:03:07.294701 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: INFO nova.api.openstack.requestlog [None req-0e7c90c4-bc2d-44a1-86d8-939c52c41237 tempest-AttachVolumeTestJSON-1609025183 tempest-AttachVolumeTestJSON-1609025183-project] 10.222.0.61 "GET /compute/v2.1/servers/748407bd-67ec-47e8-9a38-3c31cc18118c" status: 200 len: 1304 microversion: 2.1 time: 0.090134 May 14 16:03:07.295399 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: [pid: 128729|app: 0|req: 659/1338] 10.222.0.61 () {58 vars in 1235 bytes} [Sat May 14 16:03:07 2022] GET /compute/v2.1/servers/748407bd-67ec-47e8-9a38-3c31cc18118c => generated 1304 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 16:03:08.312057 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi [None req-5892c490-ee9e-442b-a810-67b0affa92f6 tempest-AttachVolumeTestJSON-1609025183 tempest-AttachVolumeTestJSON-1609025183-project] Calling method '>' {{(pid=128728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 16:03:08.312609 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.compute.api [None req-5892c490-ee9e-442b-a810-67b0affa92f6 tempest-AttachVolumeTestJSON-1609025183 tempest-AttachVolumeTestJSON-1609025183-project] [instance: 748407bd-67ec-47e8-9a38-3c31cc18118c] Fetching instance by UUID {{(pid=128728) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 16:03:08.319159 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-5892c490-ee9e-442b-a810-67b0affa92f6 tempest-AttachVolumeTestJSON-1609025183 tempest-AttachVolumeTestJSON-1609025183-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 16:03:08.319610 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-5892c490-ee9e-442b-a810-67b0affa92f6 tempest-AttachVolumeTestJSON-1609025183 tempest-AttachVolumeTestJSON-1609025183-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 16:03:08.320380 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-5892c490-ee9e-442b-a810-67b0affa92f6 tempest-AttachVolumeTestJSON-1609025183 tempest-AttachVolumeTestJSON-1609025183-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 16:03:08.320814 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-5892c490-ee9e-442b-a810-67b0affa92f6 tempest-AttachVolumeTestJSON-1609025183 tempest-AttachVolumeTestJSON-1609025183-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 16:03:08.451626 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.policy [None req-5892c490-ee9e-442b-a810-67b0affa92f6 tempest-AttachVolumeTestJSON-1609025183 tempest-AttachVolumeTestJSON-1609025183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '742938d3a02a4c8babf518b7b6cf53a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '882808bd43644908a21ff8a58997c57f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128728) authorize /opt/stack/nova/nova/policy.py:199}} May 14 16:03:08.459732 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: INFO nova.api.openstack.requestlog [None req-5892c490-ee9e-442b-a810-67b0affa92f6 tempest-AttachVolumeTestJSON-1609025183 tempest-AttachVolumeTestJSON-1609025183-project] 10.222.0.61 "GET /compute/v2.1/servers/748407bd-67ec-47e8-9a38-3c31cc18118c" status: 200 len: 1360 microversion: 2.1 time: 0.151592 May 14 16:03:08.460849 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: [pid: 128728|app: 0|req: 680/1339] 10.222.0.61 () {58 vars in 1235 bytes} [Sat May 14 16:03:08 2022] GET /compute/v2.1/servers/748407bd-67ec-47e8-9a38-3c31cc18118c => generated 1360 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 16:03:08.802069 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi [req-f79c0d10-d903-4861-83c8-3223636cdd5d req-e8124719-2e7f-464f-83ea-ed02f0bbeb6b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "748407bd-67ec-47e8-9a38-3c31cc18118c", "tag": "fd37895f-d764-4c1d-ae98-012764ee826a"}]} {{(pid=128729) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 16:03:08.815079 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [req-f79c0d10-d903-4861-83c8-3223636cdd5d req-e8124719-2e7f-464f-83ea-ed02f0bbeb6b service nova] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 16:03:08.816603 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [req-f79c0d10-d903-4861-83c8-3223636cdd5d req-e8124719-2e7f-464f-83ea-ed02f0bbeb6b service nova] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 16:03:08.840205 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: INFO nova.api.openstack.compute.server_external_events [req-f79c0d10-d903-4861-83c8-3223636cdd5d req-e8124719-2e7f-464f-83ea-ed02f0bbeb6b service nova] Creating event network-changed:fd37895f-d764-4c1d-ae98-012764ee826a for instance 748407bd-67ec-47e8-9a38-3c31cc18118c on hv-cinder-83979 May 14 16:03:08.845403 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: INFO nova.api.openstack.requestlog [req-f79c0d10-d903-4861-83c8-3223636cdd5d req-e8124719-2e7f-464f-83ea-ed02f0bbeb6b service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047059 May 14 16:03:08.847411 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: [pid: 128729|app: 0|req: 660/1340] 10.222.0.61 () {64 vars in 1317 bytes} [Sat May 14 16:03:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 14 16:03:09.476879 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi [None req-2efc68df-5876-4543-82ef-0f84fdabfd3a tempest-AttachVolumeTestJSON-1609025183 tempest-AttachVolumeTestJSON-1609025183-project] Calling method '>' {{(pid=128728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 16:03:09.477417 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.compute.api [None req-2efc68df-5876-4543-82ef-0f84fdabfd3a tempest-AttachVolumeTestJSON-1609025183 tempest-AttachVolumeTestJSON-1609025183-project] [instance: 748407bd-67ec-47e8-9a38-3c31cc18118c] Fetching instance by UUID {{(pid=128728) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 16:03:09.483651 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-2efc68df-5876-4543-82ef-0f84fdabfd3a tempest-AttachVolumeTestJSON-1609025183 tempest-AttachVolumeTestJSON-1609025183-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 16:03:09.484096 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-2efc68df-5876-4543-82ef-0f84fdabfd3a tempest-AttachVolumeTestJSON-1609025183 tempest-AttachVolumeTestJSON-1609025183-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 16:03:09.484959 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-2efc68df-5876-4543-82ef-0f84fdabfd3a tempest-AttachVolumeTestJSON-1609025183 tempest-AttachVolumeTestJSON-1609025183-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 16:03:09.485396 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-2efc68df-5876-4543-82ef-0f84fdabfd3a tempest-AttachVolumeTestJSON-1609025183 tempest-AttachVolumeTestJSON-1609025183-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 16:03:09.608433 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.policy [None req-2efc68df-5876-4543-82ef-0f84fdabfd3a tempest-AttachVolumeTestJSON-1609025183 tempest-AttachVolumeTestJSON-1609025183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '742938d3a02a4c8babf518b7b6cf53a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '882808bd43644908a21ff8a58997c57f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128728) authorize /opt/stack/nova/nova/policy.py:199}} May 14 16:03:09.615956 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: INFO nova.api.openstack.requestlog [None req-2efc68df-5876-4543-82ef-0f84fdabfd3a tempest-AttachVolumeTestJSON-1609025183 tempest-AttachVolumeTestJSON-1609025183-project] 10.222.0.61 "GET /compute/v2.1/servers/748407bd-67ec-47e8-9a38-3c31cc18118c" status: 200 len: 1360 microversion: 2.1 time: 0.143055 May 14 16:03:09.616516 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: [pid: 128728|app: 0|req: 681/1341] 10.222.0.61 () {58 vars in 1235 bytes} [Sat May 14 16:03:09 2022] GET /compute/v2.1/servers/748407bd-67ec-47e8-9a38-3c31cc18118c => generated 1360 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 16:03:10.634435 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi [None req-da8df5cf-a1bc-4d53-84a7-66adda8a28d7 tempest-AttachVolumeTestJSON-1609025183 tempest-AttachVolumeTestJSON-1609025183-project] Calling method '>' {{(pid=128729) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 16:03:10.635128 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.compute.api [None req-da8df5cf-a1bc-4d53-84a7-66adda8a28d7 tempest-AttachVolumeTestJSON-1609025183 tempest-AttachVolumeTestJSON-1609025183-project] [instance: 748407bd-67ec-47e8-9a38-3c31cc18118c] Fetching instance by UUID {{(pid=128729) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 16:03:10.641691 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-da8df5cf-a1bc-4d53-84a7-66adda8a28d7 tempest-AttachVolumeTestJSON-1609025183 tempest-AttachVolumeTestJSON-1609025183-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 16:03:10.642135 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-da8df5cf-a1bc-4d53-84a7-66adda8a28d7 tempest-AttachVolumeTestJSON-1609025183 tempest-AttachVolumeTestJSON-1609025183-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 16:03:10.642925 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-da8df5cf-a1bc-4d53-84a7-66adda8a28d7 tempest-AttachVolumeTestJSON-1609025183 tempest-AttachVolumeTestJSON-1609025183-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 16:03:10.643357 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-da8df5cf-a1bc-4d53-84a7-66adda8a28d7 tempest-AttachVolumeTestJSON-1609025183 tempest-AttachVolumeTestJSON-1609025183-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 16:03:10.771664 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.policy [None req-da8df5cf-a1bc-4d53-84a7-66adda8a28d7 tempest-AttachVolumeTestJSON-1609025183 tempest-AttachVolumeTestJSON-1609025183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '742938d3a02a4c8babf518b7b6cf53a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '882808bd43644908a21ff8a58997c57f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128729) authorize /opt/stack/nova/nova/policy.py:199}} May 14 16:03:10.778920 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: INFO nova.api.openstack.requestlog [None req-da8df5cf-a1bc-4d53-84a7-66adda8a28d7 tempest-AttachVolumeTestJSON-1609025183 tempest-AttachVolumeTestJSON-1609025183-project] 10.222.0.61 "GET /compute/v2.1/servers/748407bd-67ec-47e8-9a38-3c31cc18118c" status: 200 len: 1360 microversion: 2.1 time: 0.149109 May 14 16:03:10.779493 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: [pid: 128729|app: 0|req: 661/1342] 10.222.0.61 () {58 vars in 1235 bytes} [Sat May 14 16:03:10 2022] GET /compute/v2.1/servers/748407bd-67ec-47e8-9a38-3c31cc18118c => generated 1360 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 16:03:11.797402 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi [None req-13867025-30da-467d-a090-3670d4cf5b39 tempest-AttachVolumeTestJSON-1609025183 tempest-AttachVolumeTestJSON-1609025183-project] Calling method '>' {{(pid=128728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 16:03:11.797950 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.compute.api [None req-13867025-30da-467d-a090-3670d4cf5b39 tempest-AttachVolumeTestJSON-1609025183 tempest-AttachVolumeTestJSON-1609025183-project] [instance: 748407bd-67ec-47e8-9a38-3c31cc18118c] Fetching instance by UUID {{(pid=128728) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 16:03:11.804019 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-13867025-30da-467d-a090-3670d4cf5b39 tempest-AttachVolumeTestJSON-1609025183 tempest-AttachVolumeTestJSON-1609025183-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 16:03:11.804475 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-13867025-30da-467d-a090-3670d4cf5b39 tempest-AttachVolumeTestJSON-1609025183 tempest-AttachVolumeTestJSON-1609025183-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 16:03:11.805247 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-13867025-30da-467d-a090-3670d4cf5b39 tempest-AttachVolumeTestJSON-1609025183 tempest-AttachVolumeTestJSON-1609025183-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 16:03:11.805685 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-13867025-30da-467d-a090-3670d4cf5b39 tempest-AttachVolumeTestJSON-1609025183 tempest-AttachVolumeTestJSON-1609025183-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 16:03:11.931033 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.policy [None req-13867025-30da-467d-a090-3670d4cf5b39 tempest-AttachVolumeTestJSON-1609025183 tempest-AttachVolumeTestJSON-1609025183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '742938d3a02a4c8babf518b7b6cf53a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '882808bd43644908a21ff8a58997c57f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128728) authorize /opt/stack/nova/nova/policy.py:199}} May 14 16:03:11.938787 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: INFO nova.api.openstack.requestlog [None req-13867025-30da-467d-a090-3670d4cf5b39 tempest-AttachVolumeTestJSON-1609025183 tempest-AttachVolumeTestJSON-1609025183-project] 10.222.0.61 "GET /compute/v2.1/servers/748407bd-67ec-47e8-9a38-3c31cc18118c" status: 200 len: 1360 microversion: 2.1 time: 0.144726 May 14 16:03:11.939347 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: [pid: 128728|app: 0|req: 682/1343] 10.222.0.61 () {58 vars in 1235 bytes} [Sat May 14 16:03:11 2022] GET /compute/v2.1/servers/748407bd-67ec-47e8-9a38-3c31cc18118c => generated 1360 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 16:03:12.956107 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi [None req-2a514c30-9c92-4efb-80c4-152105693bc4 tempest-AttachVolumeTestJSON-1609025183 tempest-AttachVolumeTestJSON-1609025183-project] Calling method '>' {{(pid=128729) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 16:03:12.956727 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.compute.api [None req-2a514c30-9c92-4efb-80c4-152105693bc4 tempest-AttachVolumeTestJSON-1609025183 tempest-AttachVolumeTestJSON-1609025183-project] [instance: 748407bd-67ec-47e8-9a38-3c31cc18118c] Fetching instance by UUID {{(pid=128729) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 16:03:12.963057 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-2a514c30-9c92-4efb-80c4-152105693bc4 tempest-AttachVolumeTestJSON-1609025183 tempest-AttachVolumeTestJSON-1609025183-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 16:03:12.963517 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-2a514c30-9c92-4efb-80c4-152105693bc4 tempest-AttachVolumeTestJSON-1609025183 tempest-AttachVolumeTestJSON-1609025183-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 16:03:12.964298 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-2a514c30-9c92-4efb-80c4-152105693bc4 tempest-AttachVolumeTestJSON-1609025183 tempest-AttachVolumeTestJSON-1609025183-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 16:03:12.964741 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-2a514c30-9c92-4efb-80c4-152105693bc4 tempest-AttachVolumeTestJSON-1609025183 tempest-AttachVolumeTestJSON-1609025183-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 16:03:13.092889 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.policy [None req-2a514c30-9c92-4efb-80c4-152105693bc4 tempest-AttachVolumeTestJSON-1609025183 tempest-AttachVolumeTestJSON-1609025183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '742938d3a02a4c8babf518b7b6cf53a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '882808bd43644908a21ff8a58997c57f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128729) authorize /opt/stack/nova/nova/policy.py:199}} May 14 16:03:13.100623 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: INFO nova.api.openstack.requestlog [None req-2a514c30-9c92-4efb-80c4-152105693bc4 tempest-AttachVolumeTestJSON-1609025183 tempest-AttachVolumeTestJSON-1609025183-project] 10.222.0.61 "GET /compute/v2.1/servers/748407bd-67ec-47e8-9a38-3c31cc18118c" status: 200 len: 1360 microversion: 2.1 time: 0.149042 May 14 16:03:13.101178 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: [pid: 128729|app: 0|req: 662/1344] 10.222.0.61 () {58 vars in 1235 bytes} [Sat May 14 16:03:12 2022] GET /compute/v2.1/servers/748407bd-67ec-47e8-9a38-3c31cc18118c => generated 1360 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 16:03:14.117987 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi [None req-9a952017-a1dc-4067-9921-72f152dfb9f7 tempest-AttachVolumeTestJSON-1609025183 tempest-AttachVolumeTestJSON-1609025183-project] Calling method '>' {{(pid=128728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 16:03:14.118618 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.compute.api [None req-9a952017-a1dc-4067-9921-72f152dfb9f7 tempest-AttachVolumeTestJSON-1609025183 tempest-AttachVolumeTestJSON-1609025183-project] [instance: 748407bd-67ec-47e8-9a38-3c31cc18118c] Fetching instance by UUID {{(pid=128728) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 16:03:14.125021 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-9a952017-a1dc-4067-9921-72f152dfb9f7 tempest-AttachVolumeTestJSON-1609025183 tempest-AttachVolumeTestJSON-1609025183-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 16:03:14.125470 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-9a952017-a1dc-4067-9921-72f152dfb9f7 tempest-AttachVolumeTestJSON-1609025183 tempest-AttachVolumeTestJSON-1609025183-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 16:03:14.126234 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-9a952017-a1dc-4067-9921-72f152dfb9f7 tempest-AttachVolumeTestJSON-1609025183 tempest-AttachVolumeTestJSON-1609025183-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 16:03:14.126686 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-9a952017-a1dc-4067-9921-72f152dfb9f7 tempest-AttachVolumeTestJSON-1609025183 tempest-AttachVolumeTestJSON-1609025183-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 16:03:14.252925 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.policy [None req-9a952017-a1dc-4067-9921-72f152dfb9f7 tempest-AttachVolumeTestJSON-1609025183 tempest-AttachVolumeTestJSON-1609025183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '742938d3a02a4c8babf518b7b6cf53a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '882808bd43644908a21ff8a58997c57f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128728) authorize /opt/stack/nova/nova/policy.py:199}} May 14 16:03:14.260101 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: INFO nova.api.openstack.requestlog [None req-9a952017-a1dc-4067-9921-72f152dfb9f7 tempest-AttachVolumeTestJSON-1609025183 tempest-AttachVolumeTestJSON-1609025183-project] 10.222.0.61 "GET /compute/v2.1/servers/748407bd-67ec-47e8-9a38-3c31cc18118c" status: 200 len: 1360 microversion: 2.1 time: 0.145994 May 14 16:03:14.260658 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: [pid: 128728|app: 0|req: 683/1345] 10.222.0.61 () {58 vars in 1235 bytes} [Sat May 14 16:03:14 2022] GET /compute/v2.1/servers/748407bd-67ec-47e8-9a38-3c31cc18118c => generated 1360 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 16:03:15.277089 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi [None req-bb64ee55-870b-4b17-a6a9-59a8bd45e202 tempest-AttachVolumeTestJSON-1609025183 tempest-AttachVolumeTestJSON-1609025183-project] Calling method '>' {{(pid=128729) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 16:03:15.277704 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.compute.api [None req-bb64ee55-870b-4b17-a6a9-59a8bd45e202 tempest-AttachVolumeTestJSON-1609025183 tempest-AttachVolumeTestJSON-1609025183-project] [instance: 748407bd-67ec-47e8-9a38-3c31cc18118c] Fetching instance by UUID {{(pid=128729) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 16:03:15.284811 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-bb64ee55-870b-4b17-a6a9-59a8bd45e202 tempest-AttachVolumeTestJSON-1609025183 tempest-AttachVolumeTestJSON-1609025183-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 16:03:15.285261 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-bb64ee55-870b-4b17-a6a9-59a8bd45e202 tempest-AttachVolumeTestJSON-1609025183 tempest-AttachVolumeTestJSON-1609025183-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 16:03:15.286025 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-bb64ee55-870b-4b17-a6a9-59a8bd45e202 tempest-AttachVolumeTestJSON-1609025183 tempest-AttachVolumeTestJSON-1609025183-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 16:03:15.286511 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-bb64ee55-870b-4b17-a6a9-59a8bd45e202 tempest-AttachVolumeTestJSON-1609025183 tempest-AttachVolumeTestJSON-1609025183-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 16:03:15.418245 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.policy [None req-bb64ee55-870b-4b17-a6a9-59a8bd45e202 tempest-AttachVolumeTestJSON-1609025183 tempest-AttachVolumeTestJSON-1609025183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '742938d3a02a4c8babf518b7b6cf53a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '882808bd43644908a21ff8a58997c57f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128729) authorize /opt/stack/nova/nova/policy.py:199}} May 14 16:03:15.427693 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: INFO nova.api.openstack.requestlog [None req-bb64ee55-870b-4b17-a6a9-59a8bd45e202 tempest-AttachVolumeTestJSON-1609025183 tempest-AttachVolumeTestJSON-1609025183-project] 10.222.0.61 "GET /compute/v2.1/servers/748407bd-67ec-47e8-9a38-3c31cc18118c" status: 200 len: 1360 microversion: 2.1 time: 0.154337 May 14 16:03:15.428377 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: [pid: 128729|app: 0|req: 663/1346] 10.222.0.61 () {58 vars in 1235 bytes} [Sat May 14 16:03:15 2022] GET /compute/v2.1/servers/748407bd-67ec-47e8-9a38-3c31cc18118c => generated 1360 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 16:03:15.605758 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi [req-3eab2383-4600-40c9-b357-61847ffd0d8c req-8b6078cb-604f-4477-bd56-6245d799fc76 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "748407bd-67ec-47e8-9a38-3c31cc18118c", "name": "network-vif-plugged", "status": "completed", "tag": "fd37895f-d764-4c1d-ae98-012764ee826a"}]} {{(pid=128728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 16:03:15.614558 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [req-3eab2383-4600-40c9-b357-61847ffd0d8c req-8b6078cb-604f-4477-bd56-6245d799fc76 service nova] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 16:03:15.615011 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [req-3eab2383-4600-40c9-b357-61847ffd0d8c req-8b6078cb-604f-4477-bd56-6245d799fc76 service nova] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 16:03:15.625875 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: INFO nova.api.openstack.compute.server_external_events [req-3eab2383-4600-40c9-b357-61847ffd0d8c req-8b6078cb-604f-4477-bd56-6245d799fc76 service nova] Creating event network-vif-plugged:fd37895f-d764-4c1d-ae98-012764ee826a for instance 748407bd-67ec-47e8-9a38-3c31cc18118c on hv-cinder-83979 May 14 16:03:15.630922 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: INFO nova.api.openstack.requestlog [req-3eab2383-4600-40c9-b357-61847ffd0d8c req-8b6078cb-604f-4477-bd56-6245d799fc76 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.089511 May 14 16:03:15.631567 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: [pid: 128728|app: 0|req: 684/1347] 10.222.0.61 () {64 vars in 1317 bytes} [Sat May 14 16:03:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 14 16:03:16.444950 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi [None req-ea0d9047-472b-431b-b03b-41673e2df98d tempest-AttachVolumeTestJSON-1609025183 tempest-AttachVolumeTestJSON-1609025183-project] Calling method '>' {{(pid=128729) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 16:03:16.445540 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.compute.api [None req-ea0d9047-472b-431b-b03b-41673e2df98d tempest-AttachVolumeTestJSON-1609025183 tempest-AttachVolumeTestJSON-1609025183-project] [instance: 748407bd-67ec-47e8-9a38-3c31cc18118c] Fetching instance by UUID {{(pid=128729) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 16:03:16.451794 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-ea0d9047-472b-431b-b03b-41673e2df98d tempest-AttachVolumeTestJSON-1609025183 tempest-AttachVolumeTestJSON-1609025183-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 16:03:16.452239 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-ea0d9047-472b-431b-b03b-41673e2df98d tempest-AttachVolumeTestJSON-1609025183 tempest-AttachVolumeTestJSON-1609025183-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 16:03:16.452997 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-ea0d9047-472b-431b-b03b-41673e2df98d tempest-AttachVolumeTestJSON-1609025183 tempest-AttachVolumeTestJSON-1609025183-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 16:03:16.453641 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-ea0d9047-472b-431b-b03b-41673e2df98d tempest-AttachVolumeTestJSON-1609025183 tempest-AttachVolumeTestJSON-1609025183-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 16:03:16.580586 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.policy [None req-ea0d9047-472b-431b-b03b-41673e2df98d tempest-AttachVolumeTestJSON-1609025183 tempest-AttachVolumeTestJSON-1609025183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '742938d3a02a4c8babf518b7b6cf53a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '882808bd43644908a21ff8a58997c57f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128729) authorize /opt/stack/nova/nova/policy.py:199}} May 14 16:03:16.587670 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: INFO nova.api.openstack.requestlog [None req-ea0d9047-472b-431b-b03b-41673e2df98d tempest-AttachVolumeTestJSON-1609025183 tempest-AttachVolumeTestJSON-1609025183-project] 10.222.0.61 "GET /compute/v2.1/servers/748407bd-67ec-47e8-9a38-3c31cc18118c" status: 200 len: 1360 microversion: 2.1 time: 0.146574 May 14 16:03:16.588235 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: [pid: 128729|app: 0|req: 664/1348] 10.222.0.61 () {58 vars in 1235 bytes} [Sat May 14 16:03:16 2022] GET /compute/v2.1/servers/748407bd-67ec-47e8-9a38-3c31cc18118c => generated 1360 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 16:03:17.605617 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi [None req-f7124b05-2d14-4920-b1ac-09fcb38b6e7f tempest-AttachVolumeTestJSON-1609025183 tempest-AttachVolumeTestJSON-1609025183-project] Calling method '>' {{(pid=128728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 16:03:17.606344 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.compute.api [None req-f7124b05-2d14-4920-b1ac-09fcb38b6e7f tempest-AttachVolumeTestJSON-1609025183 tempest-AttachVolumeTestJSON-1609025183-project] [instance: 748407bd-67ec-47e8-9a38-3c31cc18118c] Fetching instance by UUID {{(pid=128728) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 16:03:17.612507 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-f7124b05-2d14-4920-b1ac-09fcb38b6e7f tempest-AttachVolumeTestJSON-1609025183 tempest-AttachVolumeTestJSON-1609025183-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 16:03:17.612953 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-f7124b05-2d14-4920-b1ac-09fcb38b6e7f tempest-AttachVolumeTestJSON-1609025183 tempest-AttachVolumeTestJSON-1609025183-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 16:03:17.613723 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-f7124b05-2d14-4920-b1ac-09fcb38b6e7f tempest-AttachVolumeTestJSON-1609025183 tempest-AttachVolumeTestJSON-1609025183-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 16:03:17.614160 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-f7124b05-2d14-4920-b1ac-09fcb38b6e7f tempest-AttachVolumeTestJSON-1609025183 tempest-AttachVolumeTestJSON-1609025183-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 16:03:17.742441 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.policy [None req-f7124b05-2d14-4920-b1ac-09fcb38b6e7f tempest-AttachVolumeTestJSON-1609025183 tempest-AttachVolumeTestJSON-1609025183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '742938d3a02a4c8babf518b7b6cf53a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '882808bd43644908a21ff8a58997c57f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128728) authorize /opt/stack/nova/nova/policy.py:199}} May 14 16:03:17.749920 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: INFO nova.api.openstack.requestlog [None req-f7124b05-2d14-4920-b1ac-09fcb38b6e7f tempest-AttachVolumeTestJSON-1609025183 tempest-AttachVolumeTestJSON-1609025183-project] 10.222.0.61 "GET /compute/v2.1/servers/748407bd-67ec-47e8-9a38-3c31cc18118c" status: 200 len: 1545 microversion: 2.1 time: 0.149060 May 14 16:03:17.751157 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: [pid: 128728|app: 0|req: 685/1349] 10.222.0.61 () {58 vars in 1235 bytes} [Sat May 14 16:03:17 2022] GET /compute/v2.1/servers/748407bd-67ec-47e8-9a38-3c31cc18118c => generated 1545 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 16:03:17.767325 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi [None req-a62e2993-0b12-4d98-86af-12d9f7c827e4 tempest-AttachVolumeTestJSON-1609025183 tempest-AttachVolumeTestJSON-1609025183-project] Calling method '>' {{(pid=128729) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 16:03:17.767845 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.compute.api [None req-a62e2993-0b12-4d98-86af-12d9f7c827e4 tempest-AttachVolumeTestJSON-1609025183 tempest-AttachVolumeTestJSON-1609025183-project] [instance: 748407bd-67ec-47e8-9a38-3c31cc18118c] Fetching instance by UUID {{(pid=128729) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 16:03:17.774155 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-a62e2993-0b12-4d98-86af-12d9f7c827e4 tempest-AttachVolumeTestJSON-1609025183 tempest-AttachVolumeTestJSON-1609025183-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 16:03:17.774657 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-a62e2993-0b12-4d98-86af-12d9f7c827e4 tempest-AttachVolumeTestJSON-1609025183 tempest-AttachVolumeTestJSON-1609025183-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 16:03:17.775435 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-a62e2993-0b12-4d98-86af-12d9f7c827e4 tempest-AttachVolumeTestJSON-1609025183 tempest-AttachVolumeTestJSON-1609025183-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 16:03:17.775880 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-a62e2993-0b12-4d98-86af-12d9f7c827e4 tempest-AttachVolumeTestJSON-1609025183 tempest-AttachVolumeTestJSON-1609025183-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 16:03:17.850892 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: INFO nova.api.openstack.requestlog [None req-a62e2993-0b12-4d98-86af-12d9f7c827e4 tempest-AttachVolumeTestJSON-1609025183 tempest-AttachVolumeTestJSON-1609025183-project] 10.222.0.61 "GET /compute/v2.1/servers/748407bd-67ec-47e8-9a38-3c31cc18118c/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.088150 May 14 16:03:17.851515 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: [pid: 128729|app: 0|req: 665/1350] 10.222.0.61 () {58 vars in 1274 bytes} [Sat May 14 16:03:17 2022] GET /compute/v2.1/servers/748407bd-67ec-47e8-9a38-3c31cc18118c/os-interface => generated 284 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 14 16:03:18.863043 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi [req-66224027-7535-4abb-9d25-843ff5adbc2c req-ffe81754-f41d-46d9-bc42-200326e206d3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "748407bd-67ec-47e8-9a38-3c31cc18118c", "tag": "fd37895f-d764-4c1d-ae98-012764ee826a"}]} {{(pid=128728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 16:03:18.870790 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [req-66224027-7535-4abb-9d25-843ff5adbc2c req-ffe81754-f41d-46d9-bc42-200326e206d3 service nova] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 16:03:18.871232 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [req-66224027-7535-4abb-9d25-843ff5adbc2c req-ffe81754-f41d-46d9-bc42-200326e206d3 service nova] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 16:03:18.882724 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: INFO nova.api.openstack.compute.server_external_events [req-66224027-7535-4abb-9d25-843ff5adbc2c req-ffe81754-f41d-46d9-bc42-200326e206d3 service nova] Creating event network-changed:fd37895f-d764-4c1d-ae98-012764ee826a for instance 748407bd-67ec-47e8-9a38-3c31cc18118c on hv-cinder-83979 May 14 16:03:18.887801 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: INFO nova.api.openstack.requestlog [req-66224027-7535-4abb-9d25-843ff5adbc2c req-ffe81754-f41d-46d9-bc42-200326e206d3 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.087055 May 14 16:03:18.888629 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: [pid: 128728|app: 0|req: 686/1351] 10.222.0.61 () {64 vars in 1317 bytes} [Sat May 14 16:03:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 14 16:03:27.891802 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 14 16:03:27.892445 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: Sat May 14 16:03:27 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 14 16:04:34.306040 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi [None req-53b75030-f355-449f-8b14-5d7d7dd62d60 tempest-AttachVolumeTestJSON-1609025183 tempest-AttachVolumeTestJSON-1609025183-project] Calling method '>' {{(pid=128729) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 16:04:34.306580 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.compute.api [None req-53b75030-f355-449f-8b14-5d7d7dd62d60 tempest-AttachVolumeTestJSON-1609025183 tempest-AttachVolumeTestJSON-1609025183-project] [instance: 748407bd-67ec-47e8-9a38-3c31cc18118c] Fetching instance by UUID {{(pid=128729) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 16:04:34.319257 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-53b75030-f355-449f-8b14-5d7d7dd62d60 tempest-AttachVolumeTestJSON-1609025183 tempest-AttachVolumeTestJSON-1609025183-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 16:04:34.319714 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-53b75030-f355-449f-8b14-5d7d7dd62d60 tempest-AttachVolumeTestJSON-1609025183 tempest-AttachVolumeTestJSON-1609025183-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 16:04:34.320491 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-53b75030-f355-449f-8b14-5d7d7dd62d60 tempest-AttachVolumeTestJSON-1609025183 tempest-AttachVolumeTestJSON-1609025183-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 16:04:34.320932 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-53b75030-f355-449f-8b14-5d7d7dd62d60 tempest-AttachVolumeTestJSON-1609025183 tempest-AttachVolumeTestJSON-1609025183-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 16:04:34.349443 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: INFO nova.api.openstack.requestlog [None req-53b75030-f355-449f-8b14-5d7d7dd62d60 tempest-AttachVolumeTestJSON-1609025183 tempest-AttachVolumeTestJSON-1609025183-project] 10.222.0.61 "GET /compute/v2.1/servers/748407bd-67ec-47e8-9a38-3c31cc18118c/ips" status: 200 len: 144 microversion: 2.1 time: 0.100512 May 14 16:04:34.350002 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: [pid: 128729|app: 0|req: 666/1352] 10.222.0.61 () {58 vars in 1247 bytes} [Sat May 14 16:04:34 2022] GET /compute/v2.1/servers/748407bd-67ec-47e8-9a38-3c31cc18118c/ips => generated 144 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 14 16:04:35.655996 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi [None req-c978e8ae-3c6b-4210-a188-11b979a93608 tempest-AttachVolumeTestJSON-1609025183 tempest-AttachVolumeTestJSON-1609025183-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "a4a503b5-d036-4552-a023-bc18bf00e067"}} {{(pid=128728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 16:04:35.657206 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.compute.api [None req-c978e8ae-3c6b-4210-a188-11b979a93608 tempest-AttachVolumeTestJSON-1609025183 tempest-AttachVolumeTestJSON-1609025183-project] [instance: 748407bd-67ec-47e8-9a38-3c31cc18118c] Fetching instance by UUID {{(pid=128728) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 16:04:35.664013 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-c978e8ae-3c6b-4210-a188-11b979a93608 tempest-AttachVolumeTestJSON-1609025183 tempest-AttachVolumeTestJSON-1609025183-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 16:04:35.664458 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-c978e8ae-3c6b-4210-a188-11b979a93608 tempest-AttachVolumeTestJSON-1609025183 tempest-AttachVolumeTestJSON-1609025183-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 16:04:35.665224 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-c978e8ae-3c6b-4210-a188-11b979a93608 tempest-AttachVolumeTestJSON-1609025183 tempest-AttachVolumeTestJSON-1609025183-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 16:04:35.665654 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-c978e8ae-3c6b-4210-a188-11b979a93608 tempest-AttachVolumeTestJSON-1609025183 tempest-AttachVolumeTestJSON-1609025183-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 16:04:35.918567 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: INFO nova.api.openstack.requestlog [None req-c978e8ae-3c6b-4210-a188-11b979a93608 tempest-AttachVolumeTestJSON-1609025183 tempest-AttachVolumeTestJSON-1609025183-project] 10.222.0.61 "POST /compute/v2.1/servers/748407bd-67ec-47e8-9a38-3c31cc18118c/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.267466 May 14 16:04:35.919129 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: [pid: 128728|app: 0|req: 687/1353] 10.222.0.61 () {60 vars in 1322 bytes} [Sat May 14 16:04:35 2022] POST /compute/v2.1/servers/748407bd-67ec-47e8-9a38-3c31cc18118c/os-volume_attachments => generated 194 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 14 16:04:43.396640 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi [None req-a57f2358-cdea-48e5-a0ea-93e1c9d1f6b5 tempest-AttachVolumeTestJSON-1609025183 tempest-AttachVolumeTestJSON-1609025183-project] Calling method '>' {{(pid=128729) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 16:04:43.397645 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.compute.api [None req-a57f2358-cdea-48e5-a0ea-93e1c9d1f6b5 tempest-AttachVolumeTestJSON-1609025183 tempest-AttachVolumeTestJSON-1609025183-project] [instance: 748407bd-67ec-47e8-9a38-3c31cc18118c] Fetching instance by UUID {{(pid=128729) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 16:04:43.403949 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-a57f2358-cdea-48e5-a0ea-93e1c9d1f6b5 tempest-AttachVolumeTestJSON-1609025183 tempest-AttachVolumeTestJSON-1609025183-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 16:04:43.404427 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-a57f2358-cdea-48e5-a0ea-93e1c9d1f6b5 tempest-AttachVolumeTestJSON-1609025183 tempest-AttachVolumeTestJSON-1609025183-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 16:04:43.405191 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-a57f2358-cdea-48e5-a0ea-93e1c9d1f6b5 tempest-AttachVolumeTestJSON-1609025183 tempest-AttachVolumeTestJSON-1609025183-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 16:04:43.405622 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-a57f2358-cdea-48e5-a0ea-93e1c9d1f6b5 tempest-AttachVolumeTestJSON-1609025183 tempest-AttachVolumeTestJSON-1609025183-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 16:04:43.434641 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: INFO nova.api.openstack.requestlog [None req-a57f2358-cdea-48e5-a0ea-93e1c9d1f6b5 tempest-AttachVolumeTestJSON-1609025183 tempest-AttachVolumeTestJSON-1609025183-project] 10.222.0.61 "GET /compute/v2.1/servers/748407bd-67ec-47e8-9a38-3c31cc18118c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042506 May 14 16:04:43.435190 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: [pid: 128729|app: 0|req: 667/1354] 10.222.0.61 () {58 vars in 1301 bytes} [Sat May 14 16:04:43 2022] GET /compute/v2.1/servers/748407bd-67ec-47e8-9a38-3c31cc18118c/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 14 16:04:43.445935 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi [None req-561f8164-eb53-4c78-94df-65bf48f69e62 tempest-AttachVolumeTestJSON-1609025183 tempest-AttachVolumeTestJSON-1609025183-project] Calling method '>' {{(pid=128728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 16:04:43.446551 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.compute.api [None req-561f8164-eb53-4c78-94df-65bf48f69e62 tempest-AttachVolumeTestJSON-1609025183 tempest-AttachVolumeTestJSON-1609025183-project] [instance: 748407bd-67ec-47e8-9a38-3c31cc18118c] Fetching instance by UUID {{(pid=128728) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 16:04:43.452549 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-561f8164-eb53-4c78-94df-65bf48f69e62 tempest-AttachVolumeTestJSON-1609025183 tempest-AttachVolumeTestJSON-1609025183-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 16:04:43.452998 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-561f8164-eb53-4c78-94df-65bf48f69e62 tempest-AttachVolumeTestJSON-1609025183 tempest-AttachVolumeTestJSON-1609025183-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 16:04:43.453762 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-561f8164-eb53-4c78-94df-65bf48f69e62 tempest-AttachVolumeTestJSON-1609025183 tempest-AttachVolumeTestJSON-1609025183-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 16:04:43.454197 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-561f8164-eb53-4c78-94df-65bf48f69e62 tempest-AttachVolumeTestJSON-1609025183 tempest-AttachVolumeTestJSON-1609025183-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 16:04:43.482066 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: INFO nova.api.openstack.requestlog [None req-561f8164-eb53-4c78-94df-65bf48f69e62 tempest-AttachVolumeTestJSON-1609025183 tempest-AttachVolumeTestJSON-1609025183-project] 10.222.0.61 "GET /compute/v2.1/servers/748407bd-67ec-47e8-9a38-3c31cc18118c/os-volume_attachments/a4a503b5-d036-4552-a023-bc18bf00e067" status: 200 len: 194 microversion: 2.1 time: 0.040953 May 14 16:04:43.482663 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: [pid: 128728|app: 0|req: 688/1355] 10.222.0.61 () {58 vars in 1412 bytes} [Sat May 14 16:04:43 2022] GET /compute/v2.1/servers/748407bd-67ec-47e8-9a38-3c31cc18118c/os-volume_attachments/a4a503b5-d036-4552-a023-bc18bf00e067 => generated 194 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 14 16:04:44.780819 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi [None req-d84b3290-ec89-457d-9682-c8b4cde23993 tempest-AttachVolumeTestJSON-1609025183 tempest-AttachVolumeTestJSON-1609025183-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "6c3c1fe3-efbe-4247-9ef2-1988f70ebd1d"}} {{(pid=128729) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 16:04:44.781945 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.compute.api [None req-d84b3290-ec89-457d-9682-c8b4cde23993 tempest-AttachVolumeTestJSON-1609025183 tempest-AttachVolumeTestJSON-1609025183-project] [instance: 748407bd-67ec-47e8-9a38-3c31cc18118c] Fetching instance by UUID {{(pid=128729) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 16:04:44.789136 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-d84b3290-ec89-457d-9682-c8b4cde23993 tempest-AttachVolumeTestJSON-1609025183 tempest-AttachVolumeTestJSON-1609025183-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 16:04:44.789584 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-d84b3290-ec89-457d-9682-c8b4cde23993 tempest-AttachVolumeTestJSON-1609025183 tempest-AttachVolumeTestJSON-1609025183-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 16:04:44.790379 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-d84b3290-ec89-457d-9682-c8b4cde23993 tempest-AttachVolumeTestJSON-1609025183 tempest-AttachVolumeTestJSON-1609025183-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 16:04:44.790824 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-d84b3290-ec89-457d-9682-c8b4cde23993 tempest-AttachVolumeTestJSON-1609025183 tempest-AttachVolumeTestJSON-1609025183-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 16:04:45.026705 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: INFO nova.api.openstack.requestlog [None req-d84b3290-ec89-457d-9682-c8b4cde23993 tempest-AttachVolumeTestJSON-1609025183 tempest-AttachVolumeTestJSON-1609025183-project] 10.222.0.61 "POST /compute/v2.1/servers/748407bd-67ec-47e8-9a38-3c31cc18118c/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.249455 May 14 16:04:45.027315 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: [pid: 128729|app: 0|req: 668/1356] 10.222.0.61 () {60 vars in 1322 bytes} [Sat May 14 16:04:44 2022] POST /compute/v2.1/servers/748407bd-67ec-47e8-9a38-3c31cc18118c/os-volume_attachments => generated 194 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 14 16:04:52.503868 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi [None req-c949b30e-6802-49b0-a0c4-c692ac06fcf3 tempest-AttachVolumeTestJSON-1609025183 tempest-AttachVolumeTestJSON-1609025183-project] Calling method '>' {{(pid=128728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 16:04:52.504845 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.compute.api [None req-c949b30e-6802-49b0-a0c4-c692ac06fcf3 tempest-AttachVolumeTestJSON-1609025183 tempest-AttachVolumeTestJSON-1609025183-project] [instance: 748407bd-67ec-47e8-9a38-3c31cc18118c] Fetching instance by UUID {{(pid=128728) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 16:04:52.511011 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-c949b30e-6802-49b0-a0c4-c692ac06fcf3 tempest-AttachVolumeTestJSON-1609025183 tempest-AttachVolumeTestJSON-1609025183-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 16:04:52.511460 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-c949b30e-6802-49b0-a0c4-c692ac06fcf3 tempest-AttachVolumeTestJSON-1609025183 tempest-AttachVolumeTestJSON-1609025183-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 16:04:52.512217 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-c949b30e-6802-49b0-a0c4-c692ac06fcf3 tempest-AttachVolumeTestJSON-1609025183 tempest-AttachVolumeTestJSON-1609025183-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 16:04:52.512651 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-c949b30e-6802-49b0-a0c4-c692ac06fcf3 tempest-AttachVolumeTestJSON-1609025183 tempest-AttachVolumeTestJSON-1609025183-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 16:04:52.542676 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: INFO nova.api.openstack.requestlog [None req-c949b30e-6802-49b0-a0c4-c692ac06fcf3 tempest-AttachVolumeTestJSON-1609025183 tempest-AttachVolumeTestJSON-1609025183-project] 10.222.0.61 "GET /compute/v2.1/servers/748407bd-67ec-47e8-9a38-3c31cc18118c/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.042641 May 14 16:04:52.543226 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: [pid: 128728|app: 0|req: 689/1357] 10.222.0.61 () {58 vars in 1301 bytes} [Sat May 14 16:04:52 2022] GET /compute/v2.1/servers/748407bd-67ec-47e8-9a38-3c31cc18118c/os-volume_attachments => generated 371 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 14 16:04:52.680419 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi [None req-15e1ab5c-804c-484d-8456-ef7a9dd62346 tempest-AttachVolumeTestJSON-1609025183 tempest-AttachVolumeTestJSON-1609025183-project] Calling method '>' {{(pid=128729) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 16:04:52.680924 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.compute.api [None req-15e1ab5c-804c-484d-8456-ef7a9dd62346 tempest-AttachVolumeTestJSON-1609025183 tempest-AttachVolumeTestJSON-1609025183-project] [instance: 748407bd-67ec-47e8-9a38-3c31cc18118c] Fetching instance by UUID {{(pid=128729) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 16:04:52.687579 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-15e1ab5c-804c-484d-8456-ef7a9dd62346 tempest-AttachVolumeTestJSON-1609025183 tempest-AttachVolumeTestJSON-1609025183-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 16:04:52.688029 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-15e1ab5c-804c-484d-8456-ef7a9dd62346 tempest-AttachVolumeTestJSON-1609025183 tempest-AttachVolumeTestJSON-1609025183-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 16:04:52.688800 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-15e1ab5c-804c-484d-8456-ef7a9dd62346 tempest-AttachVolumeTestJSON-1609025183 tempest-AttachVolumeTestJSON-1609025183-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 16:04:52.689242 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-15e1ab5c-804c-484d-8456-ef7a9dd62346 tempest-AttachVolumeTestJSON-1609025183 tempest-AttachVolumeTestJSON-1609025183-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 16:04:52.717877 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: INFO nova.api.openstack.requestlog [None req-15e1ab5c-804c-484d-8456-ef7a9dd62346 tempest-AttachVolumeTestJSON-1609025183 tempest-AttachVolumeTestJSON-1609025183-project] 10.222.0.61 "GET /compute/v2.1/servers/748407bd-67ec-47e8-9a38-3c31cc18118c/os-volume_attachments/a4a503b5-d036-4552-a023-bc18bf00e067" status: 200 len: 194 microversion: 2.1 time: 0.041835 May 14 16:04:52.718469 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: [pid: 128729|app: 0|req: 669/1358] 10.222.0.61 () {58 vars in 1412 bytes} [Sat May 14 16:04:52 2022] GET /compute/v2.1/servers/748407bd-67ec-47e8-9a38-3c31cc18118c/os-volume_attachments/a4a503b5-d036-4552-a023-bc18bf00e067 => generated 194 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 14 16:04:52.728081 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi [None req-06b72171-e47f-42bc-82e2-79b7c54be089 tempest-AttachVolumeTestJSON-1609025183 tempest-AttachVolumeTestJSON-1609025183-project] Calling method '>' {{(pid=128728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 16:04:52.728580 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.compute.api [None req-06b72171-e47f-42bc-82e2-79b7c54be089 tempest-AttachVolumeTestJSON-1609025183 tempest-AttachVolumeTestJSON-1609025183-project] [instance: 748407bd-67ec-47e8-9a38-3c31cc18118c] Fetching instance by UUID {{(pid=128728) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 16:04:52.734386 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-06b72171-e47f-42bc-82e2-79b7c54be089 tempest-AttachVolumeTestJSON-1609025183 tempest-AttachVolumeTestJSON-1609025183-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 16:04:52.734876 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-06b72171-e47f-42bc-82e2-79b7c54be089 tempest-AttachVolumeTestJSON-1609025183 tempest-AttachVolumeTestJSON-1609025183-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 16:04:52.737416 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-06b72171-e47f-42bc-82e2-79b7c54be089 tempest-AttachVolumeTestJSON-1609025183 tempest-AttachVolumeTestJSON-1609025183-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 16:04:52.741281 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-06b72171-e47f-42bc-82e2-79b7c54be089 tempest-AttachVolumeTestJSON-1609025183 tempest-AttachVolumeTestJSON-1609025183-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 16:04:52.819386 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.objects.instance [None req-06b72171-e47f-42bc-82e2-79b7c54be089 tempest-AttachVolumeTestJSON-1609025183 tempest-AttachVolumeTestJSON-1609025183-project] Lazy-loading 'services' on Instance uuid 748407bd-67ec-47e8-9a38-3c31cc18118c {{(pid=128728) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 14 16:04:52.888313 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: INFO nova.api.openstack.requestlog [None req-06b72171-e47f-42bc-82e2-79b7c54be089 tempest-AttachVolumeTestJSON-1609025183 tempest-AttachVolumeTestJSON-1609025183-project] 10.222.0.61 "DELETE /compute/v2.1/servers/748407bd-67ec-47e8-9a38-3c31cc18118c/os-volume_attachments/a4a503b5-d036-4552-a023-bc18bf00e067" status: 202 len: 0 microversion: 2.1 time: 0.164130 May 14 16:04:52.888899 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: [pid: 128728|app: 0|req: 690/1359] 10.222.0.61 () {58 vars in 1415 bytes} [Sat May 14 16:04:52 2022] DELETE /compute/v2.1/servers/748407bd-67ec-47e8-9a38-3c31cc18118c/os-volume_attachments/a4a503b5-d036-4552-a023-bc18bf00e067 => generated 0 bytes in 166 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 14 16:04:54.000194 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi [None req-6d866ac1-6827-4259-8be0-dc03331cb6b7 tempest-AttachVolumeTestJSON-1609025183 tempest-AttachVolumeTestJSON-1609025183-project] Calling method '>' {{(pid=128729) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 16:04:54.000725 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.compute.api [None req-6d866ac1-6827-4259-8be0-dc03331cb6b7 tempest-AttachVolumeTestJSON-1609025183 tempest-AttachVolumeTestJSON-1609025183-project] [instance: 748407bd-67ec-47e8-9a38-3c31cc18118c] Fetching instance by UUID {{(pid=128729) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 16:04:54.007494 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-6d866ac1-6827-4259-8be0-dc03331cb6b7 tempest-AttachVolumeTestJSON-1609025183 tempest-AttachVolumeTestJSON-1609025183-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 16:04:54.007946 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-6d866ac1-6827-4259-8be0-dc03331cb6b7 tempest-AttachVolumeTestJSON-1609025183 tempest-AttachVolumeTestJSON-1609025183-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 16:04:54.008711 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-6d866ac1-6827-4259-8be0-dc03331cb6b7 tempest-AttachVolumeTestJSON-1609025183 tempest-AttachVolumeTestJSON-1609025183-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 16:04:54.009156 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-6d866ac1-6827-4259-8be0-dc03331cb6b7 tempest-AttachVolumeTestJSON-1609025183 tempest-AttachVolumeTestJSON-1609025183-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 16:04:54.036406 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: INFO nova.api.openstack.requestlog [None req-6d866ac1-6827-4259-8be0-dc03331cb6b7 tempest-AttachVolumeTestJSON-1609025183 tempest-AttachVolumeTestJSON-1609025183-project] 10.222.0.61 "GET /compute/v2.1/servers/748407bd-67ec-47e8-9a38-3c31cc18118c/os-volume_attachments/6c3c1fe3-efbe-4247-9ef2-1988f70ebd1d" status: 200 len: 194 microversion: 2.1 time: 0.040395 May 14 16:04:54.036982 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: [pid: 128729|app: 0|req: 670/1360] 10.222.0.61 () {58 vars in 1412 bytes} [Sat May 14 16:04:53 2022] GET /compute/v2.1/servers/748407bd-67ec-47e8-9a38-3c31cc18118c/os-volume_attachments/6c3c1fe3-efbe-4247-9ef2-1988f70ebd1d => generated 194 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 14 16:04:54.047156 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi [None req-b2ca36bd-4665-4052-922c-92fea2fa199e tempest-AttachVolumeTestJSON-1609025183 tempest-AttachVolumeTestJSON-1609025183-project] Calling method '>' {{(pid=128728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 16:04:54.047751 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.compute.api [None req-b2ca36bd-4665-4052-922c-92fea2fa199e tempest-AttachVolumeTestJSON-1609025183 tempest-AttachVolumeTestJSON-1609025183-project] [instance: 748407bd-67ec-47e8-9a38-3c31cc18118c] Fetching instance by UUID {{(pid=128728) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 16:04:54.054944 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-b2ca36bd-4665-4052-922c-92fea2fa199e tempest-AttachVolumeTestJSON-1609025183 tempest-AttachVolumeTestJSON-1609025183-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 16:04:54.055406 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-b2ca36bd-4665-4052-922c-92fea2fa199e tempest-AttachVolumeTestJSON-1609025183 tempest-AttachVolumeTestJSON-1609025183-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 16:04:54.056195 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-b2ca36bd-4665-4052-922c-92fea2fa199e tempest-AttachVolumeTestJSON-1609025183 tempest-AttachVolumeTestJSON-1609025183-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 16:04:54.056641 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-b2ca36bd-4665-4052-922c-92fea2fa199e tempest-AttachVolumeTestJSON-1609025183 tempest-AttachVolumeTestJSON-1609025183-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 16:04:54.135450 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.objects.instance [None req-b2ca36bd-4665-4052-922c-92fea2fa199e tempest-AttachVolumeTestJSON-1609025183 tempest-AttachVolumeTestJSON-1609025183-project] Lazy-loading 'services' on Instance uuid 748407bd-67ec-47e8-9a38-3c31cc18118c {{(pid=128728) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 14 16:04:54.202916 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: INFO nova.api.openstack.requestlog [None req-b2ca36bd-4665-4052-922c-92fea2fa199e tempest-AttachVolumeTestJSON-1609025183 tempest-AttachVolumeTestJSON-1609025183-project] 10.222.0.61 "DELETE /compute/v2.1/servers/748407bd-67ec-47e8-9a38-3c31cc18118c/os-volume_attachments/6c3c1fe3-efbe-4247-9ef2-1988f70ebd1d" status: 202 len: 0 microversion: 2.1 time: 0.159732 May 14 16:04:54.203527 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: [pid: 128728|app: 0|req: 691/1361] 10.222.0.61 () {58 vars in 1415 bytes} [Sat May 14 16:04:54 2022] DELETE /compute/v2.1/servers/748407bd-67ec-47e8-9a38-3c31cc18118c/os-volume_attachments/6c3c1fe3-efbe-4247-9ef2-1988f70ebd1d => generated 0 bytes in 161 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 14 16:04:55.355576 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi [None req-30f45e55-f286-4d7d-9449-a4382d8b6fda tempest-AttachVolumeTestJSON-1609025183 tempest-AttachVolumeTestJSON-1609025183-project] Calling method '>' {{(pid=128729) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 16:04:55.356587 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.compute.api [None req-30f45e55-f286-4d7d-9449-a4382d8b6fda tempest-AttachVolumeTestJSON-1609025183 tempest-AttachVolumeTestJSON-1609025183-project] [instance: 748407bd-67ec-47e8-9a38-3c31cc18118c] Fetching instance by UUID {{(pid=128729) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 16:04:55.362901 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-30f45e55-f286-4d7d-9449-a4382d8b6fda tempest-AttachVolumeTestJSON-1609025183 tempest-AttachVolumeTestJSON-1609025183-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 16:04:55.363352 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-30f45e55-f286-4d7d-9449-a4382d8b6fda tempest-AttachVolumeTestJSON-1609025183 tempest-AttachVolumeTestJSON-1609025183-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 16:04:55.364122 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-30f45e55-f286-4d7d-9449-a4382d8b6fda tempest-AttachVolumeTestJSON-1609025183 tempest-AttachVolumeTestJSON-1609025183-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 16:04:55.364557 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-30f45e55-f286-4d7d-9449-a4382d8b6fda tempest-AttachVolumeTestJSON-1609025183 tempest-AttachVolumeTestJSON-1609025183-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 16:04:55.392399 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: INFO nova.api.openstack.requestlog [None req-30f45e55-f286-4d7d-9449-a4382d8b6fda tempest-AttachVolumeTestJSON-1609025183 tempest-AttachVolumeTestJSON-1609025183-project] 10.222.0.61 "GET /compute/v2.1/servers/748407bd-67ec-47e8-9a38-3c31cc18118c/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.040818 May 14 16:04:55.392949 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: [pid: 128729|app: 0|req: 671/1362] 10.222.0.61 () {58 vars in 1301 bytes} [Sat May 14 16:04:55 2022] GET /compute/v2.1/servers/748407bd-67ec-47e8-9a38-3c31cc18118c/os-volume_attachments => generated 25 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) May 14 16:04:55.496120 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi [None req-6e215b4c-ee3e-4029-9eaf-927ee77cfc13 tempest-AttachVolumeTestJSON-1609025183 tempest-AttachVolumeTestJSON-1609025183-project] Calling method '>' {{(pid=128728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 16:04:55.497142 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.compute.api [None req-6e215b4c-ee3e-4029-9eaf-927ee77cfc13 tempest-AttachVolumeTestJSON-1609025183 tempest-AttachVolumeTestJSON-1609025183-project] [instance: 748407bd-67ec-47e8-9a38-3c31cc18118c] Fetching instance by UUID {{(pid=128728) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 16:04:55.503423 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-6e215b4c-ee3e-4029-9eaf-927ee77cfc13 tempest-AttachVolumeTestJSON-1609025183 tempest-AttachVolumeTestJSON-1609025183-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 16:04:55.503875 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-6e215b4c-ee3e-4029-9eaf-927ee77cfc13 tempest-AttachVolumeTestJSON-1609025183 tempest-AttachVolumeTestJSON-1609025183-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 16:04:55.504635 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-6e215b4c-ee3e-4029-9eaf-927ee77cfc13 tempest-AttachVolumeTestJSON-1609025183 tempest-AttachVolumeTestJSON-1609025183-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 16:04:55.505068 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-6e215b4c-ee3e-4029-9eaf-927ee77cfc13 tempest-AttachVolumeTestJSON-1609025183 tempest-AttachVolumeTestJSON-1609025183-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 16:04:55.532877 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: INFO nova.api.openstack.requestlog [None req-6e215b4c-ee3e-4029-9eaf-927ee77cfc13 tempest-AttachVolumeTestJSON-1609025183 tempest-AttachVolumeTestJSON-1609025183-project] 10.222.0.61 "GET /compute/v2.1/servers/748407bd-67ec-47e8-9a38-3c31cc18118c/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.041431 May 14 16:04:55.533346 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: [pid: 128728|app: 0|req: 692/1363] 10.222.0.61 () {58 vars in 1301 bytes} [Sat May 14 16:04:55 2022] GET /compute/v2.1/servers/748407bd-67ec-47e8-9a38-3c31cc18118c/os-volume_attachments => generated 25 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 14 16:04:55.589805 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi [None req-5e008367-4029-4ca5-ba8d-e4e83fb8c8d1 tempest-AttachVolumeTestJSON-1609025183 tempest-AttachVolumeTestJSON-1609025183-project] Calling method '>' {{(pid=128729) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 16:04:55.590299 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.compute.api [None req-5e008367-4029-4ca5-ba8d-e4e83fb8c8d1 tempest-AttachVolumeTestJSON-1609025183 tempest-AttachVolumeTestJSON-1609025183-project] [instance: 748407bd-67ec-47e8-9a38-3c31cc18118c] Fetching instance by UUID {{(pid=128729) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 16:04:55.596108 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-5e008367-4029-4ca5-ba8d-e4e83fb8c8d1 tempest-AttachVolumeTestJSON-1609025183 tempest-AttachVolumeTestJSON-1609025183-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 16:04:55.596569 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-5e008367-4029-4ca5-ba8d-e4e83fb8c8d1 tempest-AttachVolumeTestJSON-1609025183 tempest-AttachVolumeTestJSON-1609025183-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 16:04:55.597332 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-5e008367-4029-4ca5-ba8d-e4e83fb8c8d1 tempest-AttachVolumeTestJSON-1609025183 tempest-AttachVolumeTestJSON-1609025183-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 16:04:55.597773 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-5e008367-4029-4ca5-ba8d-e4e83fb8c8d1 tempest-AttachVolumeTestJSON-1609025183 tempest-AttachVolumeTestJSON-1609025183-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 16:04:55.621748 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.compute.api [None req-5e008367-4029-4ca5-ba8d-e4e83fb8c8d1 tempest-AttachVolumeTestJSON-1609025183 tempest-AttachVolumeTestJSON-1609025183-project] [instance: 748407bd-67ec-47e8-9a38-3c31cc18118c] Going to try to terminate instance {{(pid=128729) delete /opt/stack/nova/nova/compute/api.py:2664}} May 14 16:04:55.694781 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: INFO nova.api.openstack.requestlog [None req-5e008367-4029-4ca5-ba8d-e4e83fb8c8d1 tempest-AttachVolumeTestJSON-1609025183 tempest-AttachVolumeTestJSON-1609025183-project] 10.222.0.61 "DELETE /compute/v2.1/servers/748407bd-67ec-47e8-9a38-3c31cc18118c" status: 204 len: 0 microversion: 2.1 time: 0.108414 May 14 16:04:55.695418 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: [pid: 128729|app: 0|req: 672/1364] 10.222.0.61 () {58 vars in 1238 bytes} [Sat May 14 16:04:55 2022] DELETE /compute/v2.1/servers/748407bd-67ec-47e8-9a38-3c31cc18118c => generated 0 bytes in 110 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 14 16:04:55.703753 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi [None req-3b7c67af-4f3a-471a-95dd-9549ad7d1606 tempest-AttachVolumeTestJSON-1609025183 tempest-AttachVolumeTestJSON-1609025183-project] Calling method '>' {{(pid=128728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 16:04:55.704363 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.compute.api [None req-3b7c67af-4f3a-471a-95dd-9549ad7d1606 tempest-AttachVolumeTestJSON-1609025183 tempest-AttachVolumeTestJSON-1609025183-project] [instance: 748407bd-67ec-47e8-9a38-3c31cc18118c] Fetching instance by UUID {{(pid=128728) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 16:04:55.710825 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-3b7c67af-4f3a-471a-95dd-9549ad7d1606 tempest-AttachVolumeTestJSON-1609025183 tempest-AttachVolumeTestJSON-1609025183-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 16:04:55.711273 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-3b7c67af-4f3a-471a-95dd-9549ad7d1606 tempest-AttachVolumeTestJSON-1609025183 tempest-AttachVolumeTestJSON-1609025183-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 16:04:55.712036 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-3b7c67af-4f3a-471a-95dd-9549ad7d1606 tempest-AttachVolumeTestJSON-1609025183 tempest-AttachVolumeTestJSON-1609025183-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 16:04:55.712466 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-3b7c67af-4f3a-471a-95dd-9549ad7d1606 tempest-AttachVolumeTestJSON-1609025183 tempest-AttachVolumeTestJSON-1609025183-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 16:04:55.842153 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.policy [None req-3b7c67af-4f3a-471a-95dd-9549ad7d1606 tempest-AttachVolumeTestJSON-1609025183 tempest-AttachVolumeTestJSON-1609025183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '742938d3a02a4c8babf518b7b6cf53a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '882808bd43644908a21ff8a58997c57f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128728) authorize /opt/stack/nova/nova/policy.py:199}} May 14 16:04:55.849522 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: INFO nova.api.openstack.requestlog [None req-3b7c67af-4f3a-471a-95dd-9549ad7d1606 tempest-AttachVolumeTestJSON-1609025183 tempest-AttachVolumeTestJSON-1609025183-project] 10.222.0.61 "GET /compute/v2.1/servers/748407bd-67ec-47e8-9a38-3c31cc18118c" status: 200 len: 1669 microversion: 2.1 time: 0.149614 May 14 16:04:55.850087 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: [pid: 128728|app: 0|req: 693/1365] 10.222.0.61 () {58 vars in 1235 bytes} [Sat May 14 16:04:55 2022] GET /compute/v2.1/servers/748407bd-67ec-47e8-9a38-3c31cc18118c => generated 1669 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 16:04:56.867038 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi [None req-573ad3fd-3d0c-479c-9385-144c3eee51dd tempest-AttachVolumeTestJSON-1609025183 tempest-AttachVolumeTestJSON-1609025183-project] Calling method '>' {{(pid=128729) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 16:04:56.867745 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.compute.api [None req-573ad3fd-3d0c-479c-9385-144c3eee51dd tempest-AttachVolumeTestJSON-1609025183 tempest-AttachVolumeTestJSON-1609025183-project] [instance: 748407bd-67ec-47e8-9a38-3c31cc18118c] Fetching instance by UUID {{(pid=128729) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 16:04:56.874214 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-573ad3fd-3d0c-479c-9385-144c3eee51dd tempest-AttachVolumeTestJSON-1609025183 tempest-AttachVolumeTestJSON-1609025183-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 16:04:56.874696 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-573ad3fd-3d0c-479c-9385-144c3eee51dd tempest-AttachVolumeTestJSON-1609025183 tempest-AttachVolumeTestJSON-1609025183-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 16:04:56.875466 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-573ad3fd-3d0c-479c-9385-144c3eee51dd tempest-AttachVolumeTestJSON-1609025183 tempest-AttachVolumeTestJSON-1609025183-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 16:04:56.875907 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-573ad3fd-3d0c-479c-9385-144c3eee51dd tempest-AttachVolumeTestJSON-1609025183 tempest-AttachVolumeTestJSON-1609025183-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 16:04:57.005718 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.policy [None req-573ad3fd-3d0c-479c-9385-144c3eee51dd tempest-AttachVolumeTestJSON-1609025183 tempest-AttachVolumeTestJSON-1609025183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '742938d3a02a4c8babf518b7b6cf53a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '882808bd43644908a21ff8a58997c57f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128729) authorize /opt/stack/nova/nova/policy.py:199}} May 14 16:04:57.013134 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: INFO nova.api.openstack.requestlog [None req-573ad3fd-3d0c-479c-9385-144c3eee51dd tempest-AttachVolumeTestJSON-1609025183 tempest-AttachVolumeTestJSON-1609025183-project] 10.222.0.61 "GET /compute/v2.1/servers/748407bd-67ec-47e8-9a38-3c31cc18118c" status: 200 len: 1669 microversion: 2.1 time: 0.150558 May 14 16:04:57.013697 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: [pid: 128729|app: 0|req: 673/1366] 10.222.0.61 () {58 vars in 1235 bytes} [Sat May 14 16:04:56 2022] GET /compute/v2.1/servers/748407bd-67ec-47e8-9a38-3c31cc18118c => generated 1669 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 16:04:58.030850 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi [None req-3525313b-fe46-4de0-800c-49575511deb8 tempest-AttachVolumeTestJSON-1609025183 tempest-AttachVolumeTestJSON-1609025183-project] Calling method '>' {{(pid=128728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 16:04:58.031463 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.compute.api [None req-3525313b-fe46-4de0-800c-49575511deb8 tempest-AttachVolumeTestJSON-1609025183 tempest-AttachVolumeTestJSON-1609025183-project] [instance: 748407bd-67ec-47e8-9a38-3c31cc18118c] Fetching instance by UUID {{(pid=128728) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 16:04:58.038530 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-3525313b-fe46-4de0-800c-49575511deb8 tempest-AttachVolumeTestJSON-1609025183 tempest-AttachVolumeTestJSON-1609025183-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 16:04:58.038979 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-3525313b-fe46-4de0-800c-49575511deb8 tempest-AttachVolumeTestJSON-1609025183 tempest-AttachVolumeTestJSON-1609025183-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 16:04:58.039750 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-3525313b-fe46-4de0-800c-49575511deb8 tempest-AttachVolumeTestJSON-1609025183 tempest-AttachVolumeTestJSON-1609025183-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 16:04:58.040183 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-3525313b-fe46-4de0-800c-49575511deb8 tempest-AttachVolumeTestJSON-1609025183 tempest-AttachVolumeTestJSON-1609025183-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 16:04:58.168030 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.policy [None req-3525313b-fe46-4de0-800c-49575511deb8 tempest-AttachVolumeTestJSON-1609025183 tempest-AttachVolumeTestJSON-1609025183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '742938d3a02a4c8babf518b7b6cf53a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '882808bd43644908a21ff8a58997c57f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128728) authorize /opt/stack/nova/nova/policy.py:199}} May 14 16:04:58.175382 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: INFO nova.api.openstack.requestlog [None req-3525313b-fe46-4de0-800c-49575511deb8 tempest-AttachVolumeTestJSON-1609025183 tempest-AttachVolumeTestJSON-1609025183-project] 10.222.0.61 "GET /compute/v2.1/servers/748407bd-67ec-47e8-9a38-3c31cc18118c" status: 200 len: 1669 microversion: 2.1 time: 0.148395 May 14 16:04:58.175953 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: [pid: 128728|app: 0|req: 694/1367] 10.222.0.61 () {58 vars in 1235 bytes} [Sat May 14 16:04:58 2022] GET /compute/v2.1/servers/748407bd-67ec-47e8-9a38-3c31cc18118c => generated 1669 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 16:04:58.706903 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi [req-8603dadc-027f-44c0-8331-91f0f63d3fba req-ad375f3c-13f8-49c6-9d21-7fdd5f1ff809 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "748407bd-67ec-47e8-9a38-3c31cc18118c", "name": "network-vif-deleted", "tag": "fd37895f-d764-4c1d-ae98-012764ee826a"}]} {{(pid=128729) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 16:04:58.716976 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [req-8603dadc-027f-44c0-8331-91f0f63d3fba req-ad375f3c-13f8-49c6-9d21-7fdd5f1ff809 service nova] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 16:04:58.717450 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [req-8603dadc-027f-44c0-8331-91f0f63d3fba req-ad375f3c-13f8-49c6-9d21-7fdd5f1ff809 service nova] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 16:04:58.730190 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: INFO nova.api.openstack.compute.server_external_events [req-8603dadc-027f-44c0-8331-91f0f63d3fba req-ad375f3c-13f8-49c6-9d21-7fdd5f1ff809 service nova] Creating event network-vif-deleted:fd37895f-d764-4c1d-ae98-012764ee826a for instance 748407bd-67ec-47e8-9a38-3c31cc18118c on hv-cinder-83979 May 14 16:04:58.735698 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: INFO nova.api.openstack.requestlog [req-8603dadc-027f-44c0-8331-91f0f63d3fba req-ad375f3c-13f8-49c6-9d21-7fdd5f1ff809 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032655 May 14 16:04:58.737059 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: [pid: 128729|app: 0|req: 674/1368] 10.222.0.61 () {64 vars in 1317 bytes} [Sat May 14 16:04:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 14 16:04:59.192887 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi [None req-c60a97a8-e1c0-4e4e-bc30-509e680b672b tempest-AttachVolumeTestJSON-1609025183 tempest-AttachVolumeTestJSON-1609025183-project] Calling method '>' {{(pid=128728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 16:04:59.194421 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.compute.api [None req-c60a97a8-e1c0-4e4e-bc30-509e680b672b tempest-AttachVolumeTestJSON-1609025183 tempest-AttachVolumeTestJSON-1609025183-project] [instance: 748407bd-67ec-47e8-9a38-3c31cc18118c] Fetching instance by UUID {{(pid=128728) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 16:04:59.202060 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-c60a97a8-e1c0-4e4e-bc30-509e680b672b tempest-AttachVolumeTestJSON-1609025183 tempest-AttachVolumeTestJSON-1609025183-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 16:04:59.202864 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-c60a97a8-e1c0-4e4e-bc30-509e680b672b tempest-AttachVolumeTestJSON-1609025183 tempest-AttachVolumeTestJSON-1609025183-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 16:04:59.203949 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-c60a97a8-e1c0-4e4e-bc30-509e680b672b tempest-AttachVolumeTestJSON-1609025183 tempest-AttachVolumeTestJSON-1609025183-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 16:04:59.204451 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-c60a97a8-e1c0-4e4e-bc30-509e680b672b tempest-AttachVolumeTestJSON-1609025183 tempest-AttachVolumeTestJSON-1609025183-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 16:04:59.218502 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: INFO nova.api.openstack.wsgi [None req-c60a97a8-e1c0-4e4e-bc30-509e680b672b tempest-AttachVolumeTestJSON-1609025183 tempest-AttachVolumeTestJSON-1609025183-project] HTTP exception thrown: Instance 748407bd-67ec-47e8-9a38-3c31cc18118c could not be found. May 14 16:04:59.220257 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi [None req-c60a97a8-e1c0-4e4e-bc30-509e680b672b tempest-AttachVolumeTestJSON-1609025183 tempest-AttachVolumeTestJSON-1609025183-project] Request method failure captured: May 14 16:04:59.220257 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: request: GET /compute/v2.1/servers/748407bd-67ec-47e8-9a38-3c31cc18118c HTTP/1.1 May 14 16:04:59.220257 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: Accept: application/json May 14 16:04:59.220257 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: Accept-Encoding: identity May 14 16:04:59.220257 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: Connection: close May 14 16:04:59.220257 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: Content-Length: 0 May 14 16:04:59.220257 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: Content-Type: application/json May 14 16:04:59.220257 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: Host: 10.222.0.61 May 14 16:04:59.220257 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: Openstack-System-Scope: None May 14 16:04:59.220257 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: User-Agent: python-urllib3/1.26.9 May 14 16:04:59.220257 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: X-Auth-Token: gAAAAABif9Gr79lItj3mwTw-NdY3QT97srgkpsWpCseJJi9csZRpQOMQDp2kaxkWy888C_FDHsFiHETHxjz1y8G2SkJ75Li0I1knXUbNBk40A-O__SigSWW6C655IkbIyYax2Uzqjv_g5hPRwMaE9qqPd4XTwCSygMi72uyZ2EHg1pUAE3jSQns May 14 16:04:59.220257 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: X-Domain-Id: None May 14 16:04:59.220257 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: X-Domain-Name: None May 14 16:04:59.220257 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: X-Identity-Status: Confirmed May 14 16:04:59.220257 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: X-Is-Admin-Project: True May 14 16:04:59.220257 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: X-Project-Domain-Id: default May 14 16:04:59.220257 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: X-Project-Domain-Name: Default May 14 16:04:59.220257 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: X-Project-Id: 882808bd43644908a21ff8a58997c57f May 14 16:04:59.220257 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: X-Project-Name: tempest-AttachVolumeTestJSON-1609025183 May 14 16:04:59.220257 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: X-Role: reader,member May 14 16:04:59.220257 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: X-Roles: reader,member May 14 16:04:59.221813 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/882808bd43644908a21ff8a58997c57f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/882808bd43644908a21ff8a58997c57f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/882808bd43644908a21ff8a58997c57f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_882808bd43644908a21ff8a58997c57f"}]}] May 14 16:04:59.221813 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: X-Tenant: tempest-AttachVolumeTestJSON-1609025183 May 14 16:04:59.221813 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: X-Tenant-Id: 882808bd43644908a21ff8a58997c57f May 14 16:04:59.221813 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1609025183 May 14 16:04:59.221813 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: X-User: tempest-AttachVolumeTestJSON-1609025183-project May 14 16:04:59.221813 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: X-User-Domain-Id: default May 14 16:04:59.221813 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: X-User-Domain-Name: Default May 14 16:04:59.221813 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: X-User-Id: 742938d3a02a4c8babf518b7b6cf53a7 May 14 16:04:59.221813 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: X-User-Name: tempest-AttachVolumeTestJSON-1609025183-project May 14 16:04:59.221813 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: method: > May 14 16:04:59.221813 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: exception: Instance 748407bd-67ec-47e8-9a38-3c31cc18118c could not be found. May 14 16:04:59.221813 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: action_args: {'id': '748407bd-67ec-47e8-9a38-3c31cc18118c'} May 14 16:04:59.222731 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: {{(pid=128728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 14 16:04:59.222731 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 16:04:59.222731 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 14 16:04:59.222731 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 14 16:04:59.222731 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 14 16:04:59.222731 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 14 16:04:59.222731 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 14 16:04:59.222731 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 14 16:04:59.222731 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 14 16:04:59.222731 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 14 16:04:59.222731 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 748407bd-67ec-47e8-9a38-3c31cc18118c could not be found. May 14 16:04:59.222731 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: ERROR nova.api.openstack.wsgi May 14 16:04:59.222731 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 14 16:04:59.222731 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: ERROR nova.api.openstack.wsgi May 14 16:04:59.222731 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 16:04:59.222731 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 14 16:04:59.222731 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 14 16:04:59.222731 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 14 16:04:59.222731 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 14 16:04:59.222731 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 14 16:04:59.224180 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 14 16:04:59.224180 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 14 16:04:59.224180 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 14 16:04:59.224180 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 14 16:04:59.224180 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 14 16:04:59.224180 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 14 16:04:59.224180 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 14 16:04:59.224180 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 748407bd-67ec-47e8-9a38-3c31cc18118c could not be found. May 14 16:04:59.224180 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: ERROR nova.api.openstack.wsgi May 14 16:04:59.224180 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 14 16:04:59.224180 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: ERROR nova.api.openstack.wsgi May 14 16:04:59.224180 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 16:04:59.224180 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 14 16:04:59.224180 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 14 16:04:59.224180 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 14 16:04:59.224180 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 14 16:04:59.224180 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 748407bd-67ec-47e8-9a38-3c31cc18118c could not be found. May 14 16:04:59.224180 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: ERROR nova.api.openstack.wsgi May 14 16:04:59.227082 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi [None req-c60a97a8-e1c0-4e4e-bc30-509e680b672b tempest-AttachVolumeTestJSON-1609025183 tempest-AttachVolumeTestJSON-1609025183-project] Returning 404 to user: Instance 748407bd-67ec-47e8-9a38-3c31cc18118c could not be found. {{(pid=128728) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 14 16:04:59.227082 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: INFO nova.api.openstack.requestlog [None req-c60a97a8-e1c0-4e4e-bc30-509e680b672b tempest-AttachVolumeTestJSON-1609025183 tempest-AttachVolumeTestJSON-1609025183-project] 10.222.0.61 "GET /compute/v2.1/servers/748407bd-67ec-47e8-9a38-3c31cc18118c" status: 404 len: 111 microversion: 2.1 time: 0.032829 May 14 16:04:59.227082 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: [pid: 128728|app: 0|req: 695/1369] 10.222.0.61 () {58 vars in 1235 bytes} [Sat May 14 16:04:59 2022] GET /compute/v2.1/servers/748407bd-67ec-47e8-9a38-3c31cc18118c => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 14 16:04:59.233356 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi [None req-b558ca20-04df-47c7-a911-a47c89263f70 tempest-AttachVolumeTestJSON-1609025183 tempest-AttachVolumeTestJSON-1609025183-project] Calling method '.version_select at 0x7f77d801f310>' {{(pid=128729) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 16:04:59.250495 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: INFO nova.api.openstack.requestlog [None req-b558ca20-04df-47c7-a911-a47c89263f70 tempest-AttachVolumeTestJSON-1609025183 tempest-AttachVolumeTestJSON-1609025183-project] 10.222.0.61 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-744978699" status: 202 len: 0 microversion: 2.1 time: 0.021582 May 14 16:04:59.251083 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: [pid: 128729|app: 0|req: 675/1370] 10.222.0.61 () {58 vars in 1217 bytes} [Sat May 14 16:04:59 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-744978699 => generated 0 bytes in 24 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 14 16:05:02.133544 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi [None req-fa6cd07a-7974-4cd2-9423-168bda780398 tempest-AttachVolumeTestJSON-1609025183 tempest-AttachVolumeTestJSON-1609025183-project] Calling method '>' {{(pid=128728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 16:05:02.134060 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.compute.api [None req-fa6cd07a-7974-4cd2-9423-168bda780398 tempest-AttachVolumeTestJSON-1609025183 tempest-AttachVolumeTestJSON-1609025183-project] [instance: 748407bd-67ec-47e8-9a38-3c31cc18118c] Fetching instance by UUID {{(pid=128728) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 16:05:02.140363 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-fa6cd07a-7974-4cd2-9423-168bda780398 tempest-AttachVolumeTestJSON-1609025183 tempest-AttachVolumeTestJSON-1609025183-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 16:05:02.140807 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-fa6cd07a-7974-4cd2-9423-168bda780398 tempest-AttachVolumeTestJSON-1609025183 tempest-AttachVolumeTestJSON-1609025183-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 16:05:02.141577 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-fa6cd07a-7974-4cd2-9423-168bda780398 tempest-AttachVolumeTestJSON-1609025183 tempest-AttachVolumeTestJSON-1609025183-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 16:05:02.142017 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-fa6cd07a-7974-4cd2-9423-168bda780398 tempest-AttachVolumeTestJSON-1609025183 tempest-AttachVolumeTestJSON-1609025183-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 16:05:02.155617 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: INFO nova.api.openstack.wsgi [None req-fa6cd07a-7974-4cd2-9423-168bda780398 tempest-AttachVolumeTestJSON-1609025183 tempest-AttachVolumeTestJSON-1609025183-project] HTTP exception thrown: Instance 748407bd-67ec-47e8-9a38-3c31cc18118c could not be found. May 14 16:05:02.157153 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi [None req-fa6cd07a-7974-4cd2-9423-168bda780398 tempest-AttachVolumeTestJSON-1609025183 tempest-AttachVolumeTestJSON-1609025183-project] Request method failure captured: May 14 16:05:02.157153 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: request: DELETE /compute/v2.1/servers/748407bd-67ec-47e8-9a38-3c31cc18118c HTTP/1.1 May 14 16:05:02.157153 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: Accept: application/json May 14 16:05:02.157153 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: Accept-Encoding: identity May 14 16:05:02.157153 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: Connection: close May 14 16:05:02.157153 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: Content-Length: 0 May 14 16:05:02.157153 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: Content-Type: application/json May 14 16:05:02.157153 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: Host: 10.222.0.61 May 14 16:05:02.157153 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: Openstack-System-Scope: None May 14 16:05:02.157153 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: User-Agent: python-urllib3/1.26.9 May 14 16:05:02.157153 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: X-Auth-Token: gAAAAABif9Gr79lItj3mwTw-NdY3QT97srgkpsWpCseJJi9csZRpQOMQDp2kaxkWy888C_FDHsFiHETHxjz1y8G2SkJ75Li0I1knXUbNBk40A-O__SigSWW6C655IkbIyYax2Uzqjv_g5hPRwMaE9qqPd4XTwCSygMi72uyZ2EHg1pUAE3jSQns May 14 16:05:02.157153 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: X-Domain-Id: None May 14 16:05:02.157153 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: X-Domain-Name: None May 14 16:05:02.157153 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: X-Identity-Status: Confirmed May 14 16:05:02.157153 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: X-Is-Admin-Project: True May 14 16:05:02.157153 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: X-Project-Domain-Id: default May 14 16:05:02.157153 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: X-Project-Domain-Name: Default May 14 16:05:02.157153 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: X-Project-Id: 882808bd43644908a21ff8a58997c57f May 14 16:05:02.157153 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: X-Project-Name: tempest-AttachVolumeTestJSON-1609025183 May 14 16:05:02.157153 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: X-Role: reader,member May 14 16:05:02.157153 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: X-Roles: reader,member May 14 16:05:02.158825 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/882808bd43644908a21ff8a58997c57f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/882808bd43644908a21ff8a58997c57f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/882808bd43644908a21ff8a58997c57f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_882808bd43644908a21ff8a58997c57f"}]}] May 14 16:05:02.158825 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: X-Tenant: tempest-AttachVolumeTestJSON-1609025183 May 14 16:05:02.158825 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: X-Tenant-Id: 882808bd43644908a21ff8a58997c57f May 14 16:05:02.158825 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1609025183 May 14 16:05:02.158825 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: X-User: tempest-AttachVolumeTestJSON-1609025183-project May 14 16:05:02.158825 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: X-User-Domain-Id: default May 14 16:05:02.158825 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: X-User-Domain-Name: Default May 14 16:05:02.158825 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: X-User-Id: 742938d3a02a4c8babf518b7b6cf53a7 May 14 16:05:02.158825 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: X-User-Name: tempest-AttachVolumeTestJSON-1609025183-project May 14 16:05:02.158825 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: method: > May 14 16:05:02.158825 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: exception: Instance 748407bd-67ec-47e8-9a38-3c31cc18118c could not be found. May 14 16:05:02.158825 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: action_args: {'id': '748407bd-67ec-47e8-9a38-3c31cc18118c'} May 14 16:05:02.159872 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: {{(pid=128728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 14 16:05:02.159872 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 16:05:02.159872 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 14 16:05:02.159872 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 14 16:05:02.159872 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 14 16:05:02.159872 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 14 16:05:02.159872 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 14 16:05:02.159872 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 14 16:05:02.159872 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 14 16:05:02.159872 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 14 16:05:02.159872 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 748407bd-67ec-47e8-9a38-3c31cc18118c could not be found. May 14 16:05:02.159872 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: ERROR nova.api.openstack.wsgi May 14 16:05:02.159872 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 14 16:05:02.159872 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: ERROR nova.api.openstack.wsgi May 14 16:05:02.159872 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 16:05:02.159872 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 14 16:05:02.159872 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 14 16:05:02.159872 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 14 16:05:02.159872 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 14 16:05:02.159872 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 14 16:05:02.161189 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 14 16:05:02.161189 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 14 16:05:02.161189 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 14 16:05:02.161189 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 14 16:05:02.161189 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 14 16:05:02.161189 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 14 16:05:02.161189 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 14 16:05:02.161189 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 14 16:05:02.161189 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 14 16:05:02.161189 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 748407bd-67ec-47e8-9a38-3c31cc18118c could not be found. May 14 16:05:02.161189 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: ERROR nova.api.openstack.wsgi May 14 16:05:02.161189 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 14 16:05:02.161189 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: ERROR nova.api.openstack.wsgi May 14 16:05:02.161189 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 16:05:02.161189 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 14 16:05:02.161189 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 14 16:05:02.161189 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 14 16:05:02.161189 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 14 16:05:02.161189 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 748407bd-67ec-47e8-9a38-3c31cc18118c could not be found. May 14 16:05:02.161189 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: ERROR nova.api.openstack.wsgi May 14 16:05:02.163828 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi [None req-fa6cd07a-7974-4cd2-9423-168bda780398 tempest-AttachVolumeTestJSON-1609025183 tempest-AttachVolumeTestJSON-1609025183-project] Returning 404 to user: Instance 748407bd-67ec-47e8-9a38-3c31cc18118c could not be found. {{(pid=128728) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 14 16:05:02.163828 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: INFO nova.api.openstack.requestlog [None req-fa6cd07a-7974-4cd2-9423-168bda780398 tempest-AttachVolumeTestJSON-1609025183 tempest-AttachVolumeTestJSON-1609025183-project] 10.222.0.61 "DELETE /compute/v2.1/servers/748407bd-67ec-47e8-9a38-3c31cc18118c" status: 404 len: 111 microversion: 2.1 time: 0.030024 May 14 16:05:02.163828 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: [pid: 128728|app: 0|req: 696/1371] 10.222.0.61 () {58 vars in 1238 bytes} [Sat May 14 16:05:02 2022] DELETE /compute/v2.1/servers/748407bd-67ec-47e8-9a38-3c31cc18118c => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 14 16:05:02.167598 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi [None req-ec2736c2-b8a0-444f-a031-0067c368e00a tempest-AttachVolumeTestJSON-1609025183 tempest-AttachVolumeTestJSON-1609025183-project] Calling method '>' {{(pid=128729) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 16:05:02.168329 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.compute.api [None req-ec2736c2-b8a0-444f-a031-0067c368e00a tempest-AttachVolumeTestJSON-1609025183 tempest-AttachVolumeTestJSON-1609025183-project] [instance: 748407bd-67ec-47e8-9a38-3c31cc18118c] Fetching instance by UUID {{(pid=128729) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 16:05:02.174814 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-ec2736c2-b8a0-444f-a031-0067c368e00a tempest-AttachVolumeTestJSON-1609025183 tempest-AttachVolumeTestJSON-1609025183-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 16:05:02.175262 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-ec2736c2-b8a0-444f-a031-0067c368e00a tempest-AttachVolumeTestJSON-1609025183 tempest-AttachVolumeTestJSON-1609025183-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 16:05:02.176029 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-ec2736c2-b8a0-444f-a031-0067c368e00a tempest-AttachVolumeTestJSON-1609025183 tempest-AttachVolumeTestJSON-1609025183-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 16:05:02.176463 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-ec2736c2-b8a0-444f-a031-0067c368e00a tempest-AttachVolumeTestJSON-1609025183 tempest-AttachVolumeTestJSON-1609025183-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 16:05:02.189594 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: INFO nova.api.openstack.wsgi [None req-ec2736c2-b8a0-444f-a031-0067c368e00a tempest-AttachVolumeTestJSON-1609025183 tempest-AttachVolumeTestJSON-1609025183-project] HTTP exception thrown: Instance 748407bd-67ec-47e8-9a38-3c31cc18118c could not be found. May 14 16:05:02.191213 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi [None req-ec2736c2-b8a0-444f-a031-0067c368e00a tempest-AttachVolumeTestJSON-1609025183 tempest-AttachVolumeTestJSON-1609025183-project] Request method failure captured: May 14 16:05:02.191213 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: request: GET /compute/v2.1/servers/748407bd-67ec-47e8-9a38-3c31cc18118c HTTP/1.1 May 14 16:05:02.191213 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: Accept: application/json May 14 16:05:02.191213 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: Accept-Encoding: identity May 14 16:05:02.191213 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: Connection: close May 14 16:05:02.191213 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: Content-Length: 0 May 14 16:05:02.191213 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: Content-Type: application/json May 14 16:05:02.191213 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: Host: 10.222.0.61 May 14 16:05:02.191213 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: Openstack-System-Scope: None May 14 16:05:02.191213 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: User-Agent: python-urllib3/1.26.9 May 14 16:05:02.191213 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: X-Auth-Token: gAAAAABif9Gr79lItj3mwTw-NdY3QT97srgkpsWpCseJJi9csZRpQOMQDp2kaxkWy888C_FDHsFiHETHxjz1y8G2SkJ75Li0I1knXUbNBk40A-O__SigSWW6C655IkbIyYax2Uzqjv_g5hPRwMaE9qqPd4XTwCSygMi72uyZ2EHg1pUAE3jSQns May 14 16:05:02.191213 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: X-Domain-Id: None May 14 16:05:02.191213 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: X-Domain-Name: None May 14 16:05:02.191213 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: X-Identity-Status: Confirmed May 14 16:05:02.191213 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: X-Is-Admin-Project: True May 14 16:05:02.191213 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: X-Project-Domain-Id: default May 14 16:05:02.191213 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: X-Project-Domain-Name: Default May 14 16:05:02.191213 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: X-Project-Id: 882808bd43644908a21ff8a58997c57f May 14 16:05:02.191213 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: X-Project-Name: tempest-AttachVolumeTestJSON-1609025183 May 14 16:05:02.191213 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: X-Role: reader,member May 14 16:05:02.191213 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: X-Roles: reader,member May 14 16:05:02.192853 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/882808bd43644908a21ff8a58997c57f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/882808bd43644908a21ff8a58997c57f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/882808bd43644908a21ff8a58997c57f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_882808bd43644908a21ff8a58997c57f"}]}] May 14 16:05:02.192853 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: X-Tenant: tempest-AttachVolumeTestJSON-1609025183 May 14 16:05:02.192853 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: X-Tenant-Id: 882808bd43644908a21ff8a58997c57f May 14 16:05:02.192853 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1609025183 May 14 16:05:02.192853 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: X-User: tempest-AttachVolumeTestJSON-1609025183-project May 14 16:05:02.192853 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: X-User-Domain-Id: default May 14 16:05:02.192853 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: X-User-Domain-Name: Default May 14 16:05:02.192853 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: X-User-Id: 742938d3a02a4c8babf518b7b6cf53a7 May 14 16:05:02.192853 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: X-User-Name: tempest-AttachVolumeTestJSON-1609025183-project May 14 16:05:02.192853 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: method: > May 14 16:05:02.192853 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: exception: Instance 748407bd-67ec-47e8-9a38-3c31cc18118c could not be found. May 14 16:05:02.192853 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: action_args: {'id': '748407bd-67ec-47e8-9a38-3c31cc18118c'} May 14 16:05:02.194017 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: {{(pid=128729) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 14 16:05:02.194017 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 16:05:02.194017 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 14 16:05:02.194017 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 14 16:05:02.194017 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 14 16:05:02.194017 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 14 16:05:02.194017 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 14 16:05:02.194017 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 14 16:05:02.194017 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 14 16:05:02.194017 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 14 16:05:02.194017 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 748407bd-67ec-47e8-9a38-3c31cc18118c could not be found. May 14 16:05:02.194017 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: ERROR nova.api.openstack.wsgi May 14 16:05:02.194017 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 14 16:05:02.194017 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: ERROR nova.api.openstack.wsgi May 14 16:05:02.194017 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 16:05:02.194017 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 14 16:05:02.194017 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 14 16:05:02.194017 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 14 16:05:02.194017 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 14 16:05:02.194017 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 14 16:05:02.195649 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 14 16:05:02.195649 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 14 16:05:02.195649 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 14 16:05:02.195649 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 14 16:05:02.195649 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 14 16:05:02.195649 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 14 16:05:02.195649 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 14 16:05:02.195649 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 748407bd-67ec-47e8-9a38-3c31cc18118c could not be found. May 14 16:05:02.195649 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: ERROR nova.api.openstack.wsgi May 14 16:05:02.195649 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 14 16:05:02.195649 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: ERROR nova.api.openstack.wsgi May 14 16:05:02.195649 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 16:05:02.195649 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 14 16:05:02.195649 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 14 16:05:02.195649 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 14 16:05:02.195649 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 14 16:05:02.195649 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 748407bd-67ec-47e8-9a38-3c31cc18118c could not be found. May 14 16:05:02.195649 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: ERROR nova.api.openstack.wsgi May 14 16:05:02.197418 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi [None req-ec2736c2-b8a0-444f-a031-0067c368e00a tempest-AttachVolumeTestJSON-1609025183 tempest-AttachVolumeTestJSON-1609025183-project] Returning 404 to user: Instance 748407bd-67ec-47e8-9a38-3c31cc18118c could not be found. {{(pid=128729) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 14 16:05:02.197418 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: INFO nova.api.openstack.requestlog [None req-ec2736c2-b8a0-444f-a031-0067c368e00a tempest-AttachVolumeTestJSON-1609025183 tempest-AttachVolumeTestJSON-1609025183-project] 10.222.0.61 "GET /compute/v2.1/servers/748407bd-67ec-47e8-9a38-3c31cc18118c" status: 404 len: 111 microversion: 2.1 time: 0.028982 May 14 16:05:02.197418 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: [pid: 128729|app: 0|req: 676/1372] 10.222.0.61 () {58 vars in 1235 bytes} [Sat May 14 16:05:02 2022] GET /compute/v2.1/servers/748407bd-67ec-47e8-9a38-3c31cc18118c => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 14 16:05:03.323672 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi [None req-f8c3d94e-839c-4550-b685-25c4bebeb745 tempest-AttachVolumeTestJSON-1609025183 tempest-AttachVolumeTestJSON-1609025183-project] Calling method '>' {{(pid=128728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 16:05:03.324279 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.compute.api [None req-f8c3d94e-839c-4550-b685-25c4bebeb745 tempest-AttachVolumeTestJSON-1609025183 tempest-AttachVolumeTestJSON-1609025183-project] [instance: 34a25afd-ca05-47fe-8bba-30442b7b5348] Fetching instance by UUID {{(pid=128728) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 16:05:03.330683 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-f8c3d94e-839c-4550-b685-25c4bebeb745 tempest-AttachVolumeTestJSON-1609025183 tempest-AttachVolumeTestJSON-1609025183-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 16:05:03.331135 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-f8c3d94e-839c-4550-b685-25c4bebeb745 tempest-AttachVolumeTestJSON-1609025183 tempest-AttachVolumeTestJSON-1609025183-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 16:05:03.331909 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-f8c3d94e-839c-4550-b685-25c4bebeb745 tempest-AttachVolumeTestJSON-1609025183 tempest-AttachVolumeTestJSON-1609025183-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 16:05:03.332349 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG oslo_concurrency.lockutils [None req-f8c3d94e-839c-4550-b685-25c4bebeb745 tempest-AttachVolumeTestJSON-1609025183 tempest-AttachVolumeTestJSON-1609025183-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 16:05:03.345737 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: INFO nova.api.openstack.wsgi [None req-f8c3d94e-839c-4550-b685-25c4bebeb745 tempest-AttachVolumeTestJSON-1609025183 tempest-AttachVolumeTestJSON-1609025183-project] HTTP exception thrown: Instance 34a25afd-ca05-47fe-8bba-30442b7b5348 could not be found. May 14 16:05:03.347303 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi [None req-f8c3d94e-839c-4550-b685-25c4bebeb745 tempest-AttachVolumeTestJSON-1609025183 tempest-AttachVolumeTestJSON-1609025183-project] Request method failure captured: May 14 16:05:03.347303 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: request: DELETE /compute/v2.1/servers/34a25afd-ca05-47fe-8bba-30442b7b5348 HTTP/1.1 May 14 16:05:03.347303 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: Accept: application/json May 14 16:05:03.347303 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: Accept-Encoding: identity May 14 16:05:03.347303 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: Connection: close May 14 16:05:03.347303 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: Content-Length: 0 May 14 16:05:03.347303 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: Content-Type: application/json May 14 16:05:03.347303 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: Host: 10.222.0.61 May 14 16:05:03.347303 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: Openstack-System-Scope: None May 14 16:05:03.347303 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: User-Agent: python-urllib3/1.26.9 May 14 16:05:03.347303 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: X-Auth-Token: gAAAAABif9Gr79lItj3mwTw-NdY3QT97srgkpsWpCseJJi9csZRpQOMQDp2kaxkWy888C_FDHsFiHETHxjz1y8G2SkJ75Li0I1knXUbNBk40A-O__SigSWW6C655IkbIyYax2Uzqjv_g5hPRwMaE9qqPd4XTwCSygMi72uyZ2EHg1pUAE3jSQns May 14 16:05:03.347303 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: X-Domain-Id: None May 14 16:05:03.347303 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: X-Domain-Name: None May 14 16:05:03.347303 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: X-Identity-Status: Confirmed May 14 16:05:03.347303 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: X-Is-Admin-Project: True May 14 16:05:03.347303 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: X-Project-Domain-Id: default May 14 16:05:03.347303 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: X-Project-Domain-Name: Default May 14 16:05:03.347303 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: X-Project-Id: 882808bd43644908a21ff8a58997c57f May 14 16:05:03.347303 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: X-Project-Name: tempest-AttachVolumeTestJSON-1609025183 May 14 16:05:03.347303 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: X-Role: reader,member May 14 16:05:03.347303 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: X-Roles: reader,member May 14 16:05:03.348945 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/882808bd43644908a21ff8a58997c57f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/882808bd43644908a21ff8a58997c57f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/882808bd43644908a21ff8a58997c57f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_882808bd43644908a21ff8a58997c57f"}]}] May 14 16:05:03.348945 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: X-Tenant: tempest-AttachVolumeTestJSON-1609025183 May 14 16:05:03.348945 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: X-Tenant-Id: 882808bd43644908a21ff8a58997c57f May 14 16:05:03.348945 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1609025183 May 14 16:05:03.348945 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: X-User: tempest-AttachVolumeTestJSON-1609025183-project May 14 16:05:03.348945 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: X-User-Domain-Id: default May 14 16:05:03.348945 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: X-User-Domain-Name: Default May 14 16:05:03.348945 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: X-User-Id: 742938d3a02a4c8babf518b7b6cf53a7 May 14 16:05:03.348945 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: X-User-Name: tempest-AttachVolumeTestJSON-1609025183-project May 14 16:05:03.348945 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: method: > May 14 16:05:03.348945 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: exception: Instance 34a25afd-ca05-47fe-8bba-30442b7b5348 could not be found. May 14 16:05:03.348945 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: action_args: {'id': '34a25afd-ca05-47fe-8bba-30442b7b5348'} May 14 16:05:03.350569 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: {{(pid=128728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 14 16:05:03.350569 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 16:05:03.350569 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 14 16:05:03.350569 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 14 16:05:03.350569 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 14 16:05:03.350569 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 14 16:05:03.350569 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 14 16:05:03.350569 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 14 16:05:03.350569 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 14 16:05:03.350569 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 14 16:05:03.350569 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 34a25afd-ca05-47fe-8bba-30442b7b5348 could not be found. May 14 16:05:03.350569 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: ERROR nova.api.openstack.wsgi May 14 16:05:03.350569 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 14 16:05:03.350569 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: ERROR nova.api.openstack.wsgi May 14 16:05:03.350569 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 16:05:03.350569 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 14 16:05:03.350569 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 14 16:05:03.350569 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 14 16:05:03.350569 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 14 16:05:03.350569 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 14 16:05:03.352131 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 14 16:05:03.352131 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 14 16:05:03.352131 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 14 16:05:03.352131 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 14 16:05:03.352131 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 14 16:05:03.352131 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 14 16:05:03.352131 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 14 16:05:03.352131 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 14 16:05:03.352131 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 14 16:05:03.352131 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 34a25afd-ca05-47fe-8bba-30442b7b5348 could not be found. May 14 16:05:03.352131 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: ERROR nova.api.openstack.wsgi May 14 16:05:03.352131 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 14 16:05:03.352131 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: ERROR nova.api.openstack.wsgi May 14 16:05:03.352131 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 16:05:03.352131 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 14 16:05:03.352131 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 14 16:05:03.352131 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 14 16:05:03.352131 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 14 16:05:03.352131 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 34a25afd-ca05-47fe-8bba-30442b7b5348 could not be found. May 14 16:05:03.352131 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: ERROR nova.api.openstack.wsgi May 14 16:05:03.353869 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: DEBUG nova.api.openstack.wsgi [None req-f8c3d94e-839c-4550-b685-25c4bebeb745 tempest-AttachVolumeTestJSON-1609025183 tempest-AttachVolumeTestJSON-1609025183-project] Returning 404 to user: Instance 34a25afd-ca05-47fe-8bba-30442b7b5348 could not be found. {{(pid=128728) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 14 16:05:03.353869 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: INFO nova.api.openstack.requestlog [None req-f8c3d94e-839c-4550-b685-25c4bebeb745 tempest-AttachVolumeTestJSON-1609025183 tempest-AttachVolumeTestJSON-1609025183-project] 10.222.0.61 "DELETE /compute/v2.1/servers/34a25afd-ca05-47fe-8bba-30442b7b5348" status: 404 len: 111 microversion: 2.1 time: 0.029237 May 14 16:05:03.353869 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: [pid: 128728|app: 0|req: 697/1373] 10.222.0.61 () {58 vars in 1238 bytes} [Sat May 14 16:05:03 2022] DELETE /compute/v2.1/servers/34a25afd-ca05-47fe-8bba-30442b7b5348 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 14 16:05:03.357440 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi [None req-95464282-b427-4c4d-bc56-2f1c6c06bf3b tempest-AttachVolumeTestJSON-1609025183 tempest-AttachVolumeTestJSON-1609025183-project] Calling method '>' {{(pid=128729) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 16:05:03.358048 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.compute.api [None req-95464282-b427-4c4d-bc56-2f1c6c06bf3b tempest-AttachVolumeTestJSON-1609025183 tempest-AttachVolumeTestJSON-1609025183-project] [instance: 34a25afd-ca05-47fe-8bba-30442b7b5348] Fetching instance by UUID {{(pid=128729) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 16:05:03.364087 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-95464282-b427-4c4d-bc56-2f1c6c06bf3b tempest-AttachVolumeTestJSON-1609025183 tempest-AttachVolumeTestJSON-1609025183-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 16:05:03.364534 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-95464282-b427-4c4d-bc56-2f1c6c06bf3b tempest-AttachVolumeTestJSON-1609025183 tempest-AttachVolumeTestJSON-1609025183-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 16:05:03.365291 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-95464282-b427-4c4d-bc56-2f1c6c06bf3b tempest-AttachVolumeTestJSON-1609025183 tempest-AttachVolumeTestJSON-1609025183-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 16:05:03.366396 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG oslo_concurrency.lockutils [None req-95464282-b427-4c4d-bc56-2f1c6c06bf3b tempest-AttachVolumeTestJSON-1609025183 tempest-AttachVolumeTestJSON-1609025183-project] Lock "793a8299-ce42-42ac-82e7-4dd54ffc49bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128729) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 16:05:03.379630 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: INFO nova.api.openstack.wsgi [None req-95464282-b427-4c4d-bc56-2f1c6c06bf3b tempest-AttachVolumeTestJSON-1609025183 tempest-AttachVolumeTestJSON-1609025183-project] HTTP exception thrown: Instance 34a25afd-ca05-47fe-8bba-30442b7b5348 could not be found. May 14 16:05:03.381213 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi [None req-95464282-b427-4c4d-bc56-2f1c6c06bf3b tempest-AttachVolumeTestJSON-1609025183 tempest-AttachVolumeTestJSON-1609025183-project] Request method failure captured: May 14 16:05:03.381213 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: request: GET /compute/v2.1/servers/34a25afd-ca05-47fe-8bba-30442b7b5348 HTTP/1.1 May 14 16:05:03.381213 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: Accept: application/json May 14 16:05:03.381213 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: Accept-Encoding: identity May 14 16:05:03.381213 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: Connection: close May 14 16:05:03.381213 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: Content-Length: 0 May 14 16:05:03.381213 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: Content-Type: application/json May 14 16:05:03.381213 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: Host: 10.222.0.61 May 14 16:05:03.381213 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: Openstack-System-Scope: None May 14 16:05:03.381213 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: User-Agent: python-urllib3/1.26.9 May 14 16:05:03.381213 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: X-Auth-Token: gAAAAABif9Gr79lItj3mwTw-NdY3QT97srgkpsWpCseJJi9csZRpQOMQDp2kaxkWy888C_FDHsFiHETHxjz1y8G2SkJ75Li0I1knXUbNBk40A-O__SigSWW6C655IkbIyYax2Uzqjv_g5hPRwMaE9qqPd4XTwCSygMi72uyZ2EHg1pUAE3jSQns May 14 16:05:03.381213 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: X-Domain-Id: None May 14 16:05:03.381213 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: X-Domain-Name: None May 14 16:05:03.381213 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: X-Identity-Status: Confirmed May 14 16:05:03.381213 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: X-Is-Admin-Project: True May 14 16:05:03.381213 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: X-Project-Domain-Id: default May 14 16:05:03.381213 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: X-Project-Domain-Name: Default May 14 16:05:03.381213 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: X-Project-Id: 882808bd43644908a21ff8a58997c57f May 14 16:05:03.381213 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: X-Project-Name: tempest-AttachVolumeTestJSON-1609025183 May 14 16:05:03.381213 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: X-Role: reader,member May 14 16:05:03.381213 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: X-Roles: reader,member May 14 16:05:03.382927 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/882808bd43644908a21ff8a58997c57f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/882808bd43644908a21ff8a58997c57f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/882808bd43644908a21ff8a58997c57f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_882808bd43644908a21ff8a58997c57f"}]}] May 14 16:05:03.382927 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: X-Tenant: tempest-AttachVolumeTestJSON-1609025183 May 14 16:05:03.382927 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: X-Tenant-Id: 882808bd43644908a21ff8a58997c57f May 14 16:05:03.382927 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1609025183 May 14 16:05:03.382927 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: X-User: tempest-AttachVolumeTestJSON-1609025183-project May 14 16:05:03.382927 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: X-User-Domain-Id: default May 14 16:05:03.382927 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: X-User-Domain-Name: Default May 14 16:05:03.382927 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: X-User-Id: 742938d3a02a4c8babf518b7b6cf53a7 May 14 16:05:03.382927 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: X-User-Name: tempest-AttachVolumeTestJSON-1609025183-project May 14 16:05:03.382927 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: method: > May 14 16:05:03.382927 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: exception: Instance 34a25afd-ca05-47fe-8bba-30442b7b5348 could not be found. May 14 16:05:03.382927 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: action_args: {'id': '34a25afd-ca05-47fe-8bba-30442b7b5348'} May 14 16:05:03.384041 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: {{(pid=128729) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 14 16:05:03.384041 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 16:05:03.384041 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 14 16:05:03.384041 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 14 16:05:03.384041 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 14 16:05:03.384041 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 14 16:05:03.384041 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 14 16:05:03.384041 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 14 16:05:03.384041 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 14 16:05:03.384041 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 14 16:05:03.384041 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 34a25afd-ca05-47fe-8bba-30442b7b5348 could not be found. May 14 16:05:03.384041 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: ERROR nova.api.openstack.wsgi May 14 16:05:03.384041 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 14 16:05:03.384041 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: ERROR nova.api.openstack.wsgi May 14 16:05:03.384041 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 16:05:03.384041 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 14 16:05:03.384041 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 14 16:05:03.384041 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 14 16:05:03.384041 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 14 16:05:03.384041 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 14 16:05:03.386098 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 14 16:05:03.386098 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 14 16:05:03.386098 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 14 16:05:03.386098 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 14 16:05:03.386098 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 14 16:05:03.386098 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 14 16:05:03.386098 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 14 16:05:03.386098 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 34a25afd-ca05-47fe-8bba-30442b7b5348 could not be found. May 14 16:05:03.386098 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: ERROR nova.api.openstack.wsgi May 14 16:05:03.386098 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 14 16:05:03.386098 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: ERROR nova.api.openstack.wsgi May 14 16:05:03.386098 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 16:05:03.386098 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 14 16:05:03.386098 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 14 16:05:03.386098 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 14 16:05:03.386098 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 14 16:05:03.386098 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 34a25afd-ca05-47fe-8bba-30442b7b5348 could not be found. May 14 16:05:03.386098 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: ERROR nova.api.openstack.wsgi May 14 16:05:03.387786 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: DEBUG nova.api.openstack.wsgi [None req-95464282-b427-4c4d-bc56-2f1c6c06bf3b tempest-AttachVolumeTestJSON-1609025183 tempest-AttachVolumeTestJSON-1609025183-project] Returning 404 to user: Instance 34a25afd-ca05-47fe-8bba-30442b7b5348 could not be found. {{(pid=128729) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 14 16:05:03.387786 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: INFO nova.api.openstack.requestlog [None req-95464282-b427-4c4d-bc56-2f1c6c06bf3b tempest-AttachVolumeTestJSON-1609025183 tempest-AttachVolumeTestJSON-1609025183-project] 10.222.0.61 "GET /compute/v2.1/servers/34a25afd-ca05-47fe-8bba-30442b7b5348" status: 404 len: 111 microversion: 2.1 time: 0.028864 May 14 16:05:03.387786 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: [pid: 128729|app: 0|req: 677/1374] 10.222.0.61 () {58 vars in 1235 bytes} [Sat May 14 16:05:03 2022] GET /compute/v2.1/servers/34a25afd-ca05-47fe-8bba-30442b7b5348 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 14 16:06:20.674450 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 14 16:06:20.675187 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: Sat May 14 16:06:20 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 14 16:06:47.900563 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 14 16:06:47.901118 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: Sat May 14 16:06:47 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 14 16:08:06.973962 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 14 16:08:06.974547 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: Sat May 14 16:08:06 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 14 16:08:18.605141 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 14 16:08:18.605736 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: Sat May 14 16:08:18 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 14 16:09:40.683265 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 14 16:09:40.683734 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: Sat May 14 16:09:40 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 14 16:10:03.454421 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 14 16:10:03.455001 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: Sat May 14 16:10:03 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 14 16:10:05.762146 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 14 16:10:05.762699 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: Sat May 14 16:10:05 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 14 16:10:07.908891 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 14 16:10:07.909445 dv-cinder-839793-11-iscsi devstack@n-api.service[128728]: Sat May 14 16:10:07 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 14 16:11:26.983492 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 14 16:11:26.984030 dv-cinder-839793-11-iscsi devstack@n-api.service[128729]: Sat May 14 16:11:26 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!!